AI Product Data Analyst

MEDvidi

Serbia remote Posted May 8, 2026

Description

Description
At MEDvidi, we are transforming mental healthcare by making it more accessible and affordable across the United States. Our mission is to remove barriers to mental health support and ensure that everyone can access the care they need. 

As our AI initiatives scale, high-quality analytics becomes a critical bottleneck - and this role is designed to solve it.

About the Role

We are hiring a Data Analyst to play a key role within the AI product team, ensuring data-driven accuracy in decision-making while evaluating, improving, and scaling AI-powered solutions in production.

This is a highly strategic, fast-paced role focused on measuring the real impact of AI agents and LLM-based systems, turning ambiguous problems and incomplete data into accurate decisions

Requirements

3+ years of hands-on experience as a Data Analyst working with product or platform data

Strong proficiency in Python for analytical work and ability to independently investigate data on the level of datapoints, build structural analyses, and present results

Confident SQL skills with experience working on complex queries

Experience building production-grade dashboards in BI tools, preferably in Tableau

Clear understanding of how LLM-based systems operate, including their limitations, failure modes, and trade-offs

Strong problem-solving and ownership mindset: you take responsibility for analytical outcomes, not just task execution

Ability to work in fast-changing, ambiguous environments and quickly learn new AI-related technologies

Proven experience linking product quality metrics to business impact and decision-making

Fluent Russian; English level B2 or higher

Ability to work CET-overlapping hours

Nice to Have

Experience evaluating or analyzing AI / ML / LLM products

Experience with dialog systems or conversational agents

Understanding of model quality metrics and evaluation approaches

Responsibilities

Analyze the performance and impact of AI initiatives already running in production

Develop and maintain dashboards that provide transparency into AI agent performance

Investigate issues, inconsistencies, and performance drops across automated user journeys

Design and implement evaluation approaches to measure system quality and user experience

Identify opportunities where automation improves outcomes, as well as areas where it introduces friction

Track adoption and effectiveness of automation across the product and support its further evolution

Partner closely with Product, Engineering, and QA teams to support data-informed decisions

Why Join Us

Work on a modern AI product where quality is a strategic function, not a formality

Real influence on product direction and engineering practices

High-impact work in a product-driven medical tech company

Startup environment: fast iteration, high ownership, minimal bureaucracy

Competitive compensation and growth opportunities

Benefits

Health insurance after probation period

Sports & wellness compensation

Fully remote, long-term B2B collaboration

19 working days of vacation per year

3 additional wellness days per year

Paid sick leave for the first 5 working days

Gifts to employees for important events

Career Development

Personalized English lessons via Preply

Ready to make an impact? Send us your profile - let’s build something meaningful together.