Data Scientist, Applied AI

The posting, as Definitive Healthcare, US wrote it

About Definitive Healthcare

At Definitive Healthcare, our mission is simple: to connect with the real people who make healthcare happen. With real data on real people, our customers get the Definitive picture of the Healthcare market to move their businesses and organizations forward.

We’re committed to delivering the industry’s most reliable, actionable, and differentiated insights and empowering the innovators and organizations transforming healthcare. Because when our customers succeed, healthcare improves—for everyone.

Since our founding in 2011, we’ve grown into a global company headquartered just outside Boston, Massachusetts, supporting more than 2,100 customers around the world. Along the way, we’ve built a culture centered on purposeful work, collaboration, curiosity, and meaningful impact.

We’re passionate about the work we do and the people we do it with. Through programs like Definitive Cares and our employee-led affinity groups, we create opportunities for our teams to connect and give back to the communities where we live and work.

About the position

This role supports the team's work on practical generative AI applications. The Data Scientist implements and tests LLM, RAG, and agent-based workflows for assigned use cases under the direction of senior team members, producing evidence that informs team decisions about which approaches to use.

What y ou’ll do

• Develop AI workflows: Build and test LLM, RAG, and tool-using agent workflows for assigned use cases.
• Evaluate approaches: Compare LLMs, embedding models, and retrieval methods against quality, reliability, latency, and cost, using evaluation criteria and methods set by senior team members.
• Maintain evaluation assets: Create and update representative test cases, benchmark datasets, and regression checks; report results and limitations.
• Improve retrieval quality: Develop and tune RAG pipelines, including embeddings, retrieval, reranking, and grounding, based on evaluation results.
• Investigate failures: Review incorrect answers, retrieval misses, and workflow failures; implement and measure improvements.
• Support production workflows: Use experimentation, tracing, and observability tools to help monitor systems and investigate performance changes.
• Collaborate on delivery: Work with engineering, product, and domain partners to clarify requirements, communicate findings, and deliver practical AI solutions.

What you'll need

Education and experience

• Bachelor’s degree in a quantitative or technical field.
• 3+ years of experience in data science, machine learning, applied AI, or a related field.
• Hands-on experience developing applications with LLMs and evaluating their outputs.

Technical and professional skills

• Strong Python, data analysis, and problem-solving skills.
• Understanding of embeddings, semantic search, retrieval, RAG and evaluation metrics.
• Experience with an agent framework such as PydanticAI, LangGraph, or a simila

[…]
being, and their financial future.

• We invest in our people. We offer a competitive benefits package, including comprehensive healthcare benefits and a 401(k) match.
• We make room for connection and impact. Definitive Cares is our 100% employee-driven program that creates opportunities to connect with colleagues through affinity groups and make a positive impact on our communities.
• We’re a great place to work. In 2024 and 2025, we earned multiple workplace honors, including Built In’s 100 Best Places to Work in Boston (both years), a Stevie Bronze Award for Great Employers, and recognition as a Great Place to Work in India.

What our Employees are saying about us on Glassdoor

“Great Work atmosphere, great work life balance, excellent company to work for, amazing top notch product, incredible customer service, lots of tools to help you succeed.”

-Business Development Manager

“Great team. Amazing growth. Employees are treated very well.”

-Research Analyst

“I have waited 36 years to work at a dream job for a dream company, and I am so happy to have finally got there.”

-Profile Analyst

If you don’t fit all of these qualifications, but believe you’re still a great fit, feel free to apply and tell us why in your cover letter.

If you are a California, Colorado, New York City or Washington resident and this role is a remote role, you can receive additional information about the compensation and benefits for this role, which we will provide upon request.

Definitive Hiring Philosophy

Definitive Healthcare is an equal opportunity employer that celebrates diversity and is committed to creating an inclusive workplace with equal opportunity for all applicants and teammates. Our goal is to recruit the most talented people from a diverse candidate pool regardless of race, color, religion, age, gender, gender identity, sexual orientation or any other status. If you’re interested in working in a fast growing, exciting working environment – we encourage you to apply!