AI Research Scientist, Learning & Evaluation

The posting, as Studyfetch wrote it

About Studyfetch
StudyFetch is the #1 AI-native learning platform globally, transforming how millions of students learn through personalized AI-powered education. We’re growing fast with backing from top-tier investors and a mission that’s redefining the future of education and ethical learning.

Why this role exists
We're a technology company building AI-native learning products used by more than seven million students worldwide, alongside Honen, our workforce-learning platform for organizations. Both run on the Learn Engine, the intelligence that moves a learner from initial understanding to demonstrated mastery. We work with partners like NVIDIA to bring responsible, learning-first AI to the students who need it most.
Nobody has settled how to measure whether an AI tutor teaches. Public benchmarks tell you a model can answer a question. They don't tell you whether a fourteen-year-old understood the explanation, whether the model handed over the answer when it should have asked a follow-up, or whether the student could still do the problem a week later. We train and tune our own models for learning outcomes rather than leaderboard scores, and that only works if someone can define what better means and prove when we've hit it.
That's this role. You'll build the evaluation and measurement layer that sits under model training, product decisions, and learning science across both StudyFetch and Honen. This is a founding-team role. You'll work directly with the people making the decisions, and the standard you set is the one every model and feature gets held to.
What we believe
Every learner deserves the chance to succeed. StudyFetch started with one idea: high-quality, personalized learning should be within reach for anyone, at any stage of life. Honen carries that belief into the workforce.
Accessible to everyone. Learning should reach every person, whatever their background, role, or resources.
Meet people where they are. Every course adapts to a person's pace, their level, and the way they learn best.
Learning never stops. From a first job to a new career, people keep growing at every stage of life.
We hire people who share this conviction. The work is demanding and the hours can be long, and what sustains you through it is caring whether a real student finally understands the material.
What you'll own
Evaluation for the models we train. We fine-tune our own model family for tutoring, and you decide how we know whether a new checkpoint is better than the last one. That covers accuracy and reasoning, and it also covers child safety, resistance to sycophancy, and whether the model teaches Socratically instead of answering outright. You'll design the evals, run them against every candidate model, and hold the release bar.
An internal benchmark for multi-turn tutoring. Single-turn Q&A benchmarks miss almost everything we care about. You'll build and maintain our benchmark for real tutoring conversations, decide what it measures, and defend those
[…]
ions about it. Genuine curiosity is the one thing we can't teach.
The mission is why you're here. What sustains you through the hard weeks is the learner on the other end, the one who finally understands because of something you built.
The stack you'll work in
You don't need every item below, but you should be deep in most and able to ramp quickly on the rest:

• Analysis: Python (Pandas, NumPy, SciPy, Jupyter), expert-level SQL, large-scale datasets
• Statistics: experimental design, causal inference, Bayesian and frequentist methods, hypothesis testing
• AI/LLM: eval frameworks, LLM-as-judge and its failure modes, RAG, embeddings, agent workflows, fine-tuning and post-training
• Data: MongoDB and PostgreSQL, vector databases, warehouse and pipeline tooling
• Infra: GCP, and comfort reasoning about inference cost, latency, throughput, and GPU utilization
• Reporting: dashboards people return to, in whatever tool gets there fastest

Learning science, psychometrics, or item response theory is a real plus. So is having worked with children's data and the rules that come with it.
What to expect
This is an in-person role at a fast pace, with periods of intense work around major launches.
You'll have significant ownership and autonomy with limited oversight. The role suits researchers who do their best work with room to run.
You'll be the first person in this seat. Some weeks are model evaluation, some weeks are a retention question from the founders, and you'll have to decide which one matters more that week.
It's a strong fit for people who have shipped analysis that changed a decision. If your experience has been mostly reports that nobody acted on, this likely isn't the right match.
Compensation & benefits
$180,000–$280,000 base salary, plus equity

• 100% employer-paid Medical, Dental, and Vision; 75% dependent coverage
• 401(k) with employer matching
• Daily team dinner provided in-office
• A small, mission-driven team changing how the world learns

#LI-SF1