Agent Data Scientist
Decagon · San Francisco · $165k–$215k
Posted by Decagon on their careers site · View the original posting
Draft this job a résumé tailored to it, and the application filled in
draft's reading
Open 81 days
The posting, as Decagon wrote it
About Decagon
Decagon is the leading conversational AI platform empowering every brand to deliver concierge customer experiences.
Our technology enables industry-defining enterprises like Avis Budget Group, Block’s Cash App and Square, Chime, Oura Health, and Hunter Douglas to deploy AI agents that power personalized, deeply satisfying interactions across voice, chat, email, SMS, and every other channel.
We’re building a future where customer experiences are being redefined from support tickets and hold music to faster resolutions, richer conversations, and deeper relationships. We’re proud to be backed by world-class investors who share that vision, including a16z, Accel, Bain Capital Ventures, Coatue, and Index Ventures, along with many others.
We’re an in-office company, driven by a shared commitment to excellence and velocity. Our values — Just Get It Done, Invent What Customers Want, Winner’s Mindset, and The Polymath Principle — shape how we work and grow as a team.
About the Team
When a Fortune 500 hands its customer experience to an AI agent, it is one of the largest bets the business will make that year — and enterprises of that size do not make it on a demo. Each customer has their own requirements for how an AI agent should be evaluated, and the narratives we build have to start there and hold up long after the decision is made. Data plays a central role in almost every one of those narratives, which is why Agent Data Science exists.
A deployment is evaluated by many stakeholders inside the customer's organization, including senior leaders, customer experience teams, and technical functions, each with their own criteria for success. You own how performance is defined, measured, and demonstrated against these criteria, from translating them into metrics we operationalize and deliver, to improving the ones that are key to each evaluation. You hold that from the first pre-sales evaluation through the life of the account.
Our team sits within Agent Product Management and focuses mostly on our largest and most complex deployments, while supporting the data needs of Decagon customers more broadly. We are small relative to that surface area, which means the scope you own is very wide and exceptionally cross-functional. The work compounds accordingly: every metric you define on a flagship deployment becomes the default for the deals that follow, and the frameworks you build outlive any single account.
Demonstrating the value of our product is everyone's responsibility, not only ours. So the primary leverage we create comes from making the rest of the organization better at it. That is what lets us stay focused on the hardest and most novel measurement problems our customers bring us, which gives this team real influence over the long-term product roadmap.
About the Role
Most of your time will be spent working directly with customers to establish what should be measured and then building what produces it. Usually, the hard
[…]
eone arguing for us and against us. This includes 80/20 intuition on what’s most important vs. analyzing everything.
- Comfort in fast-moving, ambiguous situations where you shape the approach as much as you implement it. Given a question with no established right answer, you can identify the best available option and defend it.
- Strong independence. You operate with very little day-to-day direction, set your own priorities against a broad mandate, and bring decisions rather than questions. You are comfortable being the person who defines the work rather than the person who receives it.
- Ability to bring stakeholders to a shared definition of success, even when they arrive with different priorities and different levels of technical depth.
- Strong technical fundamentals. Fluency in SQL and Python, and comfort working with large volumes of messy, unstructured conversational data.
Even better if you have
- A history of building internal tooling that gained meaningful adoption, and the judgment to recognize when a problem should stay a one-off.
- Experience working on AI products in production, including evaluating LLM or agent behavior and building the evaluations yourself.
Compensation
$165K-$215K + Equity
Benefits
We proudly offer the following benefits for our full-time employees:
- Medical, Dental, and Vision benefits for you and your family
- Life Insurance and Disability Benefits
- Retirement Plan (e.g., 401K, pension)
- Parental Leave
- Fertility and family building benefits through Carrot
- Monthly stipend to support your wellness, lifestyle, and work-life balance
- Daily lunches and snacks in the office to keep you at your best
- Take what you need vacation policy (subject to local requirements; UK employees receive 25 days of statutory leave)
These benefits are described in more detail in Decagon’s policies, may vary by location, and can change at any time according to applicable compensation and benefits plans.