Applied AI Engineer, Evals
San Francisco, CAFull-timePosted 3w agoStill listed 4 days ago
Most applications go out cold — see where you stand first. No sign-up to start.
Watch jobs like this. New roles like this one near San Francisco, CA, by email.
Don't just apply. Show up ready.
Olive works from this exact posting.
At a glance
Olive lists jobs from US employers, including remote roles you can work from the United States.
Job overview
Sable is developing Aidan, an AI employee that conducts real‑time voice, vision and browser‑based customer calls, adapting interactions and improving through a self‑learning context graph. The Applied AI Engineer, Evals will translate performance criteria into measurable signals and evaluate agents across voice, vision and browser use to drive model and system enhancements.
Skills & qualifications
Skills
Full job description
About Sable Sable built Aidan, the first AI employee who can lead customer calls using realtime voice, vision, and browser use. Aidan runs a live, two-way conversation inside a real product environment, clicking through the product like a human, watching the user's screen, and adapting the journey on the fly. Every conversation feeds a self-improving context graph we call the Brain, so Aidan gets smarter with each call.
The role You translate what makes a good performance into clear, defensible signals, and use those signals to improve Aidan. Role involves carrying out evaluations of agents on a broad range of areas on the frontier including voice, vision, and browser use, and using the findings to optimize the agent, context, and models.
What you'll do
-
Design evaluations for voice, vision, and browser use to direct and accelerate improvements in the agent, context, and models
-
Build and maintain our internal benchmarks and simulations
-
Work on systems to score customer-specific scenarios and identify gaps in current capabilities.
Who you are
-
Engineer with statistics and/or applied machine learning experience
-
Comfortable in a production codebase
-
Bonus: prior experience with evaluations or with voice, realtime, or browser use/computer use agents.
Similar jobs, posted recently
Open roles like this one, listed in the last 30 days.
Senior PMM, EvalsMercor · San Francisco, CA · $190–230K/yrPosted 4 days agoPosted 4 days ago
Staff Applied AI Engineer - Enterprise AI SolutionsSnorkel AI · San Francisco, CA (Hybrid) · $230–360K/yrPosted 6 days agoPosted 6 days ago- Applied ScientistTwitch · San Francisco, CA · $172–222K/yrPosted 3 days agoPosted 3 days ago
Research Engineer, Applied ResearchSierra · San Francisco, CAPosted 6 days agoPosted 6 days agoStaff Software Engineer, AI TeammatesAsana · San Francisco, CA (Hybrid) · $248–282K/yrPosted 1w agoPosted 1w ago
You've read the whole posting — now see how you match it.