Member of Technical Staff, Model Evaluation
United States, CAFull-time$300–400K/yrPosted 3mo agoStill listed 3 days ago
Most applications go out cold — see where you stand first. No sign-up to start.
Watch jobs like this. New roles like this one near United States, CA, by email.
Don't just apply. Show up ready.
Olive works from this exact posting.
At a glance
Olive lists jobs from US employers, including remote roles you can work from the United States.
Job overview
Mirendil is seeking a research engineer to create evaluation infrastructure that determines model improvements. The role involves designing and building frameworks, automated pipelines, and regression‑detection systems, developing agent‑assisted workflows, instrumenting training runs with observability tools, and partnering with post‑training and reinforcement‑learning teams to close the loop between evaluation signals and training decisions.
Skills & qualifications
Skills
Full job description
Mirendil Mirendil is a tech-first company focused on solving core bottlenecks that unlock step-change acceleration across science and technology. Our first goal is to democratize frontier AI R&D across scientific disciplines. We are building a frontier AI research company and training our own models end-to-end.
The Role We are looking for a research engineer to build the evaluation infrastructure that tells us whether our models are getting better in ways we care about. You'll own the frameworks, pipelines, and tooling that measure model behavior across capabilities. Some example areas you might work on (not limited to):
-
Design and build evaluation frameworks that measure model capabilities along realistic axes, beyond standard benchmarks.
-
Build automated eval pipelines and regression-detection systems that run continuously and surface signal quickly.
-
Develop agent-assisted workflows for humans to efficiently inspect model behavior.
-
Instrument training runs with observability tooling so researchers can understand what's changing in model behavior, and why.
-
Partner with post-training and RL teams to close the loop between eval signal and training decisions.
If you're excited about the hard problem of knowing whether a frontier AI system is actually improving, we'd love to hear from you.
We offer a base salary of $300,000–$400,000 USD and a meaningful equity grant, depending on experience and background, along with competitive benefits.
Similar jobs, posted recently
Open roles like this one, listed in the last 30 days.
Member of Technical Staff, AI EngineeringHandshake · San Francisco, CA · $200–350K/yrPosted 1w agoPosted 1w ago
Member of Product StaffArena · Bay Area, CAPosted 2w agoPosted 2w agoMember of Technical Staff, EvalsHandshake · San Francisco, CA · $200–350K/yrPosted 1w agoPosted 1w ago
Member of Technical Staff, AlignmentAbundant · San Francisco, CA · $250–450K/yrPosted 3w agoPosted 3w agoMember of Technical StaffLabelbox · San Francisco, CA · $140–200K/yrPosted 2w agoPosted 2w ago
You've read the whole posting — now see how you match it.