Member of Technical Staff, ML Engineer
San Francisco, CAJobPosted 2w agoStill listed 5 days ago
Most applications go out cold — see where you stand first. No sign-up to start.
Watch jobs like this. New roles like this one near San Francisco, CA, by email.
Don't just apply. Show up ready.
Olive works from this exact posting.
At a glance
Olive lists jobs from US employers, including remote roles you can work from the United States.
Job overview
The role involves building machine learning systems that power an evaluation platform and data engine, training preference models, developing large‑scale experimentation infrastructure, and designing systems to convert human interaction data into reliable signals for AI model evaluation.
Skills & qualifications
Skills
Qualifications
Benefits
Full job description
Why join Intelligence Mission: Give every human superintelligence, and make superintelligence more human. Intelligence is the product lab company behind DesignArena - 5.2M+ users in 8 months, leaderboard referenced by Andrew Ng, Elon Musk, Demis Hassabis, and more. The team is incredibly talent-dense (11 from Harvard + Berkeley), backed by Tier 1 VC Index Ventures, YC, SV Angel, Lenny Rachitsky, Paul Graham, Figma Ventures, and one of the fastest-growing seed-stage startups in SF. Behind closed doors, we see what the models can do six months before the world does. We are trusted by the best frontier model providers like OpenAI to rigorously evaluate the capabilities of state-of-the-art multimodal models across design, web dev, game dev, image, video, audio, slide generation, and more, through the large-scale platforms that we’ve built. Design Arena, our flagship product, is the most referenced benchmark for AI-generated visuals, and is powered by over 5.3M+ authentic users across 192 countries. Prediction Arena was the first time models traded autonomously with real cash on real-time, real-world events. Social Arena tested whether AI models can effectively grow and engage audiences on X by having them operate as independent social media agents.
Role You'll build the machine learning systems that power our evaluation platform and next-generation data engine. You'll train human preference models, build large-scale data pipelines, and develop the infrastructure that transforms millions of human interactions into reliable signals for evaluating and improving frontier AI models. In this role, you also have an opportunity to be forward-deployed should it interest you, and work directly with the researchers at frontier labs to creatively scale new model capability strategies for improvement.
What You’ll Own
-
Train and improve preference, reward, and ranking models from millions of human interactions
-
Develop infrastructure for large-scale experimentation, model training, and specialize in online evaluation techniques
-
Design systems that transform human preference data into reliable signals for downstream model evaluation and training
What We’re Looking For
-
Strong STEM background. You studied Computer Science, Data Science, Statistics, Math, Engineering, Physics, or a related field.
-
Experience building ML systems. You've trained preference models, built data pipelines, or worked on ML infrastructure that runs in production.
-
Interested in how AI learns from human feedback. You're excited by solving problems at the intersection of human-model interaction.
Details
-
Location: San Francisco, Levi’s Plaza. We sponsor visas and handle relocation.
-
Work Schedule: Sunday-Friday. Saturdays are yours!
-
Compensation: Competitive salary + meaningful equity. You'd be joining at the stage when ownership matters most.
Similar jobs, posted recently
Open roles like this one, listed in the last 30 days.
Member of Technical Staff - ML Infrastructure Engineer, Post-trainingPreference Model · San Francisco, CA · $200–350K/yrPosted 3w agoPosted 3w ago
Member of Technical Staff — Machine Learning & Agent Security EngineeringSalesforce · Bellevue, WA · $117–177K/yrPosted 1w agoPosted 1w ago
Member of Technical Staff, Platform EngineeringAbundant · San Francisco, CAPosted 3w agoPosted 3w ago
Member of Technical Staff, Research (Intern)Abundant · San Francisco, CA · $10,000/moPosted 3w agoPosted 3w agoStaff Data EngineerDrata · San Francisco, CA (Hybrid) · $165–270K/yrPosted 1w agoPosted 1w ago
You've read the whole posting — now see how you match it.