Software Engineer, AI
Alameda, CAFull-timeSeen 1mo agoStill listed 2 days ago
Most applications go out cold — see where you stand first. No sign-up to start.
Watch jobs like this. New roles like this one near Alameda, CA, by email.
Don't just apply. Show up ready.
Olive works from this exact posting.
At a glance
Olive lists jobs from US employers, including remote roles you can work from the United States.
Job overview
Respan is creating a self‑driving observability and evaluation platform for AI teams, serving dozens of YC‑backed companies. The role focuses on building production‑grade AI systems, including automated evaluations, prompt optimization, model routing, and AI‑powered analysis of traces and logs, requiring deep expertise in large language models.
Skills & qualifications
Skills
Full job description
What we’re building Respan is building the self-driving observability and evals platform for AI teams, used by 60+ YC companies and hundreds of AI teams. The role You will work on the systems that make Respan intelligent: automated evaluations, prompt optimization, model routing, and AI-powered analysis of traces and logs. This is deeply technical AI engineering, not just API calls. We are looking for someone who understands LLMs from the inside out and can build reliable, production-grade AI systems that thousands of teams depend on daily. What you’ll do:
- Design and build AI-powered features including eval frameworks and prompt optimization
- Develop LLM-as-judge pipelines for automated quality assessment
- Build and maintain model routing, caching, and fallback systems
- Experiment with new model capabilities and translate them into product features
- Collaborate with customers to understand AI workflow pain points and build solutions
What you must have:
- Strong software engineering skills with Python and TypeScript
- Hands-on experience building with LLMs in production (not just prototypes)
- Deep understanding of prompt engineering, eval methodologies, and model behavior
Strong plus:
- Experience with fine-tuning, RAG, or agent frameworks
- Background in ML infrastructure or MLOps
- Familiarity with observability systems or developer tools
- Contributions to open-source AI/ML projects
Similar jobs, posted recently
Open roles like this one, listed in the last 30 days.
Senior Software Engineer: AISwayable · San Francisco, CA · $175–250K/yrPosted 4w agoPosted 4w agoSoftware Engineer, AI Teammates PlatformAsana · San Francisco, CA (Hybrid) · $171–190K/yrPosted 1w agoPosted 1w ago
Software Engineer, AI Systems (PMTS)Salesforce · San Francisco, CA · $173–314K/yrPosted 3 days agoPosted 3 days ago
You've read the whole posting — now see how you match it.