Skip to main content
Respan logo

Software Engineer, AI

Respan

Alameda, CAFull-timeSeen 2mo agoStill listed today

See where you stand before you apply. No sign-up to start.

You apply on the posting's application page, with no Olive account needed.

Watch jobs like this.

Don't just apply. Show up ready.

Olive works from this exact posting.

At a glance

Compensation
No compensation found
Location
Alameda, CA
Schedule
Full-time
Work Authorization
Not specified

Olive focuses on jobs in the United States, including remote roles you can work from there.

Job overview

Respan is creating a self‑driving observability and evaluation platform for AI teams, serving dozens of YC‑backed companies. The role focuses on building production‑grade AI systems, including automated evaluations, prompt optimization, model routing, and AI‑powered analysis of traces and logs, requiring deep expertise in large language models.

Skills & qualifications

RequiredNice to have

Skills

Python, requiredTypeScript, requiredLarge Language Models, requiredPrompt Engineering, requiredEval Methodologies, requiredFine‑Tuning, nice to haveRAG, nice to haveAgent Frameworks, nice to haveML Infrastructure, nice to haveMLOps, nice to haveObservability Systems, nice to haveDeveloper Tools, nice to haveOpen‑Source Contributions, nice to have

Full job description

What we’re building Respan is building the self-driving observability and evals platform for AI teams, used by 60+ YC companies and hundreds of AI teams. The role You will work on the systems that make Respan intelligent: automated evaluations, prompt optimization, model routing, and AI-powered analysis of traces and logs. This is deeply technical AI engineering, not just API calls. We are looking for someone who understands LLMs from the inside out and can build reliable, production-grade AI systems that thousands of teams depend on daily. What you’ll do:

  • Design and build AI-powered features including eval frameworks and prompt optimization
  • Develop LLM-as-judge pipelines for automated quality assessment
  • Build and maintain model routing, caching, and fallback systems
  • Experiment with new model capabilities and translate them into product features
  • Collaborate with customers to understand AI workflow pain points and build solutions

What you must have:

  • Strong software engineering skills with Python and TypeScript
  • Hands-on experience building with LLMs in production (not just prototypes)
  • Deep understanding of prompt engineering, eval methodologies, and model behavior

Strong plus:

  • Experience with fine-tuning, RAG, or agent frameworks
  • Background in ML infrastructure or MLOps
  • Familiarity with observability systems or developer tools
  • Contributions to open-source AI/ML projects

How this job compares

Set against the 37,998 open Software Engineer jobs on Olive Jobs, counted November 16, 2026.

Pay
  • This postingNot listed
  • California median$162–243K/yr6,822 salary ranges
  • California median$48–67/hr124 hourly ranges
Openings
Olive Jobs lists 8,392 open Software Engineer jobs in California and 37,998 across the US. 8% of them nationwide are listed as remote or flexible.
Hiring the most in California
Experience
This posting asks for at least 3 years of experience; Software Engineer postings that state a minimum ask for 5 years at the median (31,530 postings).
Education
11,518 of the 37,998 open Software Engineer jobs (30%) ask for a bachelor's degree or higher.

Pay, requirements and demand for Software Engineer jobs

Counted across the open, public US postings on Olive Jobs on November 16, 2026. Figures based on too few postings are left out.

Prepare for this role

You've read the whole posting — now see how you match it.