
Staff Software Engineer
San Francisco, CA · HybridJobSeen 1w agoSeen in employer's feed 2 days ago
Most applications go out cold — see where you stand first. No sign-up to start.
Watch jobs like this. New roles like this one near San Francisco, CA, by email.
Don't just apply. Show up ready.
Olive works from this exact posting.
At a glance
Olive lists jobs from US employers, including remote roles you can work from the United States.
Requirements
Credentials this posting asks for.
Job overview
The Staff Software Engineer will design and develop secure, scalable GenAI platform services and tooling for LLM-powered applications, agentic workflows, and experimentation. The role includes building retrieval and knowledge systems, evaluation frameworks, observability, security controls, and developer-facing APIs. It also covers lifecycle management and integration of model providers. The position offers the option to telecommute three days per week.
Skills & qualifications
Skills
Qualifications
Full job description
Drive the design and development of the next generation of agentic, reliable, and scalable GenAI platforms supporting state-of-the-art large language models, evaluation systems, and secure developer tooling. Shape technical direction, ensuring architectural excellence to infuse AI into real-world production solution. Lead the design and development of secure, scalable platform services and tooling for LLM-powered applications, agentic workflows, and experimentation. Design and implement retrieval and knowledge systems (e.g., RAG pipelines, embeddings, vector stores) to support enterprise use cases. Establish evaluation frameworks, benchmarks, and feedback loops to measure and continuously improve quality, correctness, and safety of GenAI systems. Build observability and debugging capabilities for LLM applications, including tracing, cost monitoring, latency analysis, and failure detection. Optimize cost and performance of GenAI workloads through model routing, caching, prompt optimization, and efficient infrastructure design. Architect multi-tenant capabilities including isolation, configuration, quota management, and cost attribution. Implement GenAI-specific security controls, including prompt injection mitigation, data protection, and access governance. Design and implement agent orchestration frameworks, including tool integration, state management, and workflow control. Build developer-facing APIs, SDKs, and tooling to enable rapid experimentation and productionization of GenAI use cases. Drive end-to-end lifecycle management from experimentation to production, including versioning, deployment strategies, and rollback mechanisms. Integrate and evaluate multiple model providers and frameworks, defining abstraction and selection strategies. Develop Software using C#, Java, JavaScript, Go, or Python. Apply experience with generative AI, large language models (LLMs), and cloud infrastructure. Work with GenAI platform technologies (MCP, LangGraph, OpenAI, Bedrock). Option to telecommute 3 days per week. Bachelors degree in Computer Science, Computer or Software Engineering or Information Systems plus 5 years of experience in the job offered or in a related occupation.
How this job compares
Set against the 7,944 open Software Engineering jobs on Olive Jobs, counted October 30, 2026.
- Pay
- This postingNot listed
- California median$187–274K/yr1,221 salary ranges
- California median$43–53/hr114 hourly ranges
- Openings
- Olive Jobs lists 1,670 open Software Engineering jobs in California and 7,944 across the US. 7% of them nationwide are listed as remote or flexible.
- Experience
- This posting asks for at least 5 years of experience; Software Engineering postings that state a minimum ask for 7 years at the median (6,138 postings).
- Education
- This posting asks for a bachelor's degree; 2,188 of the 7,944 open Software Engineering jobs (28%) ask for a bachelor's degree or higher.
Counted across the open, public US postings on Olive Jobs on October 30, 2026. Pay medians are the middle values of the low ends and of the high ends of postings that list both ends of a range in the same cadence (a yearly salary or an hourly rate); a range's midpoint is halfway between its ends. Pay and experience figures resting on fewer than 20 postings are left out.
Similar jobs, posted recently
Open roles like this one, listed in the last 30 days.
Senior Lead Software Engineer- AI Platform engineerJPMorgan Chase · San Francisco, CA · $176–260K/yr
Senior Staff AI-Native Software Engineer - Agentic SystemsServiceNow, Inc. · San Francisco, CA · $191–334K/yrPosted 1w agoPosted 1w ago
Staff Software Engineer - AI/Security PlatformCisco · San Francisco, CA (Hybrid) · $187–268K/yrPosted 1w agoPosted 1w agoSenior Software Engineer - AI PlatformHinge Health · San Francisco, CA (Hybrid) · $188–257K/yrPosted 3 days agoPosted 3 days ago
Staff Software Engineer, AI Platform & InfrastructureOkta · San Francisco, CA · $194–267K/yrPosted 6 days agoPosted 6 days ago
You've read the whole posting — now see how you match it.