Software Engineer, Machine Learning Infrastructure
San Francisco, CAFull-time$140–230K/yrSeen 2mo agoStill listed 6 days ago
Most applications go out cold — see where you stand first. No sign-up to start.
Watch jobs like this. New roles like this one near San Francisco, CA, by email.
Don't just apply. Show up ready.
Olive works from this exact posting.
At a glance
Olive lists jobs from US employers, including remote roles you can work from the United States.
Job overview
The role involves building and scaling core infrastructure for cutting‑edge audio machine‑learning products, designing data pipelines, developing training frameworks, creating deployment services, and ensuring high‑availability production workloads at David AI.
Skills & qualifications
Skills
Qualifications
Benefits
Full job description
About our Engineering team At David AI, our engineers build the pipelines, platforms, and models that transform raw audio into high-signal data for leading AI labs and enterprises. We're a tight-knit team of product engineers, infrastructure specialists, and machine learning experts focused on building the world’s first audio data research company. We move fast, own our work end-to-end, and ship to production daily. Our team designs real-time pipelines handling terabytes of speech data and deploys cutting-edge generative audio models. About this role As a Software Engineer, Machine Learning Infrastructure at David AI, you will build and scale the core infrastructure that powers our cutting-edge audio ML products. You’ll be leading the development of the systems that enable our researchers and engineers to train, deploy, and evaluate machine learning models efficiently. In this role, you will
- Design and maintain data pipelines for processing massive audio datasets, ensuring terabytes of data are managed, versioned, and fed into model training efficiently.
- Develop frameworks for training audio models on compute clusters, managing cloud resources, optimizing GPU utilization, and improving experiment reproducibility.
- Create robust infrastructure for deploying ML models to production, including APIs, microservices, model serving frameworks, and real-time performance monitoring.
- Apply software engineering best practices with monitoring, logging, and alerting to guarantee high availability and fault-tolerant production workloads.
- Translate research prototypes into production pipelines, working with ML engineers and data teams to support efficient data labeling and preparation.
- Evaluate and integrate new MLOps technologies and optimization techniques to enhance infrastructure velocity and reliability.
Your background looks like
- 5+ years of backend engineering with 2+ years ML infrastructure experience.
- Hands-on experience scaling cloud infrastructure and large-scale data processing pipelines for ML model training and evaluation.
- Proficient with Docker, Kubernetes, and CI/CD pipelines.
- Proven ML model deployment and lifecycle management in production.
- Strong system design skills optimizing for scale and performance.
- Proficient in Python with deep Kubernetes experience.
Bonus points if you have
- Experience with feature stores, experiment tracking (MLflow, Weights and Biases), or custom CI/CD pipelines.
- Familiarity with large-scale data ingestion and streaming systems (Spark, Kafka, Airflow).
- Proven ability to thrive in fast-moving startup environments.
Some technologies we work with
- Next.js, TypeScript, TailwindCSS, Node.js, tRPC, PostgreSQL, AWS, Trigger.dev, WebRTC, FFmpeg.
Compensation and benefits
- Rapid career growth at one of the fastest growing Series A companies, within a new and booming industry.
- Competitive salary and equity package.
- Flexible PTO policy.
- Top-notch health, dental, and vision coverage with 100% company reimbursement for most plans.
- Paid lunch and dinner in the office, every day through DoorDash.
- 401k access.
How this job compares
Set against the 40,501 open Software Engineer jobs on Olive Jobs, counted November 2, 2026.
- Pay
- This posting$140–230K/yr
- California median$165–245K/yr7,649 salary ranges
- US median$135–217K/yr32,212 salary ranges
This range's midpoint, $185K, is 10% below the California median midpoint ($205K) — in the middle half of Software Engineer salary ranges in California.
- Openings
- Olive Jobs lists 9,523 open Software Engineer jobs in California and 40,501 across the US. 7% of them nationwide are listed as remote or flexible.
- Experience
- This posting asks for at least 3 years of experience; Software Engineer postings that state a minimum ask for 5 years at the median (32,858 postings).
- Education
- 14,142 of the 40,501 open Software Engineer jobs (35%) ask for a bachelor's degree or higher.
Counted across the open, public US postings on Olive Jobs on November 2, 2026. Pay medians are the middle values of the low ends and of the high ends of postings that list both ends of a range in the same cadence (a yearly salary or an hourly rate); a range's midpoint is halfway between its ends. Pay and experience figures resting on fewer than 20 postings are left out.
You've read the whole posting — now see how you match it.

