Senior Machine Learning Engineer
San Francisco, CA · HybridFull-timePosted 3mo agoStill listed 3 days ago
See where you stand before you apply. No sign-up to start.
You apply on the posting's application page, with no Olive account needed.
Watch jobs like this. New roles like this one near San Francisco, CA, by email.
Don't just apply. Show up ready.
Olive works from this exact posting.
At a glance
Olive focuses on jobs in the United States, including remote roles you can work from there.
Job overview
Plenful builds AI automation for healthcare operations. The Senior Machine Learning Engineer will own production agents, models, and the data and evaluation loop that improves them. The role focuses on reliable healthcare workflows, model fine-tuning and serving, evaluation, and MLOps, while handling patient data carefully. R&D roles follow a hybrid model with two days per week in the San Francisco office.
Skills & qualifications
Skills
Qualifications
Benefits
Full job description
About Plenful Plenful is on a mission to transform healthcare operations from the inside out. Fresh off our $50M Series B and backed by Notable Capital, Bessemer Venture Partners, TQ Ventures, Susa/Kivu Ventures, and other leading investors, we’re building the category-defining AI automation platform that healthcare teams rely on to operate smarter, faster, and more efficiently. Our technology empowers healthcare operators across hospital and health systems, pharmacies and payors to eliminate manual work, reduce administrative burden, and improve compliance, all while unlocking critical revenue to fund programs for their in-need patient populations.
Built by healthcare operators for healthcare operators, Plenful is driven by a deep understanding of the challenges facing today’s care teams. We’re passionate about equipping healthcare workers with world-class tools that deliver real, measurable impact, and we’re proud to serve 100+ leading health systems, pharmacies, and healthcare organizations across the country. If you’re excited to help shape the future of healthcare, we’d love to meet you. Apply now to join our growing team. About the role Healthcare's back office still runs on faxes, PDFs and phone calls. AI can take that work off people's plates, but only if it is accurate enough to trust with patient and financial data. At Plenful, we build agents and models that do that work in production, with people in the loop wherever judgment matters. As a Senior Machine Learning Engineer, you own the pieces that make those systems reliable: the agents, the models behind them, and the data and evaluation loop that improves both every week.
What you'll do You ship agents that do real work
-
Design, build and run production agents that use tools, retrieval and multi-step reasoning to finish healthcare workflows end to end.
-
Build the orchestration, tracing and failure recovery that keep agents dependable when inputs are messy.
-
Decide when a problem needs an agent, a model or a deterministic rule, and route low-confidence cases to a person.
You make models better, not just call them
-
Fine-tune and post-train LLMs and vision-language models on healthcare tasks, using methods like supervised fine-tuning, preference optimization and distillation.
-
Choose between prompting, retrieval and fine-tuning for each problem, and prove the choice with data.
-
Balance quality, latency and cost when you serve models.
You own the loop that makes it all improve
-
Build and version datasets: labeled sets, golden sets and synthetic data drawn from production signal.
-
Write evals that catch regressions before customers do: automated graders, LLM-as-judge calibrated against human labels, and regression suites that run in CI.
-
Instrument production with tracing, drift detection and failure taxonomies, then feed what you learn back into training data.
-
Keep releases reproducible with solid MLOps: Docker, Kubernetes, MLflow or equivalent, and CI/CD.
You handle patient data with care
-
Use the minimum data necessary, and de-identified or synthetic data wherever it does the job.
-
Follow HIPAA and Plenful's security and AI usage practices in how you build, test and log.
What we're looking for
-
5+ years building and shipping software or ML systems, including 2+ years with LLM-based systems in production.
-
Strong Python, plus PyTorch and Hugging Face Transformers.
-
Hands-on agent experience with a framework like LangGraph, and with RAG and vector search (for example Pinecone).
-
You have fine-tuned an LLM or VLM and can explain what improved and how you measured it.
-
You have built an evaluation harness and know why accuracy alone misleads and how to calibrate an LLM judge.
-
Comfort with large-scale datasets, databases and data pipelines.
-
Experience with traditional ML, and the judgment to know when a simpler model beats an LLM.
You stay current, and you can show it
-
You use the newest models and coding agents every week, form opinions, and test them on real problems.
-
You go from idea to working prototype in hours, then bring back what works.
-
You have proof: shipped projects, open source, write-ups or your own evals of new releases.
Nice to have
-
Healthcare data experience: EHR, FHIR, claims, prior authorization.
-
Document AI or vision model experience.
-
Serving and training at scale with tools like vLLM, FSDP or DeepSpeed.
-
Work in another regulated, high-stakes domain.
What your first 90 days look like By day 30, you have shipped a change to a production agent or model. By day 90, you own the eval suite and improvement loop for one workflow, and its quality numbers are moving. Why You'll Love Working Here
-
🚀 Mission-Driven, World-Class Team — Join an exceptional group of professionals aligned around a meaningful mission and committed to making an impact
-
📈 Opportunities for Growth — Strengthen your expertise through collaboration with experienced, high-performing leaders across the organization
-
🏢 Flexible Hybrid Work Environment — We're remote-first, with meaningful office presence in San Francisco and New York. R&D roles follow a hybrid model, with two days per week in our San Francisco office
Benefits & Perks
-
🏥 Healthcare Coverage — Full medical, dental, and vision insurance for you and participation for your family
-
💰 401(k) with Company Match — Plenful matches 50% of your first 3% contributed
-
📊 Equity — Every full-time employee shares in our success
-
🌴 Unlimited PTO — Take the time you need, when you need it
-
🍽️ Daily Lunch Stipend — $100/week to cover your midday meals
-
💪 Wellness Stipend — $100/month to support your health and well-being
-
🚇 Commuter Benefits — $100/month for SF and NYC-based employees
-
👶 Parental Leave — Paid leave to support growing families
Compensation The compensation range for this position reflects the average span for this role. Where an offer lands depends on your experience, qualifications, and interview performance, measured against Plenful’s internal leveling guidelines and market benchmarks. We set offers individually. This role is also eligible to participate in Plenful’s equity plan, subject to the terms of the applicable plans and policies.
How this job compares
Set against the 6,360 open Machine Learning Engineer jobs on Olive Jobs, counted November 16, 2026.
- Pay
- This postingNot listed
- California median$175–261K/yr1,420 salary ranges
- California median$50–70/hr23 hourly ranges
- Openings
- Olive Jobs lists 1,833 open Machine Learning Engineer jobs in California and 6,360 across the US. 8% of them nationwide are listed as remote or flexible.
- Hiring the most in California
- Apple182 open
- Google132 open
- Capital One63 open
- Experience
- This posting asks for at least 5 years of experience; Machine Learning Engineer postings that state a minimum ask for 5 years at the median (5,294 postings).
- Education
- 2,204 of the 6,360 open Machine Learning Engineer jobs (35%) ask for a bachelor's degree or higher.
Pay, requirements and demand for Software Engineer jobs
Counted across the open, public US postings on Olive Jobs on November 16, 2026. Figures based on too few postings are left out.
Prepare for this role
You've read the whole posting — now see how you match it.

