Skip to main content
Plenful logo

Senior Machine Learning Engineer

Plenful

San Francisco, CA · HybridFull-timePosted 3mo agoStill listed 3 days ago

See where you stand before you apply. No sign-up to start.

You apply on the posting's application page, with no Olive account needed.

Watch jobs like this.

Don't just apply. Show up ready.

Olive works from this exact posting.

At a glance

Compensation
No compensation found
Location
San Francisco, CAHybrid
Schedule
Full-time
Work Authorization
Not specified

Olive focuses on jobs in the United States, including remote roles you can work from there.

Job overview

Plenful builds AI automation for healthcare operations. The Senior Machine Learning Engineer will own production agents, models, and the data and evaluation loop that improves them. The role focuses on reliable healthcare workflows, model fine-tuning and serving, evaluation, and MLOps, while handling patient data carefully. R&D roles follow a hybrid model with two days per week in the San Francisco office.

Skills & qualifications

RequiredNice to have

Skills

Python, requiredPyTorch, requiredHugging Face Transformers, requiredAgent Development, requiredLangGraph, requiredRetrieval-Augmented Generation, requiredVector Search, requiredLLM Fine-Tuning, requiredEvaluation Harnesses, requiredLarge-Scale Datasets, requiredDatabases, requiredData Pipelines, requiredTraditional Machine Learning, requiredCoding Agents, nice to haveHealthcare Data, nice to haveEHR, nice to haveFHIR, nice to haveClaims, nice to havePrior Authorization, nice to haveDocument AI, nice to haveVision Models, nice to havevLLM, nice to haveFSDP, nice to haveDeepSpeed, nice to haveRegulated Domains, nice to have

Qualifications

5+ Years Software or ML Systems, required2+ Years Production LLM Systems, required

Benefits

Medical Insurance
Dental Insurance
Vision Insurance
401(k) Match
Paid Time Off
Parental Leave

Full job description

About Plenful Plenful is on a mission to transform healthcare operations from the inside out. Fresh off our $50M Series B and backed by Notable Capital, Bessemer Venture Partners, TQ Ventures, Susa/Kivu Ventures, and other leading investors, we’re building the category-defining AI automation platform that healthcare teams rely on to operate smarter, faster, and more efficiently. Our technology empowers healthcare operators across hospital and health systems, pharmacies and payors to eliminate manual work, reduce administrative burden, and improve compliance, all while unlocking critical revenue to fund programs for their in-need patient populations.

Built by healthcare operators for healthcare operators, Plenful is driven by a deep understanding of the challenges facing today’s care teams. We’re passionate about equipping healthcare workers with world-class tools that deliver real, measurable impact, and we’re proud to serve 100+ leading health systems, pharmacies, and healthcare organizations across the country. If you’re excited to help shape the future of healthcare, we’d love to meet you. Apply now to join our growing team. About the role Healthcare's back office still runs on faxes, PDFs and phone calls. AI can take that work off people's plates, but only if it is accurate enough to trust with patient and financial data. At Plenful, we build agents and models that do that work in production, with people in the loop wherever judgment matters. As a Senior Machine Learning Engineer, you own the pieces that make those systems reliable: the agents, the models behind them, and the data and evaluation loop that improves both every week.

What you'll do You ship agents that do real work

  • Design, build and run production agents that use tools, retrieval and multi-step reasoning to finish healthcare workflows end to end.

  • Build the orchestration, tracing and failure recovery that keep agents dependable when inputs are messy.

  • Decide when a problem needs an agent, a model or a deterministic rule, and route low-confidence cases to a person.

You make models better, not just call them

  • Fine-tune and post-train LLMs and vision-language models on healthcare tasks, using methods like supervised fine-tuning, preference optimization and distillation.

  • Choose between prompting, retrieval and fine-tuning for each problem, and prove the choice with data.

  • Balance quality, latency and cost when you serve models.

You own the loop that makes it all improve

  • Build and version datasets: labeled sets, golden sets and synthetic data drawn from production signal.

  • Write evals that catch regressions before customers do: automated graders, LLM-as-judge calibrated against human labels, and regression suites that run in CI.

  • Instrument production with tracing, drift detection and failure taxonomies, then feed what you learn back into training data.

  • Keep releases reproducible with solid MLOps: Docker, Kubernetes, MLflow or equivalent, and CI/CD.

You handle patient data with care

  • Use the minimum data necessary, and de-identified or synthetic data wherever it does the job.

  • Follow HIPAA and Plenful's security and AI usage practices in how you build, test and log.

What we're looking for

  • 5+ years building and shipping software or ML systems, including 2+ years with LLM-based systems in production.

  • Strong Python, plus PyTorch and Hugging Face Transformers.

  • Hands-on agent experience with a framework like LangGraph, and with RAG and vector search (for example Pinecone).

  • You have fine-tuned an LLM or VLM and can explain what improved and how you measured it.

  • You have built an evaluation harness and know why accuracy alone misleads and how to calibrate an LLM judge.

  • Comfort with large-scale datasets, databases and data pipelines.

  • Experience with traditional ML, and the judgment to know when a simpler model beats an LLM.

You stay current, and you can show it

  • You use the newest models and coding agents every week, form opinions, and test them on real problems.

  • You go from idea to working prototype in hours, then bring back what works.

  • You have proof: shipped projects, open source, write-ups or your own evals of new releases.

Nice to have

  • Healthcare data experience: EHR, FHIR, claims, prior authorization.

  • Document AI or vision model experience.

  • Serving and training at scale with tools like vLLM, FSDP or DeepSpeed.

  • Work in another regulated, high-stakes domain.

What your first 90 days look like By day 30, you have shipped a change to a production agent or model. By day 90, you own the eval suite and improvement loop for one workflow, and its quality numbers are moving. Why You'll Love Working Here

  • 🚀 Mission-Driven, World-Class Team — Join an exceptional group of professionals aligned around a meaningful mission and committed to making an impact

  • 📈 Opportunities for Growth — Strengthen your expertise through collaboration with experienced, high-performing leaders across the organization

  • 🏢 Flexible Hybrid Work Environment — We're remote-first, with meaningful office presence in San Francisco and New York. R&D roles follow a hybrid model, with two days per week in our San Francisco office

Benefits & Perks

  • 🏥 Healthcare Coverage — Full medical, dental, and vision insurance for you and participation for your family

  • 💰 401(k) with Company Match — Plenful matches 50% of your first 3% contributed

  • 📊 Equity — Every full-time employee shares in our success

  • 🌴 Unlimited PTO — Take the time you need, when you need it

  • 🍽️ Daily Lunch Stipend — $100/week to cover your midday meals

  • 💪 Wellness Stipend — $100/month to support your health and well-being

  • 🚇 Commuter Benefits — $100/month for SF and NYC-based employees

  • 👶 Parental Leave — Paid leave to support growing families

Compensation The compensation range for this position reflects the average span for this role. Where an offer lands depends on your experience, qualifications, and interview performance, measured against Plenful’s internal leveling guidelines and market benchmarks. We set offers individually. This role is also eligible to participate in Plenful’s equity plan, subject to the terms of the applicable plans and policies.

How this job compares

Set against the 6,360 open Machine Learning Engineer jobs on Olive Jobs, counted November 16, 2026.

Pay
  • This postingNot listed
  • California median$175–261K/yr1,420 salary ranges
  • California median$50–70/hr23 hourly ranges
Openings
Olive Jobs lists 1,833 open Machine Learning Engineer jobs in California and 6,360 across the US. 8% of them nationwide are listed as remote or flexible.
Hiring the most in California
Experience
This posting asks for at least 5 years of experience; Machine Learning Engineer postings that state a minimum ask for 5 years at the median (5,294 postings).
Education
2,204 of the 6,360 open Machine Learning Engineer jobs (35%) ask for a bachelor's degree or higher.

Pay, requirements and demand for Software Engineer jobs

Counted across the open, public US postings on Olive Jobs on November 16, 2026. Figures based on too few postings are left out.

Prepare for this role

You've read the whole posting — now see how you match it.