Skip to main content
Apple logo

Software Engineering Manager, AIML — LLM Inference Quality

Apple

Seattle, WAFull-timeSeen todayIn the employer's feed · checked in the last 2 days

See where you stand before you apply. No sign-up to start.

You apply on the posting's application page, with no Olive account needed.

Watch jobs like this.

Don't just apply. Show up ready.

Olive works from this exact posting.

At a glance

Compensation
No compensation found
Location
Seattle, WA
Schedule
Full-time
Work Authorization
Not specified

Olive focuses on jobs in the United States, including remote roles you can work from there.

Job overview

Apple is seeking a hands-on engineering manager to lead the team responsible for the quality, correctness, consistency, and stability of LLM inference in production. The team develops automation frameworks, evaluation methodology, and qualification strategies for models, prompts, serving stacks, and infrastructure changes. The manager will guide technical direction and delivery, partner across engineering teams and sites, hire and develop engineers, and represent the team to senior leadership.

Skills & qualifications

RequiredNice to have

Skills

Software and ML Systems Development, requiredEngineering Management, requiredLarge-Scale Project Delivery, requiredTest Strategy, requiredQualification Strategy, requiredEvaluation Strategy, requiredDistributed Systems, requiredCompiled Languages, requiredScripting Languages, requiredSelf-Direction, requiredStrategy Execution, requiredMachine Learning, nice to haveLarge Language Models, nice to havePyTorch, nice to haveHugging Face Transformers, nice to haveLLM Serving, nice to haveInference Optimization, nice to haveGPU-Accelerated Software, nice to haveAI-Assisted Testing, nice to haveCI/CD, nice to haveKubernetes, nice to haveContainers, nice to haveCloud-Native Systems, nice to haveObservability, nice to haveDistributed Tracing, nice to haveModel Drift Monitoring, nice to haveAgentic Workflow Validation, nice to haveHiring and Developing Engineers, nice to haveChange Leadership, nice to have

Qualifications

8+ Years Software or ML Systems Experience, required3+ Years Engineering Management Experience, requiredBachelor's, Master's, PhD or Equivalent Experience, required

Full job description

Weekly Hours: 40

Role Number: 200694970-3337

Summary

Apple is building the next generation of AI data center infrastructure to power large language model (LLM) services at scale. We are looking for a hands-on engineering manager to lead the team that owns the Quality, correctness, consistency, and stability of LLM inference in production.

Your team builds the automation frameworks, evaluation methodology, and qualification strategy that give Apple confidence in every model, prompt, serving stack, and infrastructure change before it reaches users. This is the safety net that lets Apple ship frontier AI quickly — without sacrificing quality, safety, or trust. We are seeking a deeply experienced manager who stays close to the technology to drive both the technical roadmap and the delivery of a high-performing team.

Description

As a technical manager, you will lead a team of engineers spanning quality engineering, distributed systems, and applied ML evaluation. Your team qualifies LLM inference and output-correctness automation frameworks for large-scale AI data center deployment and platform validation — validating that outputs remain correct, consistent, and stable as models, weights, prompts, serving runtimes, quantization schemes, and accelerator hardware change underneath them.

You will stay close to architecture, design reviews, and trade-offs, and partner with ML engineers, inference/performance engineers, distributed systems teams, and platform teams across Cupertino, Seattle, and other sites. You will hire and grow engineers, shape the team's roadmap, define quality bars where none exist yet, and represent the team to senior leadership and partners. This role requires strong technical depth, exceptional people-management skills, and the ability to navigate ambiguity in a fast-paced environment — including the inherently non-deterministic, probabilistic nature of generative output.

Minimum Qualifications

  • 8+ years of experience in software and/or ML systems development, or equivalent experience.

  • 3+ years of engineering management experience, with a proven track record of delivering complex, large-scale projects across multiple teams or organizations.

  • Experience architecting test, qualification, or evaluation strategy for large-scale distributed systems — ideally ML serving or inference platforms.

  • Hands-on background in one or more compiled languages (C, C++, Objective-C, or Swift) and proficiency in a scripting language (e.g., Python).

  • Self-directed: the ability to drive a strategy or project from a simple idea to production, setting clear priorities and consistently delivering on schedule with measurable outcomes.

  • B.S., M.S., or Ph.D. in Computer Science, Computer Engineering, Electrical Engineering, or equivalent experience.

Preferred Qualifications

  • Experience with machine learning and LLMs — common practical applications and frameworks (e.g., PyTorch, Hugging Face Transformers, or comparable inference/serving stacks).

  • Familiarity with LLM serving and inference optimization (batching, KV-cache, quantization, speculative decoding, distributed/multi-accelerator serving) and GPU-accelerated software.

  • Experience using AI/LLMs to improve testing itself — test-case generation, defect detection, or reducing manual QA effort.

  • Experience with CI/CD, Kubernetes, containers, and cloud-native systems, and integrating automated evals into release pipelines.

  • Experience with observability and distributed tracing for ML systems (e.g., Splunk, Prometheus, Grafana, LangSmith, or similar) and monitoring for model drift.

  • Experience validating agentic workflows — tool-use, function-calling, and multi-turn coherence.

  • Track record of hiring, developing, and retaining strong engineers, and leading change across multiple sites.

Apple is an equal opportunity employer that is committed to inclusion and diversity. We seek to promote equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other legally protected characteristics.

How this job compares

Set against the 2,658 open Engineering Management jobs on Olive Jobs, counted November 18, 2026.

Pay
  • This postingNot listed
  • Washington median$164–275K/yr91 salary ranges
Openings
Olive Jobs lists 99 open Engineering Management jobs in Washington and 2,658 across the US. 7% of them nationwide are listed as remote or flexible.
Hiring the most in Washington
Experience
This posting asks for at least 8 years of experience; Engineering Management postings that state a minimum ask for 8 years at the median (2,271 postings).
Education
888 of the 2,658 open Engineering Management jobs (33%) ask for a bachelor's degree or higher.

Counted across the open, public US postings on Olive Jobs on November 18, 2026. Figures based on too few postings are left out.

Prepare for this role

You've read the whole posting — now see how you match it.