
AIML - Sr. LLM Inference Quality Engineer
Seattle, WAFull-timeSeen 4 days agoIn the employer's feed · checked in the last 2 days
See where you stand before you apply. No sign-up to start.
You apply on the posting's application page, with no Olive account needed.
Watch jobs like this. New roles like this one near Seattle, WA, by email.
Don't just apply. Show up ready.
Olive works from this exact posting.
At a glance
Olive focuses on jobs in the United States, including remote roles you can work from there.
Job overview
Apple is seeking a senior engineer to own the correctness, consistency, and stability of production LLM inference. The role leads qualification of inference and output-correctness systems for large-scale AI data center deployment, building automation frameworks and evaluation methods for models, prompts, serving stacks, and infrastructure changes. It combines hands-on AI systems engineering with quality strategy and collaboration across machine learning, inference, distributed systems, and platform teams.
Skills & qualifications
Skills
Qualifications
Full job description
Weekly Hours: 40
Role Number: 200694964-3337
Summary
Apple is building the next generation of AI data center infrastructure to power large language model (LLM) services at scale. We are looking for a senior engineer to own the correctness, consistency, and stability of LLM inference in production. You will design and build the automation frameworks, evaluation methodology, and qualification strategy that give us confidence in every model, prompt, serving stack, and infrastructure change before it reaches our users. Your work is the safety net that lets Apple ship frontier AI quickly, without sacrificing quality, safety, or trust.
Description
In this role, you will lead the qualification of an LLM inference, output-correctness, automation framework for large-scale AI data center deployment and platform validation. You will architect qualification systems for generative AI, including agentic workflows and tool-using models, running at data center scale, validating that outputs remain correct, consistent, and stable as models, weights, prompts, serving runtimes, quantization schemes, and accelerator hardware change underneath them. This is a hands-on AI systems engineering role at the intersection of machine learning, distributed systems, and quality engineering. You will write production-quality software in Python, C++, and/or Swift, apply statistical and ML-evaluation methods to validate both data and model behavior, and build AI-assisted QA tooling that makes testing itself smarter and faster. You will partner closely with ML engineers, inference/performance engineers, distributed systems engineers, and platform teams, and you will be a trusted Quality voice on what “correct” and “stable” mean for LLM inference at scale, including the inherently non-deterministic, probabilistic nature of generative output. You should be comfortable operating in ambiguity, defining quality bars where none exist yet, and delivering rigorous results on tight schedules.
Minimum Qualifications
-
5+ years of experience with hardware and/or software development lifecycle processes.
-
5+ years of experience in one or more compiled languages (e.g., C, C++, Objective-C/Swift).
-
Proficiency in one or more scripting languages (e.g., Python, Go, or JavaScript).
-
Experience using AI/LLMs to improve testing itself — test-case generation, defect detection, or reducing manual QA effort.
-
Familiarity with LLM serving and inference optimization (batching, KV-cache, quantization, speculative decoding, distributed/multi-accelerator serving) and GPU-accelerated software.
-
Experience with CI/CD, Kubernetes, containers, and cloud-native systems, and integrating automated evals into release pipelines.
-
Experience with machine learning and LLMs, their common practical applications, and commonly used frameworks (e.g., PyTorch, Hugging Face Transformers, or comparable inference/serving stacks).
-
Experience with observability and distributed tracing for ML systems (e.g., Splunk, Prometheus, Grafana, LangSmith, or similar) and monitoring for model drift.
-
B.S., M.S., or Ph.D. in Computer Engineering, Electrical Engineering, Computer Science, or equivalent experience.
Preferred Qualifications
-
5+ years using one or more of the following scripting languages: Python, Go, or JavaScript
-
5+ years of experience working with and building operating systems
-
2+ years of experience in LLM testing/development.
Apple is an equal opportunity employer that is committed to inclusion and diversity. We seek to promote equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other legally protected characteristics.
How this job compares
Set against the 2,770 open Quality Engineer jobs on Olive Jobs, counted November 18, 2026.
- Pay
- This postingNot listed
- Washington median$103–160K/yr41 salary ranges
- US median$39–45/hr149 hourly ranges
- Openings
- Olive Jobs lists 55 open Quality Engineer jobs in Washington and 2,770 across the US. 2% of them nationwide are listed as remote or flexible.
- Experience
- This posting asks for at least 5 years of experience; Quality Engineer postings that state a minimum ask for 5 years at the median (2,257 postings).
- Education
- 1,330 of the 2,770 open Quality Engineer jobs (48%) ask for a bachelor's degree or higher.
Counted across the open, public US postings on Olive Jobs on November 18, 2026. Figures based on too few postings are left out.
Prepare for this role
You've read the whole posting — now see how you match it.



