Skip to main content
Apple logo

Sr Software Engineer - LLM Evaluation and Test Infrastructure

Apple

Cupertino, CAFull-timeSeen todayIn the employer's feed · checked in the last 2 days

See where you stand before you apply. No sign-up to start.

You apply on the posting's application page, with no Olive account needed.

Watch jobs like this.

Don't just apply. Show up ready.

Olive works from this exact posting.

At a glance

Compensation
No compensation found
Location
Cupertino, CA
Schedule
Full-time
Work Authorization
Not specified

Olive focuses on jobs in the United States, including remote roles you can work from there.

Job overview

Apple seeks a senior software engineer to define and develop validation infrastructure for generative AI systems. The role builds online and offline testing tools, frameworks, and methodologies for client/server machine-learning systems across Apple platforms. The engineer collaborates with machine-learning, data-science, software, product, and program teams to support rigorous model testing and align infrastructure development with product roadmaps.

Skills & qualifications

RequiredNice to have

Skills

Software Development, requiredJava, requiredPython, requiredSwift, requiredObjective-C, requiredSoftware Engineering, nice to haveScalable Infrastructure, nice to haveMachine Learning Concepts, nice to haveML Product Lifecycle, nice to haveML Operations, nice to havePyTorch, nice to haveTensorFlow, nice to haveScikit-Learn, nice to haveAutomation Infrastructure, nice to haveAI/ML Applications, nice to haveCloud Applications, nice to haveMachine Learning Evaluation, nice to haveMachine Learning Testing, nice to havePerformance Metrics, nice to haveValidation Techniques, nice to haveStatistical Analysis, nice to haveGenerative AI, nice to haveAdaptability, nice to haveCreative Problem Solving, nice to haveVerbal Communication, nice to haveWritten Communication, nice to haveCross-Functional Collaboration, nice to haveTechnical Communication, nice to have

Qualifications

BS/MS in Computer Science, Machine Learning or Related Field, required6+ Years Software Development Experience, required

Full job description

Weekly Hours: 40

Role Number: 200695921-0836

Summary

Do you believe generative models can transform smart assistants and creative workflows used by billions? Do you believe it can fundamentally shift how people interact with devices and communicate? We truly believe it can! We are looking for highly skilled senior software engineers experienced in architecting and deploying test and validation infrastructure for consumer-facing products using large-scale client/server ML systems.

You will play a critical role in designing and building LLMs online and offline validation infrastructure, tools, frameworks, and methodologies that enable product teams across Apple to develop state-of-the-art generative AI solutions that power amazingly intelligent user experiences on iPhone, Mac, Watch, iPad, and more. We are the Intelligence System Experience (ISE) team within Apple’s software organization. The team works at the intersection between multimodal machine learning and system experiences. System Experience (Springboard, Settings), Keyboards, Pencil & Paper, Shortcuts are some of the experiences that the team oversees. These experiences that our users enjoy are backed by production scale ML workflows. Visual Understanding of People, Text, Handwriting & Scenes, multilingual NLP for writing workflows & knowledge extraction, behavioral modeling for proactive suggestions, and privacy preserving learning are areas our multi disciplinary ML teams focus on.

Description

This role is responsible for defining and developing generative AI systems validation infrastructure by collaborating with diverse cross-functional partners, including machine learning engineers, data scientists, software developers, and product managers. The evaluation infrastructure includes adopting or building new client and server CI pipelines and developing scalable automation tools and frameworks across all Apple platforms. The evaluation infrastructure should allow cross-functional teams to conduct rigorous testing to ensure the accuracy, performance, reliability, and stability of ISE’s future generative AI models across various products and use cases. This role will also work closely with product and program teams to ensure validation infrastructure development is done in lockstep with the new features and products roadmap and to drive a high adoption among product and ML engineers. This is a fast-paced role with high visibility, impact, and influence in building one of the industry’s most advanced generative AI systems.

Minimum Qualifications

  • BS/MS in Computer Science, Machine Learning or related field

  • 6+ years of proven expertise in software development with Java, Python, Swift, or Objective-C

Preferred Qualifications

  • Strong software engineering skills to create a scalable and robust infrastructure for generative AI systems training and inference pipelines leveraging on-device and server-side ML models.

  • Fundamental knowledge of ML concepts and understanding of ML-based product lifecycle and operations

  • Familiarity with ML toolkits such as PyTorch, TensorFlow, SkLearn, etc.

  • Hands-on experience in building an automation infrastructure, tools, and frameworks for large-scale AI/ML or cloud- based applications leveraging cross-functional partnerships

  • Demonstrated experience in evaluating and testing machine learning models. Familiarity with performance metrics, validation techniques, and statistical analysis.

  • A passion for staying up-to-date with the latest advancements in generative AI models and their applications. Ability to quickly learn new technologies, adapt to evolving project requirements, and think creatively to solve complex challenges.

  • Excellent verbal and written communication skills to effectively collaborate with multidisciplinary teams. Ability to articulate complex technical concepts to both technical and non-technical stakeholders.

Apple is an equal opportunity employer that is committed to inclusion and diversity. We seek to promote equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other legally protected characteristics.

How this job compares

Set against the 9,916 open Software Engineering jobs on Olive Jobs, counted November 21, 2026.

Pay
  • This postingNot listed
  • California median$188–280K/yr1,547 salary ranges
  • California median$42–55/hr129 hourly ranges
Openings
Olive Jobs lists 2,062 open Software Engineering jobs in California and 9,916 across the US. 11% of them nationwide are listed as remote or flexible.
Hiring the most in California
Experience
This posting asks for at least 6 years of experience; Software Engineering postings that state a minimum ask for 7 years at the median (7,553 postings).
Education
2,070 of the 9,916 open Software Engineering jobs (21%) ask for a bachelor's degree or higher.

Counted across the open, public US postings on Olive Jobs on November 21, 2026. Figures based on too few postings are left out.

Prepare for this role

You've read the whole posting — now see how you match it.