Skip to main content
Apple logo

Machine Learning Compute Efficiency Lead, Infrastructure & Planning

Apple

Cupertino, CAJobSeen 6mo agoIn the employer's feed · checked in the last 2 days

See where you stand before you apply. No sign-up to start.

You apply on the posting's application page, with no Olive account needed.

Watch jobs like this.

Don't just apply. Show up ready.

Olive works from this exact posting.

At a glance

Compensation
No compensation found
Location
Cupertino, CA
Work Authorization
Not specified

Olive focuses on jobs in the United States, including remote roles you can work from there.

Job overview

Apple’s Platform Acceleration & Compute Efficiency team works across machine learning organizations, compute infrastructure, and platform tooling to improve scalable compute. The Senior Architect will focus on making machine learning compute faster, more reliable, and cost-effective, while defining efficiency metrics and shaping inference strategy. The role partners with model developers and infrastructure providers to improve utilization, reduce serving costs, and support large-scale inference.

Skills & qualifications

RequiredNice to have

Skills

ML Infrastructure, requiredSystems Architecture, requiredEfficiency Optimization, requiredFoundation Model Inference, requiredModel Serving, requiredDistributed Training, requiredData Parallelism, requiredTensor Parallelism, requiredPipeline Parallelism, requiredGPU Utilization, requiredTPU Utilization, requiredMemory Hierarchies, requiredCluster Scheduling, requiredAI Workflows, requiredAnalytical Skills, requiredUtilization Analysis, requiredCapacity Modeling, requiredEfficiency Metrics, requiredWritten Communication, requiredVerbal Communication, requiredPyTorch, nice to haveJAX, nice to haveCluster Management, nice to haveSlurm, nice to haveKubernetes, nice to haveGPU Hardware, nice to haveTPU Hardware, nice to haveFinOps, nice to haveCapacity Planning, nice to haveTechnical Roadmap Negotiation, nice to haveTCO Modeling, nice to haveCost Optimization, nice to have

Qualifications

Bachelor's in Computer Science, Computer Engineering or Equivalent Practical Experience, required7+ Years ML Infrastructure, Systems Architecture or Optimization Experience, requiredMaster's or PhD in Relevant Field, nice to have

Full job description

Role Number: 200659537-0836

Summary

Apple’s Platform Acceleration & Compute Efficiency (PACE) is a high-leverage team operating at the critical intersection of our ML organizations, underlying compute infrastructure, and core platform tooling. Our mission is to empower Apple’s software engineering teams with efficient, scalable compute. By driving out operational friction and optimizing the broader machine learning ecosystem, we directly accelerate the pace of development across the company.

As foundation models become increasingly central to Apple's user experiences, maximizing the efficiency of our ML compute is paramount. In this role, you will focus relentlessly on compute efficiency, ensuring that Apple’s models run as fast, reliably, and cost-effectively as possible. You will tackle massive optimization challenges, from maximizing hardware utilization across GPUs, TPUs, and custom Apple Silicon, to shaping workload scheduling and capacity allocation for large model serving.

We are seeking a Senior Architect with deep expertise in ML infrastructure to act as a linchpin for Apple’s foundational inference strategy. You will be instrumental in defining, establishing, and monitoring compute efficiency metrics across the software engineering organization. By partnering closely with model developers and infrastructure providers, your work will directly reduce serving costs, shape core engineering decisions, and enable the highly efficient, scalable inference required to power Apple Intelligence for hundreds of millions of users.

Description

  • Own and support ML compute management for Apple’s inference workloads (GPU, TPU, and custom silicon) to enable large-scale model serving.
  • Collaborate closely with Apple Intelligence and ML engineering teams to understand roadmaps and resource pain points to develop and implement resource strategies.
  • Optimize Apple’s ML workloads by driving performance improvements, maximizing resource utilization, and reducing service costs through deep root cause analysis that shapes both engineering decisions and the end customer experience.
  • Architect solutions for large-scale optimization problems, including capacity allocation, workload scheduling, and cost reduction, enabling Apple's AI-driven experiences.
  • Advocate on behalf of Apple’s ML engineers to bring a consolidated view of ML platform and model inference requirements to Apple’s internal infrastructure platform providers and 3rd party public cloud providers.

Minimum Qualifications

  • BS in Computer Science, Computer Engineering, or equivalent practical experience

  • 7+ years in ML infrastructure, systems architecture, or efficiency/optimization roles at scale

  • Strong conceptual understanding of foundation model inference/serving at scale and distributed training (data/tensor/pipeline parallelism), GPU/TPU utilization, memory hierarchies, and cluster scheduling

  • AI-fluent and capable of quickly adapting to AI workflows and empowerment

  • Proven track record of driving complex cross-org technical initiatives through influence, not authority

  • Strong analytical skills with experience designing or interpreting utilization analyses, capacity models, or efficiency metrics

  • Clear written and verbal communication, comfortable presenting to VPs and white-boarding with senior ML engineers

Preferred Qualifications

  • MS or PhD in a relevant field

  • Direct experience with foundation model serving, inference, and training at scale

  • Familiarity with PyTorch, JAX, cluster management (Slurm, Kubernetes), or GPU/TPU hardware

  • Prior experience in efficiency, FinOps, or capacity planning

  • Experience negotiating technical roadmaps with platform or infrastructure teams

  • Background in technical and financial decision-making (TCO modeling, cost optimization)

Apple is an equal opportunity employer that is committed to inclusion and diversity. We seek to promote equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other legally protected characteristics.

How this job compares

Set against the 435 open Capacity Planning jobs on Olive Jobs, counted November 18, 2026.

Pay
  • This postingNot listed
  • California median$192–277K/yr43 salary ranges
Openings
Olive Jobs lists 49 open Capacity Planning jobs in California and 435 across the US. 16% of them nationwide are listed as remote or flexible.
Hiring the most in California
Experience
This posting asks for at least 7 years of experience; Capacity Planning postings that state a minimum ask for 7 years at the median (397 postings).
Education
55 of the 435 open Capacity Planning jobs (13%) ask for a bachelor's degree or higher.

Counted across the open, public US postings on Olive Jobs on November 18, 2026. Figures based on too few postings are left out.

Prepare for this role

You've read the whole posting — now see how you match it.