Skip to main content
Apple logo

ML Software Engineer

Apple

Seattle, WAJobSeen 3mo agoIn the employer's feed · checked in the last 2 days

See where you stand before you apply. No sign-up to start.

You apply on the posting's application page, with no Olive account needed.

Watch jobs like this.

Don't just apply. Show up ready.

Olive works from this exact posting.

At a glance

Compensation
No compensation found
Location
Seattle, WA
Work Authorization
Not specified

Olive focuses on jobs in the United States, including remote roles you can work from there.

Job overview

Our team builds the ML‑inference stack that powers generative AI for Apple Intelligence’s Private Cloud Compute, running on Apple Silicon in datacenters and scaling across platforms. We engineer stability, performance, and new functionality, integrating inference code into a full service stack for reliable, high‑throughput user traffic.

Skills & qualifications

RequiredNice to have

Skills

Swift, nice to haveC++, requiredPython, requiredGo, requiredRust, requiredJava, requiredgRPC, nice to haveProtocol Buffers, nice to haveOpenTelemetry, nice to haveSplunk, nice to haveML Inference Serving, requiredDistributed Systems, required

Qualifications

Bachelor's Degree in Computer Science or Computer Engineering or Related Field, required2 Years Practical Experience, requiredExperience Building Large-Scale Distributed Systems That Serve ML Inference, required

Full job description

Role Number: 200675086-3337

Summary

Our team builds the ML-inference stack that powers generative AI for Apple Intelligence's Private Cloud Compute — running on Apple Silicon in the datacenter, distributing work across on-SoC acceleration hardware and multi-node clusters. Built on Private Cloud Compute's privacy guarantees, we're growing the team to scale across more platforms and support a widening set of features.

Description

As part of the team you will help engineer continuous improvements in stability and performance for Private Cloud Compute, help implement entirely new functionality as it emerges from the research community, and help bring our inference stack up on new generations of SoCs and hardware acceleration IP as we extend to more platforms — in collaboration with hardware, product and research teams throughout Apple.

We write performant and scalable frameworks (primarily in Swift, with C++ where we bridge to the hardware) to distribute and coordinate ML inference across the acceleration IP blocks of different SoCs, and to move data and coordinate work reliably across multi-node inference clusters. You will integrate inference code into a full service stack so that user traffic is served reliably and performantly, with a strong focus on code that is easy and safe to develop, update, and monitor in production.

We're a collection of highly skilled and friendly engineers who value each other's opinions and experience. We strive for excellence and believe strongly in the quality of our output. We are a team of domain experts, each specializing in specific core subject areas, with broad collective experience across cloud software services and platforms.

Minimum Qualifications

  • 2 Years practical experience plus Bachelor's degree in Computer Science, Computer Engineering, or a related field — or equivalent practical experience.

  • Experience building large-scale distributed systems that serve ML inference, reasoning across processes, hosts, and service tiers as well as model behavior under load.

  • A ML performance-centric mindset — able to reason about latency/throughput trade-offs and to distinguish what can be solved at the system level from what requires model–system co-design.

  • Strong in a systems or server language — Python, Go, Rust, Java, C++, or similar. Swift is what we write, but we don't expect it going in.

Preferred Qualifications

  • Low-level or close-to-the-metal work — systems programming, performance, or hardware/SoC bring-up.

  • Server-side Swift, or RPC/networking stacks (gRPC, Protocol Buffers).

  • Strong debugging and observability instincts — fluent in logs, metrics, and traces, with observability-stack (OpenTelemetry, Splunk), SLO/error-budget, and on-call experience, and able to drive a production incident to root cause.

  • Depth in ML inference serving optimizations — quantization, sparsity, batching, KV cache, tokenization, GPU acceleration — enough to optimize the system and reason about the trade-offs and requirements it places on models (you won't be training them).

  • Solid grasp of concurrency, async/streaming, resource lifecycle, and error/cancellation handling; bonus for Apple platform experience (XPC, Instruments, Swift Concurrency).

Apple is an equal opportunity employer that is committed to inclusion and diversity. We seek to promote equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other legally protected characteristics.

How this job compares

Set against the 320 open ML Engineer jobs on Olive Jobs, counted November 18, 2026.

Pay
  • This postingNot listed
  • US median$144–235K/yr248 salary ranges
Openings
Olive Jobs lists 19 open ML Engineer jobs in Washington and 320 across the US. 5% of them nationwide are listed as remote or flexible.
Hiring the most across the US
Experience
This posting asks for at least 2 years of experience — less than three in four ML Engineer postings that state a minimum ask for (median 5 years, across 255 postings).
Education
178 of the 320 open ML Engineer jobs (56%) ask for a bachelor's degree or higher.

Pay, requirements and demand for Software Engineer jobs

Counted across the open, public US postings on Olive Jobs on November 18, 2026. Figures based on too few postings are left out.

Prepare for this role

You've read the whole posting — now see how you match it.