Staff AI Performance Engineer
Milpitas, CA · HybridJobPosted todayStill listed today
Most applications go out cold — see where you stand first. No sign-up to start.
Watch jobs like this. New roles like this one near Milpitas, CA, by email.
Don't just apply. Show up ready.
Olive works from this exact posting.
At a glance
Olive lists jobs from US employers, including remote roles you can work from the United States.
Job overview
The Staff AI Performance Engineer analyzes and optimizes AI training and inference workloads across distributed systems, connecting compute, memory, networking, and software behavior. The role leads complex hardware and software performance workstreams, builds benchmarks and analysis tools, profiles demanding workloads, and turns performance evidence into engineering decisions. Based in Milpitas, California, the position works across AI infrastructure at data center scale.
Skills & qualifications
Skills
Benefits
Full job description
About the Job
Lead performance work that turns large-scale AI workloads into faster, more efficient systems.
As a Staff AI Performance Engineer, you will analyze and optimize AI training and inference workloads across distributed systems. Your work will connect compute, memory, networking and software behavior.
You will lead complex performance workstreams across hardware and software. You will find bottlenecks, validate improvements and turn performance evidence into practical engineering decisions.
You will build benchmarks, profile demanding workloads and develop C++ and Python tools for analysis and optimization. Your recommendations will help teams improve efficiency, scalability and reliability.
This role gives you broad technical scope across AI infrastructure at data center scale. It is based in Milpitas, California.
The team and culture
The System Engineering Performance team architects, evaluates and optimizes high-performance infrastructure for large-scale data center deployments. The team works across the computing stack to understand real system behavior.
Work moves through evidence, ownership and clear technical judgment. You will lead investigations, coordinate across teams and validate impact with reliable performance data.
Decisions are shaped through benchmarks, models, simulations and practical engineering tradeoffs. The team values engineers who think big, act fast, take responsibility, speak up and lead beyond their own area.
What we’re looking for
- Strong experience profiling and optimizing AI, machine learning or high-performance computing workloads.
- Experience with distributed systems and communication libraries such as MPI, NCCL, UCX or libfabric.
- Strong C++ and Python skills, including reliable tools or performance-sensitive software.
- Deep understanding of compute, memory and communication behavior in large-scale systems.
- Ability to lead technically complex work and coordinate improvements across teams.
- Familiarity with MLPerf, accelerated architectures, ML frameworks or high-performance interconnects.
While we have outlined a set of requirements, we value transferable skills and diverse experiences. We also welcome engineers returning to the profession after a career break, including through returnship routes.
Benefits
Graphcore offers competitive compensation and benefits designed to support employees' health, financial well-being, work-life needs, and professional growth. Benefits and programs for eligible U.S. employees may include:
- Medical, dental, and vision coverage, with options that may extend to eligible dependents.
- Mental health, wellness, and employee assistance resources.
- Retirement savings benefits and company contributions where applicable.
- Paid vacation, sick time, company holidays, and parental or family leave in accordance with applicable plans and policies.
- Life insurance and short-term or long-term disability coverage.
- Flexible working hours and hybrid working arrangements where compatible with the role and team requirements.
- Professional-development resources, learning programs, office amenities, and team-led activities.
Benefits vary by work location, employment status, scheduled hours, and plan eligibility and are subject to the terms of the applicable plans and company policies. This overview is not a contract or guarantee of benefits.
Graphcore is an equal opportunity employer. We consider qualified applicants without regard to race, color, religion, creed, sex, pregnancy, sexual orientation, gender identity or expression, national origin, ancestry, age, disability, genetic information, veteran status, or any other status protected by applicable law.
Graphcore is committed to an inclusive and accessible hiring process. If you need a reasonable accommodation to participate in the application or interview process, please let the recruiting team know.
Personal information submitted during the recruiting process will be handled in accordance with Graphcore's applicable candidate privacy notices.
Join the Team at Graphcore
Graphcore is one of the world’s leading innovators in Artificial Intelligence compute. It is developing hardware, software and systems infrastructure that will unlock the next generation of AI breakthroughs and power the widespread adoption of AI solutions across every industry.
As part of the SoftBank Group, Graphcore is a member of an elite family of companies responsible for some of the world’s most transformative technologies. Together, they share a bold vision: to enable Artificial Super Intelligence and ensure its benefits are accessible to everyone.
Graphcore’s teams are drawn from diverse backgrounds and bring a broad range of skills and perspectives. A melting pot of AI research specialists, silicon designers, software engineers and systems architects, Graphcore brings together deep expertise to solve complex problems and deliver meaningful progress in AI compute.
Ready to lead performance improvements across AI systems at data center scale? Apply now to join Graphcore in Milpitas.
Similar jobs, posted recently
Open roles like this one, listed in the last 30 days.
Senior Staff AI Accelerator Performance ArchitectCerebras · Sunnyvale, CA · $175–275K/yrPosted 3w agoPosted 3w ago
Senior Software Engineer, AI Cluster Networking Performance EngineerCisco · Milpitas, CA (Hybrid) · $168–245K/yrPosted 3 days agoPosted 3 days ago
Senior Staff Software Engineer — Agentic AI Applications and FoundationsNVIDIA · Santa Clara, CA · $224–431K/yrPosted 1w agoPosted 1w ago
Senior High Performance AI Engineer, Agentic AINVIDIA · Santa Clara, CA · $152–242K/yrPosted 4w agoPosted 4w ago
Staff Software Engineer – AI PlatformGeneral Motors · Warren, MI (Hybrid) · $189–333K/yrPosted 1w agoPosted 1w ago
You've read the whole posting — now see how you match it.