Google logo

Software Engineering Manager, AI/ML

Google

Sunnyvale, CAJob$207–300K/yrSeen 5 days agoSeen in employer's feed 5 days ago

Most applications go out cold — see where you stand first. No sign-up to start.

You apply on the employer's site, with no Olive account needed.

Watch jobs like this.

Don't just apply. Show up ready.

Olive works from this exact posting.

At a glance

Compensation
$207–300K/yr
Location
Sunnyvale, CA
Work Authorization
Not specified

Olive lists jobs from US employers, including remote roles you can work from the United States.

Job overview

Google’s Software Engineering Manager will lead engineers working on large-scale distributed ML systems, performance optimization, and open-source generative AI models. The role manages engineers across teams and locations, contributes to project goals and product strategy, and oversees large-scale project deployment. The JAX Models and Performance team supports and optimizes performance for key model architectures used in Google Cloud generative AI workloads.

Skills & qualifications

RequiredNice to have

Skills

Software DevelopmentSpeech and AudioReinforcement LearningML InfrastructureMachine LearningML DesignModel DeploymentModel EvaluationData ProcessingDebuggingFine-TuningTechnical LeadershipPeople ManagementCross-Functional Collaboration

Qualifications

Bachelor's Degree or Equivalent Practical Experience8 Years Software Development Experience5 Years ML Field Experience5 Years Leading ML Design3 Years Technical Leadership Experience2 Years People Management ExperienceMaster's or PhD in Related Field3 Years Complex Organization ExperienceEnglish Proficiency

Benefits

Medical Insurance
Dental Insurance
Vision Insurance
401(k) Match
Paid Time Off
Parental Leave

Full job description

Software Engineering Manager, AI/ML

Share Software Engineering Manager, AI/ML

corporate_fare Google place Seattle, WA, USA; Kirkland, WA, USA; +2 more; +1 more

Advanced

Experience owning outcomes and decision making, solving ambiguous problems and influencing stakeholders; deep expertise in domain.

Share Software Engineering Manager, AI/ML

info_outline

XIn most instances, this position requires in-person interviews as part of the hiring process.

In accordance with Washington state law, we are highlighting our comprehensive benefits package, which is available to all eligible US based employees. Benefits for this role include:

  • Health, dental, vision, life, disability insurance

  • Retirement Benefits: 401(k) with company match

  • Paid Time Off: 20 days of vacation per year, accruing at a rate of 6.15 hours per pay period for the first five years of employment

  • Sick Time: 40 hours/year (increased to 69 hours/year for Seattle) including 5 discretionary sick days per instance

  • Maternity Leave (Short-Term Disability + Baby Bonding): 28-30 weeks

  • Baby Bonding Leave: 18 weeks

  • Holidays: 13 paid days per year

Note: By applying to this position you will have an opportunity to share your preferred working location from the following: Seattle, WA, USA; Kirkland, WA, USA; Sunnyvale, CA, USA .

Minimum qualifications:

  • Bachelor’s degree or equivalent practical experience.

  • 8 years of experience in software development.

  • 5 years of experience with one or more of the following: speech/audio (e.g., technology duplicating and responding to the human voice), reinforcement learning (e.g., sequential decision making), ML infrastructure, or specialization in another ML field.

  • 5 years of experience leading ML design and optimizing end-to-end Machine Learning (e.g., model deployment, model evaluation, data processing, debugging, fine tuning).

  • 3 years of experience in a technical leadership role.

  • 2 years of experience in a people management or team leadership role.

Preferred qualifications:

  • Master’s degree or PhD in Engineering, Computer Science, or a related technical field.

  • 3 years of experience working in a complex, matrixed organization involving cross-functional, or cross-business projects.

About the job

Like Google's own ambitions, the work of a Software Engineer goes beyond just Search. Software Engineering Managers have not only the technical expertise to take on and provide technical leadership to major projects, but also manage a team of Engineers. You not only optimize your own code but make sure Engineers are able to optimize theirs. As a Software Engineering Manager you manage your project goals, contribute to product strategy and help develop your team. Teams work all across the company, in areas such as information retrieval, artificial intelligence, natural language processing, distributed computing, large-scale system design, networking, security, data compression, user interface design; the list goes on and is growing every day. Operating with scale and speed, our exceptional software engineers are just getting started -- and as a manager, you guide the way.

With technical and leadership expertise, you manage engineers across multiple teams and locations, a large product budget and oversee the deployment of large-scale projects across multiple sites internationally.

The JAX Models and Performance team empowers GCP customers’ Gen AI workloads by supporting and optimizing performance for key model architectures. We are part of the ML Training team in the AI Engine organization in Core ML.

Google Cloud accelerates every organization’s ability to digitally transform its business and industry. We deliver enterprise-grade solutions that leverage Google’s cutting-edge technology, and tools that help developers build more sustainably. Customers in more than 200 countries and territories turn to Google Cloud as their trusted partner to enable growth and solve their most critical business problems.Individual pay is determined by factors including job-related skills, experience, and relevant education or training.

US: $207000 - $300000 (USD) + 20% bonus target + equity + benefits

Learn more aboutbenefits at Google (https://www.google.com/about/careers/applications/benefits/) .

Responsibilities

  • Provide coaching, mentorship, and career growth for engineers working across large-scale distributed ML systems, performance optimization, and open-source generative AI models.

  • Partner with Tech Leads, product management, and cross-functional teams to define and execute the roadmap for scalable JAX-based LLM (MaxText) and Diffusion (MaxDiffusion) frameworks.

  • Guide the team in implementing core performance optimizations (e.g., quantization, sparsity, custom kernels) and supporting new accelerator architectures (TPUs and GPUs) on GCP AI Hypercomputer.

  • Collaborate closely with DeepMind, Core ML, and the open-source community to deliver high-quality, reusable software artifacts and benchmark-setting MLPerf submissions.

  • Balance rapid model innovation with sustainable engineering practices, operational reliability, and high-trust team environment.

Information collected and processed as part of your Google Careers profile, and any job applications you choose to submit is subject to Google'sApplicant and Candidate Privacy Policy (./privacy-policy) .

Google is proud to be an equal opportunity and affirmative action employer. We are committed to building a workforce that is representative of the users we serve, creating a culture of belonging, and providing an equal employment opportunity regardless of race, creed, color, religion, gender, sexual orientation, gender identity/expression, national origin, disability, age, genetic information, veteran status, marital status, pregnancy or related condition (including breastfeeding), expecting or parents-to-be, criminal histories consistent with legal requirements, or any other basis protected by law. See alsoGoogle's EEO Policy (https://www.google.com/about/careers/applications/eeo/) ,Know your rights: workplace discrimination is illegal (https://careers.google.com/jobs/dist/legal/EEOC\_KnowYourRights\_10\_20.pdf) ,Belonging at Google (https://about.google/belonging/) , andHow we hire (https://careers.google.com/how-we-hire/) .

If you have a need that requires accommodation, please let us know by completing ourAccommodations for Applicants form (https://goo.gl/forms/aBt6Pu71i1kzpLHe2) .

Google is a global company and, in order to facilitate efficient collaboration and communication globally, English proficiency is a requirement for all roles unless stated otherwise in the job posting.

To all recruitment agencies: Google does not accept agency resumes. Please do not forward resumes to our jobs alias, Google employees, or any other organization location. Google is not responsible for any fees related to unsolicited resumes.

Equity is granted exclusively and discretionarily by Alphabet Inc. on the basis of an agreement concluded between you and Alphabet Inc. Alphabet Inc. is your sole contractual partner with respect to equity grants. GSU grants are not guaranteed, are discretionary, are subject to approval by the Alphabet Inc. board of directors or its delegate, the terms of the relevant Alphabet Inc. stock plan, and your grant agreement. They have no impact on statutory payments. Current or past grants do not confer an acquired right.

Google is proud to be an equal opportunity workplace and is an affirmative action employer. We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity or Veteran status. We also consider qualified applicants regardless of criminal histories, consistent with legal requirements. See also https://careers.google.com/eeo/ and https://careers.google.com/jobs/dist/legal/OFCCP_EEO_Post.pdf If you have a need that requires accommodation, please let us know by completing our Accommodations for Applicants form: https://goo.gl/forms/aBt6Pu71i1kzpLHe2.

How this job compares

Set against the 1,132 open Software Engineering Manager jobs on Olive Jobs, counted November 3, 2026.

Pay
  • This posting$207–300K/yr
  • California median$207–300K/yr193 salary ranges
  • US median$143–262K/yr965 salary ranges

This range's midpoint, $254K, is close to the California median midpoint ($254K) — in the middle half of Software Engineering Manager salary ranges in California.

Openings
Olive Jobs lists 223 open Software Engineering Manager jobs in California and 1,132 across the US. 5% of them nationwide are listed as remote or flexible.
Hiring the most in California
Experience
This posting asks for at least 8 years of experience; Software Engineering Manager postings that state a minimum ask for 8 years at the median (983 postings).
Education
421 of the 1,132 open Software Engineering Manager jobs (37%) ask for a bachelor's degree or higher.

Counted across the open, public US postings on Olive Jobs on November 3, 2026. Pay medians are the middle values of the low ends and of the high ends of postings that list both ends of a range in the same cadence (a yearly salary or an hourly rate); a range's midpoint is halfway between its ends. Pay and experience figures resting on fewer than 20 postings are left out.

Prepare for this role

You've read the whole posting — now see how you match it.