Skip to main content
Microsoft Corporation logo

Software Engineering II - AI Compiler Engineer

Microsoft Corporation

Multiple LocationsJob$102–202K/yrSeen 1w agoSeen in employer's feed 1 day ago

Most applications go out cold — see where you stand first. No sign-up to start.

You apply on the employer's site, with no Olive account needed.

Watch jobs like this.

Don't just apply. Show up ready.

Olive works from this exact posting.

At a glance

Compensation
$102–202K/yr
Location
Multiple Locations
Work Authorization
Not specified

Olive lists jobs from US employers, including remote roles you can work from the United States.

Requirements

Credentials this posting asks for.

Microsoft Cloud Background Check, required

Job overview

Microsoft’s AI Frameworks team develops software for AI training and deployment on supercomputers and the Maia-200 accelerator. The AI Compiler Engineer will build mechanisms for deploying application code to accelerator devices, including LLVM IR transformations, JIT compilation, and system and runtime components. The role works across hardware, platform, research, and machine-learning disciplines on an end-to-end AI software stack.

Skills & qualifications

RequiredNice to have

Skills

C/C++, nice to havePython, nice to haveGNU/Linux, nice to haveUnix-Like Platforms, nice to haveSystems-Level Programming, nice to haveCompiler Frameworks, nice to haveLLVM, nice to have

Qualifications

Bachelor's in Computer Science or Related Technical Field or Equivalent Experience, required2+ Years Technical Engineering Experience, requiredMicrosoft Cloud Background Check, requiredBachelor's in Computer Engineering, Computer Science, or Related Technical Field or Equivalent Experience, nice to have2+ Years Software Development Experience, nice to have1+ Years C/C++ Experience, nice to have1+ Years GNU/Linux or Unix-Like Development Experience, nice to have1+ Years Optimized Systems-Level Programming Experience, nice to have

Full job description

Overview

The AI Frameworks team at Microsoft develops the AI software used to train and deploy the world’s most advanced AI models. We build software for Microsoft’s next-generation supercomputers and the Maia-200 AI accelerator, working closely with hardware architects, platform engineers, researchers, and ML developers. Our interdisciplinary team operates at the intersection of AI, compiler engineering, systems software, and high-performance computing. We have a collaborative and inclusive culture and participate in the open-source community.

We are seeking a Software Engineer II - AI Compiler Engineer to join the Maia Code-gen team. You will work on the fundamental mechanisms for building and deploying application code to Microsoft AI accelerator devices. This includes analyzing and modifying code through the LLVM IR API, implementing dynamic code-generation and JIT-compilation features, and developing system and runtime components for dynamic-code deployment. This is a hands-on technical role for someone who enjoys solving difficult engineering problems, takes initiative, and wants to help build an end-to-end AI software stack.

At Microsoft, our mission to empower every person and every organization on the planet to achieve more guides how we partner with customers to deliver trusted, impactful solutions. With a growth mindset culture, we innovate responsibly and measure success by shared progress people, teams, and customers. Join us to do meaningful work that changes the world and helps shape what’s next for everyone.

Responsibilities

  • Design and implement robust, maintainable software architectures and components for dynamic code generation and deployment.

  • Analyze and transform code using LLVM IR and develop advanced JIT-compilation features.

  • Build system and runtime components that support deploying application code to AI accelerator devices.

  • Develop software in C/C++, Python, and other languages as appropriate.

  • Collaborate across disciplines, from hardware architects to ML developers.

  • Identify requirements, scope solutions, estimate work, and plan deliverables.

  • Contribute to sound engineering practices and an inclusive, collaborative team culture.

Qualifications

Required/minimum qualifications

  • Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, or Python OR equivalent experience.

Other Requirements:

  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.

Preferred qualifications

  • Bachelor’s degree in computer engineering, computer science, or a related technical field, or equivalent experience.

  • 2+ years of software development experience.

  • 1+ years of experience with C/C++ 1+ years of experience developing software for GNU/Linux or another Unix-like platform.

  • 1+ years of experience with optimized systems‑level programming.

  • Experience building compilers or other tooling using compiler frameworks like LLVM.

#AIInfra

Software Engineering IC3 - The typical base pay range for this role across the U.S. is USD $102,100 - $202,200 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $133,800 - $219,200 per year.

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:

https://careers.microsoft.com/us/en/us-corporate-pay

This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.

Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations. (https://careers.microsoft.com/v2/global/en/accessibility.html)

How this job compares

Set against the 9,158 open Software Engineering jobs on Olive Jobs, counted November 12, 2026.

Pay
  • This posting$102–202K/yr
  • US median$146–252K/yr7,037 salary ranges

This range's midpoint, $152K, is 25% below the US median midpoint ($202K) — in the lowest quarter of Software Engineering salary ranges across the US.

Openings
Olive Jobs lists 9,158 open Software Engineering jobs across the US. 9% of them nationwide are listed as remote or flexible.
Hiring the most across the US
Experience
This posting asks for at least 2 years of experience — less than three in four Software Engineering postings that state a minimum ask for (median 7 years, across 6,943 postings).
Education
2,228 of the 9,158 open Software Engineering jobs (24%) ask for a bachelor's degree or higher.

Counted across the open, public US postings on Olive Jobs on November 12, 2026. Pay medians are the middle values of the low ends and of the high ends of postings that list both ends of a range in the same cadence (a yearly salary or an hourly rate); a range's midpoint is halfway between its ends. Pay and experience figures resting on fewer than 20 postings are left out.

Prepare for this role

You've read the whole posting — now see how you match it.