Skip to main content
Microsoft Corporation logo

Principal Technical Program Manager

Microsoft Corporation

United StatesJob$166–296K/yrSeen 1w agoStill listed · checked in the last 2 days

See where you stand before you apply. No sign-up to start.

You apply on the posting's application page, with no Olive account needed.

Watch jobs like this.

Don't just apply. Show up ready.

Olive works from this exact posting.

At a glance

Compensation
$166–296K/yr
Location
United States
Work Authorization
Not specified

Olive focuses on jobs in the United States, including remote roles you can work from there.

Requirements

Credentials this posting asks for.

Microsoft Cloud Background Check, required

Job overview

Microsoft’s Azure HPC & AI Infrastructure team seeks a Principal Technical Lead for AI Infrastructure Networking to shape networking architecture for large-scale AI training and inference systems. The role defines technical strategy and roadmaps, evaluates networking technologies, and drives infrastructure programs from technology evaluation through deployment and operation. It works across engineering, product, operations, customers, and suppliers to improve performance, reliability, scalability, and efficiency.

Skills & qualifications

RequiredNice to have

Skills

Program Management, nice to haveInternetworking, nice to haveData Analysis, nice to haveArchitectural Design, nice to haveTeam Leadership, nice to havePerformance Analysis, nice to haveCloud Computing, nice to haveHigh Performance Computing, nice to haveEngineering, requiredProduct Development, requiredCross-Functional Project Management, requiredDistributed Infrastructure, nice to haveHigh-Performance Networking, nice to haveInfiniBand, nice to haveEthernet, nice to haveRDMA/RoCE, nice to haveNetwork Interface Devices, nice to haveSwitching Architectures, nice to haveCongestion Management, nice to haveOptics, nice to haveHigh-Speed Interconnects, nice to haveSystem Architecture Evaluation, nice to haveWorkload Requirements Translation, nice to haveTechnical Decision Influence, nice to haveStakeholder Alignment, nice to have

Qualifications

Bachelor's Degree or Equivalent Experience, required8+ Years Relevant Experience, required6+ Years Cross-Team Project Experience, requiredMicrosoft Cloud Background Check, required15+ Years Relevant Experience, nice to have10+ Years Cross-Team Project Experience, nice to have6+ Years Infrastructure Experience, nice to have6+ Years Networking Experience, nice to have6+ Years Architecture Evaluation Experience, nice to have6+ Years Technical Influence Experience, nice to have

Full job description

Overview The Azure HPC & AI Infrastructure team defines and delivers the systems that power some of the world’s largest AI training and inference workloads. As Microsoft continues to expand the scale and sophistication of its AI infrastructure, networking is a key defining technology determining system performance, reliability, efficiency, and speed of deployment. We are seeking a Principal Technical Lead for AI Infrastructure Networking to provide technical leadership for the networking architectures that connect GPU and accelerated computing infrastructure. This role will help deliver the next generation of networking capabilities behind Microsoft’s AI infrastructure, spanning technologies including InfiniBand, RDMA, high-performance Ethernet, network interface devices, switches, optics, and emerging AI interconnect architectures.

This is a highly cross-functional technical leadership role operating at the intersection of AI systems architecture, networking, GPU platforms, datacenter infrastructure, software, operations, and silicon and networking suppliers. The successful candidate will define technical strategy, shape architecture and roadmap decisions, and drive complex infrastructure programs from early technology evaluation through qualification, deployment, and operation at hyperscale.

The role requires both deep technical expertise and the ability to operate effectively in highly ambiguous environments where technology, business requirements, and customer demand are evolving rapidly. You will work with senior engineering and product leaders across Microsoft as well as strategic technology partners to make decisions that influence the performance, reliability, scalability, and economics of Microsoft’s AI infrastructure. Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.

Responsibilities

  • Define the technical strategy and multi-year AI architecture direction for networking capabilities supporting Microsoft’s large-scale AI training and inference infrastructure. Use fleet telemetry, performance analysis, customer signals, and operational incidents to identify systemic improvements and influence future architecture and product investments.
  • Provide technical leadership across complex AI infrastructure systems spanning GPU and accelerated computing infrastructure, systems software, telemetry, and operations into scalable end-to-end solutions.
  • Translate AI workload requirements into system and networking architecture requirements spanning bandwidth, latency, topology, congestion management, resiliency, security, observability, serviceability, and operational efficiency.
  • Lead technical evaluation and architectural decision-making across technologies including InfiniBand, RDMA, advanced Ethernet fabrics, network interface devices, switches, optics, cables, GPU interconnects, and emerging AI networking technologies.
  • Create clarity in highly ambiguous problem spaces by driving alignment on complex architectural decisions and technical tradeoffs across networking, hardware and software engineering, systems architecture, datacenter infrastructure, operations, supply chain, finance, and customer-facing organizations.
  • Partner with internal AI workload teams and strategic customers to understand evolving training and inference requirements and convert those requirements into infrastructure capabilities and technology roadmap investments.
  • Influence the roadmaps and technical direction of strategic silicon, networking, and systems suppliers, ensuring emerging technologies can meet Microsoft’s requirements for performance, reliability, scale, serviceability, supply, and cost.
  • Establish technical success criteria and engineering mechanisms for measuring performance, reliability, availability, deployment readiness, operational health, and infrastructure efficiency.

Qualifications Required Qualifications:

  • Bachelor's Degree AND 8+ years experience in engineering, product/technical program management, data analysis, or product development• OR equivalent experience.

  • 6+ years of experience managing cross-functional and/or cross-team projects.

Other Requirements:

  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings:• Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud Background Check upon hire/transfer and every two years thereafter.

Preferred Qualifications:

  • Bachelor's Degree AND 15+ years experience engineering, product/technical program management, data analysis, or product development• OR equivalent experience.

  • 10+ years of experience managing cross-functional and/or cross-team projects.

  • 6+ year(s) experience designing, developing, deploying, or operating distributed large-scale datacenter, cloud, HPC, accelerated computing, or AI infrastructure.

  • 6+ year(s) deep technical experience with high-performance networking technologies such as InfiniBand, Ethernet, RDMA/RoCE, network interface devices, switches, routing and switching architectures, congestion management, optics, or high-speed interconnects.

  • 6+ year(s) experience evaluating complex system architectures and translating workload requirements into technical requirements, architecture decisions, and executable engineering plans.

  • 6+ year(s) experience influencing technical decisions without relying solely on direct organizational authority, including the ability to build alignment among engineering, architecture, operations, product, and business stakeholders.

#azurecorejobs

Technical Program Management IC6 - The typical base pay range for this role across the U.S. is USD $165,600 - $296,400 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $220,800 - $331,200 per year.

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here: https://careers.microsoft.com/us/en/us-corporate-pay

This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.

Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.

How this job compares

Set against the 1,136 open Technical Program Management jobs on Olive Jobs, counted November 18, 2026.

Pay
  • This posting$166–296K/yr
  • US median$144–257K/yr1,038 salary ranges

This range's midpoint, $231K, is 18% above the US median midpoint ($195K) — in the top quarter of Technical Program Management salary ranges across the US.

Openings
Olive Jobs lists 1,136 open Technical Program Management jobs across the US. 3% of them nationwide are listed as remote or flexible.
Hiring the most across the US
Experience
This posting asks for at least 8 years of experience; Technical Program Management postings that state a minimum ask for 7 years at the median (926 postings).
Education
210 of the 1,136 open Technical Program Management jobs (18%) ask for a bachelor's degree or higher.

Counted across the open, public US postings on Olive Jobs on November 18, 2026. Figures based on too few postings are left out.

Prepare for this role

You've read the whole posting — now see how you match it.