McKesson Corporation logo

Principal AI Engineer

McKesson Corporation

Columbus, OHJobSeen todaySeen in employer's feed today

Most applications go out cold — see where you stand first. No sign-up to start.

Watch jobs like this.

Don't just apply. Show up ready.

Olive works from this exact posting.

At a glance

Compensation
No compensation found
Location
Columbus, OH
Work Authorization
Not specified

Olive lists jobs from US employers, including remote roles you can work from the United States.

Job overview

McKesson’s Principal AI Engineer provides enterprise-wide technical leadership for its AI platform in a regulated healthcare environment. The role sets multi-year architecture strategy for agentic and LLM-powered systems, advises executives on AI strategy and risk, resolves complex cross-team technical challenges, and shapes governance and standards. It also leads high-risk technical initiatives and develops senior engineering leaders.

Skills & qualifications

RequiredNice to have

Skills

AI Platform StrategyAgentic SystemsLarge Language ModelsRetrieval-Augmented GenerationRetrieval ArchitectureConnector EcosystemsEvaluation FrameworksArchitectureReliabilitySecurity StandardsModel RiskPrototypingAI GovernancePHI HandlingFoundation Model EvaluationAI InfrastructureTechnical Coaching

Full job description

McKesson is an impact-driven, Fortune 10 company that touches virtually every aspect of healthcare. We are known for delivering insights, products, and services that make quality care more accessible and affordable. Here, we focus on the health, happiness, and well-being of you and those we serve - we care. What you do at McKesson matters. We foster a culture where you can grow, make an impact, and are empowered to bring new ideas. Together, we thrive as we shape the future of health for patients, our communities, and our people. If you want to be part of tomorrow's health today, we want to hear from you. The Principal AI Engineer provides the highest level of individual-contributor technical leadership for the company's AI platform, operating one level above the Lead AI Engineer role. This person sets the multi-year architecture strategy for agentic and LLM-powered systems - spanning model strategy, retrieval-augmented generation (RAG), tool/connector ecosystems, and evaluation/governance tooling - across every team that builds on the AI platform, not just one. In a highly regulated healthcare environment, the Principal AI Engineer resolves the hardest, most ambiguous technical problems facing the platform, is a primary technical voice with executive leadership on AI strategy and risk, and shapes how the entire engineering organization adopts AI safely and effectively. Success is measured by the durability and adoption of the technical strategy this role sets across multiple teams, this role's ability to unblock cross-organizational technical risk before it becomes a delivery or compliance problem, and its influence on AI investment decisions at the executive level. Key Responsibilities - Enterprise AI Strategy: Own the multi-year technical strategy and roadmap for the AI platform across all teams building on it, not a single product or team - model strategy, RAG/retrieval architecture, connector ecosystems, and evaluation frameworks. - Technical Authority: Serve as the final technical escalation point for the hardest, most ambiguous architecture and reliability problems on the AI platform, spanning multiple teams and systems. - Cross-Team Standards: Set architecture, security, and evaluation standards that multiple Lead AI Engineers and their teams adopt; audit and evolve those standards as the platform and threat landscape change. - Executive Advisory: Serve as a primary technical voice to VP- and executive-level leadership on AI platform strategy, model risk, and investment trade-offs. - Deep Technical Delivery: Personally lead architecture and prototyping for the organization's highest-ambiguity, highest-risk AI initiatives - the problems no existing team or pattern already solves. - Mentorship at Scale: Develop Lead and Senior AI Engineers into stronger technical leaders through design review, technical coaching, and structured knowledge-sharing across teams. - Responsible AI & Governance: Shape enterprise-wide AI governance policy - model risk review, connector/tool approval frameworks, and PHI-handling standards - in partnership with Legal/Compliance/Privacy leadership. - Vendor & Model Strategy at Scale: Own evaluation and long-term strategy for foundation model providers and AI infrastructure vendors across the company, not just a single team's stack. - External Technical Representation: Represent the company's AI engineering capability externally - industry forums, partner/vendor technical relationships, and recruiting for senior technical talent. - Organizational Impact: Influence AI platform direction and investment across the broader enterprise, extending beyond a single business unit. Priority will be given to candidates who reside in the Columbus, OH metropolitan area. We are unable to provide sp

How this job compares

Set against the 7,304 open AI Engineer jobs on Olive Jobs, counted October 31, 2026.

Pay
  • This postingNot listed
  • Ohio median$122–241K/yr209 salary ranges
  • US median$30–77/hr142 hourly ranges
Openings
Olive Jobs lists 265 open AI Engineer jobs in Ohio and 7,304 across the US. 8% of them nationwide are listed as remote or flexible.
Hiring the most in Ohio
Experience
AI Engineer postings that state a minimum ask for 5 years of experience at the median; the middle half ask for 3 to 8 years (6,232 postings).
Education
3,378 of the 7,304 open AI Engineer jobs (46%) ask for a bachelor's degree or higher.

Counted across the open, public US postings on Olive Jobs on October 31, 2026. Pay medians are the middle values of the low ends and of the high ends of postings that list both ends of a range in the same cadence (a yearly salary or an hourly rate); a range's midpoint is halfway between its ends. Pay and experience figures resting on fewer than 20 postings are left out.

You've read the whole posting — now see how you match it.