Lead AI Engineer
Columbus, OHJobSeen 1w agoSeen in employer's feed 2 days ago
Most applications go out cold — see where you stand first. No sign-up to start.
You apply on the employer's site, with no Olive account needed.
Watch jobs like this. New roles like this one near Columbus, OH, by email.
Don't just apply. Show up ready.
Olive works from this exact posting.
At a glance
Olive lists jobs from US employers, including remote roles you can work from the United States.
Job overview
McKesson’s AI Enablement team builds and operates infrastructure, integrations, and knowledge systems for enterprise adoption of generative AI. The Lead AI Engineer sets architecture and technical standards for agentic and LLM-powered systems, owns shared AI platform design, and delivers complex components. The role also mentors engineers, guides governance and vendor decisions, and represents AI architecture across engineering and compliance stakeholders in a regulated healthcare environment.
Skills & qualifications
Skills
Full job description
McKesson is an impact-driven, Fortune 10 company that touches virtually every aspect of healthcare. We are known for delivering insights, products, and services that make quality care more accessible and affordable. Here, we focus on the health, happiness, and well-being of you and those we serve - we care. What you do at McKesson matters. We foster a culture where you can grow, make an impact, and are empowered to bring new ideas. Together, we thrive as we shape the future of health for patients, our communities, and our people. If you want to be part of tomorrow's health today, we want to hear from you. About the Team Our AI Enablement team drives enterprise-wide adoption of generative AI, spanning platform engineering, governance, and hands-on delivery of AI-powered products and internal tooling. The team builds and operates the infrastructure, integrations, and knowledge systems that let engineering and business teams safely adopt large language models at scale. The Lead AI Engineer joins as the senior technical authority on this team, setting the architectural direction that Senior and Associate AI Engineers build against. Position Summary The Lead AI Engineer provides technical leadership and architecture ownership for the company's AI platform and its embedded delivery initiatives, operating one level above the Senior AI Engineer role. This person owns the technical design of agentic and LLM-powered systems built on large language model APIs, including retrieval-augmented generation (RAG), tool/connector integration, and evaluation/governance tooling, in a highly regulated healthcare environment. The Lead AI Engineer sets architectural standards across AI-embedded product delivery, mentors Senior and Associate AI Engineers, and represents AI platform architecture to engineering leadership and Legal/Compliance/Privacy. Success is measured by the reliability, security, and scalability of the AI systems shipped, the rate at which Senior/Associate engineers adopt the architectural standards this role sets, and this role's influence on AI platform decisions across the organization. Key Responsibilities AI Architecture Leadership: Define the technical architecture and roadmap for LLM/agentic systems - model routing across cloud AI platforms, connector/integration patterns, RAG pipelines, and prompt/evaluation frameworks. Solution Design & Governance: Lead architecture reviews for new AI capabilities and ensure designs meet enterprise security, privacy, and data-provenance requirements. Platform Ownership: Drive the technical design of shared AI platform capabilities, including knowledge-retrieval systems, citation/traceability of AI-generated outputs, and permission-aware access to data. Hands-On Delivery: Personally architect and build high-complexity components on priority AI delivery initiatives where a working system, not just a design doc, is the deliverable. Technical Mentorship: Set coding, architecture, and evaluation standards for Senior and Associate AI Engineers; run design reviews and pair on complex agentic workflows. LLMOps & Responsible AI: Establish secure, observable, and cost-attributed AI operations - usage/spend attribution, abuse monitoring, model evaluation, and rollback strategy - for production LLM systems. Cross-Functional Architecture: Partner with engineering managers, product, platform, and Legal/Compliance to align AI architecture decisions with delivery timelines and enterprise standards. Vendor & Model Strategy: Evaluate foundation model providers and AI tooling vendors; make build-vs-buy and model-selection recommendations. Compliance & Risk: Ensure AI systems handling protected health information (PHI) meet regulatory and enterprise governance requirements. Organizational Impact: Represent AI architecture in cross-company forums a
How this job compares
Set against the 7,503 open AI Engineer jobs on Olive Jobs, counted November 6, 2026.
- Pay
- This postingNot listed
- Ohio median$123–241K/yr218 salary ranges
- US median$30–78/hr139 hourly ranges
- Openings
- Olive Jobs lists 267 open AI Engineer jobs in Ohio and 7,503 across the US. 8% of them nationwide are listed as remote or flexible.
- Experience
- AI Engineer postings that state a minimum ask for 5 years of experience at the median; the middle half ask for 4 to 7 years (6,436 postings).
- Education
- 2,962 of the 7,503 open AI Engineer jobs (39%) ask for a bachelor's degree or higher.
Counted across the open, public US postings on Olive Jobs on November 6, 2026. Pay medians are the middle values of the low ends and of the high ends of postings that list both ends of a range in the same cadence (a yearly salary or an hourly rate); a range's midpoint is halfway between its ends. Pay and experience figures resting on fewer than 20 postings are left out.
Prepare for this role
You've read the whole posting — now see how you match it.
