Skip to main content
J&J Family of Companies logo

Senior Manager, AI Architecture

J&J Family of Companies

Raritan, NJJob$140–242K/yrSeen todaySeen in employer's feed today

Most applications go out cold — see where you stand first. No sign-up to start.

You apply on the employer's site, with no Olive account needed.

Watch jobs like this.

Don't just apply. Show up ready.

Olive works from this exact posting.

At a glance

Compensation
$140–242K/yr
Location
Raritan, NJ
Work Authorization
Not specified

Olive lists jobs from US employers, including remote roles you can work from the United States.

Requirements

Credentials this posting asks for.

Bachelor's degree, required

Job overview

Johnson & Johnson seeks a Senior Manager, AI Architecture & Innovation to lead enterprise AI strategy, architecture, the AI Innovation Lab, and a distributed team of architects and engineers. The role shapes generative and agentic AI capabilities, evaluates emerging technologies, and guides strategic platforms and applications from exploration through production. It partners with business, product, platform, security, and governance leaders to establish reusable solutions and support enterprise adoption and scale.

Skills & qualifications

RequiredNice to have

Skills

Enterprise AI Strategy, requiredAI Architecture, requiredAgent Orchestration, requiredRAG, requiredGraph RAG, requiredTool Calling, requiredMCP/A2A, requiredAI Gateways, requiredAI Evaluation, requiredVector Databases, requiredData Platforms, requiredDatabricks, requiredLakehouse Architecture, requiredApache Spark, requiredKafka, requiredStreaming, requiredData Products, requiredGoverned Data Access, requiredCloud Architecture, requiredAWS, nice to haveAzure, nice to haveGoogle Cloud, nice to haveKubernetes, requiredContainers, requiredCI/CD, requiredInfrastructure as Code, requiredPython, requiredSQL, requiredAPIs, requiredDistributed Systems, requiredEnterprise Platforms, requiredAI Platform Development, requiredAI-Enabled SDLC, nice to haveGxP, nice to haveData Privacy, nice to haveValidated Systems, nice to haveEnterprise Agent Platforms, nice to haveAI Product Services, nice to haveConference Speaking, nice to havePublications, nice to have

Qualifications

Bachelor's in Computer Science, Engineering or Related Technical Field, required15+ Years Software, Data and AI Engineering Experience, required5+ Years Architecture or Senior Technical Leadership Experience, required3+ Years People Leadership Experience, required2+ Years Generative and Agentic AI Production Experience, requiredMaster's or PhD in Computer Science, Machine Learning or Related Field, nice to haveRelevant AWS, Databricks, AI Architecture or Cloud Certifications, nice to haveEnglish Proficiency, requiredUp to 10% Travel, required

Benefits

401(k) Match
Paid Time Off
Parental Leave

Full job description

At Johnson & Johnson, we believe health is everything. Our strength in healthcare innovation empowers us to build a world where complex diseases are prevented, treated, and cured, where treatments are smarter and less invasive, and solutions are personal. Through our expertise in Innovative Medicine and MedTech, we are uniquely positioned to innovate across the full spectrum of healthcare solutions today to deliver the breakthroughs of tomorrow, and profoundly impact health for humanity. Learn more at jnj.com

As guided by Our Credo, Johnson & Johnson is responsible to our employees who work with us throughout the world. We provide an inclusive work environment where each person is considered as an individual. At Johnson & Johnson, we respect the diversity and dignity of our employees and recognize their merit.

Job Function:

Technology Product & Platform Management

Job Sub Function:

Platform/Cloud Engineering

Job Category:

People Leader

All Job Posting Locations:

Raritan, New Jersey, United States of America

Job Description:

"Johnson & Johnson announced plans to separate our Orthopaedics business to establish a standalone orthopaedics company,

operating as DePuy Synthes. The process of the planned separation is anticipated to be completed within 18 to 24 months,

subject to legal requirements, including consultation with works councils and other employee representative bodies, as may be

required, regulatory approvals and other customary conditions and approvals. Should you accept this position, it is anticipated that,

following conclusion of the transaction, you would be an employee of DePuy Synthes and your employment would be governed by

DePuy Synthes employment processes, programs, policies, and benefit plans. In that case, details of any planned changes would be

provided to you by DePuy Synthes at an appropriate time and subject to any necessary consultation processes."

Why this matters

This role represents a rare opportunity to define and build the AI capabilities of a newly standalone company. You will shape how generative and agentic AI is designed, governed, reused and scaled at DePuy Synthes, while leading a team that turns emerging technologies and priority business needs into enterprise platforms, accelerators and strategic applications.

What you'll do

DePuy Synthes is seeking a Senior Manager, AI Architecture & Innovation to join the Architecture & Platforms team, reporting to the Sr. Director, Architecture & Platforms. You will lead the enterprise AI strategy and architecture, the AI Innovation Lab, and a distributed team of AI architects and engineers, including the GCC Innovation Squad in Bengaluru.

Your primary focus will be strategy, architecture and innovation: defining the AI technology roadmap, establishing reference architectures and engineering patterns, evaluating emerging capabilities, and translating priority opportunities into practical enterprise solutions. You may also lead the design and delivery of strategic AI platforms, accelerators and applications, particularly where architectural continuity and technical depth are critical from concept through production.

You will serve as the senior technical counterpart to portfolio, product, platform and business leaders, helping determine what should be built, how it should be architected, and when capabilities are ready for enterprise adoption and scale. You will build a technically strong team that can move from exploration and architecture through prototype, pilot and production, with clear transition points to long-term platform, product or application owners.

How you'll make an impact

AI Strategy & Architecture

  • Define and evolve the enterprise AI strategy, architecture and roadmap across Databricks Mosaic AI, Amazon Bedrock, AgentCore, the enterprise model gateway and related services.

  • Architect the agentic runtime, including agent orchestration and mesh, MCP tool and skill registries, Agent-to-Agent interoperability, agent identity, entitlements and secure tool execution.

  • Design reusable context and knowledge services, including RAG and Graph RAG, vector stores, knowledge graphs such as Amazon Neptune, shared memory and context assembly.

  • Establish patterns for LLMOps and MLOps, observability, evaluation, Responsible AI, security and AI cost management in partnership with platform and governance teams.

  • Create a discoverable catalog of AI services, models, agents, tools, skills and reference patterns that teams can reuse across the enterprise.

  • Guide architecture decisions across strategic AI applications, balancing speed, reuse, interoperability, regulatory requirements and long-term operability.

Innovation & Strategic Delivery

  • Lead the AI Innovation Lab and maintain an actionable innovation portfolio aligned to business strategy across Commercial, R&D, Supply Chain and Global Functions.

  • Scout, evaluate and prototype emerging models, agent frameworks, protocols and development approaches, separating durable enterprise capabilities from short-lived technology trends.

  • Lead capabilities through clear stage gates: explore, prototype, pilot and scale, with explicit criteria for investment, production readiness, adoption or termination.

  • Own or direct delivery of selected strategic AI platforms, accelerators and applications when architectural continuity, innovation risk or cross-platform integration requires sustained technical leadership.

  • Graduate successful prototypes into reusable platform capabilities or supported applications, with clear ownership, service expectations, documentation and operational handoff.

  • Drive AI-enabled software development lifecycle automation, including coding assistants such as Claude, Microsoft Copilot and Codex, and persona-based agent workflows.

  • Demonstrate working capabilities to senior leadership and translate technical outcomes into measurable business value and informed investment decisions.

People & Technical Leadership

  • Build, lead and develop a high-performing team of AI architects and engineers across US and GCC locations.

  • Set priorities, technical direction, engineering standards and quality expectations for the AI Innovation Lab and GCC Innovation Squad.

  • Remain sufficiently close to the technology to challenge architecture and engineering decisions, review critical designs and guide teams through complex implementation trade-offs.

  • Develop talent through coaching, mentoring, technical reviews and challenging assignments, while building succession and critical skill depth.

  • Align capacity to the highest-value strategic priorities and establish the appropriate balance among research, architecture, prototyping and production delivery.

  • Lead distributed teams and influence partner organizations, vendors and stakeholders without relying solely on direct authority.

Architecture Leadership & Governance

  • Serve as a core member of the Architecture Review Board and ensure AI solutions follow enterprise architecture standards, cybersecurity requirements and Responsible AI guardrails.

  • Partner with Architecture Standards & Responsible AI, Data & AI Platforms, Cybersecurity, Product and domain architecture teams to convert priority use cases into reusable solutions.

  • Define decision rights and transition points among innovation, platform and product teams to avoid unclear ownership or unsupported production solutions.

  • Contribute to vendor strategy, technical due diligence and partnerships with AI providers, startups, academia and the broader technology ecosystem.

Measures of Impact

  • Business value and adoption generated by AI platforms, accelerators and strategic applications.

  • Priority capabilities progressed from idea to prototype, pilot and production with clear evidence-based decisions at each stage.

  • Reuse of common services, reference patterns, agents, tools and accelerators across business domains.

  • Reduction in time from opportunity identification to working prototype and from validated pilot to scaled capability.

  • Architecture quality, production readiness, reliability, security and cost efficiency of strategically delivered AI capabilities.

  • Team capability, technical depth, talent development and effectiveness across US and GCC resources.

  • Innovation pipeline health, including the quality of opportunities, experiments concluded, capabilities scaled and low-value initiatives stopped early.

What you'll bring

Required Qualifications

  • Bachelor's degree in Computer Science, Engineering or a related technical field.

  • 15+ years of experience across software, data and AI engineering, including enterprise-scale platforms and distributed systems.

  • 5+ years in architecture or senior technical leadership roles responsible for platform strategy, target-state architecture and major technology decisions.

  • 3+ years of people leadership or direct accountability for leading multidisciplinary architecture and engineering teams.

  • 2+ years designing, building or leading generative and agentic AI capabilities in production.

  • Hands-on technical foundation in LLM integration, multi-agent orchestration, RAG and Graph RAG, tool calling, MCP/A2A, AI gateways, evaluation and vector databases.

  • Strong data platform background, including Databricks, lakehouse architectures, Spark, Kafka or streaming, data products and governed data access.

  • Cloud architecture experience on AWS preferred, or Azure/GCP, together with Kubernetes, containers, CI/CD and Infrastructure-as-Code.

  • Working proficiency in Python, SQL and APIs, with the technical depth to inspect code, evaluate prototypes and guide architecture and engineering decisions.

  • A track record of taking AI platforms, accelerators or strategic applications from 0 to 1 and establishing a path to enterprise scale with measurable outcomes.

  • Experience managing distributed or offshore teams and influencing across architecture, product, platform, security and business organizations.

Preferred Qualifications

  • Master's degree or PhD in Computer Science, Machine Learning or a related field.

  • Experience in medical device, life sciences or another regulated industry, including familiarity with GxP, data privacy and validated systems.

  • Experience building enterprise agent platforms, AI-enabled SDLC capabilities and reusable AI product or platform services.

  • Relevant AWS, Databricks, AI architecture or cloud certifications.

  • External thought leadership through conference speaking, publications, standards participation or AI community leadership.

Other

  • Travel: Up to 10%.

  • Language: English proficiency required.

  • Certifications: Relevant AI or cloud architecture certifications preferred.

Required Skills:

Preferred Skills:

Accessible Design, Agility Jumps, Business Alignment, Cloud Computing, Cloud Migrations, Cloud Security, Collaboration, Compliance Management, Developing Others, Human-Computer Interaction (HCI), Hybrid Clouds, Inclusive Leadership, Leadership, Multi Cloud Models, Risk Management, Software Development Management, Tactical Planning, Team Management

The anticipated base pay range for this position is :

$140,000.00 - $241,500.00

Additional Description for Pay Transparency:

Subject to the terms of their respective plans, employees are eligible to participate in the Company’s consolidated retirement plan (pension) and savings plan (401(k)).

Subject to the terms of their respective policies and date of hire, employees are eligible for the following time off benefits:

Vacation –120 hours per calendar year

Sick time - 40 hours per calendar year; for employees who reside in the State of Colorado –48 hours per calendar year; for employees who reside in the State of Washington –56 hours per calendar year

Holiday pay, including Floating Holidays –13 days per calendar year

Work, Personal and Family Time - up to 40 hours per calendar year

Parental Leave – 480 hours within one year of the birth/adoption/foster care of a child

Bereavement Leave – 240 hours for an immediate family member: 40 hours for an extended family member per calendar year

Caregiver Leave – 80 hours in a 52-week rolling period10 days

Volunteer Leave – 32 hours per calendar year

Military Spouse Time-Off – 80 hours per calendar year

For additional general information on Company benefits, please go to: https://www.careers.jnj.com/employee-benefits

How this job compares

Set against the 574 open Technology Leadership jobs on Olive Jobs, counted November 11, 2026.

Pay
  • This posting$140–242K/yr
  • New Jersey median$177–265K/yr24 salary ranges
  • US median$154–255K/yr412 salary ranges

This range's midpoint, $191K, is 14% below the New Jersey median midpoint ($221K) — in the middle half of Technology Leadership salary ranges in New Jersey.

Openings
Olive Jobs lists 26 open Technology Leadership jobs in New Jersey and 574 across the US. 9% of them nationwide are listed as remote or flexible.
Hiring the most in New Jersey
Experience
This posting asks for at least 15 years of experience — more than three in four Technology Leadership postings that state a minimum ask for (median 10 years, across 492 postings).
Education
This posting asks for a bachelor's degree; 155 of the 574 open Technology Leadership jobs (27%) ask for a bachelor's degree or higher.

Counted across the open, public US postings on Olive Jobs on November 11, 2026. Pay medians are the middle values of the low ends and of the high ends of postings that list both ends of a range in the same cadence (a yearly salary or an hourly rate); a range's midpoint is halfway between its ends. Pay and experience figures resting on fewer than 20 postings are left out.

Prepare for this role

You've read the whole posting — now see how you match it.