
Senior AI Architect - Enterprise Integrations
Remote · USJobSeen todaySeen in employer's feed today
See where you stand before you apply. No sign-up to start.
You apply on the posting's application page, with no Olive account needed.
Watch jobs like this. New remote roles like this one, by email.
Don't just apply. Show up ready.
Olive works from this exact posting.
At a glance
Olive focuses on jobs in the United States, including remote roles you can work from there.
Job overview
The Application Architect for AI Integration designs and governs end-to-end architectures that embed AI capabilities into enterprise applications and workflows. The role translates business objectives into scalable designs, balances vendor-managed services with custom development, and drives governance for AI integration. It can be performed from anywhere in the US and focuses on integrating AI services with existing systems, APIs, and data platforms.
Skills & qualifications
Skills
Full job description
Introduction
A career in IBM Consulting is built on long-term client relationships and close collaboration worldwide. You'll work with leading companies across industries, helping them shape their hybrid cloud and AI journeys. With support from our strategic partners, robust IBM technology, and Red Hat, you'll have the tools to drive meaningful change and accelerate client impact. At IBM Consulting, curiosity fuels success. You'll be encouraged to challenge the norm, explore new ideas, and create innovative solutions that deliver real results. Our culture of growth and empathy focuses on your long-term career development while valuing your unique skills and experiences.
Your role and responsibilities
As an Application Architect for AI Integration, this role is responsible for designing and governing end-to-end architectures that embed AI capabilities into enterprise applications and workflows. The Application Architect collaborates with stakeholders to translate business objectives into scalable designs, balancing vendor-managed services with custom development, and drives governance for AI integration.
Your primary responsibilities will include:
-
Designing Architectures: defining reference patterns for AI services, models, and orchestration layers to integrate seamlessly with existing systems, APIs, and data platforms.
-
Collaborating with Stakeholders: translating business objectives into scalable, resilient, and policy-compliant designs, ensuring performance, security, compliance, and cost objectives are met.
-
Governing AI Integration: driving governance for prompts, guardrails, and lifecycle management, ensuring observability, privacy, and responsible AI principles are embedded from design through operations.
This role can be performed from anywhere in the US.
Required technical and professional expertise
-
Deep AI Expertise: Experience with designing and governing end-to-end architectures that embed AI capabilities into enterprise applications and workflows, ensuring seamless integration with existing systems, APIs, and data platforms.
-
Architecture Design: Experience defining reference patterns for AI services, models, and orchestration layers, including Retrieval-Augmented Generation (RAG), event-driven and microservices architectures, and hybrid reasoning.
-
AI Governance: Experience driving governance for prompts, guardrails, and lifecycle management, ensuring observability, privacy, and responsible AI principles are embedded from design through operations.
-
Technical Leadership: Experience collaborating with stakeholders to translate business objectives into scalable, resilient, and policy-compliant designs, balancing vendor-managed services with custom development.
-
Integration Expertise: Experience integrating AI services, models, and orchestration layers with existing systems, APIs, and data platforms, meeting performance, security, compliance, and cost objectives.
Preferred technical and professional experience
-
Advanced AI Knowledge: Deep expertise in AI services, models, and orchestration layers, including Retrieval-Augmented Generation (RAG) and hybrid reasoning.
-
Technical Architecture: Experience with event-driven and microservices architectures, ensuring seamless integration with existing systems, APIs, and data platforms.
-
AI Governance Tools: Familiarity with tools for driving governance, prompts, guardrails, and lifecycle management, ensuring observability, privacy, and responsible AI principles.
IBM is committed to creating a diverse environment and is proud to be an equal-opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, gender, gender identity or expression, sexual orientation, national origin, caste, genetics, pregnancy, disability, neurodivergence, age, veteran status, or other characteristics. IBM is also committed to compliance with all fair employment practices regarding citizenship and immigration status.
How this job compares
Set against the 1,330 open AI Architect jobs on Olive Jobs, counted November 14, 2026.
- Pay
- This postingNot listed
- New Jersey median$144–294K/yr39 salary ranges
- Openings
- Olive Jobs lists 45 open AI Architect jobs in New Jersey and 1,330 across the US. 10% of them nationwide are listed as remote or flexible.
- Experience
- AI Architect postings that state a minimum ask for 9 years of experience at the median; the middle half ask for 6 to 10 years (1,203 postings).
- Education
- 659 of the 1,330 open AI Architect jobs (50%) ask for a bachelor's degree or higher.
Counted across the open, public US postings on Olive Jobs on November 14, 2026. Figures based on too few postings are left out.
Prepare for this role
You've read the whole posting — now see how you match it.


