
AI Architect
NEW YORK, NY · HybridFull-time$152–155K/yrSeen 5 days agoSeen in employer's feed 5 days ago
Most applications go out cold — see where you stand first. No sign-up to start.
You apply on the employer's site, with no Olive account needed.
Watch jobs like this. New roles like this one near NEW YORK, NY, by email.
Don't just apply. Show up ready.
Olive works from this exact posting.
At a glance
Olive lists jobs from US employers, including remote roles you can work from the United States.
Job overview
Pyramid Consulting seeks an AI Architect for a hybrid, full-time opportunity in New York City with long-term potential. The role designs and scales enterprise AI/ML systems, leads generative and agentic AI innovation, and establishes architecture standards, governance, and responsible AI practices. It also shapes AI strategy, collaborates with business and technical stakeholders, and mentors engineers and data scientists.
Skills & qualifications
Skills
Qualifications
Benefits
Full job description
Immediate need for a talented AI Architect. This is a Fulltime opportunity with long-term potential and is located in New York City, New York(Hybrid).Please review the job description below and contact me ASAP if you are interested. Job Diva ID: 26-12615 Pay Range: $152000 - $155000/annum base + 10% + 5 % bonus. Employee benefits include, but are not limited to, health insurance (medical, dental, vision), 401(k) plan, and paid sick leave (depending on work location). Key Responsibilities: Architect & Scale AI Solutions: Design end-to-end AI/ML architectures, including scalable, secure, and production-ready systems using Machine Learning, Deep Learning, and Large Language Models (LLMs). Establish best practices for building robust and reusable AI platforms. Lead Generative & Agentic AI Innovation: Define and implement enterprise-grade Generative AI and Agentic AI solutions, including multi-agent systems, autonomous workflows, and LLM orchestration frameworks. Drive innovation in areas such as RAG, context engineering, and intelligent automation. Enterprise Impact & Transformation: Own and deliver scalable AI solutions across multiple business domains (marketing, supply chain, retail, operations), ensuring measurable business impact and alignment with organizational strategy. Technical Leadership & Governance: Act as a technical authority defining architecture standards, AI governance, model lifecycle management, and responsible AI practices. Ensure scalability, security, and compliance across all AI initiatives. Cross-functional Leadership: Collaborate with senior stakeholders, product leaders, data engineers, and platform teams to translate business problems into AI-driven solutions. Lead architecture discussions and influence key technical decisions. Mentorship & Capability Building: Mentor senior engineers and data scientists, drive knowledge sharing, and build a strong AI engineering culture. Lead communities of practice and contribute to organizational capability development. Additional Expectations (Architect Level): Define AI roadmap and contribute to organizational AI strategy Establish reusable frameworks, accelerators, and best practices Drive cost optimization and performance efficiency at scale Ensure ethical AI and responsible AI implementation Key Requirements and Technology Experience: Must have skills: 11-13 years of experience in AI/ML, with significant experience in designing and deploying large-scale AI systems Data Modeling, Generative & Agentic AI, Machine Learning, Python, Embeddings & Vector Databases Proven experience in architecting enterprise-grade AI/ML platforms and solutions Technical Expertise: AI/ML & Advanced Analytics: Strong expertise in Machine Learning, Deep Learning, and statistical modeling Experience designing scalable ML systems and production pipelines Generative AI & Agentic AI: Deep expertise in LLMs (GPT, Claude, Llama, Gemini) and their enterprise applications Strong experience in RAG architectures, prompt engineering, context engineering, embeddings, and vector databases Hands-on experience with agentic frameworks (LangGraph, CrewAI, AutoGen) and multi agent orchestration Architecture & Engineering: Strong system design and architecture skills for distributed AI systems Expertise in Python, SQL, and software engineering best practices Experience with microservices, APIs, and scalable backend systems MLOps & Platform Engineering: Strong experience in MLOps practices including CI/CD, model versioning, monitoring, and governance Hands-on experience with tools such as MLflow, Vertex AI, Kubeflow, or similar Cloud & Data Platforms: Deep experience with cloud platforms, especially GCP (Vertex AI, BigQuery) and/or Databricks Strong understanding of data lakes, data warehouses, and real-time data processing Soft Skills & Mindset: Strategic Leadership: Ability to align AI initiatives with business goals and drive long-term technology visio Ownership & Accountability: Takes end-to-end owners
How this job compares
Set against the 1,524 open AI Architect jobs on Olive Jobs, counted November 4, 2026.
- Pay
- This posting$152–155K/yr
- New York median$144–316K/yr77 salary ranges
- US median$144–287K/yr1,345 salary ranges
This range's midpoint, $154K, is 27% below the New York median midpoint ($209K) — in the lowest quarter of AI Architect salary ranges in New York.
- Openings
- Olive Jobs lists 95 open AI Architect jobs in New York and 1,524 across the US. 8% of them nationwide are listed as remote or flexible.
- Experience
- This posting asks for at least 11 years of experience — more than three in four AI Architect postings that state a minimum ask for (median 8 years, across 1,402 postings).
- Education
- 724 of the 1,524 open AI Architect jobs (48%) ask for a bachelor's degree or higher.
Counted across the open, public US postings on Olive Jobs on November 4, 2026. Pay medians are the middle values of the low ends and of the high ends of postings that list both ends of a range in the same cadence (a yearly salary or an hourly rate); a range's midpoint is halfway between its ends. Pay and experience figures resting on fewer than 20 postings are left out.
Prepare for this role
You've read the whole posting — now see how you match it.




