Concentrix logo

AI Service Experience Analyst

Concentrix

Remote · USJob$92–120K/yrSeen 2 days agoSeen in employer's feed 2 days ago

Most applications go out cold — see where you stand first. No sign-up to start.

Watch jobs like this.

At a glance

Compensation
$92–120K/yr
Location
Remote · US
Work Authorization
Not specified

Olive lists jobs from US employers, including remote roles you can work from the United States.

Job overview

The AI Service Experience Analyst shapes and improves AI-enabled service experiences, including journeys, prompts, agent instructions, knowledge readiness, testing, and performance feedback. The role partners with engineering, product, technology, operations, compliance, governance, and vendors to develop scalable solutions. It applies healthcare service journey design principles and evaluates AI experiences for accuracy, usability, risk, compliance, and business value.

Skills & qualifications

RequiredNice to have

Skills

AI Experience DesignConversational DesignPrompt DesignAgent InstructionsKnowledge RetrievalAI Response EvaluationKnowledge ManagementBusiness RequirementsAcceptance CriteriaQuality StandardsTest Scenario DesignAnalytical SkillsCross-Functional CollaborationRequirements TranslationDocumentationHealthcare Service DesignAI GovernanceComplianceRisk-Aware Design

Benefits

Medical Insurance
Dental Insurance
Vision Insurance
401(k) Match
Paid Time Off
Tuition Assistance

Full job description

Title: AI Service Experience Analyst

Location: Remote in USA

Position Summary

The AI Service Experience Designer will shape, refine, and continuously improve AI-enabled service experiences that are intuitive, accurate, compliant, and aligned to business outcomes. This role owns the business design of AI journeys, prompt frameworks, agent instructions, knowledge readiness, testing methods, and performance feedback loops—partnering closely with AI Engineers, product, technology, operations, compliance, governance, and vendor teams to bring scalable AI solutions to life.

Responsibilities

  • Own the business setup and ongoing refinement of AI-enabled service experiences, including experience objectives, user journeys, conversational flows, agent instructions, escalation paths, and desired outcomes.

  • Design, test, and optimize prompts, agent instructions, and interaction patterns for generative AI tools, AI agents, knowledge assistants, and other AI-enabled service solutions.

  • Assess, structure, modify, and maintain knowledge base content, procedures, job aids, scripts, and source materials to improve AI readiness, retrieval quality, response accuracy, and consistency.

  • Provide business oversight of AI agents by monitoring performance, reviewing outputs, identifying gaps or risks, validating behavior against business expectations, and recommending corrective actions.

  • Define business requirements, test scenarios, acceptance criteria, quality standards, and success measures for AI-enabled service experiences and agent performance.

  • Conduct structured testing and quality reviews of prompts, knowledge retrieval, agent responses, conversational experiences, and end-to-end service flows using experimentation, user feedback, and performance data.

  • Analyze AI outputs for accuracy, relevance, clarity, consistency, usability, bias, risk, compliance considerations, and alignment with business intent; iterate and improve as needed.

  • Collaborate with technology, product, data, compliance, governance, operations, and vendor partners to ensure AI-enabled experiences are technically feasible, secure, scalable, governed, and aligned with approved AI guardrails.

  • Partner with AI Engineers to translate business-owned experience designs, prompt logic, agent behavior expectations, knowledge requirements, test findings, and performance gaps into engineering-ready requirements, build considerations, troubleshooting needs, and enhancement recommendations.

  • Create and maintain reusable prompt frameworks, agent playbooks, knowledge readiness standards, testing methods, documentation, and business guidance to support consistent AI adoption and continuous improvement.

  • Measure and communicate AI experience effectiveness, agent performance, adoption, efficiency gains, service quality improvements, knowledge quality improvements, and contribution to business value or ROI targets.

  • Apply healthcare service journey and experience design principles to identify pain points, map current and future-state experiences, and shape AI-enabled solutions that support operational needs and improve employee, member, provider, or stakeholder experiences.

  • Stay current on emerging AI capabilities, prompt and agent design methods, knowledge management practices, model behavior, evaluation techniques, healthcare payer trends, and industry best practices.

  • Perform any other job-related duties as requested.

Qualifications

  • Experience designing or improving AI-enabled service experiences, conversational flows, user journeys, knowledge assistants, AI agents, or generative AI interactions.

  • Strong understanding of prompt design, agent instructions, interaction patterns, knowledge retrieval, and AI response evaluation.

  • Experience working with knowledge base content, procedures, scripts, job aids, or source materials to improve accuracy, consistency, usability, and AI readiness.

  • Ability to define business requirements, acceptance criteria, quality standards, test scenarios, and success measures for digital or AI-enabled solutions.

  • Strong analytical skills with the ability to review AI outputs for accuracy, relevance, clarity, consistency, usability, bias, risk, and business alignment.

  • Experience collaborating with cross-functional teams, including technology, product, data, operations, compliance, governance, vendors, and engineering partners.

  • Ability to translate business expectations, experience designs, knowledge needs, prompt logic, and test findings into clear requirements and actionable recommendations.

  • Strong documentation skills, including the ability to create reusable playbooks, frameworks, standards, testing methods, and business guidance.

  • Comfortable working in an evolving AI environment with a continuous improvement mindset and a focus on measurable business value.

  • Healthcare, healthcare payer, member/provider service, or service journey design experience is a plus.

  • Familiarity with AI governance, approved AI guardrails, compliance considerations, and risk-aware design practices is a plus.

The base salary for this position is $92,250 to $120,000 plus incentives that align with individual and company performance. Actual salaries will vary based on work location, qualifications, skills, education, experience, and competencies. Benefits available to eligible employees in this role include medical, dental, and vision insurance, comprehensive employee assistance program, 401(k) retirement plan, paid time off and holidays and paid learning days.

The deadline to apply for this position is: 10/09/2026. This position is for an existing, immediate vacancy. We are currently seeking to fill this role with an individual who can start as soon as possible.

As part of the hiring process, candidates may be required to undergo background screening and identity verification, where permitted by applicable law and consistent with the requirements of the role. Certain verification processes used by the Company or its service providers may involve technologies that rely on biometric identifiers or biometric information, where permitted by law. If biometric identifiers or biometric information are collected, used, or stored, the Company will provide the legally required disclosures and obtain any required written consent prior to such collection, and will handle such information in accordance with applicable biometric privacy laws and Company policies.

#LI-Remote

#Concentrix

Physical and Mental Requirements:

The employee is regularly required to operate a computer, keyboard, telephone/headset, and/or other office equipment as essential functions of this position. Work is generally sedentary in nature.

Equal Employment Opportunity:

Concentrix is an equal opportunity and affirmative action (EEO-AA) employer. We promote equal opportunity to all qualified individuals and do not discriminate in any phase of the employment process based on race, color, religion, sex, sexual orientation, gender identity, national origin, age, pregnancy or related condition, disability, status as a protected veteran, or any other basis protected by law.

For more information regarding your EEO rights as an applicant, please visit the following websites:

Accommodation:

Concentrix welcomes and encourages applications from candidates with disabilities and is committed to providing an inclusive recruitment process. If you require reasonable accommodation to participate in any stage of the application or interview process, please let us know. Requests may be made by contacting [email protected] . All information will be treated confidentially and used solely to facilitate your participation in the recruitment process.

Artificial Intelligence:

As part of our recruitment process, we may use artificial intelligence (AI) tools to assist in the screening and/or assessment of job applicants. These tools could be used to evaluate resumes, applications, and other materials submitted to help us identify the best candidates for the role.

Work Authorization:

In accordance with federal law, only applicants who are legally authorized to work in the United States will be considered for this position. Must reside in the United States or have a valid U.S. address for residence.

For further information on available work states and Equal Employment Opportunity as an applicant, please click HERE (https://jobs.concentrix.com/north-america-equal-employment-opportunity-information/)

Similar jobs, posted recently

Open roles like this one, listed in the last 30 days.

You've read the whole posting — now see how you match it.