CVS Health logo

Senior Software Development Engineer AI

CVS Health

Remote · USFull-time$83–204K/yrPosted 1 day agoStill listed today

Most applications go out cold — see where you stand first. No sign-up to start.

Watch jobs like this.

At a glance

Compensation
$83–204K/yr
Location
Remote · US
Schedule
Full-time
Work Authorization
Not specified

Olive lists jobs from US employers, including remote roles you can work from the United States.

Job overview

CVS Health is seeking an experienced AI/LLM Engineer to build and operationalize enterprise language-model applications, including reasoning systems, RAG pipelines, and prompt-engineering frameworks. The role involves translating business needs into secure, explainable, production-ready solutions and collaborating with cross-functional stakeholders to advance enterprise AI capabilities.

Skills & qualifications

RequiredNice to have

Skills

PythonSoftware Engineering Best PracticesProduction AI/ML SystemsLarge Language ModelsLLM APIsNatural Language ProcessingMachine LearningRetrieval-Augmented GenerationPrompt EngineeringPrompt OptimizationEmbeddingsVector SearchAPI DesignMicroservicesDistributed SystemsModel EvaluationPerformance MetricsDebuggingProblem SolvingOpenAIAnthropicGoogle Vertex AILangChainLlamaIndexSemantic KernelVector DatabasesPineconeWeaviateFAISSMongoDB Atlas Vector SearchMLOpsCI/CDCloud DeploymentAWSAzureGoogle Cloud PlatformAgent-Based ArchitecturesMulti-Step AI WorkflowsFinancial ServicesLLM Benchmarking

Qualifications

Bachelor's or Master's in CS, Engineering, Data Science or Related Field or Equivalent Experience

Benefits

Medical Insurance
Dental Insurance
Vision Insurance
Paid Time Off
401(k) Match

Full job description

We’re building a world of health around every individual — shaping a more connected, convenient and compassionate health experience. At CVS Health®, you’ll be surrounded by passionate colleagues who care deeply, innovate with purpose, hold ourselves accountable and prioritize safety and quality in everything we do. Join us and be part of something bigger – helping to simplify health care one person, one family and one community at a time.

Position Summary We are seeking an experienced AI / LLM Engineer to design, develop, and operationalize advanced language model–powered applications for enterprise use cases. This role will focus on building text-based reasoning systems, Retrieval-Augmented Generation (RAG) pipelines, and scalable prompt engineering frameworks that enhance decision-making, automation, and knowledge discovery across the organization.

As a key member of a cross-functional team, you will collaborate with business stakeholders to translate business requirements into reliable, explainable, and production-ready AI solutions. You will play a critical role in shaping enterprise AI capabilities by ensuring solutions are secure, responsible, and optimized for real-world performance.

Required Qualifications

  • Strong programming experience in Python and familiarity with software engineering best practices.

  • Hands-on experience building production-grade AI/ML systems, not just prototypes.

  • Experience working with Large Language Models (LLMs) and APIs.

  • Solid understanding of:

  • Natural Language Processing (NLP) fundamentals

  • Machine learning concepts (training, evaluation, overfitting, bias)

  • Practical experience with:

  • Retrieval-Augmented Generation (RAG) systems

  • Prompt engineering and prompt optimization

  • Embeddings and vector search

  • Experience designing and implementing APIs, microservices, or distributed systems.

  • Familiarity with model evaluation techniques and performance metrics.

  • Strong debugging and problem-solving skills in complex systems.

Preferred Qualifications

  • Experience with LLM platforms such as OpenAI, Anthropic, Google Vertex AI, or similar.

  • Familiarity with orchestration frameworks like LangChain, LlamaIndex, Semantic Kernel, or equivalent.

  • Experience with vector databases (e.g., Pinecone, Weaviate, FAISS, MongoDB Atlas Vector Search).

  • Knowledge of MLOps practices, including CI/CD pipelines for AI systems.

  • Experience deploying solutions in cloud environments (e.g., AWS, Azure, GCP).

  • Exposure to agent-based architectures or multi-step AI workflows.

  • Experience in financial services enterprise environments (or similar data-intensive industries).

  • Experience with evaluation frameworks and benchmarking for LLMs.

Tools and Technologies

  • Programming: Python (primary), SQL

  • LLM Platforms: OpenAI, Anthropic, Google Vertex AI

  • Frameworks: LangChain, LlamaIndex, Semantic Kernel

  • Vector Databases: Pinecone, Weaviate, FAISS, MongoDB Atlas Vector Search

  • Data Processing: Spark, Pandas

  • APIs & Services: FastAPI, Flask, REST/gRPC

  • Cloud Platforms: AWS, Azure, Google Cloud Platform (GCP)

  • DevOps & MLOps: Docker, Kubernetes, CI/CD tools

  • Monitoring & Evaluation: Prompt evaluation tools, logging frameworks, observability platforms

Education ​Bachelor’s or Master’s degree in Computer Science, Engineering, Data Science, or a related field, or equivalent practical experience.

Anticipated Weekly Hours 40

Time Type Full time

Pay Range The typical pay range for this role is:

$83,430.00 - $203,940.00 This pay range represents the base hourly rate or base annual full-time salary for all positions in the job grade within which this position falls. The actual base salary offer will depend on a variety of factors including experience, education, geography and other relevant factors. This position is eligible for a CVS Health bonus, commission or short-term incentive program in addition to the base pay range listed above.

Our people fuel our future. Our teams reflect the customers, patients, members and communities we serve and we are committed to fostering a workplace where every colleague feels valued and that they belong.

Great benefits for great people

We take pride in offering a comprehensive and competitive mix of pay and benefits that reflects our commitment to our colleagues and their families.

This full‑time position is eligible for a comprehensive benefits package designed to support the physical, emotional, and financial well‑being of colleagues and their families. The benefits for this position include medical, dental, and vision coverage, paid time off, retirement savings options, wellness programs, and other resources, based on eligibility. Additional details about available benefits are provided during the application process and on Benefits Moments.

We anticipate the application window for this opening will close on: 10/16/2026

Qualified applicants with arrest or conviction records will be considered for employment in accordance with all federal, state and local laws.

Similar jobs, posted recently

Open roles like this one, listed in the last 30 days.

You've read the whole posting — now see how you match it.