Skip to main content
NVIDIA logo

Senior Production Engineer - DGX Cloud

NVIDIA

Santa Clara, CAFull-time$184–288K/yrPosted 1mo agoStill listed · checked in the last 2 days

See where you stand before you apply. No sign-up to start.

You apply on the posting's application page, with no Olive account needed.

Watch jobs like this.

Don't just apply. Show up ready.

Olive works from this exact posting.

At a glance

Compensation
$184–288K/yr
Location
Santa Clara, CA
Schedule
Full-time
Work Authorization
Not specified

Olive focuses on jobs in the United States, including remote roles you can work from there.

Requirements

Credentials this posting asks for.

Bachelor's degree, required

Job overview

NVIDIA is seeking a Senior Production Engineer to design, build, and operate software, automation, and tooling that ensure the reliability, scalability, and safety of DGX Cloud services across multiple cloud and on‑premises environments.

Skills & qualifications

RequiredNice to have

Skills

Python, requiredGo, requiredInfrastructure as Code, requiredGitOps, requiredTerraform, requiredArgo CD, requiredCI/CD, requiredLinux, requiredKubernetes, requiredContainers, requiredCloud Infrastructure, requiredDistributed Systems, requiredNetworking Fundamentals, requiredSRE Principles, requiredTechnical Communication, requiredvLLM, nice to haveSGLang, nice to havePyTorch, nice to haveTensorRT LLM, nice to haveNVIDIA Dynamo, nice to haveCUDA, nice to haveNCCL, nice to haveKubernetes Operators, nice to haveControllers, nice to haveFleet Management Systems, nice to haveSelf-Healing Automation, nice to haveAI Tools, nice to haveAgents, nice to have

Qualifications

BS/MS in Computer Science or Equivalent Experience, required8+ Years of Production Services Experience, required

Full job description

NVIDIA DGX Cloud delivers AI services and endpoints for research and production workloads. We are looking for a Senior Production Engineer to build software and automation that make those services reliable, scalable, and safe to operate. The Production Engineering team works on large-scale distributed systems spanning internal and external model endpoints; regional control plane services that orchestrate workloads and route requests; and the GPU/CPU compute infrastructure where inference and agentic workloads run. Our work spans Kubernetes clusters across AWS, Azure, Google Cloud, other partner cloud environments, and on-premises deployments.

What you’ll be doing:

  • Build and operate production software, automation, and tooling for control plane services, model deployments, and inference and agentic workloads across DGX Cloud environments.
  • Improve the reliability of inference and agentic platforms and services, including NVIDIA Cloud Functions, SGLang- and vLLM-based endpoints, and inference services built with NVIDIA Dynamo, through health validation, safer rollouts, observability, and recovery.
  • Improve endpoint availability, inference routing, capacity management, and service health to maintain predictable performance as workloads and demand change.
  • Use infrastructure as code and GitOps to deploy, configure, validate, upgrade, and recover services consistently across environments.
  • Build workflows for service enablement, model releases, handoff, deprecation, and ongoing operations; replace repeatable manual work with reliable automation.
  • Define and instrument SLIs and SLOs for inference and control plane services, including availability and latency, use error budgets to guide reliability improvements, and make production health visible to partner teams.
  • Participate in on-call and incident response, troubleshoot failures across routing, model runtimes, software, and infrastructure, and turn recurring issues into automation and durable fixes.
  • Collaborate with model, platform, storage, networking, security, and GPU infrastructure teams to design and operate services safely at scale.

What we need to see:

  • 8+ years of experience building or operating production services and large-scale distributed systems, including hands-on automation.
  • Strong programming skills in Python, Go, or a comparable language, with experience developing tools for production operations.
  • Experience with infrastructure as code, configuration management, or GitOps, and with building automation for repeatable service deployments and changes.
  • Strong knowledge of Linux, Kubernetes, containers, cloud infrastructure, distributed systems, and networking fundamentals; ability to diagnose failures in production.
  • Understanding of SRE principles, including SLIs, SLOs, error budgets, incident response, and reducing operational toil.
  • Experience instrumenting services and using metrics, logs, and traces to understand system behavior and improve reliability.
  • Clear technical communication and ability to work across engineering teams.
  • BS/MS in Computer Science or equivalent experience.

Ways to stand out from the crowd

  • Familiarity with technologies such as vLLM, SGLang, PyTorch, TensorRT-LLM, NVIDIA Dynamo, CUDA, or NCCL, and with GPU performance analysis.
  • Experience building Kubernetes operators, controllers, workload orchestration services, fleet management systems, or self-healing automation.
  • Experience with Terraform, Argo CD, CI/CD, policy validation, or safe deployment and rollback systems.
  • Experience developing with AI tools and agents.
  • Background with production AI inference or agentic workloads, including debugging issues across models, runtimes, Kubernetes, and hardware.

NVIDIA is leading the way in groundbreaking developments in Artificial Intelligence, High-Performance Computing and Visualization. The GPU, our invention, serves as the visual cortex of modern computers and is at the heart of our products and services. We have some of the most forward-thinking and hard-working people on the planet working for us. If you're creative, hard-working and self-motivated, we want to hear from you!

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 184,000 USD - 287,500 USD for Level 4, and 224,000 USD - 356,500 USD for Level 5. You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until October 6, 2026. This posting is for an existing vacancy. NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

How this job compares

Set against the 467 open Production Engineer jobs on Olive Jobs, counted November 18, 2026.

Pay
  • This posting$184–288K/yr
  • California median$147–197K/yr97 salary ranges
  • US median$136–196K/yr346 salary ranges

This range's midpoint, $236K, is 39% above the California median midpoint ($170K) — in the top quarter of Production Engineer salary ranges in California.

Openings
Olive Jobs lists 108 open Production Engineer jobs in California and 467 across the US. 3% of them nationwide are listed as remote or flexible.
Hiring the most in California
Experience
This posting asks for at least 8 years of experience — more than three in four Production Engineer postings that state a minimum ask for (median 5 years, across 396 postings).
Education
This posting asks for a bachelor's degree; 183 of the 467 open Production Engineer jobs (39%) ask for a bachelor's degree or higher.

Counted across the open, public US postings on Olive Jobs on November 18, 2026. Figures based on too few postings are left out.

Prepare for this role

You've read the whole posting — now see how you match it.