
Software Engineering SMTS
Bellevue, WAJobPosted 1 day agoStill listed · checked in the last 2 days
See where you stand before you apply. No sign-up to start.
You apply on the posting's application page, with no Olive account needed.
Watch jobs like this. New roles like this one near Bellevue, WA, by email.
Don't just apply. Show up ready.
Olive works from this exact posting.
At a glance
Olive focuses on jobs in the United States, including remote roles you can work from there.
Job overview
Salesforce is building a Kubernetes-based AI inference platform that serves custom models and LLM traffic across public clouds. The Software Engineer will develop infrastructure for GPU scheduling, distributed inference, model serving, and agentic runtimes, while supporting enterprise reliability, security, and tenant isolation. The role also includes operating services at fleet scale and contributing to open-source foundations.
Skills & qualifications
Skills
Qualifications
Benefits
Full job description
Description Software Engineer (MTS / SMTS / LMTS), AI Runtime Platform
The role Build the inference platform behind Salesforce’s AI agents. Behind every Salesforce AI agent is a model, and behind every model is infrastructure that has to be fast, cheap, and secure. We’re building the Kubernetes-based platform that serves those models: a large and fast-growing fleet of custom models handling massive volumes of LLM traffic across multiple public clouds. You’ll join the Hyperforce Container Platform (HCP) team and build the layer beneath the models: GPU scheduling, distributed inference, and model serving. This role is for engineers who want their code in the serving path of nearly every agentic request. You’ll work in the open-source ecosystem that the AI industry runs on, and make it production-grade for enterprise requirements: reliability, security, and strict tenant isolation. What you’ll do
- Build the inference platform. Design and build core capabilities on Kubernetes: GPU scheduling, distributed model serving, and intelligent request routing.
- Scale the LLM runtime. Support both inference and training with high-throughput serving and distributed multi-GPU execution.
- Make shared GPUs a multi-tenant service. Drive inference performance and cost efficiency at fleet scale, with strong tenant isolation.
- Treat AI as a first-class workload. Secure and operate it on the same service mesh, workload identity, and caching layer as every other Salesforce service.
- Build the agentic runtime layer. Work on multi-agent orchestration, retrieval-augmented generation (RAG), knowledge graphs, and evaluation for accuracy and safety.
- Isolate untrusted workloads. Build sandboxing for AI agents and the code they generate, keeping production workloads separated from each other.
- Own reliability end to end. Run services to a 99.99% availability SLA, and make the platform observable and self-healing at fleet scale.
- Shape the open-source foundations. Contribute upstream to vLLM, llm-d, Ray, and Kueue, Agent Substrate, and influence their direction and roadmaps.
You’re a great fit if you
- Have strong software engineering experience, with hands-on depth in distributed systems and production service ownership
- Have proven experience developing with AI coding agents (such as Claude Code, Cursor, or Copilot): you know how to direct them, review their output critically, and ship reliable code with them in your daily workflow
- Know Kubernetes well and have built controllers or operators using Go. Istio/Envoy mesh experience is a plus.
- Have built or operated services on a major public cloud (AWS or GCP)
- Have worked with managed AI platforms for training and inference, such as AWS SageMaker or Google Vertex AI
- Write Go fluently
- Have worked on AI/ML model serving, model training or agentic systems, and can reason about the architecture, cost, and quality of what you build
- Treat reliability as a design principle: observability, SLOs, and self-healing are built in from the start
- Hold a degree in a related technical field
Even better if you
- Have used inference and orchestration stacks such as vLLM, llm-d, Ray, or Kueue
- Have hands-on experience with GPU scheduling, CUDA, or inference performance tuning
- Know networking fundamentals: TCP/IP, DNS, and TLS termination
- Have used Terraform and Argo, and observability tools such as Prometheus, Grafana, Splunk, or Elasticsearch
- Have built multi-agent or RAG systems, or worked with knowledge graphs and LLM-as-judge evaluation
- Have contributed to open-source projects upstream
In the United States, compensation offered will be determined by factors such as location, job level, job-related knowledge, skills, and experience. Certain roles may be eligible for incentive compensation, equity, and benefits. Salesforce offers a variety of benefits to help you live well including: time off programs, medical, dental, vision, mental health support, paid parental leave, life and disability insurance, 401(k), and an employee stock purchasing program. More details about company benefits can be found at the following link: https://www.salesforcebenefits.com.
How this job compares
Set against the 36,955 open Software Engineer jobs on Olive Jobs, counted November 22, 2026.
- Pay
- This postingNot listed
- Washington median$144–214K/yr1,789 salary ranges
- Washington median$58–78/hr22 hourly ranges
- Openings
- Olive Jobs lists 1,995 open Software Engineer jobs in Washington and 36,955 across the US. 8% of them nationwide are listed as remote or flexible.
- Experience
- Software Engineer postings that state a minimum ask for 5 years of experience at the median; the middle half ask for 3 to 7 years (30,474 postings).
- Education
- 10,846 of the 36,955 open Software Engineer jobs (29%) ask for a bachelor's degree or higher.
Pay, requirements and demand for Software Engineer jobs
Counted across the open, public US postings on Olive Jobs on November 22, 2026. Figures based on too few postings are left out.
Prepare for this role
You've read the whole posting — now see how you match it.




