Senior Software Engineer
Raleigh, NCFull-timePosted 1 day agoStill listed today
See where you stand before you apply. No sign-up to start.
You apply on the posting's application page, with no Olive account needed.
Watch jobs like this. New roles like this one near Raleigh, NC, by email.
Don't just apply. Show up ready.
Olive works from this exact posting.
At a glance
Olive focuses on jobs in the United States, including remote roles you can work from there.
Job overview
Mirantis is building an enterprise AI infrastructure product for running and governing large language models on customers’ Kubernetes clusters. The Senior Software Engineer will join a small team with broad ownership of the model-serving layer and its path to production, contributing to infrastructure design, enterprise packaging, platform integrations, production observability, and engineering direction.
Skills & qualifications
Skills
Qualifications
Full job description
Company Description
About Mirantis Mirantis is the Kubernetes-native AI infrastructure company, enabling organizations to build and operate scalable, secure, and sovereign infrastructure for modern AI, machine learning, and data-intensive applications. By combining open source innovation with deep expertise in Kubernetes orchestration, Mirantis empowers platform engineering teams to deliver composable, production-ready developer platforms across any environment—on-premises, in the cloud, at the edge, or in sovereign data centers. As enterprises navigate the growing complexity of AI-driven workloads, Mirantis delivers the automation, GPU orchestration, and policy-driven control needed to manage infrastructure with confidence and agility. Committed to open standards and freedom from lock-in, Mirantis ensures that customers retain full control of their infrastructure strategy.
Job Description
Mirantis is building a new enterprise AI infrastructure product that lets organizations run and govern large language models on their own Kubernetes clusters. You will join a small senior team early, with broad ownership of the model-serving layer and its path to production. What you'll do
-
Design and build LLM serving infrastructure on Kubernetes: deployment, GPU scheduling, scaling, and model lifecycle management.
-
Package the platform for enterprise environments: Helm-based installs, upgrades, and restricted/offline networks.
-
Integrate the serving layer with the platform's API gateway, identity, and metering services.
-
Build the observability for operating GPU inference in production (serving metrics, GPU telemetry).
-
Contribute across a multi-service codebase and help set engineering direction through design docs and reviews.
Qualifications
-
5+ years of software engineering experience in infrastructure, platform, or distributed systems.
-
Deep hands-on Kubernetes experience: building and operating production workloads and Helm charts, not just consuming managed clusters.
-
Experience with GPU workloads or LLM inference, or strong adjacent systems experience and a track record of learning fast.
-
Strong Go programming skills; solid CI/CD and infrastructure-as-code skills.
-
Fluency with AI-assisted development tools (Claude Code, OpenAI Codex) as part of your daily engineering workflow.
-
Comfortable with high autonomy on a small, remote-first, written-culture team.
Nice to have
-
Inference performance work (quantization, batching, caching) or distributed serving frameworks.
-
Enterprise deployment experience: air-gapped installs, SSO/OIDC, supply-chain security.
-
UI development experience (e.g. React/TypeScript), useful as the product's management surfaces grow.
-
Open-source contributions in the Kubernetes or ML-infrastructure ecosystems.
Additional Information
Why you’ll love Mirantis
- Work with an established leader in the cloud infrastructure industry.
- Work with exceptionally passionate, talented and engaging colleagues, helping Fortune 500 and Global 2000 customers implement next-generation cloud technologies.
- Be a part of cutting-edge, open-source innovation.
- Thrive in the high-energy environment of a young company where openness, collaboration, risk-taking, and continuous growth are valued.
- Receive a competitive compensation package with strong benefits plan.
- We are a Leader for Container Management in G2 (#2 after AWS)!
It is understood that Mirantis, Inc. may use automated decision-making technology (ADMT) for specific employment-related decisions. Opting out of ADMT use is requested for decisions about evaluation and review connected with the specific employment decision for the position applied for. You also have the right to appeal any decisions made by ADMT by sending your request to [email protected] By submitting your resume, you consent to the processing and storage of your personal data in accordance with applicable data protection laws, for the purposes of considering your application for current and future job opportunities.
We are a Leader for Container Management in G2 (#2 after AWS)!
How this job compares
Set against the 38,785 open Software Engineer jobs on Olive Jobs, counted November 14, 2026.
- Pay
- This postingNot listed
- North Carolina median$114–200K/yr588 salary ranges
- North Carolina median$55–70/hr48 hourly ranges
- Openings
- Olive Jobs lists 807 open Software Engineer jobs in North Carolina and 38,785 across the US. 8% of them nationwide are listed as remote or flexible.
- Experience
- This posting asks for at least 5 years of experience; Software Engineer postings that state a minimum ask for 5 years at the median (32,072 postings).
- Education
- 12,065 of the 38,785 open Software Engineer jobs (31%) ask for a bachelor's degree or higher.
Pay, requirements and demand for Software Engineer jobs
Counted across the open, public US postings on Olive Jobs on November 14, 2026. Figures based on too few postings are left out.
Prepare for this role
You've read the whole posting — now see how you match it.



