
Remote - Senior Backend Software Engineer (Infrastructure MLOps)
Remote · USJobSeen 1 day agoSeen in employer's feed 1 day ago
Most applications go out cold — see where you stand first. No sign-up to start.
Watch jobs like this. New remote roles like this one, by email.
Don't just apply. Show up ready.
Olive works from this exact posting.
At a glance
Olive lists jobs from US employers, including remote roles you can work from the United States.
Job overview
Insight Global seeks a Senior Backend Software Engineer specializing in Infrastructure MLOps to bridge infrastructure and machine learning teams for a leading streaming and media technology client. The role involves building and maintaining AWS and Kubernetes platforms, developing MLOps tooling, managing infrastructure-as-code, supporting CI/CD pipelines, and ensuring reliable, secure AI/LLM workloads in production.
Skills & qualifications
Skills
Full job description
Job Description
Insight Global is seeking a Senior Backend Software Engineer (Infrastructure MLOps) for a leading streaming and media technology client. This engineer will serve as a critical bridge between the Infrastructure and Machine Learning organizations, helping operationalize and scale AI-powered applications that support customer-facing recommendation systems, internal AI assistants, and advanced classification platforms. The ideal candidate brings a strong software engineering foundation combined with deep expertise in AWS, Kubernetes, Infrastructure-as-Code, and production systems. This role offers the opportunity to own highly visible infrastructure initiatives, partner closely with ML engineers, influence MLOps strategy, and help build reliable, secure, and scalable AI platforms within a lean, high-impact engineering organization.
Day-to-Day:
- Build and maintain infrastructure supporting AWS and Kubernetes environments
- Partner with ML engineers to operationalize and scale machine learning workloads
- Develop and improve MLOps processes, tooling, and deployment practices
- Manage infrastructure-as-code and automation initiatives
- Support CI/CD pipelines and developer tooling platforms
- Monitor system health, reliability, and production performance
- Troubleshoot networking, infrastructure, and application issues
- Improve observability through monitoring, logging, alerting, and dashboards
- Design secure and scalable solutions for AI/LLM workloads
- Participate in load testing, change management, incident response, and on-call activities
- Support recommendation systems, internal AI tools, and ad-classification platforms in production
- Drive reliability, scalability, and operational excellence across critical services
Skills and Requirements
- 8+ years of experience in infrastructure / backend / platform engineering
- Strong AWS experience
- Strong Kubernetes administation and production support expeience
- Infrastructre as Code experience (Terraform preferred)
- Linux adminstration proficiency
- Experience supporting ML/LLM deployments in production
- Deep understanding of networking, debugging, and production systems
- Experience with observability, monitoring, logging, and alerting tools
- Strong CI/CD knowledge
- Experience supporting recommendation engines or ML-driven customer-facing products
- Experience securing AI/LLM-powered applications and internal tools
- Background supporting inference workloads at scale
- Experience with model deployment, orchestration, and ML infrastructure automation
- Experience supporting internal AI assistants or developer productivity tools
- Video streaming or media platform infrastructure experience
We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal employment opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment without regard to race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request to [email protected].
Similar jobs, posted recently
Open roles like this one, listed in the last 30 days.
- Senior Software Engineer, Agentic AICurai · Remote · US · $175–210K/yrPosted 3 days agoPosted 3 days ago
Senior Software Developer, SearchMaintainX · Remote · US · $143–249K/yrPosted 4w agoPosted 4w ago
Software Engineer (Remote)Home Depot · Remote · US · $50–130K/yrPosted 4 days agoPosted 4 days ago
Staff Software Engineer - BackendGoDaddy · Remote · US · $140–210K/yrPosted 3w agoPosted 3w ago
Staff Software Engineer, Backend (Continuous Integration)Affirm · Remote · location unlisted · CAD 181–241K/yrPosted 4 days agoPosted 4 days ago
You've read the whole posting — now see how you match it.