Stellar Cyber logo

Machine Learning Infrastructure Engineer - LLM & Agentic AI

Stellar Cyber

Remote · USJob$150–215K/yrPosted 1 day agoStill listed today

Most applications go out cold — see where you stand first. No sign-up to start.

Watch jobs like this.

Don't just apply. Show up ready.

Olive works from this exact posting.

At a glance

Compensation
$150–215K/yr
Location
Remote · US
Work Authorization
Not specified

Olive lists jobs from US employers, including remote roles you can work from the United States.

Job overview

Stellar Cyber is seeking a Machine Learning Infrastructure Engineer to build systems powering its Autonomous SOC applications. The role focuses on agentic AI frameworks, scalable LLM inference, MCP servers, and supporting API services for agent operations. The engineer will collaborate with machine learning and security researchers, engineering teams, and product management to align infrastructure with evolving product needs.

Skills & qualifications

RequiredNice to have

Skills

Machine LearningRESTDockerDistributed SystemsOrchestrationML InfrastructureSecurity OperationsgRPCKubernetesPythonSOA/MicroservicesVirtualizationInfrastructureAlgorithmsDatabasesObservabilityComputer SecurityCloud ComputingArtificial IntelligenceAgent SystemsAutomationScalable ArchitectureData StructuresFinanceJavaCPPAgentic AI FrameworksLLM Inference InfrastructureMCP ServersAPI ServicesSoftware DevelopmentBackend InfrastructureREST APIsMicroservicesMLOpsContainerizationDeploymentGoLLM ApplicationsGenerative AI FrameworksPrompt EngineeringVector DatabasesRetrieval-Augmented GenerationML ObservabilityLLM Inference DeploymentML Platform DevelopmentResearcher ToolingSecOps Workflows

Qualifications

Bachelor's or Master's in CS or Related or Equivalent2+ Years Software Development or 1+ Year With Advanced Degree2+ Years Data Structures or Algorithms ExperienceLLM Experience in High-Sensitivity DomainsML Platform Team Experience

Benefits

Medical Insurance
Dental Insurance
Vision Insurance
401(k) Match
Paid Time Off

Full job description

Join a fast-growing global leader in cybersecurity, trusted by some of the biggest names in the industry. In addition to some of the world’s largest enterprises and government agencies, more than 30% of the world’s top MSSPs rely on our platform. We’re at the forefront of protecting organizations against sophisticated cyber threats using cutting-edge AI and automation technologies. Our culture is built on diversity, openness, and collaboration, fostering creativity and innovation that drives real impact in the market. We are looking for a highly skilled Machine Learning Infrastructure Engineer with a passion for building robust and scalable systems to power Stellar Cyber’s Autonomous SOC applications. In this role, you will be at the forefront of AI infrastructure innovation, responsible for developing the foundational components that enable intelligent agents to work like true SOC analysts to operate in dynamic SecOps environments.

Responsibilities

  • Design and build Agentic AI frameworks to orchestrate LLM-based agents capable of reasoning, planning, and executing SecOps tasks in Stellar Cyber’s Open XDR platform.
  • Design and develop scalable LLM inference infrastructure that supports runtime- and cost-efficient serving and resource management across LLM hosting providers.
  • Develop MCP servers that interact with Open XDR platform services and features, and integrate with LLM-based agents.
  • Develop other supporting API services necessary for Autonomous SOC applications to provide reliable and extensible interface for agent operations.
  • Collaborate closely with machine learning / security researchers, UI / backend / infrastructure engineers, and product management to align infrastructure with evolving product needs.

Requirements

  • Bachelor’s or Master’s degree in Computer Science or a related field, or equivalent practical experience.
  • 2 years of experience with software development or 1 year of experience with an advanced degree in an industry setting.
  • 2 years of experience with data structures or algorithms in either an academic or industry setting.
  • 2 years of experience with developing backend infrastructure, distributed systems, APIs (REST / gRPC), and microservices for MLOps related projects.
  • Experience with cloud computing technologies, including containerization, orchestration, and deployment (Docker, Kubernetes, etc).
  • Experience in one or more of the following programming languages: Python, Java, Go.

Preferred Qualifications

  • Experience working on LLM applications in high-sensitivity domains (e.g., finance, defense, health).
  • Experience with Generative AI frameworks (e.g., LangChain, LangGraph, AutoGen, or other frameworks) and technologies (prompt engineering, vector databases, RAG, etc.).
  • Experience with observability practices in ML systems (e.g., metrics, cost tracking).
  • Experience deploying and scaling LLMs for inference using frameworks such as vLLM, llama.cpp, and etc.
  • Experience working on ML platform teams and/or building tools for researchers.
  • Knowledge of SecOps concepts, activities, workflows is a plus.

Benefits

We pride ourselves in recognizing our employees. Here are some examples of our benefits program:

  • Pre-IPO Stock Options
  • Medical, Dental & Vision care
  • 401(k)
  • Employee Assistance Program
  • Employee Discount Program
  • Life Insurance
  • Paid time off
  • Referral Program
  • Rewards and Recognition Program

Why Join Us

  • Work at the forefront of cybersecurity innovation within a dynamic, fast-growing team.
  • Opportunity to significantly influence and shape the integration architecture of a next-generation SecOps platform powered by AI and automation.
  • Competitive salary, comprehensive benefits, and ample career growth opportunities.

The base compensation range for this role is USD 150,000-215,000 per year. Total compensation includes bonus opportunity and equity, and will vary based on candidate location.

How this job compares

Set against the 4,533 open Infrastructure Engineer jobs on Olive Jobs, counted October 29, 2026.

Pay
  • This posting$150–215K/yr
  • US median$123–220K/yr3,728 salary ranges

This range's midpoint, $183K, is 5% above the US median midpoint ($175K) — in the middle half of Infrastructure Engineer salary ranges across the US.

Openings
Olive Jobs lists 4,533 open Infrastructure Engineer jobs across the US. 8% of them nationwide are listed as remote or flexible.
Hiring the most across the US
Experience
This posting asks for at least 2 years of experience — less than three in four Infrastructure Engineer postings that state a minimum ask for (median 6 years, across 3,489 postings).
Education
1,023 of the 4,533 open Infrastructure Engineer jobs (23%) ask for a bachelor's degree or higher.

Counted across the open, public US postings on Olive Jobs on October 29, 2026. Pay medians are the middle values of the low ends and of the high ends of postings that list both ends of a range in the same cadence (a yearly salary or an hourly rate); a range's midpoint is halfway between its ends. Pay and experience figures resting on fewer than 20 postings are left out.

Similar jobs, posted recently

Open roles like this one, listed in the last 30 days.

You've read the whole posting — now see how you match it.