Skip to main content
Together AI logo

Infrastructure Security Lead

Together AI

San Francisco, CAFull-time$200–300K/yrPosted 1y agoStill listed today

See where you stand before you apply. No sign-up to start.

You apply on the posting's application page, with no Olive account needed.

Watch jobs like this.

Don't just apply. Show up ready.

Olive works from this exact posting.

At a glance

Compensation
$200–300K/yr
Location
San Francisco, CA
Schedule
Full-time
Work Authorization
Not specified

Olive focuses on jobs in the United States, including remote roles you can work from there.

Job overview

Together AI seeks a hands-on infrastructure security leader to own security across its globally distributed systems. The role combines technical leadership, internal security tooling, telemetry and detection, vulnerability remediation, and collaboration with engineering and infrastructure teams. The lead will build a security team and increasingly shape protection for AI infrastructure, including training clusters, GPU fleets, model artifacts, and inference endpoints.

Skills & qualifications

RequiredNice to have

Skills

Security Leadership, requiredSystems Engineering, requiredCloud-Native Engineering, requiredLinux Configuration, requiredLinux Security, requiredLinux Administration, requiredAutomation, requiredInfrastructure as Code, requiredTerraform, requiredAnsible, requiredSalt, requiredSecurity Telemetry, requiredSecurity Detection, requiredOSQuery, requiredFalco, requiredSIEM, requiredVulnerability Remediation, requiredDistributed Systems Security, requiredGo Development, nice to haveRust Development, nice to haveCloud-Native Services, nice to haveAWS, nice to haveGCP, nice to haveLinux Networking, nice to haveOCP, nice to haveOpenBMC, nice to haveCoreboot, nice to haveLinuxboot, nice to havePublic Security Practice, nice to have

Benefits

Medical Insurance

Full job description

About Together AI

Together AI is a research-driven AI infrastructure company building the go-to platform for developers to run, fine-tune, and build on open models. We believe open and transparent AI systems drive innovation and create the best outcomes for society, and we're on a mission to dramatically lower the cost of modern AI systems. Our team has helped ship foundational open-source research like FlashAttention, FlexGen, and RedPajama — and we're building the next generation of AI infrastructure.

About the Role

We're looking for a hands-on security leader to own infrastructure security.

You'll be the technical owner of how we keep our systems secure, building internal security tooling, deepening our detection and telemetry, and hardening our global infrastructure against threats that range from opportunistic attackers to sophisticated nation-state actors.

You'll report directly to our SVP of Engineering and help define infrastructure security. Over time, you'll grow the team, set the standards, and increasingly shape how we secure the systems at the heart of modern AI: training clusters, GPU fleets, model artifacts, and inference.

Responsibilities

  • Own infrastructure security for Together AI's globally distributed systems — hands-on, as the technical leader of the function.

  • Build and lead the infrastructure security team, defining what great looks like and attracting engineers who want to build with you.

  • Partner with engineering and infrastructure teams to harden global systems — shipping security as something that speeds engineering up, not slows it down.

  • Develop and implement internal security tooling that addresses security challenges at scale.

  • Deepen our security telemetry and detection — gathering system telemetry and improving detection of and response to potential security events.

  • Identify and remediate vulnerabilities across our engineering systems, including authenticated vulnerability scanning of distributed systems.

  • Grow into securing the AI-specific surface — training clusters, GPU fleets, model artifacts, and inference endpoints — as the threat landscape evolves.

Requirements

  • Hands-on security leadership — you can lead a team and stay deep in the technical work. You lead by building, not just by delegating.

  • Strong systems and cloud-native software engineering experience, with deep proficiency in Linux configuration, security, and administration.

  • Fluency with automation and infrastructure-as-code (Terraform, Ansible, and/or Salt) to solve security problems at scale.

  • A pragmatic security instinct — you treat security as an enabler, make sound risk calls, and help the team ship safely and fast rather than piling on friction.

  • Experience with security telemetry and detection (e.g. OSQuery, Falco, SIEM) and with finding and fixing vulnerabilities in distributed systems.

  • Curiosity about how AI changes the security landscape — you don't need to be an AI-security expert today, but you're the kind of engineer who becomes one.

  • Bonus: Go or Rust development, cloud-native service experience (AWS, GCP), deep Linux/networking fundamentals, OCP familiarity (OpenBMC, Coreboot, Linuxboot), or a public security-practitioner footprint (talks, OSS, writing).

Compensation

We offer competitive compensation, startup equity, health insurance and other competitive benefits. The US base salary range for this full-time position is: $200k - 300k+ equity + benefits. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge.

Equal Opportunity

Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.

Please see our privacy policy at https://www.together.ai/privacy

How this job compares

Set against the 1,180 open Security Engineering jobs on Olive Jobs, counted November 14, 2026.

Pay
  • This posting$200–300K/yr
  • California median$187–284K/yr155 salary ranges
  • US median$146–251K/yr1,034 salary ranges

This range's midpoint, $250K, is 9% above the California median midpoint ($230K) — in the middle half of Security Engineering salary ranges in California.

Openings
Olive Jobs lists 187 open Security Engineering jobs in California and 1,180 across the US. 9% of them nationwide are listed as remote or flexible.
Hiring the most in California
Experience
Security Engineering postings that state a minimum ask for 8 years of experience at the median; the middle half ask for 5 to 10 years (894 postings).
Education
213 of the 1,180 open Security Engineering jobs (18%) ask for a bachelor's degree or higher.

Counted across the open, public US postings on Olive Jobs on November 14, 2026. Figures based on too few postings are left out.

Prepare for this role

You've read the whole posting — now see how you match it.