Traversal logo

AI Engineer - Cloud Infrastructure

Traversal

New York, NYFull-time$175–275K/yrPosted 2mo agoVerified open 4 days ago

Most applications go out cold — see where you stand first. No sign-up to start.

At a glance

Compensation
$175–275K/yr
Location
New York, NY
Schedule
Full-time
Work Authorization
Not specified

Job overview

Traversal is hiring an AI Engineer - Cloud Infrastructure. Traversal seeks an AI Engineer focused on cloud infrastructure to design, secure, and operate scalable AI systems for enterprise customers, leveraging Terraform, Kubernetes, and cloud platforms while supporting high‑availability, cost‑efficiency, and compliance in a fully in‑office New York setting.

Key focus areas include Design scalable, reliable infrastructure for AI workloads, inference, data pipelines, and agentic workflows, Build and deliver best‑in‑class developer experience and CI/CD tooling for the engineering team, and Scale systems on real signals, adding burst capacity and safe drains.

Successful candidates bring 7+ Years Of Experience At Technically Rigorous Companies Or Teams and Operating Cloud And Kubernetes Native Infrastructure And Applications At Scale With >99.9% Availability. Important skills include Terraform, Helm, Operating Cloud Infrastructure, Operating Kubernetes Native Infrastructure, Operating Applications At Scale, and AWS. Preferred (not required): System Design & Architecture, CI/CD, Autoscaling, and Infrastructure as Code.

Skills & qualifications

RequiredNice to have

Skills

TerraformHelmOperating Cloud InfrastructureOperating Kubernetes Native InfrastructureOperating Applications at ScaleAWSAmazon EKSDesigning Idempotent SystemsIncident ManagementChaos TestingCapacity PlanningDebugging SkillsSystem Design & ArchitectureCI/CDAutoscalingInfrastructure as CodeObservabilitySecurityLeast Privilege PrinciplesJIT Access WorkflowsDefault-Deny EgressAuditabilityPolicy-as-CodeService MeshEnvoyIstioCilium/eBPFGPU Workload OperationsInference ServersToken Streaming GatewaysPythonRustTypeScriptData GovernancePII Discovery/RedactionLineageTokenizationDesigning Cross-Region Active/Active ArchitecturesGCPAzureOracle Cloud

Qualifications

7+ Years of Experience at Technically Rigorous Companies or TeamsOperating Cloud and Kubernetes Native Infrastructure and Applications at Scale With >99.9% Availability

Benefits

Medical Insurance
Paid Time Off

Full job description

About Traversal Traversal is the AI Site Reliability Engineer (SRE) for the enterprise—already trusted by some of the largest companies in the world to troubleshoot, remediate, and even prevent the most complex production incidents. Our mission is to free engineers from endless firefighting and enable them to focus on creative, high-impact work.

Our roots remain deeply embedded in AI research, and we’re channeling that scientific rigor and creativity into building the premier AI agent lab for the enterprise. Hence, what we’re proudest of is assembling the most talented yet nicest group of individuals, including researchers from MIT, Harvard, and Berkeley, to world-class engineers from industry: Citadel Securities, Cockroach Labs, Datadog, DE Shaw, ServiceNow, Glean, Perplexity, Pinecone, and more, to take on one of the hardest problems for AI to solve. Without the entire team, none of this would be possible.

The Role As an AI Engineer - Cloud Infrastructure on Traversal’s Infrastructure team, you’ll design, secure, and operate the core systems that power Traversal’s AI products. We already serve Fortune 50 enterprises with large-scale, multi-tenant environments, BYOC deployments, and SOC 2 Type II controls, and we’re rapidly scaling.

You’ll focus on the building blocks of our Terraform-defined infrastructure and Kubernetes environments, while supporting the complex needs of operating the highly-available, highly-resilient, and cost-efficient platform that supports the Traversal AI SRE agent.

This is a senior, high-impact role: you’ll own foundational systems, work across AWS-native infrastructure, cloud networking, Kubernetes environments, Terraform, Helm, Python, and more, shaping how enterprise AI reliability is built and scaled.

Responsibilities

  • System Design & Architecture: Design scalable, reliable infrastructure for AI workloads, inference, data pipelines, and agentic workflows

  • CI/CD: Build and deliver best-in-class developer experience and software development lifecycle tooling for our growing engineering team

  • Autoscaling: Scale on real signals (queue lag, in-flight requests, latency); add burst capacity and safe drains

  • Infrastructure as Code: Evolve Terraform+Helm for multi-environment deployments, secrets, policy-as-code, and workload identity

  • Observability: Build and deliver end-to-end visibility into our infrastructure, systems, and applications, and connect it to Traversal’s AI SRE agent for self-driving production

  • Security : Partner with our cloud security lead to improve Traversal’s security and compliance posture, implementing least privilege principles, JIT access workflows, default-deny egress, auditability, and policy-as-code

Requirements

  • 7+ years of experience at technically rigorous companies or teams

  • Proven experience operating cloud and Kubernetes native infrastructure and applications at scale with >99.9% availability

  • Demonstrated hands-on experience with AWS, EKS, Terraform, Helm

  • Experience designing idempotent systems (outbox, dedupe keys, safe replay)

  • Incident response, chaos testing, capacity planning

  • Strong debugging skills across infrastructure, compute, network, runtime, storage, and auth layers

Nice to Have

  • Service mesh (Envoy/Istio), Cilium/eBPF

  • GPU workload operations, inference servers, token streaming gateways

  • Production experience building and maintaining systems in Python, Rust, and TypeScript

  • Data governance (PII discovery/redaction), lineage, tokenization

  • Experience designing, implementing, and deploying cross-region active/active architectures

  • Familiarity with other cloud providers (GCP, Azure, Oracle Cloud)

Compensation We offer competitive compensation, startup equity, health insurance, and additional benefits. The U.S. base salary range for this full-time, in-person role in New York is $175,000–$275,000, plus equity and benefits. Our salary ranges are based on location, level, and role. Individual compensation is determined by experience, skills, and job-related knowledge.

Why You Should Join Us We’ll make sure you’re fully supported with health insurance, a great tech setup, flexible time off, and plenty of in-office snacks. We offer competitive salary and equity packages, and take thoughtful consideration with every hire on our small, high-impact team.

Traversal is fully in-office, 5 days a week, based in New York near Madison Square Park. We have a collaborative, hard-working culture and are energized by building the future of AI-powered software maintenance.

Working here means owning meaningful parts of the product, having the flexibility to move fast, and learning constantly. This is a place to grow your career, make a real impact, and help define a new category of infrastructure software.

You've read the whole posting — now see how you match it.