Julius logo

Software Engineer - Infrastructure (Mid - Senior)

Julius

San Francisco, CAFull-time$150–200K/yrPosted 3mo agoStill listed 3w ago

Evaluate my fit

Most applications go out cold — see where you stand first. No sign-up to start.

Watch jobs like this.

Don't just apply. Show up ready.

Olive works from this exact posting.

At a glance

Compensation
$150–200K/yr
Location
San Francisco, CA
Schedule
Full-time
Work Authorization
Not specified

Olive lists jobs from US employers, including remote roles you can work from the United States.

Job overview

Julius is hiring a Software Engineer - Infrastructure (Mid - Senior). Julius is an applied AI lab that builds coding agents, executing about 1 million lines of code every 36 hours for over a million users. The company runs code sandboxes in isolated remote containers, managing them at scale, and is revenue‑generating with backing from AI Grant, Y Combinator and top venture firms.

Key focus areas include Design and operate secure, multi‑tenant container infrastructure with fast startup and smart autoscaling., Ship cloud deployments (Helm/Terraform) with SSO, network controls, and audit logging., and Drive observability (metrics, traces, logs) with clear SLOs; lead incident response..

Successful candidates bring Production Kubernetes Experience. Important skills include Design Container Infrastructure, Operate Container Infrastructure, Fast Startup, Smart Autoscaling, Helm, and Terraform. Preferred (not required): Scheduling, gVisor, Kata, and Firecracker.

Skills & qualifications

RequiredNice to have

Skills

Design Container InfrastructureOperate Container InfrastructureFast StartupSmart AutoscalingHelmTerraformSSONetwork ControlsAudit LoggingObservabilityMetricsTracesLoggingSLOsIncident ManagementOptimize ImagesSchedulingNetworkingCost OptimizationFair-Use ControlsRate-Limiting ControlsKubernetesContainer InternalsDockerContainerdAWSGCPAzureInfrastructure as CodePrometheusGrafanaOpenTelemetryElastic StackVectorSecurity Best PracticesgVisorKataFirecrackerCiliumeBPFServerless AutoscalingKEDAKnativeKarpenterAI Side ProjectTinkering With LLMs

Qualifications

Production Kubernetes Experience

Benefits

Medical Insurance
Dental Insurance

Full job description

Compensation: Competitive base salary and meaningful equity

Benefits: Health & dental insurance, gym reimbursement, daily team meals, commuter benefits

We’re an applied AI lab building coding agents. Julius executes ~1M lines of code every 36 hours for 1M+ users and has generated 3M+ visualizations. All code runs in code sandboxes (isolated remote containers) that we manage. We’re revenue‑generating and backed by AI Grant, YCombinator, Bessemer Venture Partners and the founders from Vercel, Notion, Perplexity, Palantir, Replit, Zapier, Intercom, and Dropbox.

The Role

Build and scale the code‑execution sandboxes that power Julius across cloud environments (AWS and GCP). We orchestrate 500k+ containers/month and growing. You’ll own reliability, performance, and security for multi‑tenant compute.

What You’ll Do

  • Design and operate secure, multi‑tenant container infrastructure with fast startup and smart autoscaling.

  • Ship cloud deployments (Helm/Terraform) with SSO, network controls, and audit logging.

  • Drive observability (metrics, traces, logs) with clear SLOs; lead incident response.

  • Optimize images, scheduling, networking, and cost ; build fair‑use and rate‑limiting controls.

What You Bring

  • Production Kubernetes and container internals (Docker/containerd); strong networking fundamentals.

  • Cloud (AWS/GCP/Azure) and IaC (Terraform/Helm).

  • Monitoring/Logging (Prometheus, Grafana, OpenTelemetry, ELK/Vector).

  • Security best practices for containerized, multi‑tenant systems.

Nice to Have

  • gVisor/Kata/Firecracker; Cilium/eBPF; GPU scheduling; serverless autoscaling (KEDA/Knative/Karpenter).

  • You’ve built an AI side project and enjoy tinkering with LLMs.

Why Julius

Small, senior team; massive impact surface; hard infra problems at meaningful scale.

Similar jobs, posted recently

Open roles like this one, listed in the last 30 days.

You've read the whole posting — now see how you match it.

Evaluate my fit