Olive Jobs
Fal logo

Software Engineer, Site Reliability

Fal

San Francisco, CAHybridFull-time$180–250K/yrPosted 6mo agoVerified open 4 days ago
Evaluate my fit

Most applications go out cold — see where you stand first. No sign-up to start.

Don't just apply. Show up ready.

Olive works from this exact posting — no sign-up to start.

Evaluate your fitSee where you stand — strengths, gaps, and what to fix first.Get started →Tailor your résuméRewritten against this posting, with a diff of every change.Get started →Practice the interviewA voice mock interview built from this job description.Get started →

At a glance

Compensation
$180–250K/yr
Location
San Francisco, CAHybrid
Schedule
Full-time
Work Authorization
Not specified

Job overview

Fal is hiring a Software Engineer, Site Reliability. Fal is a generative media ecosystem that builds infrastructure, tools, and model access for AI products. The company provides a unified platform for high‑performance inference, orchestration, and observability, enabling developers and enterprises to create AI‑native offerings at scale.

Key focus areas include Own and operate Kubernetes infrastructure, including cluster lifecycle, upgrades, networking, and multi-tenant isolation., Build and maintain CI/CD pipelines and deployment infrastructure., and Leverage AI to automate analysis and resolution of production issues, improving reliability..

Successful candidates bring 5+ Years Experience Managing Critical Production Systems and 5+ Years Experience Software Development Workflows. Important skills include Kubernetes, Terraform, Ansible, Linux Networking, Container Networking, and CNI Plugins. Preferred (not required): Managing GPU Workloads, Managing AI/ML Workloads, Kernel-Based Routing, and eBPF.

Skills & qualifications

RequiredNice to have

Skills

KubernetesTerraformAnsibleLinux NetworkingContainer NetworkingCNI PluginsVXLANBGPDNSCI/CD SystemsGitOps WorkflowsFluxCDArgo CDPythonGoBashLoggingMonitoringAlertingPrometheusGrafanaLokiThanosVictoriaMetricsDatadogCommunicationTechnical Decision MakingSelf-StarterOwnershipContinuous ImprovementManaging GPU WorkloadsManaging AI/ML WorkloadsKernel-Based RoutingeBPFXDPSecurity ToolingFalcoCorootSIEMCalicoCiliumMetalLBDistributed Storage SystemsCephLonghornExecutionGPU WorkloadsAI/ML Workloads

Qualifications

5+ Years Experience in Managing Critical Production Systems5+ Years Experience in Software Development Workflows

Benefits

Medical Insurance
Dental Insurance
Vision Insurance
Relocation Assistance

Full job description

fal is the generative media ecosystem powering the next generation of AI products. We build the infrastructure, tools, and model access that teams need to move from idea to production, and do it at scale without compromise. For developers and enterprises, fal is the foundation that makes generative media not just possible, but practical: a unified platform where high-performance inference, orchestration, and observability come together to unlock new categories of AI-native products.

As generative media reshapes industries across a market projected to grow by hundreds of billions over the next decade, fal is becoming the ecosystem that ambitious teams build on.

About this role You are a seasoned SRE who keeps production infrastructure running at scale. You own the reliability and availability of customer-facing systems — from Kubernetes clusters to deployment pipelines to the networking layer that connects it all. You think in SLOs, automate ruthlessly, and treat every incident as a chance to make the system better.

Key Responsibilities

  • Own and operate our Kubernetes infrastructure: cluster lifecycle, upgrades, networking, and multi-tenant isolation for customer workloads

  • Build and maintain CI/CD pipelines and deployment infrastructure

  • Leverage AI to an extreme level to automate analysis and resolution of production issues, and improve software development speed, reliability and maintainability

  • Build dashboards, alerting, and anomaly detection across our systems

  • Define and enforce SLOs and build out incident response processes

  • Manage and improve our networking, load balancing, and service mesh configurations

  • Drive reliability improvements across the stack through automation, runbooks, and chaos engineering

Requirements

  • 5+ years experience in managing critical production systems and software development workflows

  • Strong production experience setting up and operating Kubernetes at scale, using infrastructure-as-code (Terraform, Ansible)

  • Deep knowledge of Linux networking, container networking (CNI plugins, VXLAN, BGP), and DNS

  • Experience building CI/CD systems and GitOps workflows (FluxCD, ArgoCD)

  • Proficiency in Python and either Go or Bash for tooling and automation

  • Strong experience with logging, monitoring and alerting (Prometheus, Grafana, Loki, Thanos, VictoriaMetrics, Datadog)

  • Excellent communication and ability to drive technical decisions across teams

  • Self-starter who executes quickly, takes ownership, and constantly seeks improvement

Nice to have

  • Experience with managing GPU and AI/ML workloads

  • Experience with kernel-based monitoring and routing (eBPF, XDP)

  • Experience with security tooling (Falco, Coroot, SIEM)

  • Experience with bare metal Kubernetes networking (Calico, Cilium, MetalLB)

  • Experience with distributed storage systems (Ceph, Longhorn, etc.)

Location

  • San Francisco, CA

What we offer at fal

  • Interesting and challenging work

  • A lot of learning and growth opportunities

  • We are currently hiring in downtown San Francisco.

  • Health, dental, and vision insurance (US)

  • Regular team events and offsites

You've read the whole posting — now see how you match it.

Evaluate my fit