
Member of Technical Staff (Site Reliability Engineer, Search Crawler)
Dublin, CAFull-timePosted 1w agoStill listed · checked in the last 2 days
See where you stand before you apply. No sign-up to start.
You apply on the posting's application page, with no Olive account needed.
Watch jobs like this. New roles like this one near Dublin, CA, by email.
Don't just apply. Show up ready.
Olive works from this exact posting.
At a glance
Olive focuses on jobs in the United States, including remote roles you can work from there.
Job overview
Perplexity’s Crawler team seeks a Site Reliability Engineer to improve crawler throughput, plan capacity, and strengthen operational reliability. The role focuses on safer deployments, observability, and durable fixes across fetching and rendering fleets. The engineer will operate Kubernetes workloads, build automation and monitoring, diagnose bottlenecks, participate in on-call and incident response, and improve reliability through production software and postmortems.
Skills & qualifications
Skills
Qualifications
Full job description
Keeping a crawler running is not the same as keeping it productive. Queues can grow while servers look healthy, and a small change can become a fleet-wide bottleneck. On Perplexity's Crawler team, you'll improve throughput, plan capacity, and build operational reliability through safer deployments, better observability, and durable fixes.
Responsibilities
-
Operate and optimize Kubernetes workloads and supporting infrastructure for crawler services, including fetching and rendering fleets.
-
Build and maintain infrastructure as code and CI/CD pipelines, with safe rollouts, validation, and fast rollback.
-
Define SLOs and build monitoring, alerting, and observability for availability, latency, throughput, and resource saturation.
-
Own capacity planning and resource efficiency; diagnose queue backlogs, network failures, and resource bottlenecks with service owners.
-
Participate in the team's on-call rotation, lead incident response, and turn blameless postmortems into durable reliability improvements.
-
Write production software to automate diagnosis and routine remediation, with validation and approval gates for high-impact actions.
Qualifications
-
5+ years of experience in SRE, production engineering, or infrastructure-heavy backend roles, with strong programming skills in Python, C++, Rust, or Go.
-
Hands-on experience with cloud infrastructure, production Kubernetes, infrastructure as code such as Terraform, and automated deployment workflows.
-
Strong Linux and networking fundamentals, including TCP/IP, DNS, TLS, HTTP, and load balancing.
-
Experience building observability with tools such as Datadog, Prometheus, or Grafana, and using SLOs to guide reliability improvements.
-
Proven experience diagnosing distributed-system failures, leading production incidents, and improving system performance or resource efficiency.
Nice to have
-
Experience operating web crawlers, search infrastructure, or browser fleets at scale.
-
Experience with distributed queues, backpressure, workload isolation, or multi-region recovery.
How this job compares
Set against the 2,333 open Site Reliability Engineer jobs on Olive Jobs, counted November 20, 2026.
- Pay
- This postingNot listed
- California median$160–246K/yr331 salary ranges
- US median$58–67/hr28 hourly ranges
- Openings
- Olive Jobs lists 422 open Site Reliability Engineer jobs in California and 2,333 across the US. 18% of them nationwide are listed as remote or flexible.
- Hiring the most in California
- SpaceX42 open
- Apple21 open
- Palo Alto Networks20 open
- Experience
- This posting asks for at least 5 years of experience; Site Reliability Engineer postings that state a minimum ask for 6 years at the median (1,948 postings).
- Education
- 472 of the 2,333 open Site Reliability Engineer jobs (20%) ask for a bachelor's degree or higher.
Counted across the open, public US postings on Olive Jobs on November 20, 2026. Figures based on too few postings are left out.
Prepare for this role
You've read the whole posting — now see how you match it.


