Stripe logo

Senior Staff Engineer, Big Data Infrastructure

Stripe

San Francisco, CAJobPosted 1 day agoStill listed today

Most applications go out cold — see where you stand first. No sign-up to start.

You apply on the employer's site, with no Olive account needed.

Watch jobs like this.

Don't just apply. Show up ready.

Olive works from this exact posting.

At a glance

Compensation
No compensation found
Location
San Francisco, CA
Work Authorization
Not specified

Olive lists jobs from US employers, including remote roles you can work from the United States.

Job overview

Stripe’s Big Data Infrastructure team builds and maintains data orchestration, batch compute, and data lake platforms used across the company. The Senior Staff Engineer will lead the organization’s technical direction, guide a 40+ person engineering team, modernize foundational systems, and advance multi-region, multi-cloud, and AI-agent capabilities. The role also focuses on reducing operational burden and mentoring engineers.

Skills & qualifications

RequiredNice to have

Skills

DatabasesStorageDistributed SystemsInfrastructureOperational ExcellenceData InfrastructureDistributed InfrastructurePlatform ServicesComputeCross-Team LeadershipSystem ScalingSystem MigrationReliability OptimizationSecurity OptimizationMetricsAlertingDashboardsAI-Led TransformationAgentic WorkflowsBig Data InfrastructureSparkIcebergS3AirflowYARNCelebornDatabase InternalsKubernetes

Qualifications

BS or MS in Computer Science or Related Field12+ Years Software Development Experience

Full job description

Who we are About Stripe Stripe is a financial infrastructure platform for businesses. Millions of companies - from the world’s largest enterprises to the most ambitious startups - use Stripe to accept payments, grow their revenue, and accelerate new business opportunities. Our mission is to increase the GDP of the internet, and we have a staggering amount of work ahead. That means you have an unprecedented opportunity to put the global economy within everyone’s reach while doing the most important work of your career. About the team In this role, you’d be joining the Big Data Infrastructure team. Our team builds and maintains the platforms that power data work across Stripe, managing three core layers:

  • Data Orchestration (Airflow)
  • Batch Compute (Spark, Celeborn)
  • Data Lake (Iceberg, Hive, S3, Azure Blob Storage)

We support over 2,000 engineers and 600+ internal teams, processing workloads that organically grow more than 30% year over year. Our infrastructure handles massive scale, managing over 800 PB of data, running 325,000 applications a day, and accounting for hundreds of millions of dollars in annual spend, directly powering critical pipelines like inbound payments, network reconciliation, and capital underwriting. What you’ll do As the technical leader for the Big Data Infrastructure organization, you will guide a 40+ person engineering team to scale our foundational data systems. You will partner closely with major internal customers like Data Foundations, Payins Engineering, and AI/ML Foundations to modernize our tech stack and execute Stripe's transition to the "Agentic Era" - building "invisible infrastructure" where AI agents operate data pipelines end-to-end. Responsibilities

  • Serve as the technical leader for the Big Data Infrastructure organization, overseeing distributed systems that manage 20% of Stripe's total AWS spend
  • Execute Stripe's transition to the "Agentic Era" by building invisible infrastructure that empowers AI agents to author, validate, ship, and operate data pipelines
  • Drive the architecture and delivery of critical modernization bets, including YARN to Kubernetes migrations, native vectorization (Gluten/Velox), and Airflow and Data Catalog modernization
  • Lead the implementation of a multi-region and multi-cloud data strategy for high availability, disaster recovery, and Azure Blob Storage compliance
  • Reduce operational burden and maintenance overhead (KTLO) from over 40% to under 10% by shifting fixes into the platform instead of relying on runbooks
  • Foster a culture of operational excellence and mentor engineers at various stages in their careers, up to Staff+

Who you are We’re looking for someone who meets the minimum requirements to be considered for the role. If you meet these requirements, you are encouraged to apply. The preferred qualifications are a bonus, not a requirement. Minimum requirements

  • BS or MS in Computer Science or a related field
  • This is a Senior Staff role, so ideally 12+ years of professional experience in a software development role
  • A strong engineering background in distributed infrastructure and/or platform services, including one or more of the following: storage, databases, or compute
  • Experience leading projects on a cross-team and company-wide scale, including scaling and migrating systems with little to no downtime
  • Experience developing, maintaining, and debugging distributed systems while optimizing their reliability and security
  • Experience driving a culture of operational excellence, with a deep understanding of metrics, alerts, and dashboards

Preferred qualifications

  • Experience driving AI-led architectural transformations and integrating agentic workflows into large-scale data systems
  • Experience in a development team at AWS, Azure, OCI, or Google
  • Experience with big data infrastructure at scale, such as Spark, Iceberg, S3, Airflow, YARN, and Celeborn
  • Experience with database internals and/or with Kubernetes

How this job compares

Set against the 2,110 open Engineering Leadership jobs on Olive Jobs, counted November 6, 2026.

Pay
  • This postingNot listed
  • California median$207–310K/yr241 salary ranges
Openings
Olive Jobs lists 285 open Engineering Leadership jobs in California and 2,110 across the US. 5% of them nationwide are listed as remote or flexible.
Hiring the most in California
Experience
This posting asks for at least 12 years of experience; Engineering Leadership postings that state a minimum ask for 10 years at the median (1,739 postings).
Education
733 of the 2,110 open Engineering Leadership jobs (35%) ask for a bachelor's degree or higher.

Counted across the open, public US postings on Olive Jobs on November 6, 2026. Pay medians are the middle values of the low ends and of the high ends of postings that list both ends of a range in the same cadence (a yearly salary or an hourly rate); a range's midpoint is halfway between its ends. Pay and experience figures resting on fewer than 20 postings are left out.

Prepare for this role

You've read the whole posting — now see how you match it.