Skip to main content
Crustdata logo

Senior Data Platform Engineer

Crustdata

San Francisco, CAFull-time$140–200K/yrSeen 2mo agoStill listed today

See where you stand before you apply. No sign-up to start.

You apply on the posting's application page, with no Olive account needed.

Watch jobs like this.

Don't just apply. Show up ready.

Olive works from this exact posting.

At a glance

Compensation
$140–200K/yr
Location
San Francisco, CA
Schedule
Full-time
Work Authorization
Not specified

Olive focuses on jobs in the United States, including remote roles you can work from there.

Job overview

The Role seeks a foundational member of the engineering team to design, create, and evolve Crustdata’s data platform, owning data ingestion and management infrastructure that powers the company’s capabilities, with a focus on building robust, scalable data systems that directly impact customers.

Skills & qualifications

RequiredNice to have

Skills

Go, nice to havePython, nice to haveSpark, nice to haveData Warehousing, nice to haveKafka, nice to haveJava, nice to haveFlink, nice to haveDask, nice to havePulsar, nice to haveKinesis, nice to haveAWS, nice to haveGCP, nice to haveAzure, nice to haveETL/ELT, nice to haveAirflow, nice to haveDagster, nice to havePrefect, nice to haveTemporal, nice to haveDocker, nice to haveKubernetes, nice to haveDelta Lake, nice to haveIceberg, nice to haveData Lake, nice to have

Qualifications

3+ Years Professional Software Engineering Experience, required

Full job description

The Role We are looking for a foundational member of our engineering team: a highly motivated Software Engineer to own the design, creation, and evolution of our data platform. You will be part of the team that owns the data ingestion and management infrastructure that powers Crustdata’s capabilities. If you are passionate about building robust, scalable data systems and want to see your work directly influence customers, this is the role for you. What You'll Do

  • Architect & Build: Design, build, and maintain our core data infrastructure, including our data warehouse and data lake, using modern cloud technologies (AWS, GCP, or Azure).
  • Pipeline Development: Develop and scale robust, fault-tolerant data pipelines (ETL/ELT) to ingest and process massive volumes of structured and unstructured data from diverse sources.
  • Enable Data Science & ML: Create the foundational platform to support our data scientists and ML engineers. This includes building systems for feature engineering, model training, and deploying ML models into production.
  • Orchestration at Scale: Implement and manage workflow orchestration for hundreds of daily data jobs, ensuring reliability, monitorability, and efficiency using tools like Airflow, Dagster, or Prefect.
  • Real-time Infrastructure: Build and manage real-time data streaming pipelines using technologies like Kafka or Flink to power live dashboards and time-sensitive product features.
  • Data Quality & Governance: Champion data quality and reliability. Implement frameworks for data validation, testing, and monitoring to ensure our data is accurate and trustworthy.

Who You Are

  • Experience: You have 3+ years of professional software engineering experience, with a significant focus on data engineering or building backend systems at scale.
  • Strong Coder: You possess strong programming skills in Python or another modern language (e.g., Java, Go).
  • Big Data Expertise: You have hands-on experience with modern big data technologies such as Spark, Flink, or Dask.
  • Pipeline Orchestration: You have practical experience with workflow management tools like Temporal, Airflow, Dagster, or Prefect.
  • Problem Solver: You are a pragmatic problem-solver who can navigate ambiguity, manage complexity, and take ownership of projects from inception to completion.
  • Startup Mentality: You are excited to work in a fast-paced, collaborative environment and wear multiple hats.

Nice to Haves

  • Experience with real-time streaming technologies (Kafka, Pulsar, Kinesis).
  • Familiarity with containerization and orchestration (Docker, Kubernetes).
  • Knowledge of modern data warehousing and lakehouse architectures (e.g., Delta Lake, Iceberg).

How this job compares

Set against the 376 open Data Platform Engineer jobs on Olive Jobs, counted November 16, 2026.

Pay
  • This posting$140–200K/yr
  • California median$170–262K/yr83 salary ranges
  • US median$145–235K/yr325 salary ranges

This range's midpoint, $170K, is 17% below the California median midpoint ($206K) — in the lowest quarter of Data Platform Engineer salary ranges in California.

Openings
Olive Jobs lists 96 open Data Platform Engineer jobs in California and 376 across the US. 28% of them nationwide are listed as remote or flexible.
Hiring the most in California
Experience
This posting asks for at least 1 year of experience — less than three in four Data Platform Engineer postings that state a minimum ask for (median 5 years, across 324 postings).
Education
53 of the 376 open Data Platform Engineer jobs (14%) ask for a bachelor's degree or higher.

Pay, requirements and demand for Software Engineer jobs

Counted across the open, public US postings on Olive Jobs on November 16, 2026. Figures based on too few postings are left out.

Prepare for this role

You've read the whole posting — now see how you match it.