Skip to main content
Crustdata logo

Software Engineer, Entity Resolution

Crustdata

San Francisco, CAFull-time$150–300K/yrSeen todayStill listed · checked in the last 2 days

See where you stand before you apply. No sign-up to start.

You apply on the posting's application page, with no Olive account needed.

Watch jobs like this.

Don't just apply. Show up ready.

Olive works from this exact posting.

At a glance

Compensation
$150–300K/yr
Location
San Francisco, CA
Schedule
Full-time
Work Authorization
Not specified

Olive focuses on jobs in the United States, including remote roles you can work from there.

Job overview

Crustdata builds web-scale person and company search for AI agents. The entity resolution team creates canonical, evidence-backed records by linking data across social networks, job boards, directories, and proof-of-work platforms. The engineer will develop and ship production methods for candidate generation, matching, clustering, truth discovery, and evaluation across billions of records.

Skills & qualifications

RequiredNice to have

Skills

Python, nice to haveMachine Learning, nice to haveNatural Language Processing, nice to haveSystems Language, requiredSimilarity Search, nice to haveHashing, nice to haveEntity Resolution, nice to haveRecord Linkage, nice to haveInformation Extraction, nice to haveKnowledge Graphs, nice to haveData Integration, nice to haveLarge-Scale ML, nice to haveLSH, nice to haveMinHash, nice to haveSketching, nice to haveApproximate Nearest Neighbor Search, nice to haveWeak Supervision, nice to haveActive Learning, nice to haveLLM-Based Labeling, nice to haveSpark, nice to haveRay, nice to haveDistributed Data Frameworks, nice to haveReadable Code, requiredCorrectness, requiredMeasurement, required

Qualifications

PhD or Research Master's in CS, ML, Data Management or Related Field, requiredThesis or First-Author Papers in Relevant Topics, requiredCode Others Can Read, requiredStartup or Small-Team Experience, nice to have

Full job description

Crustdata builds web scale person and company search for AI agents. We cover 1B+ people, we're profitable, and we got to $13M ARR in under 1.5 years. We're backed by SV Angel, YC and General Catalyst. The entity resolution team turns what we index into one canonical, evidence-backed record for each person and company, linking records across social networks, job boards, web directories such as school and institution pages, and proof-of-work platforms. AI agents query that data directly. People and companies have no shared id across these sources. You'll work on the methods that decide which records get compared, which ones match, and how matches become entities, and you'll ship them to production. What you'll do

  • Candidate generation: blocking and similarity search (LSH, sketching, learned embeddings) that finds the likely matches for each record among billions, with the recall you give up measured.
  • Matching: models that decide whether two records are the same person or company, with calibrated confidence, when names, employers, schools, handles and dates disagree.
  • Clustering: turn pairwise scores into one record per person and company, and handle merges and splits as new data arrives.
  • Truth discovery: decide which source to trust for each field, using reliability, recency and corroboration, with provenance on each value.
  • Evals: labeled sets and metrics for matching and merging when ground truth is incomplete, and lineage that shows which source or stage caused an error.

What we're looking for

  • A PhD or research master's in CS, ML, data management or a related field, finished or finishing in 2026, with a thesis or first-author papers on topics like similarity search and hashing, entity resolution or record linkage, information extraction, knowledge graphs, data integration or large-scale ML.
  • Strong Python and comfort with a systems language. Code of your own that others can read, like a paper's released repo or an open-source project.
  • You want your methods running in production on a billion records.
  • You care about correctness and measure it.

Bonus

  • LSH, MinHash, sketching or approximate nearest neighbor search at scale.
  • Weak supervision, active learning or LLM-based labeling for matching.
  • Spark, Ray or another distributed data framework.
  • Time at a startup or on a small team.

Example projects

  • Generate candidate pairs across 1B+ person records with a recall you can measure and defend.
  • Link one person's profiles across a social network, a job board, a school directory and a proof-of-work platform when no field matches exactly.
  • Build the eval set that estimates our person-matching error rate without labeling everything.
  • Resolve each company to one record across domains, name variants, subsidiaries and acquisitions.

How this job compares

Set against the 38,274 open Software Engineer jobs on Olive Jobs, counted November 18, 2026.

Pay
  • This posting$150–300K/yr
  • California median$163–243K/yr6,831 salary ranges
  • US median$131–214K/yr31,198 salary ranges

This range's midpoint, $225K, is 10% above the California median midpoint ($205K) — in the middle half of Software Engineer salary ranges in California.

Openings
Olive Jobs lists 8,409 open Software Engineer jobs in California and 38,274 across the US. 8% of them nationwide are listed as remote or flexible.
Hiring the most in California
Experience
This posting asks for no prior experience — less than three in four Software Engineer postings that state a minimum ask for (median 5 years, across 31,727 postings).
Education
11,541 of the 38,274 open Software Engineer jobs (30%) ask for a bachelor's degree or higher.

Pay, requirements and demand for Software Engineer jobs

Counted across the open, public US postings on Olive Jobs on November 18, 2026. Figures based on too few postings are left out.

Prepare for this role

You've read the whole posting — now see how you match it.