
Software Engineer, Entity Resolution
San Francisco, CAFull-time$150–300K/yrSeen todayStill listed · checked in the last 2 days
See where you stand before you apply. No sign-up to start.
You apply on the posting's application page, with no Olive account needed.
Watch jobs like this. New roles like this one near San Francisco, CA, by email.
Don't just apply. Show up ready.
Olive works from this exact posting.
At a glance
Olive focuses on jobs in the United States, including remote roles you can work from there.
Job overview
Crustdata builds web-scale person and company search for AI agents. The entity resolution team creates canonical, evidence-backed records by linking data across social networks, job boards, directories, and proof-of-work platforms. The engineer will develop and ship production methods for candidate generation, matching, clustering, truth discovery, and evaluation across billions of records.
Skills & qualifications
Skills
Qualifications
Full job description
Crustdata builds web scale person and company search for AI agents. We cover 1B+ people, we're profitable, and we got to $13M ARR in under 1.5 years. We're backed by SV Angel, YC and General Catalyst. The entity resolution team turns what we index into one canonical, evidence-backed record for each person and company, linking records across social networks, job boards, web directories such as school and institution pages, and proof-of-work platforms. AI agents query that data directly. People and companies have no shared id across these sources. You'll work on the methods that decide which records get compared, which ones match, and how matches become entities, and you'll ship them to production. What you'll do
- Candidate generation: blocking and similarity search (LSH, sketching, learned embeddings) that finds the likely matches for each record among billions, with the recall you give up measured.
- Matching: models that decide whether two records are the same person or company, with calibrated confidence, when names, employers, schools, handles and dates disagree.
- Clustering: turn pairwise scores into one record per person and company, and handle merges and splits as new data arrives.
- Truth discovery: decide which source to trust for each field, using reliability, recency and corroboration, with provenance on each value.
- Evals: labeled sets and metrics for matching and merging when ground truth is incomplete, and lineage that shows which source or stage caused an error.
What we're looking for
- A PhD or research master's in CS, ML, data management or a related field, finished or finishing in 2026, with a thesis or first-author papers on topics like similarity search and hashing, entity resolution or record linkage, information extraction, knowledge graphs, data integration or large-scale ML.
- Strong Python and comfort with a systems language. Code of your own that others can read, like a paper's released repo or an open-source project.
- You want your methods running in production on a billion records.
- You care about correctness and measure it.
Bonus
- LSH, MinHash, sketching or approximate nearest neighbor search at scale.
- Weak supervision, active learning or LLM-based labeling for matching.
- Spark, Ray or another distributed data framework.
- Time at a startup or on a small team.
Example projects
- Generate candidate pairs across 1B+ person records with a recall you can measure and defend.
- Link one person's profiles across a social network, a job board, a school directory and a proof-of-work platform when no field matches exactly.
- Build the eval set that estimates our person-matching error rate without labeling everything.
- Resolve each company to one record across domains, name variants, subsidiaries and acquisitions.
How this job compares
Set against the 38,274 open Software Engineer jobs on Olive Jobs, counted November 18, 2026.
- Pay
- This posting$150–300K/yr
- California median$163–243K/yr6,831 salary ranges
- US median$131–214K/yr31,198 salary ranges
This range's midpoint, $225K, is 10% above the California median midpoint ($205K) — in the middle half of Software Engineer salary ranges in California.
- Openings
- Olive Jobs lists 8,409 open Software Engineer jobs in California and 38,274 across the US. 8% of them nationwide are listed as remote or flexible.
- Experience
- This posting asks for no prior experience — less than three in four Software Engineer postings that state a minimum ask for (median 5 years, across 31,727 postings).
- Education
- 11,541 of the 38,274 open Software Engineer jobs (30%) ask for a bachelor's degree or higher.
Pay, requirements and demand for Software Engineer jobs
Counted across the open, public US postings on Olive Jobs on November 18, 2026. Figures based on too few postings are left out.
Prepare for this role
You've read the whole posting — now see how you match it.

