AfterQuery logo

Research Scientist - Post Training

AfterQuery

San Francisco, CAFull-time$250–450K/yrPosted 4mo agoVerified open 5 days ago

Most applications go out cold — see where you stand first. No sign-up to start.

At a glance

Compensation
$250–450K/yr
Location
San Francisco, CA
Schedule
Full-time
Work Authorization
Not specified

Requirements

Credentials this posting asks for.

Master's degree

Job overview

AfterQuery is hiring a Research Scientist - Post Training. The role involves proving data effectiveness by designing and running training experiments that assess how datasets influence model behavior, including SFT and RL post‑training, and translating results into clear, defensible evidence for partner labs.

Key focus areas include Run controlled SFT and RL experiments to measure dataset impact on model performance, Help build public evaluations and new data types that push the frontier, and Publish external‑facing research, blog posts, and technical reports.

Important skills include LLM Training, LLM Evaluation Methodologies, Data Structure, Data Selection, Data Quality, and Experimental Design. Preferred (not required): Obsession With Data Structure, Obsession With Data Selection, and Obsession With Data Quality.

Skills & qualifications

RequiredNice to have

Skills

LLM TrainingLLM Evaluation MethodologiesData StructureData SelectionData QualityExperimental DesignActionable Insights ExtractionCross-Domain WorkBias Toward BuildingDesign Lightweight ExperimentsExtract Actionable Insights From Messy ResultsWorking Across DomainsBias Toward Building Over TheorizingObsession With Data StructureObsession With Data SelectionObsession With Data QualityEvaluation MethodologiesMove FastExtract Actionable InsightsComfort Working Across DomainsSFT ExperimentsRL ExperimentsPublic EvalsExperiment DesignData Quality AnalysisCross‑Domain KnowledgeResearch Publication

Qualifications

Undergraduate Research ExperienceMaster's Research Experience

Benefits

401(k) Match
Medical Insurance
Dental Insurance
Vision Insurance

Full job description

ABOUT AFTERQUERY

AfterQuery https://www.afterquery.com/ is an applied research lab curating data solutions for foundation model development.

We serve every frontier AI lab with the mission of delivering the best data to power the best models. In doing so, we can make expertise that once took a lifetime to build available to anyone who needs it. Our customers are the ones building the foundation models themselves and our work sits directly in the loop of how those systems improve.

This is a rare opportunity to join a company at a defining moment in AI. Since raising our $30M Series A at a $300M valuation, AfterQuery has grown well over a $100M revenue run rate.

We're based in San Francisco and backed by leading investors including Altos Ventures, BoxGroup, and Y Combinator and angels from Google DeepMind, OpenAI, Anthropic, Meta Superintelligence Labs, and Microsoft AI.

WHY APPLY

  • Massive Opportunity: We are one of the fastest-growing YC companies in our batch, and we believe we can become one of the fastest-growing YC companies of all time.

  • Founding Impact: You will own and architect core infrastructure systems that power our platform from the ground up.

  • Equity & Growth: Competitive salary and meaningful equity. As we scale, you’ll have the opportunity to shape the engineering organization and lead major technical initiatives.

  • Strong Team: Our founding team has experience from Citadel Securities, Meta, Google, Silver Lake, and Morgan Stanley — work alongside world-class engineers and researchers.

OVERVIEW

Your job is to prove that our data works. You will design and run training experiments that isolate the impact of our datasets on model behavior. This includes SFT and RL-based post-training, where you’ll measure how different data sources shift capability, generalization, and alignment. Working closely with partner labs, you will turn our datasets into clear, defensible evidence: this data → this improvement → under these conditions. This is experimental, high-leverage work.

RESPONSIBILITIES

Run controlled SFT and RL experiments to measure the impact of our datasets on model performance.

Help build public evals and new data types that push the frontier.

Publish external-facing research, blog posts, and technical reports.

Work with internal SPLs to iterate on data quality based on your results.

REQUIRED QUALIFICATIONS

Strong familiarity with LLM training and evaluation methodologies.

Ability to design lightweight experiments, move fast, and extract actionable insights from messy results.

Comfort working across domains (you'll touch finance, software engineering, policy, and more).

A bias toward building over theorizing.

PREFERRED QUALIFICATIONS

Great candidates are undergrad research or master's research (but haven't done a phd).

Genuine obsession with how data structure, selection, and quality drive model behavior.

You've read the whole posting — now see how you match it.