TrainLoop logo

Research Engineer

TrainLoop

San Francisco, CAFull-time$150–250K/yrSeen 1w agoStill listed 4 days ago

Most applications go out cold — see where you stand first. No sign-up to start.

Watch jobs like this.

At a glance

Compensation
$150–250K/yr
Location
San Francisco, CA
Schedule
Full-time
Work Authorization
Not specified

Olive lists jobs from US employers, including remote roles you can work from the United States.

Job overview

TrainLoop is hiring research engineers across model training, ML infrastructure, full-stack product engineering, and customer deployment. The role’s focus depends on the candidate’s strengths and the problems they own. Engineers may build training algorithms, distributed systems, data pipelines, evaluations, experiment interfaces, or customer integrations, working with researchers and engineers to turn successful approaches into reliable, reusable capabilities.

Skills & qualifications

RequiredNice to have

Skills

Software EngineeringML EngineeringResearchSystem OwnershipLanguage Model TrainingMultimodal Model TrainingPyTorchJAXDistributed Training PipelinesDistributed GPU WorkloadsJob SchedulingContainersCheckpointingFailure RecoveryPerformance ProfilingCustomer Data IntegrationAPIsCloud InfrastructureSystems DebuggingTechnical Customer Engagement

Qualifications

3+ Years Engineering Experience1+ Year Model Training

Full job description

Build the systems that turn research into useful models and products. We’re hiring research engineers across model training, ML infrastructure, full-stack product engineering, and customer deployment. Your focus will depend on your strengths and the problems you take ownership of. You might implement training algorithms and recipes; build distributed training and inference systems; develop data pipelines and evaluations; create interfaces for running experiments and improving models; or work directly with customers to integrate their data and workflows and deploy specialized models. Across these areas, you’ll work closely with researchers and engineers and turn successful approaches into reliable, reusable capabilities. Requirements

  • Typically 3+ years of software or ML engineering experience, including relevant academic or industry research (preferred), or equivalent demonstrated work.

  • Owned a substantial system from implementation through deployment and ongoing operation. Role-specific requirements:

  • Model training: typically 1+ year training language or multimodal models; hands-on PyTorch or JAX; experience building distributed training pipelines.

  • ML infrastructure: built and operated distributed GPU workloads, including job scheduling, containers, checkpointing, failure recovery, and profiling training or inference performance.

  • Customer deployment: owned a production integration involving customer data, APIs, and cloud infrastructure; debugged systems in customer environments and worked directly with technical customers.

Similar jobs, posted recently

Open roles like this one, listed in the last 30 days.

You've read the whole posting — now see how you match it.