Odyssey logo

Member of Technical Staff, ML Performance

Odyssey

Palo Alto, CAFull-timeNo compensation foundPosted 5mo agoVerified open 4 days ago

Most applications go out cold — see where you stand first. No sign-up to start.

At a glance

Compensation
No compensation found
Location
Palo Alto, CA
Schedule
Full-time
Work Authorization
Not specified

Job overview

Odyssey is hiring a Member of Technical Staff, ML Performance. Odyssey is an AI lab focused on pioneering general world models, which are causal, multimodal systems that learn to predict and interact with the world over long horizons. The company is building inference infrastructure to scale to hundreds of thousands of users, while also working with massive datasets and models in training. This role focuses on ensuring models deliver exceptional speed, reliability, and scalability in both training and inference phases, optimizing efficiency to minimize TFLOPS per user and training compute cost.

Key focus areas include Optimize models that will be used in real-time by hundreds of thousands of users, Design and implement distributed training strategies to reduce training time and resource consumption on large GPU clusters, and Partner with our elite team of ML researchers and engineers to ensure model architectures are highly performant from conception.

Successful candidates bring 8+ Years Software Engineering Experience. Important skills include ML Performance Optimization, Distributed Training Strategies, Performance Bottleneck Identification, Innovative Approaches To Performance, PyTorch, and Triton. Preferred (not required): TensorFlow and JAX.

Skills & qualifications

RequiredNice to have

Skills

ML Performance OptimizationDistributed Training StrategiesPerformance Bottleneck IdentificationInnovative Approaches to PerformancePyTorchTritonNVIDIA GPU EcosystemsNVIDIA Optimization StacksProblem-Solving MindsetAcquire New SkillsHighly Metric-BasedTensorFlowJAX

Qualifications

8+ Years Software Engineering ExperienceSignificant Work in ML PerformanceTrack Record of Owning Projects End to End

Full job description

Who we are Odyssey is an AI lab pioneering general world models: causal, multimodal systems that learn to predict and interact with the world over long horizons. This foundational technology promises to revolutionize robotics, science, healthcare, education, gaming, defense, and beyond.

Odyssey’s founders previously pioneered the most complex application of physical AI: self-driving cars. They’ve now brought together a world-class research team from DeepMind, Tesla, Waymo, Meta, Apple, and Wayve, who have made significant contributions to language models (DeepMind Gemini), video models (DeepMind Veo), world models (Wayve GAIA), and autonomous systems (Tesla FSD).

Odyssey has raised significant venture capital from GV, Amazon, AMD, EQT, NVIDIA, Natural Capital, In-Q-Tel, Elad Gil, Jeff Dean, Guillermo Rauch, Garry Tan, Kyle Vogt, and researchers from OpenAI, DeepMind, MSL, Recursive, and Thinking Machines.

What we're looking for We're seeking those who are obsessed with gaining every last drop of performance from complex systems. We're building inference infrastructure to scale to hundreds of thousands of users within a year, while also working with massive, ever-growing datasets and models in training. Your focus will be ensuring our models deliver exceptional speed, reliability, and scalability in both the training and inference phases, optimizing efficiency to minimize TFLOPS per user and training compute cost.

What you'll do

  • Optimize models that will be used in real-time by hundreds of thousands of users.

  • Design and implement distributed training strategies to reduce training time and resource consumption on large GPU clusters.

  • Partner with our elite team of ML researchers and engineers to ensure model architectures are highly performant from conception.

  • Develop sophisticated tools to identify performance bottlenecks and stability issues in both training and serving environments.

  • Pioneer innovative approaches, frameworks, and system designs that enhance performance metrics across our model development and inference infrastructure.

  • Have significant autonomy in technical decisions.

  • Use the latest-generation GPUs.

Who you are

  • 8+ years of software engineering experience, with significant work in ML performance.

  • Deep insight into modern machine learning architectures with a natural instinct for performance optimization, particularly distributed training and inference.

  • Track record of owning projects end to end.

  • Problem-solving mindset with the ability to acquire new skills as needed.

  • Proficiency with PyTorch (or TF/JAX) and Triton as well as NVIDIA GPU ecosystems and optimization stacks.

  • Highly metric-based.

You've read the whole posting — now see how you match it.