Research Scientist / Engineer — Foundation Model (Agent)
Most applications go out cold — see where you stand first. No sign-up to start.
Don't just apply. Show up ready.
Olive works from this exact posting — no sign-up to start.
At a glance
Job overview
Luma AI is hiring a Research Scientist / Engineer — Foundation Model (Agent). Luma AI is seeking a Research Scientist/Engineer to build and train large-scale multimodal agentic models that reason, plan, code, and call tools. This role involves core research across modeling, data, systems, and evaluation, focusing on novel problems with no existing playbook. The ideal candidate is grounded in foundation models and agentic systems and has experience training models at scale.
Key focus areas include Architect large-scale multimodal agentic models that use reasoning, planning, coding, and tool calling for complex, multi-step work, Design, build, and run robust data pipelines to construct, enrich, and filter massive pixel datasets, and formulate new tasks, and Train large-scale multimodal models on massive datasets and GPU clusters.
Successful candidates bring Hands-On PyTorch And Large-Scale Training. Important skills include Machine Learning, Foundation Models, Agentic Systems, LLM/VLM Reasoning, Coding Models, and Tool Calling. Preferred (not required): State-Of-The-Art Multimodal Agents.
Skills & qualifications
Skills
Qualifications
Full job description
You'll build and train large-scale multimodal agentic models — systems that reason, plan, code, and call tools to do complex, multi-step work over pixels. This is core research shaping how users interact with what Luma's models can do.
It's a multi-stack research role across modeling, data, systems, and evaluation, on novel problems with no existing playbook, treating science and engineering as equally important. It fits someone grounded in foundation models and agentic systems who's trained models at real scale. If you want to work in only one layer of the stack, this deliberately spans several.
What You'll Own
-
Architect large-scale multimodal agentic models that use reasoning, planning, coding, and tool calling for complex, multi-step work.
-
Design, build, and run robust data pipelines to construct, enrich, and filter massive pixel datasets, and formulate new tasks.
-
Train large-scale multimodal models on massive datasets and GPU clusters.
-
Define and build novel evaluation frameworks to measure multimodal agents.
First 90 Days
One way the first 90 could unfold.
-
Days 1–30 — Immerse & Diagnose: Learn the current models, agentic approaches, and where evaluation and data are weakest.
-
Days 30–60 — Ship & Validate: Improve an agentic capability (reasoning, tool use, or coding) and prove it with a new eval.
-
Days 60–90 — Scale & Systemize: Scale the approach across datasets and clusters and harden the evaluation framework.
What You Bring
-
Strong foundation in machine learning, foundation models, and agentic systems.
-
Deep understanding of agentic systems and LLM/VLM reasoning, coding models, and tool calling.
-
Hands-on PyTorch and large-scale training (distributed, mixed precision, large datasets).
Nice to Have
- Experience with state-of-the-art foundation models in reasoning, coding, or tool calling, or state-of-the-art multimodal agents.
About Luma: Luma's mission is to build unified general intelligence that can generate, understand, and operate in the physical world. We believe multimodality is critical for intelligence — the next step beyond language models comes from vision. Luma is an equal opportunity employer.
You've read the whole posting — now see how you match it.