
AI Engineer
Remote · location unlistedFull-timePosted 2 days agoStill listed 1 day ago
Most applications go out cold — see where you stand first. No sign-up to start.
Watch jobs like this. New remote roles like this one, by email.
Don't just apply. Show up ready.
Olive works from this exact posting.
At a glance
Olive lists jobs from US employers, including remote roles you can work from the United States.
Job overview
Mastra is seeking a hands-on AI engineer to build tools for understanding agent traces, evaluating agent behavior, and improving agents over time. The role combines experiments, benchmarks, and product code. The engineer will investigate how Mastra primitives perform, use findings to improve their configuration and behavior, and turn evaluation work into capabilities developers can use in their applications.
Skills & qualifications
Skills
Qualifications
Full job description
We’re looking for an AI engineer. You’ll work on features that help developers understand their agents’ behavior, evaluate their performance, and improve them over time. This is a hands-on engineering role. You’ll move between experiments, benchmarks, and product code, taking what you learn from evaluating agents and using it to shape the framework. Why:
-
We’re starting to build more and more agentic features into Mastra: Trace intelligence, and we’re working on various Agent Learning features to automatically self-improve agents (Autoevals + Suggestions, Rollouts).
-
In addition, we’ve been increasingly running Mastra primitives like memory on industry-standard benchmarks and using the results to fine-tune configuration.
What you’ll do Build the features that make this possible: tools for understanding traces, evaluating agent behavior, and turning results into improvements. Run experiments on Mastra’s primitives, investigate where they perform well and where they fall short, and use those findings to improve their configuration and behavior. You’ll help turn that work into capabilities developers can use in their own applications. You have:
-
Shipped agents and agentic applications into production
-
Tuned and tweaked them to improve accuracy
-
You need to be able to benchmark your results against existing datasets, or intelligently creating.
About Mastra Mastra is the open-source TypeScript framework for building AI agents. Built by the team behind Gatsby, backed by Y Combinator and Spark Capital, with $35M raised total. We went from 0 to 27k+ stars and 1M+ weekly npm downloads in under 18 months. Small team, shipping fast, fully remote. Most of us work across North American and European time zones.
Similar jobs, posted recently
Open roles like this one, listed in the last 30 days.
- Associate AI EngineerFigure Lending · Remote · location unlisted · $80–120K/yrPosted 1 day agoPosted 1 day ago
Senior AI EngineerCVS Health · Remote · US · $93–204K/yrPosted 2 days agoPosted 2 days ago
Senior Forge AI EngineerNorstella · Remote · USPosted 1w agoPosted 1w agoSenior AI Engineer - USTypeform · Remote · location unlistedPosted 2w agoPosted 2w ago
Staff AI Engineer - USTypeform · Remote · location unlisted · $170–210K/yrPosted 2w agoPosted 2w ago
You've read the whole posting — now see how you match it.