
Mid-Level AI Software Test Engineer
Ann Arbor, MIJob$45–48/hrSeen 2 days agoSeen in employer's feed 2 days ago
Most applications go out cold — see where you stand first. No sign-up to start.
Watch jobs like this. New roles like this one near Ann Arbor, MI, by email.
Don't just apply. Show up ready.
Olive works from this exact posting.
At a glance
Olive lists jobs from US employers, including remote roles you can work from the United States.
Job overview
The Mid-Level AI Software Test Engineer will design and execute testing strategies for AI-powered applications, machine learning systems, agents, copilots, and generative AI solutions. The role focuses on validating model outputs, building automated evaluation pipelines, integrating testing into CI/CD, and testing guardrails and governance controls. The engineer will collaborate with engineering and product teams on quality feedback, production readiness, and defect triage.
Skills & qualifications
Skills
Qualifications
Benefits
Full job description
Our client, [Industry Descriptor] is seeking a Mid-Level AI Software Test Engineer to join their team. As a Mid-Level AI Software Test Engineer, you will be part of the [Department Name] supporting [Team Name(s)]. The ideal candidate will have a strong software testing foundation, the ability to independently own AI testing and automation efforts, and a collaborative mindset to partner with AI developers, architects, and product teams to help deliver production-quality AI solutions.
Job Title: Mid-Level AI Software Test Engineer
Location: Ann Arbor, MI
Pay Range: $45-$48/hr
What's the Job?
-
Design, automate, and execute testing strategies for AI-powered applications, machine learning systems, AI agents, copilots, and generative AI solutions.
-
Validate AI model outputs for accuracy, consistency, reliability, and safety through functional, integration, end-to-end, regression, and performance testing.
-
Build automated evaluation pipelines for AI responses and workflows, integrating AI testing into CI/CD to detect quality issues early.
-
Test AI guardrails, business rules, permissions, and governance controls, including adversarial, negative, and edge-case scenarios to uncover failures and hallucinations.
-
Partner across engineering and product teams to provide quality feedback during design reviews and support production readiness and defect triage.
What's Needed?
-
3–6 years of software testing, QA automation, or quality engineering experience, with 1–3 years of exposure to AI/ML or Generative AI technologies.
-
Experience developing automated test solutions using Python, Java, JavaScript/TypeScript, or C#.
-
Strong understanding of test automation, SDLC, Agile methodologies, and CI/CD pipelines.
-
Experience with API testing and automation tools, plus testing distributed systems, web applications, and APIs.
-
Ability to independently own AI testing and automation efforts while collaborating closely with AI developers, architects, and product teams.
What's in it for me?
-
Opportunity to combine traditional software quality engineering with emerging AI validation techniques to help ensure AI systems are reliable and production-ready.
-
Ownership of automated AI evaluation and regression detection to improve confidence in AI model and agent behavior.
-
Hands-on experience testing prompt-driven, agentic, and retrieval-based AI workflows, including RAG and tool-calling integrations.
-
Collaboration with cross-functional teams to strengthen quality standards, best practices, and production readiness.
-
Clear success measures focused on reducing AI release regressions and improving safe, scalable delivery of AI-powered features.
Upon completion of waiting period consultants are eligible for:
-
Medical and Prescription Drug Plans
-
Dental Plan
-
Vision Plan
-
Health Savings Account
-
Health Flexible Spending Account
-
Dependent Care Flexible Spending Account
-
Supplemental Life Insurance
-
Short Term and Long Term Disability Insurance
-
Business Travel Insurance
-
401(k), Plus Match
-
Weekly Pay
If this is a role that interests you and you'd like to learn more, click apply now and a recruiter will be in touch with you to discuss this great opportunity. We look forward to speaking with you!
About ManpowerGroup, Parent Company of: Manpower, Experis, Talent Solutions, and Jefferson Wells.
ManpowerGroup® (NYSE: MAN), the leading global workforce solutions company, helps organizations transform in a fast-changing world of work by sourcing, assessing, developing, and managing the talent that enables them to win. We develop innovative solutions for hundreds of thousands of organizations every year, providing them with skilled talent while finding meaningful, sustainable employment for millions of people across a wide range of industries and skills. Our expert family of brands – Manpower, Experis, Talent Solutions, and Jefferson Wells – creates substantial value for candidates and clients across more than 75 countries and territories and has done so for over 70 years. We are recognized consistently for our diversity - as a best place to work for Women, Inclusion, Equality and Disability and in 2023 ManpowerGroup was named one of the World's Most Ethical Companies for the 14th year - all confirming our position as the brand of choice for in-demand talent.
ManpowerGroup is committed to providing equal employment opportunities in a professional, high quality work environment. It is the policy of ManpowerGroup and all of its subsidiaries to recruit, train, promote, transfer, pay and take all employment actions without regard to an employee's race, color, national origin, ancestry, sex, sexual orientation, gender identity, genetic information, religion, age, disability, protected veteran status, or any other basis protected by applicable law.
Similar jobs, posted recently
Open roles like this one, listed in the last 30 days.
Staff Software Engineer– Boot SoftwareGeneral Motors · Milford, MI (Hybrid)Posted 1w agoPosted 1w ago
Software Engineer - Battery & High VoltageGeneral Motors · Milford, MI (Hybrid)Posted 4 days agoPosted 4 days ago
Senior Software Engineer - High Voltage ElectrificationGeneral Motors · Milford, MI (Hybrid)Posted 1w agoPosted 1w ago
Senior Software Engineer - ADAS Interactive ExperienceGeneral Motors · Milford, MI (Hybrid)Posted 4 days agoPosted 4 days ago
Software Architect, DuoCisco · Ann Arbor, MI (Hybrid) · $178–257K/yrPosted 1w agoPosted 1w ago
You've read the whole posting — now see how you match it.