ManpowerGroup logo

Mid-Level AI Software Test Engineer

ManpowerGroup

Ann Arbor, MIJob$45–48/hrSeen 2 days agoSeen in employer's feed 2 days ago

Most applications go out cold — see where you stand first. No sign-up to start.

Watch jobs like this.

At a glance

Compensation
$45–48/hr
Location
Ann Arbor, MI
Work Authorization
Not specified

Olive lists jobs from US employers, including remote roles you can work from the United States.

Job overview

The Mid-Level AI Software Test Engineer will design and execute testing strategies for AI-powered applications, machine learning systems, agents, copilots, and generative AI solutions. The role focuses on validating model outputs, building automated evaluation pipelines, integrating testing into CI/CD, and testing guardrails and governance controls. The engineer will collaborate with engineering and product teams on quality feedback, production readiness, and defect triage.

Skills & qualifications

RequiredNice to have

Skills

Software TestingQA AutomationAI/MLGenerative AIPythonJavaJavaScriptTypeScriptC#Test AutomationSDLCAgile MethodologiesCI/CDAPI TestingAPI Automation ToolsDistributed Systems TestingWeb Application TestingIndependent OwnershipCollaboration

Qualifications

3+ Years Software Testing Experience1+ Years AI/ML Exposure

Benefits

Medical Insurance
Dental Insurance
Vision Insurance
401(k) Match

Full job description

Our client, [Industry Descriptor] is seeking a Mid-Level AI Software Test Engineer to join their team. As a Mid-Level AI Software Test Engineer, you will be part of the [Department Name] supporting [Team Name(s)]. The ideal candidate will have a strong software testing foundation, the ability to independently own AI testing and automation efforts, and a collaborative mindset to partner with AI developers, architects, and product teams to help deliver production-quality AI solutions.

Job Title: Mid-Level AI Software Test Engineer

Location: Ann Arbor, MI

Pay Range: $45-$48/hr

What's the Job?

  • Design, automate, and execute testing strategies for AI-powered applications, machine learning systems, AI agents, copilots, and generative AI solutions.

  • Validate AI model outputs for accuracy, consistency, reliability, and safety through functional, integration, end-to-end, regression, and performance testing.

  • Build automated evaluation pipelines for AI responses and workflows, integrating AI testing into CI/CD to detect quality issues early.

  • Test AI guardrails, business rules, permissions, and governance controls, including adversarial, negative, and edge-case scenarios to uncover failures and hallucinations.

  • Partner across engineering and product teams to provide quality feedback during design reviews and support production readiness and defect triage.

What's Needed?

  • 3–6 years of software testing, QA automation, or quality engineering experience, with 1–3 years of exposure to AI/ML or Generative AI technologies.

  • Experience developing automated test solutions using Python, Java, JavaScript/TypeScript, or C#.

  • Strong understanding of test automation, SDLC, Agile methodologies, and CI/CD pipelines.

  • Experience with API testing and automation tools, plus testing distributed systems, web applications, and APIs.

  • Ability to independently own AI testing and automation efforts while collaborating closely with AI developers, architects, and product teams.

What's in it for me?

  • Opportunity to combine traditional software quality engineering with emerging AI validation techniques to help ensure AI systems are reliable and production-ready.

  • Ownership of automated AI evaluation and regression detection to improve confidence in AI model and agent behavior.

  • Hands-on experience testing prompt-driven, agentic, and retrieval-based AI workflows, including RAG and tool-calling integrations.

  • Collaboration with cross-functional teams to strengthen quality standards, best practices, and production readiness.

  • Clear success measures focused on reducing AI release regressions and improving safe, scalable delivery of AI-powered features.

Upon completion of waiting period consultants are eligible for:

  • Medical and Prescription Drug Plans

  • Dental Plan

  • Vision Plan

  • Health Savings Account

  • Health Flexible Spending Account

  • Dependent Care Flexible Spending Account

  • Supplemental Life Insurance

  • Short Term and Long Term Disability Insurance

  • Business Travel Insurance

  • 401(k), Plus Match

  • Weekly Pay

If this is a role that interests you and you'd like to learn more, click apply now and a recruiter will be in touch with you to discuss this great opportunity. We look forward to speaking with you!

About ManpowerGroup, Parent Company of: Manpower, Experis, Talent Solutions, and Jefferson Wells.

ManpowerGroup® (NYSE: MAN), the leading global workforce solutions company, helps organizations transform in a fast-changing world of work by sourcing, assessing, developing, and managing the talent that enables them to win. We develop innovative solutions for hundreds of thousands of organizations every year, providing them with skilled talent while finding meaningful, sustainable employment for millions of people across a wide range of industries and skills. Our expert family of brands – Manpower, Experis, Talent Solutions, and Jefferson Wells – creates substantial value for candidates and clients across more than 75 countries and territories and has done so for over 70 years. We are recognized consistently for our diversity - as a best place to work for Women, Inclusion, Equality and Disability and in 2023 ManpowerGroup was named one of the World's Most Ethical Companies for the 14th year - all confirming our position as the brand of choice for in-demand talent.

ManpowerGroup is committed to providing equal employment opportunities in a professional, high quality work environment. It is the policy of ManpowerGroup and all of its subsidiaries to recruit, train, promote, transfer, pay and take all employment actions without regard to an employee's race, color, national origin, ancestry, sex, sexual orientation, gender identity, genetic information, religion, age, disability, protected veteran status, or any other basis protected by applicable law.

Similar jobs, posted recently

Open roles like this one, listed in the last 30 days.

You've read the whole posting — now see how you match it.