
AI Test Engineer II
Remote · USFull-time$125–150K/yrPosted todayStill listed today
Most applications go out cold — see where you stand first. No sign-up to start.
You apply on the employer's site, with no Olive account needed.
Watch jobs like this. New remote roles like this one, by email.
Don't just apply. Show up ready.
Olive works from this exact posting.
At a glance
Olive lists jobs from US employers, including remote roles you can work from the United States.
Job overview
The AI Test Engineer II validates the quality, reliability, and safety of AI-powered systems across TREND Health Partners’ platform. The role designs automated tests for APIs, user interfaces, security, and performance; integrates testing into CI/CD pipelines; and validates data and distributed-system interactions. It also collaborates with Engineering, QA, Product, and Operations on release validation, testing practices, and defect analysis.
Skills & qualifications
Skills
Qualifications
Benefits
Full job description
At TREND Health Partners, a tech-enabled payment integrity company, our mission is to facilitate collaboration between payers and providers for mutual benefit and waste reduction, ultimately improving access to healthcare. We achieve this by aligning the common goals of payers and providers and fostering collaboration through a shared technology platform and seamless workflows.
Joining TREND Health Partners means becoming a part of a dynamic growing organization that promotes a collaborative and innovative work environment. Our comprehensive compensation package includes competitive salaries, highly valued health insurance, a 401(k) plan with employer match, paid parental leave, and more.
The AI Test Engineer II's primary responsibility is validating the quality, reliability, and safety of AI powered systems across TREND's platform.
Role and Responsibilities Test Automation & Engineering
-
Design, build, and maintain automated test suites across API, UI, security, and performance/load testing
-
Develop end-to-end and integration tests using Playwright (or equivalent modern frameworks)
-
Author API tests for REST/GraphQL services, validating contracts, error handling, and edge cases
-
Build and maintain UI automation that is stable, maintainable, and resistant to flakiness
-
Integrate all test suites into CI/CD pipelines for continuous, automated validation
AI-Assisted Testing
-
Use AI-based coding and testing tools (Claude Code, Copilot, and similar) to generate, refactor, and scale tests
-
Establish patterns and best practices for using AI assistants effectively and safely in the testing workflow
-
Continuously evaluate emerging AI testing tools and bring the useful ones into the team's toolchain
Security & Performance Testing
-
Perform security-focused testing (authn/authz, input validation, common OWASP risks) as part of the release process
-
Design and run load and performance tests to validate scalability, latency, and resilience under stress
-
Identify bottlenecks and failure points and partner with Engineering on remediation
Data & Integration Validation
-
Validate data integrity across APIs, pipelines, and integrations using strong SQL and data-validation techniques
-
Test interactions between services, APIs, and downstream systems in distributed environments
-
Detect anomalies, regressions, and gaps across end-to-end workflows
Quality Process & Collaboration
-
Work cross-functionally with Engineering, QA, Product, and Operations
-
Participate in sprint planning, backlog refinement, and release validation
-
Contribute to testing standards, best practices, and documentation
-
Support root cause analysis for defects and production issues
Qualifications
-
Bachelor's degree in Computer Science, Engineering, or a related field, or equivalent experience
-
Experience in QA automation, test engineering, or a related software engineering role
-
Hands-on experience with a modern test automation framework (Playwright strongly preferred; Cypress, Selenium, or similar acceptable)
-
Experience testing APIs, distributed systems, and data pipelines
-
Strong understanding of software testing principles and test automation design
-
Strong SQL and data-validation skills
-
Experience integrating tests into CI/CD pipelines
-
Experience working in an Agile development environment
-
Experience with cloud-based systems, preferably AWS
-
Ability to analyze system behavior and identify root causes
Preferred Skills
-
Experience testing AI/ML models or data-driven systems
-
Experience validating AI-generated outputs or prompt-based systems
-
Familiarity with LLMs, agent workflows, or AI-assisted coding tools
-
Healthcare or regulated data environment experience (HIPAA, compliance)
-
Experience working with CI/CD and DevOps pipelines.
-
Experience using AI-assisted coding/testing tools (Claude Code, Copilot, or similar) in a real testing workflow
-
Experience with security testing and/or performance/load testing tools (e.g., k6, JMeter, OWASP ZAP)
-
Experience with CI/CD and DevOps pipelines• Healthcare or regulated-data environment experience, including HIPAA and compliance
-
Familiarity with AI/ML concepts (useful context, not the core focus of the role)
Mental And Physical Demands
-
This position will be exposed mainly to an indoor office environment and will be expected to work in or around computers and printers.
-
The nature of the work is sedentary, and the employee will be sitting most of the time.
-
Essential physical functions of the job include typing and the repetitive motion to utilize computer software and hardware continuously throughout the day.
-
Essential mental functions of this position include concentrating on analytical tasks, reading information, and verbal/written communication to others continuously throughout the day.
Related Duties As Assigned
- This job description documents the general nature and level of work but is not intended to be a comprehensive list of activities, duties, or responsibilities required for this position.
Consequently, employee’s may be asked to perform other duties as required.
-
Employees may also be asked to complete certain compliance requirements set forth by our Business Partners in the performance of their jobs including but not limited to requests for background and drug screenings and disclosures of personal health information or personally identifiable information. Exemptions as provided under the ADA and TITLE VII of the Civil Rights Act will be observed and followed.
-
Reasonable accommodations may be made to enable individuals with disabilities to perform the functions outlined above.
How this job compares
Set against the 2,966 open Test Engineer jobs on Olive Jobs, counted November 12, 2026.
- Pay
- This posting$125–150K/yr
- US median$100–160K/yr2,015 salary ranges
This range's midpoint, $138K, is 5% above the US median midpoint ($131K) — in the middle half of Test Engineer salary ranges across the US.
- Openings
- Olive Jobs lists 2,966 open Test Engineer jobs across the US. 1% of them nationwide are listed as remote or flexible.
- Hiring the most across the US
- Lockheed Martin197 open
- Northrop Grumman135 open
- RTX Corporation119 open
- Experience
- Test Engineer postings that state a minimum ask for 5 years of experience at the median; the middle half ask for 2 to 5 years (2,474 postings).
- Education
- 1,518 of the 2,966 open Test Engineer jobs (51%) ask for a bachelor's degree or higher.
Counted across the open, public US postings on Olive Jobs on November 12, 2026. Pay medians are the middle values of the low ends and of the high ends of postings that list both ends of a range in the same cadence (a yearly salary or an hourly rate); a range's midpoint is halfway between its ends. Pay and experience figures resting on fewer than 20 postings are left out.
Prepare for this role
You've read the whole posting — now see how you match it.