AI SDET

Job Description

We are hiring an AI SDET (Software Development Engineer in Test) to independently validate that our AI models are actually correct — and to automate that validation so it runs continuously as our model portfolio grows. This is the person who builds the golden tests, runs the evaluations, and produces the evidence that lets Trimedx stand behind every AI decision it ships. You will own the execution of model validation within an enterprise AI governance framework, working alongside data science, DevOps/MLOps, and security.

Skills and Requirements

Test automation & CI/CD Build automated test frameworks; wire evaluation into pipelines; make tests run on every change Must-have Strong programming (Python) Production-quality code — the test infrastructure others depend on, not throwaway scripts Must-have SQL & data validation Read/write non-trivial SQL; validate a generated query against an independent one; work in Snowflake Must-have ML/LLM evaluation literacy Understand drift, hallucination/groundedness, LLM-as-judge, retrieval vs. generation failure modes Must-have Applied statistics Confidence intervals, paired comparisons, sample-size reasoning — enough to make evaluation honest Strong plus Observability / monitoring Build production dashboards and alerting for drift and guardrail breaches; think in SLOs Strong plus LLM eval frameworks Snowflake Cortex evaluations, TruLens, DeepEval, RAGAS or similar Strong plus Healthcare / regulated data Prior exposure to HIPAA-adjacent or regulated environments; understands why evidence & auditability matter Nice to have Security testing awareness Prompt-injection and data-leakage testing basics; partners with SecOps Nice to have

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal employment opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment without regard to race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request to [email protected].