DataCamp logo

Head of Assessment and Certification Content

DataCamp

United StatesJobNo compensation foundPosted 3w agoVerified open 3 days ago

Most applications go out cold — see where you stand first. No sign-up to start.

At a glance

Compensation
No compensation found
Location
United States
Work Authorization
Not specified

Job overview

DataCamp is hiring a Head of Assessment and Certification Content. The Head of Assessment and Certification Content will lead the design, production, and continuous improvement of DataCamp's assessment and certification materials, collaborating with subject‑matter experts and cross‑functional teams while building AI‑driven workflows to scale high‑quality, defensible questions.

Key focus areas include Own end‑to‑end lifecycle for assessment and certification content from blueprint to maintenance, Design psychometrically sound assessments, write and review items, and define scoring standards, and Build and operate AI workflows that draft, grade, and quality‑check assessment items.

Important skills include Data Science, Machine Learning, Psychometrics, Collaboration, Software Project Management, and Assessment Design. Preferred (not required): DataCamp Courses, DataCamp Assessments, DataCamp Certifications, and Building Sophisticated AI Systems.

Skills & qualifications

RequiredNice to have

Skills

Data ScienceMachine LearningPsychometricsCollaborationSoftware Project ManagementAssessment DesignItem WritingScoringStandard-SettingValidity PrinciplesReliability PrinciplesFairness PrinciplesAgentic AI SystemsClaude CodeCursorReplitBuilding AI Automation SystemsDataCamp CoursesDataCamp AssessmentsDataCamp CertificationsBuilding Sophisticated AI SystemsAI WorkflowsCertification Landscape in Data and AI

Qualifications

Technical Background in a STEM FieldExperience Evaluating Technical CompetencyProven Experience Building or Running Technical Assessments or Certification ProgramsGrasp of Skills Hiring Managers Screen for in Data and AI RolesIncreased Output 10x With AIGraduate Degree in a Related STEM Discipline or Equivalent Industry Experience With Hands-on Expertise in Data Science, Machine Learning, or Software Development

Full job description

About DataCamp

Data and AI skills are critical for thriving today, and DataCamp is the platform that empowers everyone to learn them. We help individuals and Fortune 1000 companies close the data and AI skills gap through world-class learning, hands-on training, and a global community of expert instructors.

In this role, you'll collaborate with instructors and teams across curriculum, engineering, product, and marketing to build and scale the assessments and certifications that prove those skills—helping millions worldwide validate what they've learned and signal it to employers.

About the role

This is an individual contributor role. You will own the design and production of DataCamp's assessment and certification content, working with subject-matter experts and building AI systems that generate, review, and continuously refresh high-quality, defensible questions at scale. Here's what your day-to-day will look like:

  • Own the end-to-end lifecycle for assessment and certification content—from blueprint and item design through review, publication, and ongoing maintenance—and manage deadlines across it.

  • Design psychometrically sound assessments: write and review items, define scoring and passing standards, and safeguard validity, reliability, and fairness.

  • Build and operate AI workflows—prompting, pipelines, and evaluation—that draft, grade, and quality-check items, so content production scales without sacrificing rigor.

  • Source and collaborate with subject-matter experts to keep certifications current with the fast-moving data and AI landscape.

  • Map certifications to the real skills hiring managers screen for, so a DataCamp credential is a credible signal to employers.

  • Benchmark against the wider certification landscape—competing programs, industry standards, and emerging role definitions—and set the strategy for where our certifications go next.

  • Continuously assess certification performance using pass rates, item statistics, and learner and employer feedback to drive improvements. Qualifications:

  • A technical background in a STEM field—such as Computer Science, Data Science, AI, Statistics, or Engineering—paired with experience evaluating technical competency (e.g., designing coding assessments, technical interviews, certification exams, or graded coursework), so you can judge whether an assessment item is accurate and genuinely tests skill.

  • Demonstrated expertise in assessment design—item writing, scoring, standard-setting, and the validity, reliability, and fairness principles behind credible certification—with proven experience building or running technical assessments or certification programs.

  • A clear grasp of the skills hiring managers actually screen for in data and AI roles, and how to translate them into what a certification measures.

  • Strong experience with agentic AI systems such as Claude Code, Cursor, or Replit, and building AI automation systems. You can demonstrate you've increased your output 10x with AI.

  • Graduate degree (Master's or PhD) in a related STEM discipline, or equivalent industry experience with hands-on expertise in data science, machine learning, or software development. Bonus if you have the following:

  • A deep understanding of the DataCamp courses, assessments, and certifications.

  • An extensive track record of building sophisticated AI systems and workflows.

  • An understanding or interest in the current certification landscape in data and AI: how leading programs are structured, where they fall short, and what makes a credential respected by employers.

You've read the whole posting — now see how you match it.