The College Board logo

Senior Manager, Psychometric Operations & Data Science

The College Board

NEW YORK, NY · HybridFull-timeSeen todaySeen in employer's feed today

Most applications go out cold — see where you stand first. No sign-up to start.

Watch jobs like this.

At a glance

Compensation
No compensation found
Location
NEW YORK, NYHybrid
Schedule
Full-time
Work Authorization
Not specified

Olive lists jobs from US employers, including remote roles you can work from the United States.

Job overview

The College Board’s Research & Measurement team supports scientifically rigorous assessments across Latin America. The Director, Psychometric Data Operations leads operational execution and improvement of psychometric data workflows, including scoring cycles, validation, and reporting readiness. The role partners with psychometricians and cross-functional teams to make processes accurate, reproducible, well-documented, and timely, while identifying opportunities for automation and responsible use of AI-enabled tools.

Skills & qualifications

RequiredNice to have

Skills

Psychometric OperationsScoring Cycle ManagementItem AnalysisItem CalibrationScoring ValidationEquatingScalingForm RotationStatistical ValidationData ValidationQuality AssuranceWorkflow AutomationAI-Enabled Tools

Full job description

External Title: Senior Manager, Psychometric Operations & Data Science Internal Title: Director, Psychometric Operations & Data Science College Board - Global Strategy and Talent, College Board LATAM Location: Hybrid- San Juan, Puerto Rico. This is a hybrid role and requires the candidate to be on-site at College Board offices every Tuesday and Wednesday and as per business needs. Remote: The search is also extended to include candidates working remotely from Continental USA . Role Type: This is a full-time position. About the Team College Board LATAM is committed to expanding educational opportunity and advancing evidence-based decision-making across the region. As part of the Research & Development division, the Research & Measurement team ensures that our assessments are scientifically rigorous, operationally sound, and aligned with our mission to expand educational opportunities across the region. We work at the intersection of psychometrics, data science, and applied research, guiding how our assessments are designed, scored, analyzed, and continuously improved. Our team ensures that research and measurement practices are transparent, defensible, reproducible, and grounded in robust methodological standards. R&M collaborates closely with internal teams - including Test Design & Development, Technology, Assessment Operations, Scoring, Reporting, and Market Development - as well as external stakeholders such as institutions, ministries, and research partners to support high-quality assessment programs across Latin America. As we modernize our assessment workflows and strengthen our data capabilities, we are seeking a hands-on director who can lead psychometric operations, improve assessment data workflows, and ensure that scoring and reporting processes are accurate, efficient, reproducible, and scalable. About the Opportunity The Director, Psychometric Data Operations will lead the operational execution and continuous improvement of psychometric data workflows for College Board LATAM assessments. This role sits at the intersection of assessment operations, psychometrics, data science, and technology. In this role, you will manage scoring cycles, improve psychometric data workflows, strengthen quality assurance processes, and help modernize item analysis, calibration, scoring, and reporting data processes. You will be responsible for ensuring that psychometric operations are accurate, reproducible, well-documented, and delivered on schedule. This is a highly hands-on role. You will work directly with data, analyses, validation routines, and scoring files while also influencing how work is structured across Research & Measurement, Technology, Scoring, and Reporting. You will partner with psychometricians on technical direction for scaling, equating, calibration, and form processes, while owning the operational execution, documentation, QA, and workflow reliability needed to support those processes. You will also help identify opportunities to reduce manual work, improve automation, and responsibly apply AI-enabled tools to strengthen QA, anomaly detection, documentation, and operational efficiency. This role does not own enterprise data governance or technology infrastructure, but it will help define operational requirements and promote strong data practices within R&M and across cross-functional assessment workflows. Key Responsibilities Psychometric Operations - 55% Manage recurring scoring cycles, ensuring that scoring, analysis, validation, and reporting readiness activities meet defined timelines, accuracy expectations, and QA standards. Execute and oversee psychometric data workflows related to item analysis, item calibration, scoring validation, equating support, reporting file readiness, and post-administration review. Partner with psychometricians to operationalize technical guidance for scaling, equating, calibration, form rotation, and scoring rules. Run, review, and improve statis ical and data validation checks

Similar jobs, posted recently

Open roles like this one, listed in the last 30 days.

You've read the whole posting — now see how you match it.