Senior Director, Psychometric Systems

Senior Director, Psychometric Systems 

College Board - Learning & Assessment  

Location: This is a remote role. Candidates who live near CB offices have the option of being fully remote or hybrid (Tuesday and Wednesday in office). All CB employees are required to occasionally travel to meet in person for business purposes. 

Role Type: This is a full-time position 

About the Team  

The Psychometrics Team supports College Board in serving more than seven million students a year as they prepare for a successful transition to college through programs and services in college readiness and college success. We provide our partners with measurement solutions that set the standard for quality, efficiency, and innovation through operational excellence and research leadership that advances the field of psychometrics and supports College Board’s mission of access and equity in education. Our team of Psychometricians and Research Statisticians collaborates deeply with other departments and divisions including, but not limited to Assessment Design & Development, College Readiness Assessments, Advanced Placement & Instruction, State & District Partnerships, and Technology. 

About the Opportunity   
Psychometrics is continuing to evolve as an implementation-driven organization, supporting a growing portfolio of products and initiatives. As the scale and complexity of this work increases – with advances in digital assessment, automated scoring, AI-enabled measurement --there is an opportunity to strengthen the operational backbone that enables consistent delivery, cross-product coherence, and future-focused evolution—while preserving deep product expertise and technical leadership. 

The Senior Director, Psychometrics Operations provides function-wide operational and people leadership to support this evolution. This role establishes prioritization mechanisms, builds a coherent cross-product operating model, and enables scalable implementation and modernization of psychometric practices. The Senior Director partners closely with Executive Directors, who serve as the technical leaders for psychometrics, to ensure work is delivered effectively and sustainably while creating space for forward-looking technical leadership. The scope of this role is intentionally focused on building sustainable operational infrastructure and people leadership capacity, rather than owning day-to-day technical delivery or product-specific decision-making. 

In this role, you will:  

Manage the Natural Language Measurement (NLM) / Automatic Scoring Team (AST) (40%) 

• Serve as the senior management leader for designated psychometrics staff, including the NLM/AST team. 

• Provide sustained people leadership as AES initiatives expand in scale and complexity. 

• Define and reinforce clear accountability, role clarity, and execution ownership. 

• Develop technical leaders and strengthen bench depth. 

• Manage workload sustainability and prioritize effectively across initiatives. 

• Partner with Executive Directors to align technical strategy with execution capacity. 

• Set vision and priorities for the team, track and mange progress to goals, and provide coaching and support to ensure team members meet and exceed goals, remain engaged, and contribute meaningfully to our mission. 

• Cultivate an inclusive and high-achieving culture that enables all team members to live out College Board’s Operating Principles effectively.  

• Bring proven leadership experience and consistently embody College Board’s Manager Expectations in your work 

Lead Execution & Demand Alignment Across Psychometrics (30%) 

• Provide senior oversight of execution priorities across the Psychometrics function, ensuring alignment with enterprise product goals and timelines. 

• Develop mechanisms to align incoming demand with available capacity, enabling sustainable delivery across multiple high-stakes assessment programs. 

• Strengthen transparency around risks, tradeoffs, and sequencing to support informed leadership decision-making. 

• Reinforce accountability, progress monitoring, and follow-through for major cross-program initiatives. 

• Ensure operational alignment between psychometric priorities and broader product and assessment delivery timelines. 

Strengthen Cross-Program Coordination & Scalable Practices (20%) 

• Improve coordination across major programs including SAT, AP, and Automated Scoring initiatives. 

• Identify opportunities to standardize operational practices, tools, and workflows where alignment reduces risk and increases efficiency. 

• Advance scalable implementation of psychometric capabilities across the portfolio, supporting consistency in measurement practices while preserving program-specific expertise. 

• Support the modernization of psychometric operations to enable emerging measurement approaches, including AI-enabled scoring and digital assessment. 

Leadership Operations & Program Support (10%) 

• Support Psychometrics leadership operations, including annual planning cycles, leadership forums, retreats, and internship programs. 

• Coordinate cross-functional initiatives that require alignment across psychometrics, research, and product teams. 

• Establish lightweight operational rhythms that improve transparency, strengthen decision-making, and accelerate execution across the function. 

About You  

 To qualify for this role, you must have: 

• Experience working closely with psychometric teams or in psychometrics-adjacent environments, with a strong understanding of how psychometric work is designed, implemented, and supported across products; experience may include operations or organizational leadership, but deep familiarity with psychometric practice is preferred over general program management. 

• 10+ years of experience in operations leadership, organizational enablement, or related roles in complex, technical, or analytics-driven environments. 

• Demonstrated ability to design and implement scalable operating models, processes, and systems that support both effective delivery and long-term capability building. 

• Experience operating across multiple products or portfolios and navigating competing priorities in matrixed organizations. 

• A strategic and inclusive leadership style, anchored in strong people leadership: you set clear priorities, build effective team structures, plan for future needs, and foster a culture of belonging. 

• A proven ability to drive performance and growth: you set high expectations, provide timely and evidence-based feedback, and coach team members to achieve meaningful impact. 

• Strong communication and stakeholder-management skills, including the ability to partner effectively with deep technical experts while providing operational clarity and alignment. 

• Ability to travel approximately 10 times per year (typically ~1.5 days per trip), representing roughly 5–10% of overall work time, to College Board offices or on behalf of College Board business. 

Exceptional candidates can effectively speak to:  

• Expertise in psychometrics-focused operations and leadership, with approximately 10+ years of experience supporting, leading, or enabling psychometric work in complex, implementation-driven environments (e.g., assessment programs, research/statistics teams, analytics organizations).  

• A strategic and inclusive leadership style, demonstrated through setting clear priorities, building effective team structures, planning for future needs, and fostering a culture of belonging. 

• A proven ability to drive performance and growth, demonstrated through setting high expectations, delivering real-time, evidence-based feedback, and coaching team members to take smart risks, stretch their skills, and achieve meaningful impact. 

• Content-specific and technical fluency relevant to psychometrics and analytics environments, including familiarity with psychometric workflows, process design, documentation standards, and the use of program and collaboration tools to manage complex, cross-functional work 

All roles at College Board require: 

• A passion for expanding educational and career opportunities and mission-driven work 

• Curiosity and enthusiasm for emerging technologies, with a willingness to experiment with and adopt new AI-driven solutions and comfort with learning and applying new digital tools independently and proactively.  

• Clear and concise communication skills, written and verbal 

• A learner's mindset and a commitment to growth: welcoming diverse perspectives, giving and receiving timely, respectful feedback, and continuously improving through iterative learning and user input. 

• A drive for impact and excellence: solving complex problems, making data-informed decisions, prioritizing what matters most, and continuously improving through learning, user input, and external benchmarking. 

• A collaborative and empathetic approach: working across differences, fostering trust, and contributing to a culture of shared success 

• Authorization to work in the United States 

About Our Process   

• Application review will begin immediately and will continue until the position is filled. This role is expected to accept applications for a minimum of 5 business days. 

• While the hiring process may vary, it generally includes: resume and application submission, recruiter phone/video screen, hiring manager interview, performance exercise such as live coding, a panel interview, a conversation with leadership and reference checks.    

What We Offer 

At College Board, we offer more than a paycheck- we provide a meaningful career, a supportive team, and a comprehensive package designed to help you thrive. We’re a self-sustaining nonprofit that believes in fair and competitive compensation grounded in your qualifications, experience, impact, and the market. 

A Thoughtful Approach to Compensation 

• The hiring range for this role is $120,000 - $175,000.  

• Your exact salary will depend on your location, experience, and how your background compares to others in similar roles at the College Board. 

• We aim to make our best offer upfront, rooted in fairness, transparency, and market data. 

• We adjust salaries by location to ensure fairness, no matter where you live. 

You’ll have open, transparent conversations about compensation, benefits, and what it’s like to work at College Board throughout your hiring process. Check out our careers page for more.