Hybrid Senior Research Scientist, Validity Research and Services Team

Posted 3 days ago

Apply now

About the role

  • Senior Research Scientist leading validity research studies for the College Board's assessments. Spearheading statistical analysis and designing educational research projects to enhance college readiness.

Responsibilities

  • Lead the initiation, design, development, and completion of high-quality research studies and projects that enhance College Board’s validity research and college and career readiness agenda
  • Lead the definition of projects of decisive importance to accomplish broader organizational goals
  • Author and contribute to publications including College Board Research Reports, Statistical Reports, Technical Memos/Manuals/Reports, peer reviewed journal articles, and other important documents
  • Develop the datasets for projects and the associated quality control (QC) of the dataset when developed by others
  • Determine the most effective methodologies to employ for studies and carry out rigorous analyses and interpretation of results
  • Remain up-to-date on advances in educational measurement, the college and career readiness and success literature, and validity research methods and approaches
  • Mentor junior staff members by reviewing analyses, providing methodological guidance, collaborating on impactful research ideas, and supporting high-quality research outputs
  • Serve as the primary analyst for many of the Digital SAT validity studies, including core placement, retention, completion, STEM outcomes, subgroup analyses, and institutional patterns
  • Conduct updated analysis and review of SAT Suite College & Career Readiness Benchmarks
  • Contribute to research-informed requests and response(s) to College Board Communications, College Board Senior Leadership, RFPs, external inquiries from researchers, and College Board Programs – e.g., SAT, AP, etc.
  • Synthesize research findings into clear information and deliverables for various stakeholders
  • When needed, support presentations translating complex concepts into clear language for the organization and public more broadly
  • Provide measurement research consultation to College Board programs to inform assessment operations and practices
  • Collaborate with educational institutions to conduct institution-specific validity studies and consult on related studies as needed

Requirements

  • Demonstrated ability to lead, design and conduct high quality educational research studies and statistical analyses
  • Strong knowledge of educational measurement and psychometrics; well-versed in test validity; knowledgeable about college outcomes as well as career/workforce outcomes
  • Excellent data coding, manipulation, and analysis skills; hands-on coding expertise in Python, R or SAS with a track record of producing analyses, rather than relying on others to execute core statistical work
  • Broad and deep methodological toolbox, including experience with multilevel modeling, experimental, and quasi-experimental methodologies, meta-analysis, and validity research methods
  • Superior written communication skills
  • Clear written communication and the ability to explain and present methods and results to technical and semi-technical audiences
  • Strong project management skills
  • Demonstrated ability to assume responsibility
  • Ability to work collaboratively with colleagues and creatively solve problems
  • Ability to mentor research staff
  • Familiarity with the history, debates, and public sensitivities surrounding standardized testing and SAT validity arguments
  • The ability to travel 3-5 times a year to College Board offices or on behalf of College Board business
  • Authorization to work in the United States for any employer

Benefits

  • Health insurance
  • 401(k) matching
  • Paid time off
  • Remote work options
  • Professional development opportunities
  • Annual bonuses and opportunities for merit-based raises and promotions

Job title

Senior Research Scientist, Validity Research and Services Team

Job type

Experience level

Senior

Salary

$120,000 - $175,000 per year

Degree requirement

Postgraduate Degree

Tech skills

Location requirements

Report this job

See something inaccurate? Let us know and we'll update the listing.

Report job