Senior Research Scientist leading validity research studies for the College Board's assessments. Spearheading statistical analysis and designing educational research projects to enhance college readiness.
Responsibilities
Lead the initiation, design, development, and completion of high-quality research studies and projects that enhance College Board’s validity research and college and career readiness agenda
Lead the definition of projects of decisive importance to accomplish broader organizational goals
Author and contribute to publications including College Board Research Reports, Statistical Reports, Technical Memos/Manuals/Reports, peer reviewed journal articles, and other important documents
Develop the datasets for projects and the associated quality control (QC) of the dataset when developed by others
Determine the most effective methodologies to employ for studies and carry out rigorous analyses and interpretation of results
Remain up-to-date on advances in educational measurement, the college and career readiness and success literature, and validity research methods and approaches
Mentor junior staff members by reviewing analyses, providing methodological guidance, collaborating on impactful research ideas, and supporting high-quality research outputs
Serve as the primary analyst for many of the Digital SAT validity studies, including core placement, retention, completion, STEM outcomes, subgroup analyses, and institutional patterns
Conduct updated analysis and review of SAT Suite College & Career Readiness Benchmarks
Contribute to research-informed requests and response(s) to College Board Communications, College Board Senior Leadership, RFPs, external inquiries from researchers, and College Board Programs – e.g., SAT, AP, etc.
Synthesize research findings into clear information and deliverables for various stakeholders
When needed, support presentations translating complex concepts into clear language for the organization and public more broadly
Provide measurement research consultation to College Board programs to inform assessment operations and practices
Collaborate with educational institutions to conduct institution-specific validity studies and consult on related studies as needed
Requirements
Demonstrated ability to lead, design and conduct high quality educational research studies and statistical analyses
Strong knowledge of educational measurement and psychometrics; well-versed in test validity; knowledgeable about college outcomes as well as career/workforce outcomes
Excellent data coding, manipulation, and analysis skills; hands-on coding expertise in Python, R or SAS with a track record of producing analyses, rather than relying on others to execute core statistical work
Broad and deep methodological toolbox, including experience with multilevel modeling, experimental, and quasi-experimental methodologies, meta-analysis, and validity research methods
Superior written communication skills
Clear written communication and the ability to explain and present methods and results to technical and semi-technical audiences
Strong project management skills
Demonstrated ability to assume responsibility
Ability to work collaboratively with colleagues and creatively solve problems
Ability to mentor research staff
Familiarity with the history, debates, and public sensitivities surrounding standardized testing and SAT validity arguments
The ability to travel 3-5 times a year to College Board offices or on behalf of College Board business
Authorization to work in the United States for any employer
Benefits
Health insurance
401(k) matching
Paid time off
Remote work options
Professional development opportunities
Annual bonuses and opportunities for merit-based raises and promotions
Job title
Senior Research Scientist, Validity Research and Services Team
Senior Research Assistant conducting research in eye regeneration using molecular tools and model organisms. The role involves CRISPRCas technology and various biological techniques.
Senior Researcher in the Greater London Authority providing policy support through research and drafting reports. Collaborating with Labour Assembly Members on housing and environment portfolios at City Hall.
Post - doctoral Research Fellow conducting research on data analytics methods for bipolar disorders. Part of the University of Edinburgh’s Centre for Medical Informatics team.
Assisting in the creation of training materials for legal topics and conducting training sessions. Collaborating with experienced colleagues to enhance training contents at KINAST Innovations in a part - time role.
Research Scientist at DeepL conducting research on neural translation networks and developing AI technologies. Collaborate with a diverse, international team in a hybrid work model.
Senior Applied Scientist designing and delivering AI solutions to enhance products at Thomson Reuters. Leading model development and collaborating with stakeholders in agile environments.
Student Research Assistant assisting Faculty with literature reviews and skill development training at Bow Valley College. Requires current enrollment as a student at Bow Valley College.
Assistente de Pesquisa & Inovação em empresa química colaborando com equipes e realizando análises. Focados em inovação e preservação do planeta com soluções químicas.
Foundational AI Research Scientist developing next - generation language models. Pioneering large - language - model architectures and attention mechanisms for efficient scaling.
Research Scientist specializing in NLP and deep learning at NVIDIA. Propose innovative model architectures and publish research findings while collaborating with diverse teams.