Measurement Scientist • Psychometrician • AI Evaluation
jdowneyphd@gmail.com
www.github.com/JonathanDowney
www.officehours.courses
Skills
Measurement & Validation: argument-based validity frameworks; psychometric modeling (IRT/Rasch; multilevel); measurement invariance & construct stability; mixed-method validation design.
Model Evaluation: end-to-end evaluation pipeline design; cross-LLM benchmarking/model comparison; experiment tracking; reliability, transfer, and uncertainty estimation; Monte Carlo, bootstrap, and power analysis workflows.
Statistical Computing: R, Python, STAN; reproducible and scripted data processing; large-scale batch workflows.
Software & Infrastructure: PostgreSQL schema design; REST APIs and microservices; Docker; AWS; CI/CD (GitHub Actions); analytics dashboards; unit testing and static type checking.
Online Learning: Moodle, Canvas, Gradescope.
Languages
English: Native speaker (C2+)
Spanish: Fluent (C2)
French: Advanced (B2)
German: Intermediate (B1)
Basque, Arabic (Moroccan): Advanced beginner (A2)
Jonathan Downey is a postdoctoral measurement scientist and educational research scholar with New Meridian Corporation through Carnegie Mellon University’s Enhance Fellowship. He holds a PhD in Education (Quantitative Methods) from the Gevirtz Graduate School of Education at the University of California, Santa Barbara. His research focuses on argument-based validity, psychometrics , and the evaluation of large-scale assessments. He currently leads and a statewide validation study of Montana's MAST through-year assessment system, integrating statistical, survey, and qualitative evidence to offer actionable public policy recommendations.
In addition to large-scale assessment research, his work examines how AI-assisted tools can support measurement tasks such as item classification and reporting, and what evidence is required to justify their use across contexts. He previously studied Applied Linguistics at the University of the Basque Country (M.A.). He has taught statistics, ESL, and high school Spanish in both domestically and internationally.
PhD in Education: Quantitative Methods in the Social Sciences
MA in Language Acquisition in Multilingual Settings
BA in Economics, BA in Spanish Literature
"Hidden Dangers in L2 Assessment: Issues of Reliability and Validity"
"Encouraging Learner Engagement with Peer Feedback"
"Sociocultural Strategies and Digital Tools for Minority Language Instruction"
"Visual Feedback: An Easier Way to Improve Pronunciation"