Skip to main content
Skip to footer

E.T.S. Research Institute: Opportunities and Challenges for Assessing Digital and AI Literacies

ETS scientists developed a human-centered AI (HAI) framework that combines data on how students interact with assessments—such as task navigation and time spent—with their performance, providing deeper insights into student performance in large-scale assessments.

  • The new human-centered framework offers a level of detail from large-scale assessments that was previously only achievable at a small scale.

    A view of a crowded classroom from the last row of seats. The background is blurred; the foreground shows a woman with her back to the camera, taking notes on her laptop.

    Read the highlights

    Download
{"id":"image-grid-1204285079","imageGridModuleTitle":"Meet the authors","contentViewer":"showAll","textAlign":"left","readMoreLabel":"Read more","readLessLabel":"Read less","imageGridModuleTheme":"ets-light","imageType":"image","contentCtas":[],"ctas":[],"imageGridCards":[{"imageGridCardEyebrow":"Hongwen Guo","imageGridCardImage":"/content/dam/ets-org/Rebrand/Photos/headshot-hongwen.jpg","imageGridCardImageAlt":"hongwen","imageGridCardImageTarget":false,"imageGridCardLongDescription":"\u003cb\u003eHongwen Guo\u003c/b\u003e\u0026nbsp;is a principal research scientist at ETS, specializing in statistical modeling and machine learning of multi-source data in measurement. She has led 40 research projects, published nearly 70 articles, and presented at numerous national and international conferences. Guo has also contributed to major educational measurement programs like the SAT® and PSAT®, earning the Bradley Hanson Award in 2019 for her innovative work on writing process modeling.\u0026nbsp;"},{"imageGridCardEyebrow":"Matthew S. Johnson","imageGridCardImage":"/content/dam/ets-org/Rebrand/Photos/MJohnson-headshot.jpg","imageGridCardImageAlt":"Johnson","imageGridCardImageTarget":false,"imageGridCardLongDescription":"\u003cb\u003eMatthew S. Johnson\u003c/b\u003e\u0026nbsp;is a principal research director at ETS, specializing in statistical methods for education and psychology, with a focus on item response theory. He returned to ETS in 2018 after a career in academia, including roles at Teachers College, Columbia University, and Baruch College. Johnson has served as co-editor of the Journal of Educational and Behavioral Statistics and authored the ETS guidelines on the responsible use of AI in assessments."},{"imageGridCardEyebrow":"Luis Saldivia","imageGridCardImage":"/content/dam/ets-org/Rebrand/Photos/headshot-luis-saldivia.png","imageGridCardImageAlt":"Saldivia","imageGridCardImageTarget":false,"imageGridCardLongDescription":"\u003cb\u003eLuis Saldivia\u003c/b\u003e\u0026nbsp;is a Strategic Advisor at ETS, specializing in assessment development, including the National Assessment of Educational Progress (NAEP), the Advanced Placement (AP) Statistics Test, the Graduate Record Examination (GRE) Mathematics Subject Test, the College-Level Examination Program (CLEP) College Algebra Test, and the Examen de Admisión a Estudios de Postgrado (EXADEP). He also led the ETS team that helped translate the Common Core State Standards-Mathematics (CCSS-M) for assessment purposes for the Partnership for Assessment of Readiness for College and Careers (PARCC), and more recently the translation of the NAEP Mathematical Practices for assessment purposes."},{"imageGridCardEyebrow":"Michelle Worthington","imageGridCardImage":"/content/dam/ets-org/Rebrand/Photos/headshot-michelle.jpg","imageGridCardImageAlt":"michelle","imageGridCardImageTarget":false,"imageGridCardLongDescription":"\u003cb\u003eMichelle Worthington\u003c/b\u003e\u0026nbsp;is an assessment development manager, specializing in assessment innovation with a focus on mathematics assessment design for K-12 and higher education. She has led cross-functional teams to design and implement new interactive components into assessments, such as graphing tools and simulations."},{"imageGridCardEyebrow":"Kadriye Ercikan","imageGridCardImage":"/content/dam/ets-org/Rebrand/Photos/KE-headshot.jpg","imageGridCardImageAlt":"kadriye","imageGridCardImageTarget":false,"imageGridCardLongDescription":"\u003cb\u003eKadriye Ercikan\u003c/b\u003e\u0026nbsp;is the Senior Vice President of Global Research at ETS and President/CEO of ETS Canada Inc. She is also the President of the International Testing Commission (ITC) and the International Academy of Education. Ercikan oversees ETS’s foundational and applied research and the delivery of large-scale assessments like the National Assessment of Educational Progress (NAEP), and the Programme for International Assessment of Adult Competencies. Her research addresses validity, and fairness of issues in assessments, AI applications and adaptivity. Ercikan has authored six books, four journal special issues and over 100 publications, she currently serves as the NCME Book Series Editor (2021-2026)."}]}