Chapter The joint estimation of accuracy and speed: An application to the INVALSI data
In Italy, the National Institute for the Evaluation of the Education and Training System (INVALSI) every year administers standardized tests via computer-based testing (CBT) to students attending grades 8, 10, and 13. The CBT mode allows to collect data not only on the students’ response accuracy (R...
সংরক্ষণ করুন:
| প্রধান লেখক: | , , , |
|---|---|
| বিন্যাস: | Online |
| ভাষা: | ইংরেজি |
| প্রকাশিত: |
Firenze University Press, Genova University Press
2023
|
| বিষয়গুলি: | |
| অনলাইন ব্যবহার করুন: | ONIX_20230803_9791221501063_107 |
| ট্যাগগুলো: |
কোনো ট্যাগ নেই, প্রথমজন হিসাবে ট্যাগ করুন!
|
| _version_ | 1869524026780549120 |
|---|---|
| author | Bungaro, Luca Desimoni, Marta MATTEUCCI, MARIAGIULIA MIGNANI, STEFANIA |
| author_browse | Bungaro, Luca Desimoni, Marta MATTEUCCI, MARIAGIULIA MIGNANI, STEFANIA |
| author_facet | Bungaro, Luca Desimoni, Marta MATTEUCCI, MARIAGIULIA MIGNANI, STEFANIA |
| author_sort | Bungaro, Luca |
| collection | Directory of Open Access Books |
| description | In Italy, the National Institute for the Evaluation of the Education and Training System (INVALSI) every year administers standardized tests via computer-based testing (CBT) to students attending grades 8, 10, and 13. The CBT mode allows to collect data not only on the students’ response accuracy (RA) based on item responses, but also on their response times (RT). By using these data, it is now possible to estimate the speed ability of examinees, besides the usual ability (e.g. Italian language, mathematics or English ability). In this study, we use the 2018 mathematics data for grade 10 to estimate the ability and speed of students following the fully Bayesian approach of Fox et al. (2021), who implemented in the R package LNIRT the models of van der Linden (2007) and Klein Entik et al. (2009). In a second step, we use the estimated mathematics ability and speed in a bivariate multilevel model, where the first-level units are represented by students and the second-level units are represented by classes. Covariates such as gender, school type, immigrant status, economic, social, and cultural status, prior achievement, grade retention, student anxiety, class compositional variables, and geographical area are included in the model. The main results show that the ability and speed are inversely proportional, e.g. as ability increases, speed decreases. Also, differences in the students performance by gender and school type are significant for both ability and speed. |
| format | Online |
| id | doab-20.500.12854ir-112309 |
| institution | Directory of Open Access Books |
| language | eng |
| publishDate | 2023 |
| publishDateRange | 2023 |
| publishDateSort | 2023 |
| publisher | Firenze University Press, Genova University Press |
| publisherStr | Firenze University Press, Genova University Press |
| record_format | ojs |
| spelling | doab-20.500.12854ir-1123092025-07-17T09:59:58Z Chapter The joint estimation of accuracy and speed: An application to the INVALSI data Bungaro, Luca Desimoni, Marta MATTEUCCI, MARIAGIULIA MIGNANI, STEFANIA educational assessment large standardized test mathematics achievement IRT models for response times multilevel models thema EDItEUR::J Society and Social Sciences thema EDItEUR::J Society and Social Sciences In Italy, the National Institute for the Evaluation of the Education and Training System (INVALSI) every year administers standardized tests via computer-based testing (CBT) to students attending grades 8, 10, and 13. The CBT mode allows to collect data not only on the students’ response accuracy (RA) based on item responses, but also on their response times (RT). By using these data, it is now possible to estimate the speed ability of examinees, besides the usual ability (e.g. Italian language, mathematics or English ability). In this study, we use the 2018 mathematics data for grade 10 to estimate the ability and speed of students following the fully Bayesian approach of Fox et al. (2021), who implemented in the R package LNIRT the models of van der Linden (2007) and Klein Entik et al. (2009). In a second step, we use the estimated mathematics ability and speed in a bivariate multilevel model, where the first-level units are represented by students and the second-level units are represented by classes. Covariates such as gender, school type, immigrant status, economic, social, and cultural status, prior achievement, grade retention, student anxiety, class compositional variables, and geographical area are included in the model. The main results show that the ability and speed are inversely proportional, e.g. as ability increases, speed decreases. Also, differences in the students performance by gender and school type are significant for both ability and speed. 2023-08-08T07:19:49Z 2023-08-08T07:19:49Z 2023-08-03T15:06:32Z 2023 chapter ONIX_20230803_9791221501063_107 2704-5846 https://library.oapen.org/handle/20.500.12657/74911 9791221501063 https://directory.doabooks.org/handle/20.500.12854/112309 eng Proceedings e report open access image/png image/jpeg Attribution 4.0 International Attribution 4.0 International https://library.oapen.org/bitstream/20.500.12657/74911/1/9791221501063-39.pdf https://library.oapen.org/bitstream/20.500.12657/74911/1/9791221501063-39.pdf Firenze University Press, Genova University Press 10.36253/979-12-215-0106-3.39 10.36253/979-12-215-0106-3.39 74113d79-2268-4658-88bb-6e8757c543b0 ASA 2022 Data-Driven Decision Making 9791221501063 6 Florence open access |
| spellingShingle | educational assessment large standardized test mathematics achievement IRT models for response times multilevel models thema EDItEUR::J Society and Social Sciences thema EDItEUR::J Society and Social Sciences Bungaro, Luca Desimoni, Marta MATTEUCCI, MARIAGIULIA MIGNANI, STEFANIA Chapter The joint estimation of accuracy and speed: An application to the INVALSI data |
| title | Chapter The joint estimation of accuracy and speed: An application to the INVALSI data |
| title_full | Chapter The joint estimation of accuracy and speed: An application to the INVALSI data |
| title_fullStr | Chapter The joint estimation of accuracy and speed: An application to the INVALSI data |
| title_full_unstemmed | Chapter The joint estimation of accuracy and speed: An application to the INVALSI data |
| title_short | Chapter The joint estimation of accuracy and speed: An application to the INVALSI data |
| title_sort | chapter the joint estimation of accuracy and speed an application to the invalsi data |
| topic | educational assessment large standardized test mathematics achievement IRT models for response times multilevel models thema EDItEUR::J Society and Social Sciences thema EDItEUR::J Society and Social Sciences |
| topic_facet | educational assessment large standardized test mathematics achievement IRT models for response times multilevel models thema EDItEUR::J Society and Social Sciences thema EDItEUR::J Society and Social Sciences |
| url | ONIX_20230803_9791221501063_107 |
| work_keys_str_mv | AT bungaroluca chapterthejointestimationofaccuracyandspeedanapplicationtotheinvalsidata AT desimonimarta chapterthejointestimationofaccuracyandspeedanapplicationtotheinvalsidata AT matteuccimariagiulia chapterthejointestimationofaccuracyandspeedanapplicationtotheinvalsidata AT mignanistefania chapterthejointestimationofaccuracyandspeedanapplicationtotheinvalsidata |