Post

New paper just published open access in Educational Assessment, Evaluation and Accountability: link.springer.com/article/10.1...

link.springer.comWhen technical standards fail. Questionnaire wording and the comparability of PISA truancy data - Educational Assessment, Evaluation and AccountabilityThis paper presents a case study of how an undetected wording change in the OECD’s Programme for International Student Assessment (PISA) may have led to erroneous conclusions. We focus on a survey que...

3/8/26, 12:54 pm1 repost4 likes

Jake Anders

@jakeanders.uk

3 Aug

Do you know the survey question that was used to generate the data you are analysing? Are you sure? Because many people probably thought they were sure about the questions on student truancy in PISA data.

Jake Anders

@jakeanders.uk

3 Aug

However, in some countries, in some years, these changed in ways that were never mentioned in international documentation and could only be spotted by wading through copious national documentation.

Jake Anders

@jakeanders.uk

3 Aug

The change from "skipped a whole day of school" to "missed a whole day of school" changes the meaning rather a lot, likely from truancy to absence for any reason. Read all about this cautionary tale in our new paper: link.springer.com/article/10.1...