Post

New Blog Post 📝 I hate QLA. Originally due to the time it sucked out of my PPA I now know that QLA documents do not provide the information we think they do. I go over the justification for why I ditched QLA and the reasons why you should get rid of it too. open.substack.com/pub/joel1201...

open.substack.comDeath to the Spreadsheet: Why I Finally Ditched QLAQuestion Level Analysis (QLA) is a staple in many schools. It is designed to turn exam results into a roadmap for student progress. But does it actually lead us where we need to go?

5 reposts12 likes

I use it as a way to record scores so that we don’t write on students papers (Maths). This leads to much better engagement from all students when we deliver the feedback sessions.

I remember reading this a while ago, it's the main reason why I hate things like QLA, hinge questions, exit tickets etc. They just arent telling us, well, anything tbh. It also made me question exam feedback... Id probably get rid of it entirely and treat an exam as a data task if I had the choice

Agree with this, I ditched this kind of QLA a while ago for reasons you've given. What I do now is a much more 'qualitative' QLA - make notes as I'm marking to identify those 'high leverage' issues to address, and drip-feed my feedback.

I'm not convinced this is 'saving' me time as such, my hunch is it still takes as long as the old-style quant QLA did, but it's just now time that's actually worthwhile spending rather than 'make-work' because it is more likely to help me help students improve.

Like anything else, I think it depends how you use it, and what you want from it. If I do a high-level overview of a cohort, and learn that they all struggle with the same *type of question*, then we can adjust teaching and structures to focus our scaffolds there (e.g. targeting 9m essays at GCSE)

But that's also about subject-specificity, which I think is much more important than popularly gets credit. What works in English won't always work in Science, or Geography or Mathematics. If I'm using QLA properly, and I know what I'm doing it for, it can make a plan more effective.

If I use it because I feel I have to, or I'm doing it for someone else's purposes, or I don't really understand what I should be doing with it, then it will not be effective, and will be a waste of time. But... show me something in life (let alone education) where that's not true!

No, as I train them up I just give them the mark scheme and have them make notes. With my year 10s, at the beginning of the course, I do the exam in front of them, using a visualiser, to model exam technique. But then, they must take ownership of their understanding.

Could have told you that 20 years ago. The fundamental problem is that summative exams are sampling student learning. You can’t ‘plug gaps’. Trying to do so is plain stupid.

Our MAT is introducing QLA after assessments ‘to help to diagnose strengths and weaknesses in teaching between our schools. Found this blog very interesting. Do you know of any other reading I can do about QLA please?

This does seem to be a growing trend of more and more QLA but weirdly, I found the reading quite scarce on it. Which I find concerning. We have a bunch of people bringing in QLA but with nothing to actually base it off and especially no rationale.

Even if you loo for academic studies, they use QLA and have quantifiers for it, however, there is no research on if the process as a whole actually works. Which is what prompted me to write this post in the first place. So in short, unfortunately nothing past a quick Google.