The quest for using data to inform educational decision making and practice is not new (Mandinach, 2012), write Professor James Tognolini and Rayanne Shakra of the Centre for Educational Measurement and Assessment, University of Sydney
This quest for data was heightened during COVID-19 when there was a real probability that there would not be Year 12 external examinations in several states; the question that was being considered was what can we do to produce scores for secondary certification if it is not possible to run the Year 12 HSC examination (or equivalent)?
The solution, in every case, was that we can use the judgement of teachers because they know their students and the content of the courses better than anyone else and would give a more valid estimate than any algorithm can generate.
The focus for this article is on how teachers interact with data on a day-to-day basis to produce the evidence that is integral to the process of teaching and learning.
“Assessment involves professional judgement about student performance with respect to a continuum of development and is based upon the image formed of the student by the collection of evidence” (Tognolini & Shakra, 2021, p17).
The key part to this definition is that teachers build images of what their students know and can do based upon data or evidence they collect from various assessments. This image is then used to track student progress through syllabi that have been designed to describe growth through an areaof learning.
Teachers constantly assess and process data in their day-to-day interactions with students. Data are “any information that helps educators know more about their students” (Wayman, 2013, p29) and which can be codified in some manner to facilitate systematic analysis (Schildkamp & Kuiper, 2010).
We can see that data are prevalent in every classroom situation. Data are more than test scores (Lai & Schildkamp, 2012). They help teachers make connections that lead to insights and improved student learning.
Typical classroom
Figure 1 (above) shows a snapshot which is replicated in most classrooms around the world at any one time resonating with every teacher of every subject.
Any teacher in the situation presented in Figure 1 would notice that the class seem very engaged; that one student in the left-hand corner seems to be distracted, that some of the students have their hands up, but are looking down at their books (which probably means they do not want to be asked) etc.
We would argue that teachers process these data constantly by focusing on an aspect, taking the resulting data back to the ‘image’, processing these in terms of their expectation based on the image and then making an informed judgment about what they are going to do.
For example, the teacher might focus on the student in the left-hand corner of the photograph. This piece of data we would call information. It is processed something like ‘he is a good student (based on all the evidence you have about this student. I will not draw attention to him on this occasion because I know he knows the answer and he is’.
This is an instance where teachers assess their students’ engagement levels. Teachers might have already formed an image of who will be excited to tell her the answer to a particular question and who might not.
Data that are in Figure 1 might or might not be new information to the teacher. The image unfolds in the classroom through the interactions and ongoing informal data that teachers choose to interact with. It is this contextual aspect of assessment that makes it highly influential in the teaching and learning process. We would argue that this is formative assessment; that teachers are formatively assessing and processing such information all the time. Therefore, formative assessment is closely integrated with teaching.
Teachers in every classroom are at the centre of the assessment process. They use their professional judgement when they interpret data, as well as to decide when and what data to collect and analyse. An important point here is that the data need to provide evidence to inform the image from a wide range of data sources.