Practicing the Art of the Data Chat

School leaders across the country are gearing up to meet with teachers for “data chats” about their students’ latest progress monitoring assessment results. For many, it will be the first quantitative evidence of how effective instruction has been this fall in comparison to years’ past.

In a best-case scenario, the teacher and leader will use the time to build a shared understanding of what conclusions can and cannot be drawn from the data at hand. They will offer hypotheses as to why the outcomes are as they are and test them using the evidence available. And then they will land on one or two clear actions they can each take in response to what they have learned.

However, we have witnessed how easy it is for these conversations to go off the rails, particularly when results are not what we hoped for.

Data chats are somewhat of an art form that require skill, not only in data analysis, but in human psychology, not to mention a solid understanding of what high quality instruction looks like in a given grade and subject.

It would not be wise to “wing it” with these crucial conversations. But we recognize leaders have precious few moments to thoroughly prepare. So the prep time must be strategic.

First and foremost, decide which essential question teachers need to be able to ask and answer.

In our opinion, the most important question for teachers is whether core instruction is effective and for whom (i.e., which subgroups and individual students).

Think about what data are necessary to answer the essential question. Prioritize a short list of visuals that are easy to read and offer context (e.g., multiple year trajectory, comparisons to other like students). Provide these to your teacher in advance of the conversation so you both have time to reflect on the same information.

We recommend that leaders come to the table with some hypotheses based on their review of the evidence, but to open the floor to the teacher first. After setting a clear purpose for the meeting, the principal might pull up the first key visual and ask the teacher “What overarching patterns do you notice?” followed by “Which groups of students seem to be responding to core instruction and which do not?”

Asking this broad question will be revelatory. Rightly so, teachers will have questions, complaints, misunderstandings, and fears that need to be acknowledged and addressed. They will also have ideas you hadn’t thought of yet, some that may serve to affirm or challenge your own hypotheses, and others that are simply distractions. To avoid going down unhelpful rabbit holes and instead work toward a defensible set of conclusions, the leader must commit to using the evidence available to test any theories or assertions made.

For example, a teacher might say “My students who are learning from home are testing at a higher level than my students in class. I think they are getting help from their parents.” Fair enough, what data can we look at to test that hypothesis? And more importantly, what will we do with the information? How will it inform our instructional choices and future conversations with students and parents?

To guide this part of discussion effectively, leaders need to know the priority data sets and how to navigate and talk about them accurately. This takes practice, and it is much harder to do in the moment, particularly if the teacher is upset or defensive. The more muscle memory you have around the technical aspects of the data, the more present you can be for the human interaction around it.

Which leads to our second piece of advice: practice navigating and helping another person make sense of the data sets you have prioritized. It is one thing to look at a graph or chart and know what it means in your head and a very different thing to explain it out loud. Role play with another administrator who is familiar with the data as well as with a friend or colleague who isn’t. Ask them for feedback on your explanation and tone. This will help you become more aware of what you say that is unhelpful, to recognize misconceptions, and to redirect (gently, but confidently) when others draw inaccurate conclusions.

It can be easy to allow vague and unhelpful statements to float in the air unchallenged. As a non-example, if a data visual shows an overall negative trend in a particular classroom, the teacher might say “My students are doing awful.” This kind of judgmental statement is not only inaccurate but potentially harmful to the psyche of the teacher and the students by reinforcing negative expectations. The leader must be ready to help the teacher interpret the data more precisely.

For example, the principal might say, “When I read the labels on the page I see that, on average, students in this classroom are learning at a slower pace than their national peers. This is driven largely by the higher-achieving students.” There is no judgment or emotion in this statement, but it is actionable. If the teacher knows which groups of students are least well-served by the current state of affairs, they will be better equipped to problem solve.

Finally, it’s important to show your teachers and yourself grace. After observing hundreds of data chats, it is fair to say no two are identical. It would be difficult for anyone to be ready for all contingencies. Make it your goal to guide the teacher through a humane confrontation with reality and land on a mutual commitment to act. The process may be messy, but if you’ve done these two things, count it as a win and keep going.

To learn how K12 Lift helps prepare school leaders for productive data chats, click the green Contact Us button at the top of the page.

Read Next: How to Set SMART Goals That Matter