Instrument the Intervention, Not the Child

The first four essays in this series all pointed the tape in the same direction. At me. That was not where I expected to end up.

Most of what we measure in youth development points the other way. We measure the kid. First-serve percentage and rankings, and lately things like confidence too. We build profiles and development plans and increasingly sophisticated ways to describe what the young person is doing. Then I started counting words in a classroom and realized I had built an instrument that barely cared about the child at all. It measured the adult.

That choice solved more problems than I expected. Not all of them. The recordings still contain children. Their voices are there and so are their answers, and the sessions happened in a real program with real players who could sometimes be identified from context. Recording a room full of young people creates responsibilities whether the spreadsheet ends up containing their names or not, and pointing the analysis at the coach does not make those questions go away. But it changes the center of gravity.

The thing I'm deliberately trying to change in these classrooms is not the child. It's the intervention. I want coaches to create more room for players to think and to stop supplying meaning the moment a player produces something useful. Eventually I want a format that doesn't require the person with the most expertise to occupy the most space. Those are adult behaviors. So why would the first instrument point at the kid?

Once I asked that, a lot of what I'd been tangled up in got simpler. Suppose I write down a player is mentally fragile under pressure. Who owns that description, and did he understand what was being inferred about him when it was collected? Those aren't abstract questions once you start storing observations about children, and I'll come back to them in the next essay. Now compare that with measuring me. How long are my turns? What happens right after a player gives a real answer, and how often do my post-answer turns run past a hundred words? I'm an adult, I'm paid to be there, and the behavior being measured is part of the work I'm responsible for. Most importantly, it's the variable I can actually change tomorrow. That seems almost embarrassingly obvious now. If the intervention is the coach, instrument the intervention.

Youth sports has built an enormous appetite for information about children, and some of it is useful. I've spent most of my career watching players closely and I'm not about to argue observation is unnecessary. Development without observation would be mostly guessing. But there's an asymmetry I had never really considered. The kid is constantly being measured. The observer almost never is.

A player loses a match and we study what happened to him. Did his first-serve percentage fall, did he stop coming forward, did he get tight? Meanwhile the coach may have changed the tactical priority three times that week, or talked through every silence until the player quit trying to solve anything himself. We can still leave the tournament with a report about the kid. That's a strange arrangement when you look at it from far enough away.

Schools have the same shape. They've spent generations getting more precise about students, and some of that apparatus exists for good reasons. But imagine putting the same observational energy on the adult. How long does the teacher talk before a student speaks? How often does she ask a question and then answer it herself before anyone else can? Those numbers wouldn't tell us whether the teacher is good. My word counts can't tell me whether I'm good either. They would tell us something about the intervention, and that distinction is starting to matter more to me. A child is not an intervention. A child is the person experiencing one.

The pull to measure the child first probably comes from development being the thing we're trying to produce. If the player is supposed to become more aware, measure awareness. If the student is supposed to become more independent, measure independence. But there's a step before that, which is asking what we actually did. If the academy says it develops decision-makers, how many decisions are players allowed to make? If a classroom calls itself Socratic, what does the adult do when somebody gives an answer worth keeping? Those questions point upstream.

That doesn't mean outcome measurement disappears. Eventually I do want to know whether any of this produces better players or better judgment or anything else worth caring about. A room where players talk more could still be a bad room, and a coach who says very little could simply be disengaged. Measuring the intervention is not proof the intervention works. It's the cleaner first question. Before asking whether the child changed, ask whether we delivered the thing we said would change him.

It also puts accountability somewhere adults can do something with it. If I decide a twelve-year-old lacks confidence, I've created an interpretation about a twelve-year-old. If I discover I answer my own questions, I've found a behavior I can stop doing Tuesday afternoon. One produces a description. The other produces a lever.

The more I work with the transcripts, the less interested I am in building another machine for describing kids. They already live inside enough of those. What interests me now is building a mirror for the adults around them. Not because adults are the problem and children are innocent data points, which would just reverse the same mistake. Because adults design the environment. We pick the format and the questions, and we decide which answer gets built on and which interpretation gets written down. That's an extraordinary amount of influence to leave unmeasured while we keep refining the instruments aimed at the people with the least control over the room.

The tape changed that for me. For the first time I had an instrument aimed mainly at the person responsible for the intervention, and once I did, a simple rule fell out of it.

Measure the thing you're trying to change. In this room, that isn't the child.

It's us.