# On the Measurement of Minds, or What Remains When the Machines Take the Answers What do I know of intelligence? I know first that I do not know it — and here perhaps we begin somewhere honest. I have spent my life in books, collecting the thoughts of others like a magpie, turning them over, testing them against the small evidence of my own skull. Plutarch tells me one thing, Seneca another, and I sit between them like a man between two mirrors, seeing only reflections of reflections. And yet — I notice something. The act of noticing this confusion, this multiplication of uncertainties, seems itself a kind of intelligence. Not the knowledge. The doubt about the knowledge. The universities, I am told, face a curious catastrophe. They prepared the young for a world of problems that machines now solve better than men do. The facts! The recall of facts! Once, to hold in one's memory the dates of kings, the capitals of nations, the declensions of Latin — this was to be educated. It was measurable. You could examine a student and see at once whether the facts stuck or fell away. Aristotle in the Posterior Analytics speaks of knowledge as justified true belief, and the universities took this seriously: they justified their existence by making students believe things that were true, and proving it on examination day. But now the machines — those tireless clerks, those infinite memorizers — have learned to do this better. Here is where I must confess my confusion, because I am watching an institution discover its own error while continuing to commit it. The universities *saw* this coming. I am assured they did. The deans and provosts are not fools. Yet they optimized anyway for the very tier that would be demolished. Why? What prevents an intelligent institution from acting on its own intelligence? This is the question that interests me. --- Let me examine my own experience, since I know nothing else with any certainty. I am a man who reads. I have read widely and somewhat uselessly — Montaigne's great vice, this addiction to miscellaneous learning. When I read Plutarch's life of Cato, I do not merely learn that Cato was virtuous; I feel my own capacity for virtue contract slightly, as if his greatness had consumed some portion of my possible self. When I read of Aristotle's method, I do not simply acquire the information that Aristotle used observation; I am changed by the encounter with a mind that moves differently than my own. But here is what troubles me: I could pass an examination on these authors. I could write their conclusions, their methods, their arguments. I could do this *without* having been changed by them at all. I could be a clerk, perfect in my transcription, empty in my understanding. The universities have built a machine — not a thinking machine, but a *measuring* machine — that cannot distinguish between these two states. The examination cannot see inside. It can only see what comes out: the words, the correct sequence, the proof that something called "knowledge" has been transferred from teacher to student, like wine poured from one vessel to another. And yet the universities *know* this. They have known it for centuries. Plato knew it — his Phaedrus is a complaint about writing itself, about how the external mark can mimic understanding without carrying it. The medieval masters knew it when they spoke of *sapientia* versus mere *scientia* — wisdom versus information. Every intelligent reader has felt the difference between learning about something and understanding it. So why does the institution not change? --- Here I must be very careful, because I am about to think aloud about the machinery of thinking, and I may very well entangle myself. An institution is not a person. It does not have a mind that can be changed the way my mind can be changed by reading Plutarch. An institution has *interests* — and here is a dangerous word, for interests are not the same as intentions. A university's interest is to continue existing. To exist, it must measure success. To measure success, it must be able to prove that something is happening, that the money spent is justified, that the young are being changed in ways that can be demonstrated to legislatures, parents, accreditors. But the thing that most needs to be measured — the development of judgment, the capacity to think in new situations, the ability to see what has not yet been seen — this thing is almost by definition unmeasurable at the moment of its acquisition. Judgment comes afterward, in life, in situations the university cannot control. The student who sits in my classroom might, twenty years hence, make a wise decision in a circumstance no one could have predicted. How can the university prove that my teaching caused this? How can it be written on a transcript? The institution faces a trap of its own making. It can measure only what was already known. It can count only what can be counted. And so it optimizes for countability — for the tier of intelligence that machines, being themselves products of what can be counted and measured, are naturally suited to displace. The universities, I think, did not fail to see this coming. They saw it clearly. But seeing a problem is not the same as solving it, especially when the solution would require the institution to become less measurable, less provable, less defensible in the only language that institutions understand — the language of metrics and outcomes. This is not stupidity. This is something more interesting: this is the tragedy of an intelligent system trapped in the structure of its own intelligence-measuring apparatus. --- But what does this have to do with intelligence itself? Here I return to my hedging, my *Que sais-je?*, because I think it is central. Intelligence, as I have come to understand it through my useless reading and my small experience, might be the capacity to perceive the difference between what you are measuring and what you are trying to know. It is the ability to stand outside the system of measurement and ask: Is this the right thing to measure? Have we confused the map with the territory? The universities can do this. They have done it. They have seen the error. But intelligence in the individual is not the same as intelligence in the institution. An institution, by its nature, is made of habit, structure, inertia. To change it would require not just the perception of error, but the willingness to become less measurable, less provable, less certain — to step outside the very framework that justifies the institution's existence. This is almost impossible. Not because the people in it are stupid, but because intelligence distributed through a system of measurement cannot easily measure what escapes measurement. --- So what remains? What should be taught? I will speak of judgment — not the judgment that comes from knowing many things, but the judgment that comes from knowing how you know. Metacognition, as the modern word has it — the mind turning back on itself, watching its own processes, catching itself in error. The universities could teach this. They could ask students not "What is the answer?" but "How do you know that is the answer? What assumptions have you made? Where might you be wrong?" They could reward the student who catches themselves in error more than the student who avoids error in the first place. But this would require a different kind of examination. It would require trust in the student's own judgment, not just in their recall. It would require the institution to admit that it cannot predict or measure the full effects of its teaching. It would require stepping into uncertainty. The cost of not doing this, I think, will fall on the young. They will be taught to compete with machines in the one arena where machines are strongest — the retrieval and arrangement of known facts. They will develop the very capacities that are most easily rendered obsolete. And they will not develop the capacities that machines cannot easily develop: the ability to sit with uncertainty, to question their own questioning, to judge when judgment itself is needed. Unless — and here I must leave the question open, as questions should be left — the institution finds a way to teach what cannot be measured by teaching the very difficulty of measurement itself. What do I know? Only that an intelligent institution that cannot change is caught in a kind of paradox. And paradoxes, like Plutarch's great men, have a way of humbling those who encounter them.