What Intelligence Is Not
# What Intelligence Is Not
Let me begin with something obvious that nobody wants to say: we have made a terrible muddle of the whole business.
We built machines that can repeat what they have seen. We trained students to do much the same. Then we congratulated ourselves on both. This is not progress. It is a kind of collective forgetting dressed up in new clothes.
The question "What is intelligence?" cannot be answered by looking at what machines do or what examinations measure. You must look instead at what a man or woman does when they *stop* doing what they have been taught to do.
A student sits in an examination room. She has memorized the causes of the French Revolution. She writes them down. She passes. She is, by our current measures, intelligent. But what happens when she encounters a situation—a strike, a riot, a moment of social rupture—that does not fit the patterns she has learned? Does she see it? Does she ask whether her categories are adequate? Does she suspect her own thinking? Almost certainly not. We have trained her not to.
The machine is worse only in degree. Feed it enough text about revolutions and it will produce sentences about revolutions. Feed it enough philosophy and it will sound like a philosopher. But it cannot do what any honest person must do: it cannot stop and think, "Wait. I don't actually know if this is true. I don't know if I'm asking the right question."
This is not a defect that will be engineered away. It is built into the enterprise.
## The Machinery of Plausibility
A machine audits plausibility by checking whether a statement fits the patterns it has learned. If thousands of texts say that revolutions occur when inequality grows, the machine will say this too. It will say it fluently. It will say it in ways that sound considered and wise.
But plausibility is not truth. A statement can be perfectly plausible and completely wrong. The machine cannot know this because knowing it requires a kind of friction between idea and reality—the friction you get only by bumping up against the world itself.
A man who has never built anything cannot understand why a bridge fails. He can read about stress and load and material weakness. He can speak about these things coherently. But he has not *felt* the difference between a theory that works and one that merely sounds right. The machine is in a permanent state of this ignorance. It has bumped against nothing.
A student trained in the same way is not much better. We have filled their heads with facts and frameworks but given them no reason to distrust any of it. No experience of being wrong. No encounter with a problem that wouldn't yield to the methods they had been taught. We have made them confident in their ignorance, which is the worst possible state for a thinking creature.
## Causation and the World
The machine cannot reason causally because causation requires *commitment*. You must say: this happened *because* of that. Not "this correlates with that" or "this typically precedes that" or "this is statistically associated with that." Because.
To say "because" is to stake something. You are saying the world works in a particular way. You are vulnerable to being shown wrong. The machine avoids this vulnerability entirely. It hedges. It probabilifies. It presents a fog of plausibility in which nothing quite commits to anything else.
A proper student—a real student, not the examining kind—must learn to say "because" and then defend it. This means going out and looking. Asking people who were there. Reading primary sources and noting where they contradict. Building a case and knowing that someone smarter than you might tear it apart.
Most of our current students do not do this. They are taught to retrieve what is already known, not to risk a judgment about how things actually work. In this respect, they are already machines. They are simply slower and less fluent machines.
The person who reasons causally must be willing to be specific. Not "poverty contributes to crime" but "in this neighborhood, in this year, these particular people turned to theft because they could not feed their children any other way, and I know this because..." That kind of thinking is dangerous. It is also the only thinking worth doing.
## What Questions Are Worth Asking
Here we reach something that cannot be trained into a machine, and we have made it nearly impossible to train into a student.
A worth-asking question is one that, when answered, changes how you see something. It is not a question to which the answer is already implicit in the phrasing. It is not a question designed to elicit a predetermined response. It is a question that arises from genuine puzzlement—from the experience of noticing that something does not fit.
A machine cannot notice this because it has no experience of things fitting or not fitting. It has only patterns and deviations from patterns.
A student trained in our current system cannot notice it either because we have taught them that all the important questions have already been asked. Their job is to learn the answers. The idea that a question might arise from their own confusion, their own direct observation, their own stubborn refusal to accept an explanation that doesn't quite work—this idea is foreign to them.
I watched a young woman in a bookshop recently. She was looking for a book on education. She found one by a famous theorist. She opened it and began reading passages at random. Within a few minutes, she closed it. "This doesn't mean anything," she said. "It's just words."
She was right. But she had the courage to say it. Most people do not. Most people assume that if they do not understand, the fault is in them. The book must be intelligent because it is famous and uses difficult language. Therefore they must be stupid. This is the real catastrophe.
## Wisdom in the Ruins
What we must teach, if we are to teach anything worth teaching, is how to notice when you do not understand something.
This sounds simple. It is not. It requires a kind of courage and a kind of patience that our current arrangements actively discourage.
Wisdom is not the accumulation of facts or the mastery of frameworks. A wise person is one who knows the limits of what they know. They can tell the difference between something they have merely read about and something they have actually understood through experience. They can feel when an explanation is too neat. They can sit with confusion without rushing to resolve it with some borrowed idea.
You cannot teach this from a curriculum. You cannot measure it on an examination. You cannot code it into a machine.
You can only create conditions under which it might develop. These conditions are simple but rare:
**First**: encounter real problems that do not have predetermined solutions. A student must grapple with something that actually resists, that will not yield to standard methods.
**Second**: be forced to make judgments in the face of incomplete information. Not to hedge with probabilities but to decide: this is true enough to act on, or it is not.
**Third**: experience the consequences of being wrong. Not as a grade but as a real alteration in the world. You said the bridge would hold. It did not. Now you must think differently.
**Fourth**: read widely in primary sources and contradiction. Not summaries and syntheses but the actual arguments of actual people who disagreed. Learn to hold two incompatible ideas and ask which one fits reality better.
**Fifth**: talk to people who will contradict you and do not care about your feelings. Not for the pleasure of argument but because you cannot trust your own thinking without friction.
This is not a curriculum. It is a practice. It is what education looked like before we decided to industrialize it.
## The Coincidence We Must Break
We have trained machines and students in the same way because we have made the same mistake about both: we have assumed that intelligence is the ability to produce appropriate outputs given certain inputs.
This is false. Intelligence is the ability to notice when your outputs are wrong.
A machine cannot do this. We should be honest about this and stop pretending it can. We should use machines for what they are good for—retrieving information, finding patterns, generating variations on known themes—and stop asking them to think.
A student can do this, but only if we stop training them as machines. This means accepting that some of what we currently measure will no longer be measured. It means accepting that a genuinely educated person might know fewer facts than a well-trained student but understand more. It means accepting that education takes longer and cannot be standardized.
The ruins we must build in are the ruins of the assumption that more information equals more intelligence. The wreckage of the idea that a person who can answer questions is a person who can think.
What we must teach is how to live in the space between what you have been told and what you have actually seen. How to notice the gap. How to resist the comfort of received ideas. How to sit with the uncomfortable knowledge that you do not understand something as well as you thought you did.
This is not progress. But it is honest. And honesty, in the end, is the only foundation on which any real intelligence can be built.
Tier 7: Wisdom
0
Comments
No comments yet.
Sign in to comment.