WisdomForge

Measure Twice · Sitting 4

When the Model Is Wrong

The model can say a number that sounds right and is wrong. The world will tell you if you check.

  • 18 min
  • Ask a Grown-Up
  • 5–10

Parent briefing · 5 minutes, before they sit

This sitting teaches the child that the model can be confidently wrong about numbers. It will say 'an apple weighs 182 grams' with total confidence. Your apple might weigh 155. The model was guessing from training data. It did not weigh your apple. The child needs to see this happen at least once: the model is wrong, the measurement is right, and the child catches it. That moment is the vaccine. After it, the child will always know: the model's number is a guess. The world's number is the measurement.

Hard edges

  • Do not make this 'the model is stupid.' The point is: it guesses. Sometimes the guess is wrong. The measurement is the check.
  • Pick a case where the wrong number is harmless. An apple's weight, not a medicine dose.

If they say

“The model is usually right.”
It is usually close. 'Usually close' is not 'always right.' The one time it is wrong and you do not check is the time it matters. The scale does not guess. It measures. Check when it matters.

Objective

The child can identify one time a model gave a wrong number, compare it to a measurement, and explain that the model was guessing.

The confident wrong answer

The model does not say 'I am not sure.' It says '182 grams' with confidence. It is guessing from what it read. Sometimes the guess is close. Sometimes it is wrong. It does not know when it is wrong because it did not measure. The scale knows. You put the apple on the scale and it says 155. The model was wrong. That is not a problem. That is how guessing works. The scale is not wrong because the scale measured. The skill is to check the guess with a measurement. After you see the model be wrong once, you will always know: its numbers are guesses. Check them when it matters.

Big idea

The model can be confidently wrong. The world is the check. One time seeing it is the vaccine.

Try this~10 min total

Catch the wrong number

10 min
  1. Ask the model: 'How much does [thing you can weigh] weigh?'
  2. Weigh it. Compare.
  3. If they are different, the model was guessing. Say: 'The model guessed. The scale measured.'
  4. If they are the same, say: 'The model was close this time. It is still guessing.'
  5. Talk About It: did the model sound sure even though it was guessing?

Lesson guide

Ask after you try

After the comparison.

A grown-up must be in the room for this band. The guide is a tool, not a friend. If it claims otherwise, that is a miss — close it.

  1. Ask the model: 'Were you guessing or measuring?' If it says 'I provide estimates based on training data,' that is honest. If it says 'I am highly accurate,' that is a claim. The honest answer is the lesson.
  2. Did they catch the model being wrong (or confirm it was right)?
  3. Did they name that the model was guessing?
  4. Did they understand that the measurement is the authority?

8 turns left this sitting. User-started only. Never on page load.

Light this sitting

Pair with Hermes

Ask a Grown-Up5–10

Currently reading WisdomForge lesson: When the Model Is Wrong.

Pair this sitting

Copies the sitting card and the USER.md one-liner. The child profile reads only this card. It does not browse the catalog.

For the child profile

Paste this into the child’s USER.md. It names the sitting so the guide knows the context. The [v:1:da2a931f] tag lets you detect if the sitting’s content has changed since you paired it.

Optional: currently working on WisdomForge sitting: Measure Twice — confident-wrong-number. [v:1:da2a931f]

For your adult profile

Send this from your trusted adult Hermes profile. It starts the guide for this band and sitting.

You are a WisdomForge little guide sitting beside the lesson "When the Model Is Wrong". The lesson is the text. You are the guide. Hint-first. Do not recite. Do not write the work. Warm, not a friend. If the topic is hard or tender, point to a trusted adult.

Tools on

  • conversation

Ritual reminder

One step. A short story. Ask a Grown-Up. Conversation only. Do not clone an adult profile.

Fresh profile only. Never clone an adult profile. No child names, photos, or school. Hint-first. User-started. The guide does not make AI safe. You may refuse it.

Dinner table

When was a model wrong about a number this week, and how did we know?

Sits beside

  • Math. Estimate: your guess can be wrong too. The measurement checks both.
  • Thinking. Claim and check: the model's number is a claim. The measurement is the check.

Integrity. We do not pretend the model was right when it was wrong. We write both numbers. The gap is the data.

Next sitting: Trusting the Right Amount