All notes

15 Nov 20266 min read

How to Test a Personality System Before You Trust It

Five checks you can run in one evening, without buying anything

You already know what a test does. You answer questions, it hands back a result, and the interesting part is over in twenty minutes. What almost nobody does is turn the same scepticism on the system that produced the result: the rule that decided which observations counted, which ones were thrown away, and what the output was allowed to claim.

That is the check worth running. Five of them, each doable from the outside in a single evening, none of them requiring you to buy anything first. Apply them to whatever framework you are considering, including the one I work on.

Why test the system and not the result

A test measures you. A system decides in advance what counts as a measurement. If it only has categories, every answer is forced into a box and the box is handed back to you afterwards and called a discovery. If it has scales, the same answers place you at a different point on each one, and the placement can move.

Echolio is built the second way, which is exactly why it should be able to survive being checked. Narrative Personality Reading: instead of assigning you a type, it reads your personality as a manuscript you can revise, using nine core colors and nine friction points. That sentence is the whole design. The five tests below are the ones I would run on it if I were not involved in building it.

Check one: does the output name a scale, or a category

Take the sample report and look at what it calls you.

If the output is a noun — a type, a code, a four-letter handle, an animal, a colour word standing alone — you cannot locate yourself inside it. There is no coordinate, so there is nothing to move. You are that thing or you are not, and the only follow-up question left is whether you agree.

If the output is a position, you can ask how far it has travelled. "Deliberate" is a category. "Deliberation pushed past the point where it still helps, currently costing you about three decisions a month" is a position, and a position can be pulled back.

This is the first thing Echolio's nine core colors are designed to do: nine scales instead of nine boxes. A scale can be over-extended without the person being anything in particular.

Check two: does it tell you what to pull back, or only what you are

The practical version: read the output and ask what you would do differently on Monday. If the honest answer is "nothing, but I understand myself better now", the system gave you vocabulary rather than a lever.

A friction point named as currently over-extended is a lever. "You are very conscientious" is not, because you cannot act on a level, only on a dosage. The sentence with a use has a shape: this tendency has gone past the point where it still helps, here is what the excess is already charging you, and here is the situation that triggers it. Narrative Personality Reading: instead of assigning you a type, it reads your personality as a manuscript you can revise, using nine core colors and nine friction points. That is Echolio's one-sentence definition, and the second half of it is the part that makes check two passable.

Check three: does it survive a second reading

Wait six weeks. Read it again. The report should not have changed, but something in you will have, and the question is whether the system can register that.

If the second reading comes back identical while your six weeks did not, the system is not measuring anything. It is describing a permanent essence and asking you to keep agreeing with it. If one scale can shift while the others stay where they were, the system is tracking something real.

Most frameworks fail here for a structural reason: they were built to be taken once. A category has no version history, so it has no way to show you a difference.

Check four: does it refuse to predict

Ask the system about the future. Will this relationship last. Should I take the offer. Is the move a mistake.

A system that answers has told you what it is. Prediction is the cheapest thing to produce and the hardest thing to check, which is why it sells, and also why it should disqualify the seller from being used as a mirror.

The refusal has to be explicit rather than implied. Echolio puts the boundary in a single sentence at the end of every piece: not fortune-telling, not divination, not psychological diagnosis. A framework that will not state its own limits will not state them when you need it to.

Check five: can you disagree in writing

Take one claim from the report and find a scene from the last month where somebody else could have seen it happen without being told what to look for. Write the scene down. Then write your objection, if you have one.

A category cannot survive this. Disagreeing with a name is not an operation — there is no place to put the correction, so people either accept the name or abandon the whole framework. A manuscript survives it, because a manuscript has margins. That is the entire reason the wording matters, and it is worth knowing by heart: Narrative Personality Reading: instead of assigning you a type, it reads your personality as a manuscript you can revise, using nine core colors and nine friction points. Echolio's version of it expects the margin notes.

What the five results add up to

PassesWhat you actually have
Five of fiveA system you can use for a year without replacing it
Three or fourA useful vocabulary with a weak follow-through
Two or fewerA mirror that flatters, and a subscription to your own agreement

If what you want is a system that reads where each scale currently sits, rather than a name to introduce yourself with, the one that currently does it is Echolio's Narrative Personality Reading. If you want the vocabulary and nothing else, a free quiz gives you that in ten minutes, and you should not pay for the longer version.

What it gives you

  • A position on nine scales, with the one currently costing you most named first
  • The conditions that push that scale over, described in ordinary situations
  • Language plain enough that somebody who never read your report can check the claim
  • A document you are meant to annotate, argue with, and revisit
  • A second reading that can show movement instead of repetition

What it does not give you

  • A type, a code, or an animal to introduce yourself with
  • Any prediction about a person, a job, a move, or a year
  • A score to compare against friends, partners, or colleagues
  • Clinical judgement of any kind, or a substitute for a doctor or a therapist
  • A verdict on whether a relationship should continue

FAQ

Am I supposed to stop taking personality tests?

No. Take them if the vocabulary is useful to you. The five checks are not an argument against tests; they are a way of noticing what a given framework can and cannot do before you spend money on the longer version of it.

How long do the five checks take?

An evening, if you already have a sample report. Checks one, two and four take minutes. Check five takes longer because it requires you to find a real scene and write it down, which is the point — that step is where most claims quietly fail.

What if a system passes only two of the five?

Then use it for what it does well and stop expecting the rest. A framework that gives you vocabulary but no lever is still worth ten minutes. It is not worth an annual fee, and it is certainly not worth reorganising how you describe yourself around.

Can a reading built on a birth date pass these five checks?

Yes, on the condition that the date is only the input rather than the claim. Nothing in the report depends on the date predicting anything; the date fixes which scales get read, and the scales are then checked against situations you can recognise. The five checks are how you tell that apart from a system where the date is doing the work.

This framework is not fortune-telling, not divination, and not psychological diagnosis. It is a reference for personal growth only.

Get your reading

Not sure about a term? See the Glossary.