Sambor Kane

Take the treasure. Leave the dogma.

Decide What Failure Looks Like First

An hourglass, an inkpot with a quill, and a written sheet hanging over the ledge

Here is a reliable way to succeed at every change you ever try: don’t decide in advance what success would look like.

It works because people are very good at reading results in their own favour. Once you’ve put time, money or pride into something, almost any outcome can be made to look like progress. The new routine lasted four days? Four more than last month. The course was a disappointment? You learnt what you don’t want. The difficult conversation went badly? At least it’s out in the open. Psychologists have a name for the general habit, confirmation bias, and a large literature showing how many shapes it takes.

Some of those readings may even be true. The trouble is that you can’t tell which, because you wrote the rules after the game.

Science has a fix for this, and you can borrow it. More and more researchers now preregister their studies: before collecting any data, they write down what they expect to find and how they’ll judge it, and they put that somewhere public, with a date on it. It’s a promise to their later selves not to cheat. Karl Popper made the underlying point decades ago: a claim that no result could ever count against isn’t a hypothesis. I’d put it less politely. It’s a mood.

You don’t need a journal to do this. You need a page and two sentences, written before you start.

It’s working if: …

It’s failing if: …

Make them things you could actually observe. Not I’ll feel more confident, but I’ll have spoken up in at least two meetings by the end of the month. Not we’ll get on better, but we’ll have had dinner together three times without an argument. Put a date on the bottom.

The second sentence is the hard one. Writing down how you might fail feels like inviting it. It isn’t. It’s what lets you notice failure in time to do something about it, instead of explaining it away for another year.

Two more habits make the page work better.

Make the change small. A big change, everything at once, has a dull flaw: when something goes wrong, you can’t tell which part was the mistake. Anyone who has fixed a machine knows the rule. Change one thing at a time, then check whether it helped.

Expect to be wrong sometimes, and don’t cheat when you are. If the failure sentence comes true, that isn’t a disaster. It’s information. You change the plan and keep the direction, or you change the direction. What you don’t do is go back and quietly rewrite the sentence.

None of this guarantees anything. Plenty of well-designed experiments fail. But a failure you saw coming, on a page you wrote yourself, teaches you something. A failure you explained away teaches you only how to explain the next one.

If you’re about to change something, write the two sentences tonight. Fold the page. Open it in a month.

This note comes from Chapter 10 of ARRR, the step of the method where you finally decide what to do.

Sources. Raymond S. Nickerson, “Confirmation Bias: A Ubiquitous Phenomenon in Many Guises”, Review of General Psychology 2 (1998) [source]. Brian A. Nosek and others, “The Preregistration Revolution”, Proceedings of the National Academy of Sciences 115 (2018) [source]. Karl Popper, The Logic of Scientific Discovery (1959; German original 1934) [interpretation]. Applying preregistration to personal decisions is this note’s synthesis.


← All notes

← Wszystkie notatki