If your search for disconfirming evidence cannot change your mind, redesign it
When searching for disconfirming evidence, if your search could not have actually changed your mind, you performed a ritual not genuine disconfirmation—redesign the search until failure is possible.
Why This Is a Rule
Confirmation bias is sophisticated. When told to "consider the opposite" or "look for disconfirming evidence," your brain complies — superficially. You search for counter-evidence in places you know won't yield any. You consider the weakest version of the opposing argument. You ask someone you know agrees with you whether they see any problems. The search feels like genuine disconfirmation but is actually a ritual: a performance of open-mindedness that cannot alter the outcome.
The test for genuine disconfirmation is simple: before you search, ask "what result from this search would actually change my mind?" If no possible result would change your mind, the search is a ritual. Redesign it until failure is possible — until you can specify, in advance, what evidence would make you abandon or significantly revise your position.
This is Popper's falsifiability criterion applied to personal reasoning: a belief you cannot specify how to disconfirm is a belief you're protecting, not testing.
When This Fires
- You've decided to "consider the other side" before committing to a position
- You're doing due diligence on a decision you've already made emotionally
- Someone asked you to play devil's advocate and you're going through the motions
- You feel good about having "looked at both sides" but your position hasn't budged at all
Common Failure Mode
Searching for disconfirming evidence in the wrong places or at the wrong resolution. You believe your product strategy is correct, so you "look for counter-evidence" by reading industry reports — which are too general to challenge your specific assumptions. Or you ask your team for concerns — but in a meeting format where disagreement has social costs. The search cannot yield disconfirmation because it's structurally incapable of it.
The Protocol
Before searching for disconfirming evidence: (1) Write down: "I would change my mind if I found [specific evidence]." If you can't complete this sentence, you're not ready to search — you need to identify what would count as disconfirmation first. (2) Design your search to go where that specific evidence would live if it existed. (3) After searching, ask: "Did my search have a realistic chance of finding disconfirming evidence if it existed?" If not, redesign and search again.