Separate reasoning from credentials: 'Would I find this compelling if it came from a low-status source?'
When someone shares expertise or makes a recommendation, separate your evaluation of their reasoning from your evaluation of their credentials by asking 'Would I find this compelling if it came from a low-status source?'
Why This Is a Rule
Authority bias — automatically weighting information more heavily when it comes from a high-status source — is one of the most pervasive cognitive biases. The same argument that sounds brilliant from a Stanford professor sounds unremarkable from a community college student. The reasoning is identical; only the source changed. Yet your brain treated them differently because status serves as a heuristic for credibility.
The counterfactual test — "Would I find this compelling from a low-status source?" — strips the status halo from the reasoning, forcing you to evaluate the argument on its own merits. If the reasoning is sound, it should be compelling regardless of source. If it's only compelling because of who said it, you're not evaluating reasoning — you're deferring to authority, which is efficient when the authority is genuinely expert in the relevant domain but dangerous when authority is mistranslated across domains or when the authority's confidence exceeds their evidence.
This doesn't mean ignore credentials — expertise is real and informative. But credentials should inform your prior probability that the reasoning is sound, not substitute for evaluating the reasoning itself. "This comes from a Nobel laureate" means "there's a higher chance the reasoning is rigorous." It doesn't mean "the reasoning is automatically correct."
When This Fires
- When evaluating advice, recommendations, or arguments from high-status sources
- When you feel compelled to accept a conclusion because of who said it rather than why they said it
- When multiple experts disagree (When credentialed experts contradict each other, treat it as a map of genuine uncertainty — not a problem requiring you to pick a winner, Ask 'why do these experts disagree' not 'who is right' — the structural source of disagreement is more informative than either conclusion) and you need to evaluate reasoning rather than pick by credentials
- When consuming content from influential thought leaders, bestselling authors, or prestigious institutions
Common Failure Mode
Authority-laundered poor reasoning: accepting weak arguments because the source is impressive. "This CEO says we should move fast and break things" sounds visionary from a billionaire founder and reckless from an unknown startup founder — but the quality of the strategy advice is the same regardless of who said it. Evaluate the strategy, not the source's net worth.
The Protocol
(1) When someone makes a recommendation or shares an argument, notice the source's status: are they high-credentials, famous, or institutionally prestigious? (2) If yes → apply the counterfactual: "If an unknown person with no special credentials made this exact same argument with this exact same evidence, would I find it compelling?" (3) If the argument is compelling regardless of source → the reasoning stands on its own merits. Accept it based on the reasoning. (4) If the argument is only compelling because of who said it → the reasoning is weak and you're deferring to authority. Investigate the reasoning independently before accepting. (5) Note: this also works in reverse. Apply "Would I dismiss this if it came from a high-status source?" to arguments from low-status sources to catch reverse authority bias.