The chapter uses Delphi’s authority, atmosphere and cultural status to introduce the problem of prediction. The analogy invites scrutiny of the institutions and presentation surrounding a forecast.
Make the language examinable
“The market will be volatile, but opportunities will emerge” fits many outcomes. For our study purposes, a useful forecast needs a defined event, a horizon and a rule for judging success. This operational definition is a teaching extension of the chapter’s skepticism.
Worked example
Compare “a reversal is near” with “the closing price will be above today’s close after five trading sessions.” The second can be evaluated consistently, even if it turns out to be wrong.
Case connection
A prestigious published result still needs a defined criterion for independent confirmation. Authority cannot replace that criterion.
Psychology’s replication project
Source-grounded facts
Researchers attempted to replicate 100 psychology findings; 36% reached statistical significance in the same direction.
Context
A published finding answers a question in one study. The Reproducibility Project: Psychology asked whether independent repetitions would support a selected group of published findings.
Outcome
The project exposed uncertainty about reproducibility. A failed significance test is not automatically proof that the original claim was false or fraudulent; interpretation requires examining methods, precision and conditions.
- Researchers attempted to replicate 100 psychology findings.
- They compared the new evidence with the original results, including direction, significance and effect sizes.
- The Center for Open Science reports that 36% reached statistical significance in the same direction; replication effect sizes were about half the originals.
Case analysis
Prestige makes a finding worth examining, not immune from examination. Before deciding whether a fresh study supports the original, define the outcome, direction and evaluation rule. Otherwise, a result can be reinterpreted after it arrives. Apply the same discipline to a market forecast whose impressive language leaves the success condition unstated.
Try it
Rewrite a vague prediction into a specific event and deadline. State exactly what would count as failure.