hebel. today · 13 November 202664 / 80
Science · Science Communication
Scientific claims require rigorous three-step validation
Ethan Siegel defines a robust scientific theory through a three-step formula: a new model must replicate all successes of the current theory, improve upon its failures, and offer unique, testable predictions validated by measurement.…
From 3 newsletters · 1 min read · one thing to try
Ethan Siegel defines a robust scientific theory through a three-step formula: a new model must replicate all successes of the current theory, improve upon its failures, and offer unique, testable predictions validated by measurement (Ethan Siegel from Big Think, Ethan Siegel from Big Think). Einstein’s general relativity supplanted Newtonian gravity because it explained the advance of Mercury’s orbit and predicted the deflection of starlight during a 1919 eclipse, whereas alternative proposals failed to pass these critical tests.
Walter M. Chesnut identified a failure to apply such rigor in a recent epidemiological study claiming a 98.2% reduction in Long COVID, noting that researchers likely included individuals with pre-existing conditions in their uninfected comparison group (WMC Research). By failing to account for undocumented prior infections, the study effectively compared the disease state against itself, a methodological flaw that obscures the actual prevalence of the condition.
Ahmad Malik advocates for a teaching-first approach to medical communication, where he clarifies complex health situations by laying out options rather than dictating treatment plans to patients (Doc Malik Honest Health). This method shifts the focus from passive receipt of information to active decision-making, allowing individuals to weigh clinical evidence and lifestyle approaches with greater confidence.
Try today · 30 min
Evaluate a scientific claim by applying the three-step validation test.
Identify a specific claim and check if it accounts for the successes of the current consensus model.
You need
- A scientific claim or news report
- A notebook for recording the three validation steps
Steps
- List the current accepted theory that explains the phenomenon in question.
- Identify the specific successes of that current theory.
- Check if the new claim accounts for those existing successes.
- Determine where the new claim attempts to succeed where the current theory fails.
- Search for the new, testable predictions the claim proposes.
- Note if these predictions have been measured and confirmed by independent observation.