At 8:30 in the morning, your phone shows a chart from social media. One line shoots upward. The caption says anxiety in teenagers has "exploded." A few minutes later, you see an ad that says a product "cuts your risk by 50%." By lunch, a poll claims that "most people" agree with a political message. None of these numbers may be fake. They can still mislead you.
That is the real problem with bad statistics. They often contain a piece of truth, wrapped in a presentation that pushes you toward the wrong conclusion.
Data journalist Mona Chalabi has argued that the answer is not to reject statistics. It is to question them better. That matters because numbers shape public debates about health, education, crime and the economy. If you can spot weak statistics early, you are less likely to be fooled by headlines, ads or viral posts.
Here are three practical ways to do that.
1. Look at the picture, not just the number
A chart can distort a true number.
The most common trick is a cut or uneven axis. If a bar chart starts at 95 instead of 0, a tiny difference can look huge. A rise from 97 to 99 may appear dramatic even though it is only a 2-point change. The number itself is not false. The display exaggerates it.
This matters because people often react to the shape of a graph before they read the labels. Research on misleading graphs found that people do respond strongly to context and presentation, even when the underlying data do not support such a strong reaction (Driessen et al., 2022).
You do not need statistical training to catch this. Check three things:
- Where does the axis start?
- Are the intervals evenly spaced?
- Does the visual change match the numeric change?
If a chart shows a giant leap, but the values move from 51 to 53, slow down. The image is trying to do more work than the numbers.
Pie charts can mislead too. If the slices do not add to 100, or if a 3D design makes one slice look bigger, the chart is selling a feeling, not just information.
A simple rule helps here: when a graph makes you feel shock very quickly, read it twice.
2. Ask what is missing
A statistic without context is like a quote with half the sentence removed.
Start with the sample. Who was counted, and who was left out? If a poll says "62% of people support X," you need to know whether that means 62% of 200 people, 2,000 people or a narrow group such as users of one app in one city. Small or skewed samples can produce numbers that look solid but are not.
Uncertainty matters here. In a plain-language example from the NCBI Bookshelf, a sample of 10 people can produce a very wide confidence interval, while a sample of 1,000 gives a much narrower one. Bigger samples do not make a study perfect, but they usually give a more stable estimate (Irwig et al., 2008).
Time frame matters too. "Crime is up 20%" sounds alarming. Compared with when? Last month? Last year? A year with unusually low crime? A short window can make normal ups and downs look like a trend.
Definitions matter just as much. "Unemployment," "middle class," "violent crime" and "dropout" all depend on how they are measured. Chalabi’s TED talk makes this point clearly. Official statistics can be useful and necessary, but they are built through choices about what to count, where to look and which questions to ask (Chalabi, 2017).
When context is missing, ask:
- Compared with what?
- Over what period?
- Measured how?
- Counted from whom?
If those answers are not available, treat the statistic as incomplete.
3. Translate percentages into real counts
This is one of the best defenses against misleading health and risk claims.
A headline might say a treatment "reduces risk by 40%." That sounds huge. Yet relative risk can make a small change sound large. If 20 out of 100 people in one group have a bad outcome and 12 out of 100 in another group do, the relative risk reduction is 40%. The absolute risk reduction is 8 percentage points. In real terms, 8 fewer people out of 100 had the bad outcome (Irwig et al., 2008).
Those are both true statements. One sounds much bigger.
Gerd Gigerenzer has warned for years that relative risks often mislead patients and doctors alike. He argues that absolute risks and simple frequencies are easier to understand and less likely to confuse people (Gigerenzer, 2009).
So when you see a big percentage, translate it:
- 50% of what?
- From what starting level?
- How many people changed in real numbers?
If a medicine cuts your risk from 2 in 10,000 to 1 in 10,000, that is a 50% relative reduction. It is also one fewer case per 10,000 people. That is still useful information, but it creates a very different impression.
The same trick works outside health. "Complaints doubled" could mean they rose from 3 to 6. "A 100% increase" is not always a big social change. Sometimes it is just a small number with louder wording.
A better habit for everyday life
You do not need to fact-check every number you see. That would be exhausting. You just need a short pause before you trust it.
Look at the chart. Ask what is missing. Turn percentages into counts.
These steps will not make you cynical. They will make you harder to manipulate. That is the goal. Good statistics help us understand the world. Bad statistics often try to manage our reaction to it.
The difference is not all in the number itself. Very often, it is in the framing around it.
References
Chalabi, M. (2017, February). 3 ways to spot a bad statistic [TED Talk]. TED Conferences. https://www.ted.com/talks/mona_chalabi_3_ways_to_spot_a_bad_statistic
Driessen, J. E. P., de Bruin, W. B., Cook, J., Kok, G. & van der Linden, S. (2022). Misleading graphs in context: Less misleading than expected. PLOS ONE, 17(6), e0265823. https://doi.org/10.1371/journal.pone.0265823
Gigerenzer, G. (2009). Making sense of health statistics. Bulletin of the World Health Organization, 87(8), 567. https://doi.org/10.2471/BLT.09.069872
Irwig, L., Irwig, J., Trevena, L. & Sweet, M. (2008). Relative risk, relative and absolute risk reduction, number needed to treat and confidence intervals. In Smart Health Choices: Making Sense of Health Advice. Hammersmith Press. https://www.ncbi.nlm.nih.gov/books/NBK63647/
