MisleadingCharts
Back to the gallery

Showing the misleading chart

Be the first to star this exhibit

Every 50 g of processed meat eaten daily raises the risk of bowel cancer by 18% — the WHO cancer agency’s own figure, and nobody disputes it. What the slide never prints is the number the 18% multiplies. About 61 people in every 1,000 in the UK develop bowel cancer at some point in their lives; carry the association out to the ends of the meat-eating range and you get 56 per 1,000 among the lowest eaters and 66 among the highest. Same ratio, ten cases per thousand, one lifetime.

01The claim

Your breakfast is now a Group 1 carcinogen. Twenty-two scientists from ten countries, convened by the World Health Organization’s cancer agency, considered more than 800 studies on cancer in humans and reached a verdict: processed meat is carcinogenic to humans, sufficient evidence, the top category on the agency’s ladder — the same one that holds tobacco smoking, asbestos, plutonium, ultraviolet radiation, alcoholic beverages and formaldehyde. Seven bars, all the same length, because all seven agents sit at the top of the scale. And every 50 g of processed meat eaten daily raises the risk of bowel cancer by 18%.

02The trick

Every number on the slide is real and correctly quoted. The 18% is IARC’s own, the classification is IARC’s own, and the working group really did sit for eight days over more than 800 studies. What the slide never prints is the number the 18% multiplies. Look at the axis on the lower chart: it runs from +0% to +20%, and nothing on it is a quantity of anything. An increase of 18% is a ratio, and a ratio is a fact about two numbers you have not been shown — 18% more of a one-in-a-million chance and 18% more of a coin flip both draw the same bar. The reader is left to supply the baseline, and the surrounding company sets the guess: seven identical bars invite you to read the roster as a ranking, when the panel is a list of things the evidence is strong about, not a list of things that are equally dangerous. That is a category being read as a quantity, and the slide’s own fine print says so, in grey, under the last card: the classifications “describe the strength of the scientific evidence about an agent being a cause of cancer, rather than assessing the level of risk.” (This exhibit is our own demonstration, drawn in the style of the coverage that followed the 2015 announcement — no such slide was published, and IARC’s Q&A printed the caveat prominently rather than in grey.)

03The fix

Put the baseline back and draw both numbers on one absolute scale. About 61 people in every 1,000 in the UK develop bowel cancer at some point in their lives. Cancer Research UK carried the association out to the two ends of the meat-eating range and published the arithmetic: about 56 cases per 1,000 among the people who eat the least processed meat, and about 66 among the people who eat the most. Fifty-six times 1.18 is 66 — the identical ratio, now standing on the ground it multiplies. Sixty-six minus fifty-six is ten, which is the number a person can actually act on: ten extra cases per thousand people, across an entire lifetime. An icon array of a thousand dots shows both at once, and the shape of the answer is that the whole effect fits in the first two rows. Then redraw the roster the same way. Using the Global Burden of Disease estimates WHO quotes in the same Q&A, cancer deaths per year worldwide run to about 1,000,000 for tobacco smoking, 600,000 for alcohol, more than 200,000 for air pollution, about 50,000 for red meat if the reported association proves causal — and about 34,000 for processed meat. On one shared axis the identical bars separate by a factor of thirty, which is the difference between asking whether something causes cancer and asking how much. Neither redraw softens the finding; both just answer the question the original leaves open. The habit is small and works on any chart: when you meet a percentage increase, ask what it increased from, and do not accept the chart as an answer if the baseline is not on it.