MisleadingCharts
Back to the gallery

The 82% fall in fly citations that happens every winter

Showing the misleading chart

Be the first to star this exhibit

A training-review slide we drew from New York City’s restaurant inspection data: after a fly-control refresher goes out to kitchen supervisors in October 2025, the share of initial inspections citing filth flies falls from 19.9% to 3.5% by February. The same September-to-February fall was 76% the winter before and 63% the winter before that, with no course, and by August 2026 the rate was back up to 24.1%.

01The claim

The refresher worked. A six-month review slide of the kind a training desk might circulate, which we drew from New York City’s public inspection records: in October 2025 a fly-control refresher (drain lines, door sweeps, waste rooms) goes out to kitchen supervisors, and the share of the city’s routine initial restaurant inspections that cite filth flies falls every month afterwards, from 19.9% in September to 3.5% in February. That is down 82%, on a zero-based axis, with every month’s inspection count printed beside it. Recommendation: make it mandatory for every new supervisor.

02The trick

Every number on the slide is right. What goes wrong is the calendar. Flies are a warm-weather pest, so fly citations in New York climb through summer and autumn and collapse over the winter, every year, whatever anyone teaches. It isn’t inspectors easing off in the cold: in the same inspections, mouse citations don’t fall over the winter, while flies and roaches do. A course that goes out in October and is judged in February is being credited with the season. The slide’s window starts near the top of the cycle and ends at the bottom, and a before-and-after comparison with nothing beside it can’t tell a course from a calendar. The city’s file shows the same fall without a course: September to February dropped 76% in 2024–25 (22.3% to 5.2%) and 63% in 2023–24 (24.1% to 9.0%). The slide’s 82% is a relative fall, 16.4 percentage points, and it looks a little steeper than the others mostly because February 2026 was the lowest month on the chart. Six months after the slide, in August 2026, 24.1% of routine initial inspections cited flies, more than in September 2025, the month before the course went out.

03The fix

Hold the season still before reading the change. The cheapest way is to compare each month with the same month a year earlier. On that view the winter after the course did run lower: 9.6% of October–March routine initial inspections cited flies, against 13.4% the winter before, a gap of 3.7 points. But the gap was there before the course existed. April–September 2025 had already run 2.4 points below the same months of 2024, and July, August and September 2026 came in 2.4 to 5.8 points above their twins. What is left for the course is about a point, and the city’s file can’t vouch for even that. It keeps only restaurants that are still open, and it drops older records of restaurants inspected recently, so earlier months hold far fewer inspections and are not a like-for-like base. A real test of the course needs a comparison that lives through the same months: kitchens whose supervisors took it against kitchens whose supervisors had not yet, ideally with a random half going first, judged winter and summer alike.