MisleadingCharts
Back to the gallery

The 61.5% of schools that hold 32.7% of the children

Showing the misleading chart

Be the first to star this exhibit

A facilities briefing on the size of American public schools: a census rather than a survey, the publisher’s own thirteen enrollment bands, zero-based axis, nothing smoothed or dropped. On that count the country is unmistakably a nation of small schools — 61.5% enroll fewer than 500 students and very nearly one in ten enrolls fewer than 100. The bars count schools, and a school enters the count once whether it holds 45 children or 4,007. The same table’s second column weights the same thirteen bands by the students inside them, and it is a different distribution: schools under 500 hold 32.7% of students, and the 9.0% of schools with 1,000 or more hold 28.5%. The average school has 512.2 students; the school the average student attends has about 916.

01The claim

A facilities briefing on one question — how big is an American public school? — answered from a census rather than a survey. Every public elementary and secondary school in the fifty states and the District of Columbia files to the federal Common Core of Data, so there is no sample here and no margin of error: 99,239 schools in the 2021–22 school year, of which the 95,839 that reported an enrollment above zero make up the publisher’s size distribution, the other 3,400 having reported none. Those 95,839 schools hold 49,089,640 students between them. The axis starts at zero. All thirteen bands are plotted, at the boundaries the publisher drew them. Nothing is smoothed, indexed, annualized, projected or rebased; there is no second axis, no log scale and no break in the scale anywhere. On that count the shape of American schooling is unambiguous, and it is a nation of small schools. The commonest school in the country holds 300 to 399 students. 61.49% of schools enroll fewer than 500; 31.99% enroll fewer than 300; and very nearly one school in ten — 9.96% — enrolls fewer than 100. Only 9.00% reach 1,000 students, 1.87% reach 2,000 and 0.34% reach 3,000. The median school falls in the 400–499 band and mean enrollment per reporting school is 512.2 students. Read-out for the facilities board: a site of roughly 500 is the country’s normal case rather than its small case. Planning note: a staffing model, a counselling ratio and a per-site technology package specified for a school of about 500 will fit the majority of American sites without modification, and large-campus provision is the exception, since fewer than one site in ten reaches 1,000 students.

02The trick

Every count needs a unit, and this one counts schools. A school enters the tally once — the same once — whether it holds 45 children or 4,007, so the picture is a fair description of the country’s stock of buildings and not of anybody’s schooling. The reader is never a school. The reader is inside one. Count the children instead and the same thirteen bands, from the same census, on the same base, rearrange themselves: the schools under 500 students that are 61.49% of schools hold 32.71% of students; the schools under 100 that are 9.96% of schools hold 0.87% of students; and the schools of 1,000 or more that are 9.00% of schools hold 28.47% of students. Read it from the other end and it is starker still: the eight bands from 500 students up are 38.50% of the schools and 67.28% of the children. The median school holds about 420 students and the median student’s school about 660. The average school holds 512.2 students and the school the average student attends holds about 916. Nothing has been added, removed, rescaled or reweighted by us to produce that. The second column is printed on the publisher’s own table, one column to the right of the first, and the exhibit simply draws both. What is doing the work is that the units differ in size and the count does not know it. Weighting each unit by its own size raises the mean by exactly the variance divided by the mean, so the two answers coincide only when every school is the same size and separate fastest where the spread is widest — which is why the long right tail matters so much here. It is a sliver of the count and a slab of the population, and a chart of schools is obliged to draw it as negligible. This is not survivorship bias and it is not a self-selected sample: nothing dropped out, nothing walked in, and every school in the base is present in both columns. Nor is it a missing denominator, because both figures are already rates — the argument is over what they are rates of. The selection happens at the moment of counting, in the choice of what one bar represents. (Both drawings are ours; the briefing, the board, the read-out and the planning note on the first are invented, and every figure behind them is real.)

03The fix

Decide who the sentence is about, then count that. Here the honest chart is barely a redraw — it is the same thirteen bands on the same zero-based axis with a second series beside the first, because the publisher already did the work and printed the student column next to the school column. Drawn as a pair, the blue bars lead in the first five bands and the gold bars in the last eight, and the gold bars stay high across the whole right-hand half of the chart where the blue ones have fallen away. The gap between the two distributions is itself the finding: it costs one extra series and it is more informative than either bar alone. Print both means where the reader can see them together, since the container mean and the contents-weighted mean are a matched pair and the distance between them is the spread in plain sight — 512.2 against about 916 is a ratio of nearly 1.8, and a reader who has seen the two numbers side by side will not confuse them again. Say in the caption which unit the bars are, the way you print a unit on an axis. Where only one chart can be shown, choose the unit the decision actually runs on, because both are legitimate and the same census honestly supports two charts for two different meetings: a maintenance budget, a heating bill and a site inspection rota really are about buildings, and a class-size promise, a counselling ratio and a per-pupil funding formula really are about children. What is not legitimate is the swap — reading the school chart and writing a sentence about children — which is what the briefing’s planning note does when it infers from “fewer than one site in ten reaches 1,000 students” that large-campus provision is an edge case. Nearly three students in ten are in one. Two things both of these charts still owe the reader, and the honest one says so on its face. The publisher’s bands are not equal in width — eight of 100, then 200, 500, 500, 1,000 and an open-ended top — and both charts draw them as equal bars, which is the uneven-intervals trick riding along on the same picture: it is why “the modal band” is not a statistic worth quoting off either chart, and why the running-share curves are drawn dashed past 3,000, since nothing on the table says where that band ends. The shares themselves are unaffected, which is why the exhibit still works; the shape of the histogram is not, which is why it is worth saying. The same test catches this everywhere it lives, which is nearly everywhere: ask a university its average class size and then ask a student theirs; ask a transit agency the average gap between buses and then ask a passenger their wait, which is longer than half the gap unless the buses run to the second, because a long gap is a bigger target to land in; ask how many employees the average firm has and then how large a firm the average employee works for. Watch for the average of averages in particular, which quietly picks the container as its unit while looking like an average of everything, and treat a long right tail as advance warning that the two answers will be far apart. And keep the distinction from the neighbouring techniques sharp, because the remedies differ. Survivorship bias is about cases that left the dataset before you looked and self-selection about cases that stepped forward, while nothing here is missing at all. The missing denominator is the nearest miss of the three and the one worth holding on to: that is a count that should have been a rate, whereas both of these figures are already rates and the whole argument is over what they are rates of. Both counts here are complete. Only one of them is about children.