A measurement audit of the Anthropic Economic Index across five waves and 51 US jurisdictions.
The range depends on weighting convention. Weighting by population, a claim about people, gives 41–48%. Weighting states equally, a claim about states, gives 66–74%. A reader who meets AI adoption reported by region is seeing at most 59% of the variation present at state level.
The Theil index decomposes exactly into between-group and within-group components, so this is arithmetic rather than approximation. Maximum residual across all waves and groupings: 2.9 × 10−16.
Five official US government geographies applied to identical data give Gini coefficients spanning 18.5–39.3% of their median. Two agencies inside the Department of Commerce publish different maps of the same country at eight and nine regions, and they disagree.
This is not evidence the map is arbitrary. Census divisions were built to group economically similar states, so they should separate high from low usage better than chance. The finding is the magnitude: a regional inequality figure computed this way is close to the largest such figure the geography admits.
Resampling the observed conversation counts, most neighbouring positions in the published ordering cannot be told apart. The index carries information in its broad strata, not its fine ordering.
The publisher already coarsens, distributing a four-tier classification with the data. Its middle boundary, the cut between the second and third quartiles of AI usage, holds in 47.4% of resamples. Only the top tier separates reliably.
No platform change, no policy change, no identifiable external event. This sets a floor: movement smaller than it cannot be interpreted. We are not aware of a published stability benchmark of this kind for any AI adoption index.
Scaled against sampling error, the median state moves 3.4 standard errors between consecutive waves and several exceed 40. Wave-to-wave variation is dominated by something other than sampling.
Usage is spatially clustered (Moran's I = 0.278, p = 0.003) in a way gross state product is not (I = 0.139, p = 0.11). AI use is more spatially structured than the economic variable most often invoked to explain it, and 43% of the apparent degrees of freedom are redundancy.
A shift-share decomposition separates a state's deviation from the national rate into occupational composition, having more people in occupations that use these systems, and within-occupation intensity, the same workers using them more.
The occupational layer classifies only 27.4% of usage in the median state, which restricts the decomposition to six jurisdictions holding 54% of US conversations. Within those six, the two highest-usage states are high for opposite reasons.
| State | Index | Composition | Intensity | Dominant |
|---|---|---|---|---|
| California | 1.473 | −0.00004 | +0.00071 | intensity |
| Washington | 1.204 | +0.00086 | −0.00057 | composition |
| Virginia | 1.064 | +0.00049 | −0.00040 | composition |
| New York | 1.031 | −0.00012 | +0.00016 | intensity |
| Texas | 0.542 | −0.00004 | −0.00061 | intensity |
| Florida | 0.496 | −0.00017 | −0.00055 | intensity |
Components in classified conversations per worker, against BLS OEWS May 2024 employment (154.2M workers, 22 SOC major groups). Decomposition identity residual: exactly 0.
A paper arguing that published statistics need better error discipline should hold itself to it. Each of these was caught by validation before release and each is documented in the manuscript.
None of this establishes that the Anthropic Economic Index is wrong. Every areal index has these properties; they follow from the construction, and the modifiable areal unit problem has been understood since 1934. The contribution is to size them for an index being cited in policy, and to ship tooling that re-runs the checks on each release.
It is worth saying plainly that this analysis was only possible because the publisher released the underlying data under an open licence. The properties measured here are almost certainly present in proprietary AI adoption statistics that cannot be examined at all.