Skip to content

Source the numbers that had no artifact, and put the units back - #173

Merged
vahid-ahmadi merged 1 commit into
mainfrom
fix/unsourced-numbers-and-units
Aug 12, 2026
Merged

Source the numbers that had no artifact, and put the units back#173
vahid-ahmadi merged 1 commit into
mainfrom
fix/unsourced-numbers-and-units

Conversation

@vahid-ahmadi

Copy link
Copy Markdown
Contributor

Three claims with nothing committed behind them, and one regression I introduced.

svar/index published six numbers with no source

Four shock probabilities and a two-figure revision decomposition appeared on that page and nowhere else in the repository, while every other number on it cites current_forecast.json.

Running latest_shocks at production draws confirms the four probabilities exactly — world demand 0.713, world energy 0.895, UK demand 0.809, monetary policy 0.840. They were right, just untraceable. The response is now committed as papers/boe-svar/figures/latest_shocks.json and the page cites it with its draw counts (6,000 draws, 430 accepted, ESS 198).

The revision figures do not survive. The page claimed +0.27pp on GDP and +0.22pp on CPI for the 2026Q1 round. The paper reports +0.40pp and −0.22pp for 2024Q2 — different quarter, different values, opposite sign on CPI. No artifact holds them, no exposed MCP tool produces that decomposition, and their resemblance to the paper's numbers with a flipped sign is the profile of a figure transcribed loosely. Removed rather than reworded.

obr/validation explained a six-fold gap with something untrue

Its held-add-factor scorecard reports GDP 0.37% against the working paper's 2.2%, reconciled as the paper covering "its own longer window". The paper says "held constant, projected over 2026Q1–2027Q4" — the same window. The difference is the EFO vintage, November 2025 against March 2026. The page now says so.

The units regression is mine

Moving the readings onto the topic pages took stored() with them, so the public-finances headline read -15,989.0 where the page it replaced said £16.0bn borrowed — and £77.1bn and £749/week stopped appearing on the site at all.

Stored-exactly-as-published is the right principle for the method note and the fidelity claim, not for the first number a reader meets. display() renders scale and unit in the headline and keeps the exact stored value on the line beneath. It also preserves the publisher's precision, so a stored 5.0 is 5.0% and not 5%.

page headline now
public finances £16.0bn borrowed · 94.9%
jobs 5.0% · 712k · £749/week
growth £709.6bn · 103.2 · £77.1bn

Verification

Twelve generator and contract gates, 1107 tests.

🤖 Generated with Claude Code

Three claims with nothing committed behind them, and one regression I
introduced.

svar/index published four shock probabilities and a two-figure revision
decomposition that appeared on that page and nowhere else in the repository,
while every other number on it cites current_forecast.json. Running
latest_shocks at production draws confirms the four probabilities exactly —
world demand 0.713, world energy 0.895, UK demand 0.809, monetary policy
0.840 — so they were right, just untraceable. The response is committed as
papers/boe-svar/figures/latest_shocks.json and the page now cites it with
its draw counts.

The revision figures do not survive. The page claimed +0.27pp on GDP and
+0.22pp on CPI for the 2026Q1 round; the paper reports +0.40pp and −0.22pp
for 2024Q2 — a different quarter, different values, and the opposite sign on
CPI. No artifact holds them, no exposed tool produces them, and their
resemblance to the paper's numbers with a flipped sign is the profile of a
figure that was transcribed loosely. Removed rather than reworded.

obr/validation explained a six-fold gap with a fact that is not true. Its
held-add-factor scorecard reports GDP 0.37% against the working paper's
2.2%, reconciled as the paper covering "its own longer window". The paper
says "held constant, projected over 2026Q1–2027Q4" — the same window. The
difference is the EFO vintage, November 2025 against March 2026, and the
page now says so.

The regression is mine. Moving the readings onto the topic pages took
stored() with them, so the public-finances headline read "-15,989.0" where
the page it replaced said "£16.0bn borrowed", and "£77.1bn" and "£749/week"
stopped appearing on the site at all. Stored-exactly-as-published is the
right principle for the method note and the fidelity claim, not for the
first number a reader meets. display() renders scale and unit in the
headline and keeps the exact stored value on the line beneath — and
preserves the publisher's precision, so a stored 5.0 is 5.0% and not 5%.

Twelve gates, 1107 tests.

Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
@vercel

vercel Bot commented Aug 12, 2026

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated (UTC)
macromod Ready Ready Preview Aug 12, 2026 1:43pm

Request Review

@vahid-ahmadi
vahid-ahmadi merged commit 1f1c49b into main Aug 12, 2026
6 checks passed
@vahid-ahmadi
vahid-ahmadi deleted the fix/unsourced-numbers-and-units branch August 12, 2026 13:44
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant