The Driftproof receipt for improve-codebase-architecture on Claude Fable 5.2, from Report 019, dated 2026-11-11, and what it can say.
improve-codebase-architecture on claude-fable-5-2
Not enough draws
Not enough draws to conclude at this effect floor.
Draws needed: no draw count at these spreads (case candidate: the two arms' spreads sum to 0.141, at or above the 0.05 floor).
Skill token cost: +2146 input and +348 output tokens per call against no skill (measured, grading excluded).
The two arms
| arm | mean | spread across cases | cases |
|---|---|---|---|
| with the skill | 0.826 | ± 0.151 | 3 |
| without the skill | 0.790 | ± 0.115 | 3 |
No lift is stated for a state that did not measure one. A spread is the sample standard deviation of the per-case means: a descriptive spread with no coverage probability. The verdict above reads each case's two bands, not these aggregates.
This receipt also reads the skill against a same-length placebo. Report 019 shows that reading.
What was verified
receipt_hash verified when this page was built from receipts/report-019/campaign-001/c62698b9ae89a64d7c90bd052726325b73d11d27ecbbddc35be0a1d98d34a78d.json; run.transcripts records retained-local.
Receipt hash: c44af9665c99f35e673fe83c158205785c7743bc13cddba2289ab17170341c83
Check this file yourself
validate shows that this file is unchanged since it was sealed. It does not show who made it or who sealed it.
curl -fsSLO https://raw.githubusercontent.com/driftproofhq/driftproof/main/receipts/report-019/campaign-001/c62698b9ae89a64d7c90bd052726325b73d11d27ecbbddc35be0a1d98d34a78d.json
npx driftproof@0.30.0 validate c62698b9ae89a64d7c90bd052726325b73d11d27ecbbddc35be0a1d98d34a78d.json
Reading on these tasks
beat the fake on 1 of 3 tasks, worse on none.