The Driftproof receipt for reddit-automation on Claude Fable 5.2, from Report 019, dated 2026-11-11, and what it can say.
reddit-automation on claude-fable-5-2
Regressed
A case separated downward under the band rule. That is a separation detected under the rule, not proof that the skill moved the score.
Skill token cost: +2775 input and +220 output tokens per call against no skill (measured, grading excluded).
The two arms
| arm | mean | spread across cases | cases |
|---|---|---|---|
| with the skill | 0.806 | ± 0.061 | 3 |
| without the skill | 0.958 | ± 0.059 | 3 |
Lift -0.152, ± 0.085. A spread is the sample standard deviation of the per-case means: a descriptive spread with no coverage probability. The verdict above reads each case's two bands, not these aggregates.
This receipt also reads the skill against a same-length placebo. Report 019 shows that reading.
What was verified
receipt_hash verified when this page was built from receipts/report-019/campaign-002/2f03edf233b827a82579511775036d487d3b9369d3eda3ec3204e7748e488945.json; run.transcripts records retained-local.
Receipt hash: ecc1cb963a360697df5142934d4390b53ae7bcc091303a8d0c6ad56555757ebe
Check this file yourself
validate shows that this file is unchanged since it was sealed. It does not show who made it or who sealed it.
curl -fsSLO https://raw.githubusercontent.com/driftproofhq/driftproof/main/receipts/report-019/campaign-002/2f03edf233b827a82579511775036d487d3b9369d3eda3ec3204e7748e488945.json
npx driftproof@0.30.0 validate 2f03edf233b827a82579511775036d487d3b9369d3eda3ec3204e7748e488945.json
Reading on these tasks
worse than the fake on 1 of 3 tasks.