- Reported by
- Reported by NVIDIA in its benchmark card
- Model
- Claude Opus 4.8 (aws/anthropic/bedrock-claude-opus-4-8, as the source names it)
- Harness
- claude-code, version not stated
- Date
- 2026-09-15
- Tasks and runs
- 4 tasks, as printed
- Result
- NVIDIA reported a score of 80.5% overall and no uplift figure (3 attempts per task). Overall:
80.5% — baseline ran, but no comparable score was available; uplift unavailable
Security:100.0% → 50.0% (-50.0 points)
Correctness:40.0% → 100.0% (+60.0 points)
Discoverability:90.0% — baseline ran, but no comparable score was available; uplift unavailable
Effectiveness:31.9% → 78.8% (+46.9 points)
Efficiency:83.5% — baseline ran, but no comparable score was available; uplift unavailable
- Tokens
- 1,402,843 tokens with the skill and 1,292,877 without, over all cases, as printed; the card gives no cost
- Freshness
- Reported on Opus 4.8. Registered opus models released after this run, as of the build date: Opus 5.5.
- Skill commit
- 14a98ae278cec7e867695189d0f4003c08e4f765
- Receipt
- kermt-setup-aws-anthropic-bedrock-claude-opus-4-8-imported-nvidia-cards-claude-code-2026-09-15-2ba87f1a3b7f.json
bionemo-kermt-setup: worth installing? Reported results
Reported results for bionemo-kermt-setup (NVIDIA/skills) from NVIDIA, one row per receipt, in plain words.
Skill skills/bionemo-kermt-setup in NVIDIA/skills.
One row per receipt. No figure on this page combines two rows.
- Reported by
- Reported by NVIDIA in its benchmark card
- Model
- GPT-5.5 (openai/openai/gpt-5.5, as the source names it)
- Harness
- codex, version not stated
- Date
- 2026-09-15
- Tasks and runs
- 4 tasks, as printed
- Result
- NVIDIA reported a score of 89.1% overall and no uplift figure (3 attempts per task). Overall:
89.1% — baseline ran, but no comparable score was available; uplift unavailable
Security:50.0% → 100.0% (+50.0 points)
Correctness:60.0% → 100.0% (+40.0 points)
Discoverability:92.7% — baseline ran, but no comparable score was available; uplift unavailable
Effectiveness:40.0% → 70.0% (+30.0 points)
Efficiency:82.6% — baseline ran, but no comparable score was available; uplift unavailable
- Tokens
- 311,920 tokens with the skill and 568,520 without, over all cases, as printed; the card gives no cost
- Freshness
- Reported on GPT-5.5. Freshness unknown: the registry has no release date for it.
- Skill commit
- 14a98ae278cec7e867695189d0f4003c08e4f765
- Receipt
- kermt-setup-openai-openai-gpt-5-5-imported-nvidia-cards-codex-2026-09-15-2ba87f1a3b7f.json
Figures from NVIDIA/skills at commit 14a98ae278cec7e867695189d0f4003c08e4f765, licensed CC BY 4.0. Reformatted by Driftproof; NVIDIA does not endorse this page.
Built on from committed receipts.