Driftproof

bionemo-kermt-setup: worth installing? Reported results

Reported results for bionemo-kermt-setup (NVIDIA/skills) from NVIDIA, one row per receipt, in plain words.

Skill skills/bionemo-kermt-setup in NVIDIA/skills.

One row per receipt. No figure on this page combines two rows.

Reported by
Reported by NVIDIA in its benchmark card
Model
Claude Opus 4.8 (aws/anthropic/bedrock-claude-opus-4-8, as the source names it)
Harness
claude-code, version not stated
Date
2026-09-15
Tasks and runs
4 tasks, as printed
Result
NVIDIA reported a score of 80.5% overall and no uplift figure (3 attempts per task). Overall: 80.5% — baseline ran, but no comparable score was available; uplift unavailable Security: 100.0% → 50.0% (-50.0 points) Correctness: 40.0% → 100.0% (+60.0 points) Discoverability: 90.0% — baseline ran, but no comparable score was available; uplift unavailable Effectiveness: 31.9% → 78.8% (+46.9 points) Efficiency: 83.5% — baseline ran, but no comparable score was available; uplift unavailable
Tokens
1,402,843 tokens with the skill and 1,292,877 without, over all cases, as printed; the card gives no cost
Freshness
Reported on Opus 4.8. Registered opus models released after this run, as of the build date: Opus 5.5.
Skill commit
14a98ae278cec7e867695189d0f4003c08e4f765
Receipt
kermt-setup-aws-anthropic-bedrock-claude-opus-4-8-imported-nvidia-cards-claude-code-2026-09-15-2ba87f1a3b7f.json
Reported by
Reported by NVIDIA in its benchmark card
Model
GPT-5.5 (openai/openai/gpt-5.5, as the source names it)
Harness
codex, version not stated
Date
2026-09-15
Tasks and runs
4 tasks, as printed
Result
NVIDIA reported a score of 89.1% overall and no uplift figure (3 attempts per task). Overall: 89.1% — baseline ran, but no comparable score was available; uplift unavailable Security: 50.0% → 100.0% (+50.0 points) Correctness: 60.0% → 100.0% (+40.0 points) Discoverability: 92.7% — baseline ran, but no comparable score was available; uplift unavailable Effectiveness: 40.0% → 70.0% (+30.0 points) Efficiency: 82.6% — baseline ran, but no comparable score was available; uplift unavailable
Tokens
311,920 tokens with the skill and 568,520 without, over all cases, as printed; the card gives no cost
Freshness
Reported on GPT-5.5. Freshness unknown: the registry has no release date for it.
Skill commit
14a98ae278cec7e867695189d0f4003c08e4f765
Receipt
kermt-setup-openai-openai-gpt-5-5-imported-nvidia-cards-codex-2026-09-15-2ba87f1a3b7f.json

Figures from NVIDIA/skills at commit 14a98ae278cec7e867695189d0f4003c08e4f765, licensed CC BY 4.0. Reformatted by Driftproof; NVIDIA does not endorse this page.

Disagree, or want a re-run?

Built on from committed receipts.