Driftproof

bionemo-molmim-nim: worth installing? Reported results

Reported results for bionemo-molmim-nim (NVIDIA/skills) from NVIDIA, one row per receipt, in plain words.

Skill skills/bionemo-molmim-nim in NVIDIA/skills.

One row per receipt. No figure on this page combines two rows.

Reported by
Reported by NVIDIA in its benchmark card
Model
Claude Opus 4.8 (aws/anthropic/bedrock-claude-opus-4-8, as the source names it)
Harness
claude-code, version not stated
Date
2026-09-23
Tasks and runs
1 task, as printed
Result
NVIDIA reported a score of 88.7% overall and no uplift figure (3 attempts per task). Overall: 88.7% — baseline ran, but no comparable score was available; uplift unavailable Security: 0.0% → 100.0% (+100.0 points) Correctness: 100.0% → 100.0% (±0.0 points) Discoverability: 85.0% — baseline ran, but no comparable score was available; uplift unavailable Effectiveness: 100.0% → 92.9% (-7.1 points) Efficiency: 65.7% — baseline ran, but no comparable score was available; uplift unavailable
Tokens
1,346,736 tokens with the skill and 1,125,898 without, over all cases, as printed; the card gives no cost
Freshness
Reported on Opus 4.8. The registry lists no opus model released after this run, as of the build date.
Skill commit
14a98ae278cec7e867695189d0f4003c08e4f765
Receipt
molmim-nim-aws-anthropic-bedrock-claude-opus-4-8-imported-nvidia-cards-claude-code-2026-09-23-9ff3680aee8a.json
Reported by
Reported by NVIDIA in its benchmark card
Model
GPT-5.5 (openai/openai/gpt-5.5, as the source names it)
Harness
codex, version not stated
Date
2026-09-23
Tasks and runs
1 task, as printed
Result
NVIDIA reported a score of 81% overall and no uplift figure (3 attempts per task). Overall: 81.0% — baseline ran, but no comparable score was available; uplift unavailable Security: 100.0% → 50.0% (-50.0 points) Correctness: 100.0% → 100.0% (±0.0 points) Discoverability: 90.0% — baseline ran, but no comparable score was available; uplift unavailable Effectiveness: 78.6% → 100.0% (+21.4 points) Efficiency: 64.8% — baseline ran, but no comparable score was available; uplift unavailable
Tokens
586,246 tokens with the skill and 365,343 without, over all cases, as printed; the card gives no cost
Freshness
Reported on GPT-5.5. Freshness unknown: the registry has no release date for it.
Skill commit
14a98ae278cec7e867695189d0f4003c08e4f765
Receipt
molmim-nim-openai-openai-gpt-5-5-imported-nvidia-cards-codex-2026-09-23-9ff3680aee8a.json

Figures from NVIDIA/skills at commit 14a98ae278cec7e867695189d0f4003c08e4f765, licensed CC BY 4.0. Reformatted by Driftproof; NVIDIA does not endorse this page.

Disagree, or want a re-run?

Built on from committed receipts.