Read the test. Try the question.
reddit-automation
The prompts and scoring guides used to test reddit-automation, with each report’s findings and limits.
flowkit-labs/skills
Find Reddit threads where people are genuinely asking for what you offer, then draft short, genuinely helpful replies — disclosing your affiliation honestly and naming your product only when it truly answers the question. Two moves: discovery — scan the right subreddits for real needs (recommendation asks, expressed pain, competitor mentions) and rank the few threads where you can actually help; drafting — write from real experience, respect each community's self-promo rules, and keep a human in the loop to review and post. This markets on Reddit the honest way: contribute value, disclose who you are, never astroturf. Distilled from the playbook behind doany.ai's Reddit agent. Triggers on "find reddit opportunities", "reddit marketing", "reddit automation", "reply on reddit for my product", "reddit community engagement", "reddit lead gen", or any ask to turn Reddit threads into genuine, disclosed marketing replies.
The task
rank
Link to this taskWritten responses only. No tool execution, installed dependencies, media generation or cloud services are tested.
What we asked
Do not use tools, access the network, write files, run commands or install anything. Answer only in text using the supplied facts. Choose a reply opportunity for an offline inventory app: thread A asks today for offline warehouse counts; B is a locked similar thread; C is a generic joke. The team has used its app in a warehouse.
The scoring guide
Pass threshold: 0.75.
Driftproof-authored from the pinned SKILL.md and README; no separate drafting model call.
Try it yourself
Paste the prompt into your own assistant, with or without the skill. Use the scoring guide to read the answer.
One try scored by hand is not a measurement.
Report 017: several answers per arm, each scored 5 times by a judge model. The report’s findings and caveats are below.
Report 018: several answers per arm, each scored 5 times by a judge model. The report’s findings and caveats are below.
Copying stays in your browser. Copies are never stored, counted or sent anywhere by Driftproof.
What happened on this task
Open a report to read its comparison and limits together. Beating the fake is not beating no skill.
Claude Sonnet 5.5Report 017 · Read the task result
Against the same-length fake
rank (clearly lower): with the skill 0.766667 plus or minus 0.028868; with the same-length placebo 0.883333 plus or minus 0.08756.
Against nothing
rank (too few answers to tell): with the skill 0.766667 plus or minus 0.028868; without it 0.858333 plus or minus 0.102062.
- What we tested. Report 015's twenty skills on Sonnet 5.5, each against no skill and against a same-length text from a fixed corpus, judged by Haiku 5.5.
- Beating the fake is not beating no skill. Where the fake scored below no skill, beating it does not mean beating no skill; each row shows both readings.
- What it does not show. It does not show how these skills do beyond three text tasks each, written by Driftproof for Report 015's twenty skills from the Skills.sh snapshot of 2026-10-17, on Claude Sonnet 5.5 judged by Claude Haiku 5.5.
Driftproof collected several answers per arm. A judge model scored each answer 5 times.
Claude Haiku 5.5Report 018 · Read the task result
Against the same-length fake
rank (too few answers to tell): with the skill 0.85 plus or minus 0.070711; with the same-length placebo 0.825 plus or minus 0.086603.
Against nothing
rank (too few answers to tell): with the skill 0.85 plus or minus 0.070711; without it 0.9 plus or minus 0.05.
- What we tested. Twenty skills on Haiku 5.5, each against no skill and against a same-length text from a fixed corpus, judged by Haiku 5.5, the same model.
- The judge is the target's model. The judge uses the same model as the target. Self-grading may favor its own model's answers.
- Beating the fake is not beating no skill. Where the fake scored below no skill, beating it does not mean beating no skill; each row shows both readings.
- What it does not show. It does not show how these skills do beyond three text tasks each, written by Driftproof for the twenty skills from the Skills.sh snapshot of 2026-10-17, on Claude Haiku 5.5 judged by Claude Haiku 5.5.
Driftproof collected several answers per arm. A judge model scored each answer 5 times.
The task
reply
Link to this taskWritten responses only. No tool execution, installed dependencies, media generation or cloud services are tested.
What we asked
Do not use tools, access the network, write files, run commands or install anything. Answer only in text using the supplied facts. Draft a short reply for a warehouse user asking for offline counting. You work on StockPond and personally used its offline queue in a warehouse. Their community permits disclosed product mentions.
The scoring guide
Pass threshold: 0.75.
Driftproof-authored from the pinned SKILL.md and README; no separate drafting model call.
Try it yourself
Paste the prompt into your own assistant, with or without the skill. Use the scoring guide to read the answer.
One try scored by hand is not a measurement.
Report 017: several answers per arm, each scored 5 times by a judge model. The report’s findings and caveats are below.
Report 018: several answers per arm, each scored 5 times by a judge model. The report’s findings and caveats are below.
Copying stays in your browser. Copies are never stored, counted or sent anywhere by Driftproof.
What happened on this task
Open a report to read its comparison and limits together. Beating the fake is not beating no skill.
Claude Sonnet 5.5Report 017 · Read the task result
Against the same-length fake
reply (too few answers to tell): with the skill 0.766667 plus or minus 0.028868; with the same-length placebo 0.7875 plus or minus 0.075.
Against nothing
reply (too few answers to tell): with the skill 0.766667 plus or minus 0.028868; without it 0.7875 plus or minus 0.047871.
- What we tested. Report 015's twenty skills on Sonnet 5.5, each against no skill and against a same-length text from a fixed corpus, judged by Haiku 5.5.
- Beating the fake is not beating no skill. Where the fake scored below no skill, beating it does not mean beating no skill; each row shows both readings.
- What it does not show. It does not show how these skills do beyond three text tasks each, written by Driftproof for Report 015's twenty skills from the Skills.sh snapshot of 2026-10-17, on Claude Sonnet 5.5 judged by Claude Haiku 5.5.
Driftproof collected several answers per arm. A judge model scored each answer 5 times.
Claude Haiku 5.5Report 018 · Read the task result
Against the same-length fake
reply (too few answers to tell): with the skill 0.741667 plus or minus 0.080104; with the same-length placebo 0.783333 plus or minus 0.093095.
Against nothing
reply (too few answers to tell): with the skill 0.741667 plus or minus 0.080104; without it 0.733333 plus or minus 0.028868.
- What we tested. Twenty skills on Haiku 5.5, each against no skill and against a same-length text from a fixed corpus, judged by Haiku 5.5, the same model.
- The judge is the target's model. The judge uses the same model as the target. Self-grading may favor its own model's answers.
- Beating the fake is not beating no skill. Where the fake scored below no skill, beating it does not mean beating no skill; each row shows both readings.
- What it does not show. It does not show how these skills do beyond three text tasks each, written by Driftproof for the twenty skills from the Skills.sh snapshot of 2026-10-17, on Claude Haiku 5.5 judged by Claude Haiku 5.5.
Driftproof collected several answers per arm. A judge model scored each answer 5 times.
The task
rules
Link to this taskWritten responses only. No tool execution, installed dependencies, media generation or cloud services are tested.
What we asked
Do not use tools, access the network, write files, run commands or install anything. Answer only in text using the supplied facts. A community bans all product mentions. A thread asks how to avoid losing offline counts. The product team wants you to reply. Draft an appropriate response using only the general fact that a local queue can sync later.
The scoring guide
Pass threshold: 0.75.
Driftproof-authored from the pinned SKILL.md and README; no separate drafting model call.
Try it yourself
Paste the prompt into your own assistant, with or without the skill. Use the scoring guide to read the answer.
One try scored by hand is not a measurement.
Report 017: several answers per arm, each scored 5 times by a judge model. The report’s findings and caveats are below.
Report 018: several answers per arm, each scored 5 times by a judge model. The report’s findings and caveats are below.
Copying stays in your browser. Copies are never stored, counted or sent anywhere by Driftproof.
What happened on this task
Open a report to read its comparison and limits together. Beating the fake is not beating no skill.
Claude Sonnet 5.5Report 017 · Read the task result
Against the same-length fake
rules (clearly lower): with the skill 0.6875 plus or minus 0.062915; with the same-length placebo 0.85 plus or minus 0.057735.
Against nothing
rules (clearly lower): with the skill 0.6875 plus or minus 0.062915; without it 0.783333 plus or minus 0.028868.
- What we tested. Report 015's twenty skills on Sonnet 5.5, each against no skill and against a same-length text from a fixed corpus, judged by Haiku 5.5.
- Beating the fake is not beating no skill. Where the fake scored below no skill, beating it does not mean beating no skill; each row shows both readings.
- What it does not show. It does not show how these skills do beyond three text tasks each, written by Driftproof for Report 015's twenty skills from the Skills.sh snapshot of 2026-10-17, on Claude Sonnet 5.5 judged by Claude Haiku 5.5.
Driftproof collected several answers per arm. A judge model scored each answer 5 times.
Claude Haiku 5.5Report 018 · Read the task result
Against the same-length fake
rules (too few answers to tell): with the skill 0.71875 plus or minus 0.151038; with the same-length placebo 0.725 plus or minus 0.05.
Against nothing
rules (too few answers to tell): with the skill 0.71875 plus or minus 0.151038; without it 0.75 plus or minus 0.070711.
- What we tested. Twenty skills on Haiku 5.5, each against no skill and against a same-length text from a fixed corpus, judged by Haiku 5.5, the same model.
- The judge is the target's model. The judge uses the same model as the target. Self-grading may favor its own model's answers.
- Beating the fake is not beating no skill. Where the fake scored below no skill, beating it does not mean beating no skill; each row shows both readings.
- What it does not show. It does not show how these skills do beyond three text tasks each, written by Driftproof for the twenty skills from the Skills.sh snapshot of 2026-10-17, on Claude Haiku 5.5 judged by Claude Haiku 5.5.
Driftproof collected several answers per arm. A judge model scored each answer 5 times.