The skill clearly helped: 0.939 with it and 0.785 without, on 3 test tasks.
runtime, template: higher scores with the skill. Compare task scores
Task score bands: runtime (separated-up): with skill 0.816667 plus or minus 0.028868; without skill 0.733333 plus or minus 0.028868; template (separated-up): with skill 1 plus or minus 0; without skill 0.6375 plus or minus 0.075.
A band is the average score plus or minus the recorded spread. These task bands, not the overall averages, determine the result.
0.939 with the skill and 0.785 without; on at least one of the 3 test tasks, the two ranges of scores (the average plus or minus one spread) did not overlap, and the gap was at least 0.05.
Test details and sourcesHow this result was decided
The reader applies the task rule, with a separated-down task taking precedence. Overall means do not determine the verdict. Bands show the mean plus or minus the recorded spread; point bands can reflect score quantization.
timeline: underpowered. With skill 1 plus or minus 0; without skill 0.983333 plus or minus 0.028868.
runtime: separated-up. With skill 0.816667 plus or minus 0.028868; without skill 0.733333 plus or minus 0.028868.
template: separated-up. With skill 1 plus or minus 0; without skill 0.6375 plus or minus 0.075.
Three text-only tasks. Driftproof wrote the suite from the pinned skill description and README. These are not author-supplied tests. External tools, generated media and deployed services were not tested.
The eval account's configuration was read and found clean before and after each run, not during it.
The skill clearly helped: 0.880 with it and 0.506 without, on 3 test tasks.
timeline, runtime, template: higher scores with the skill. Compare task scores
Task score bands: timeline (separated-up): with skill 1 plus or minus 0; without skill 0.75 plus or minus 0.05; runtime (separated-up): with skill 0.64 plus or minus 0.065192; without skill 0.2 plus or minus 0.05; template (separated-up): with skill 1 plus or minus 0; without skill 0.566667 plus or minus 0.028868.
A band is the average score plus or minus the recorded spread. These task bands, not the overall averages, determine the result.
0.880 with the skill and 0.506 without; on at least one of the 3 test tasks, the two ranges of scores (the average plus or minus one spread) did not overlap, and the gap was at least 0.05.
Test details and sourcesHow this result was decided
The reader applies the task rule, with a separated-down task taking precedence. Overall means do not determine the verdict. Bands show the mean plus or minus the recorded spread; point bands can reflect score quantization.
timeline: separated-up. With skill 1 plus or minus 0; without skill 0.75 plus or minus 0.05.
runtime: separated-up. With skill 0.64 plus or minus 0.065192; without skill 0.2 plus or minus 0.05.
template: separated-up. With skill 1 plus or minus 0; without skill 0.566667 plus or minus 0.028868.
Three text-only tasks. Driftproof wrote the suite from the pinned skill description and README. These are not author-supplied tests. External tools, generated media and deployed services were not tested.
The eval account's configuration was read and found clean before and after each run, not during it.
