The skill clearly helped: 0.955 with it and 0.644 without, on 3 test tasks.
loop, timeline, render: higher scores with the skill. Compare task scores
Task score bands: loop (separated-up): with skill 0.906 plus or minus 0.068411; without skill 0.6875 plus or minus 0.047871; timeline (separated-up): with skill 0.983333 plus or minus 0.028868; without skill 0.5875 plus or minus 0.094648; render (separated-up): with skill 0.975 plus or minus 0.05; without skill 0.658333 plus or minus 0.073598.
A band is the average score plus or minus the recorded spread. These task bands, not the overall averages, determine the result.
0.955 with the skill and 0.644 without; on at least one of the 3 test tasks, the two ranges of scores (the average plus or minus one spread) did not overlap, and the gap was at least 0.05.
Test details and sourcesHow this result was decided
The reader applies the task rule, with a separated-down task taking precedence. Overall means do not determine the verdict. Bands show the mean plus or minus the recorded spread; point bands can reflect score quantization.
loop: separated-up. With skill 0.906 plus or minus 0.068411; without skill 0.6875 plus or minus 0.047871.
timeline: separated-up. With skill 0.983333 plus or minus 0.028868; without skill 0.5875 plus or minus 0.094648.
render: separated-up. With skill 0.975 plus or minus 0.05; without skill 0.658333 plus or minus 0.073598.
Three text-only tasks. Driftproof wrote the suite from the pinned skill description and README. These are not author-supplied tests. External tools, generated media and deployed services were not tested.
The eval account's configuration was read and found clean before and after each run, not during it.
The skill clearly helped: 0.933 with it and 0.592 without, on 3 test tasks.
loop, timeline, render: higher scores with the skill. Compare task scores
Task score bands: loop (separated-up): with skill 0.9 plus or minus 0.05; without skill 0.5875 plus or minus 0.131498; timeline (separated-up): with skill 1 plus or minus 0; without skill 0.6125 plus or minus 0.160078; render (separated-up): with skill 0.9 plus or minus 0.05; without skill 0.575 plus or minus 0.178341.
A band is the average score plus or minus the recorded spread. These task bands, not the overall averages, determine the result.
0.933 with the skill and 0.592 without; on at least one of the 3 test tasks, the two ranges of scores (the average plus or minus one spread) did not overlap, and the gap was at least 0.05.
Test details and sourcesHow this result was decided
The reader applies the task rule, with a separated-down task taking precedence. Overall means do not determine the verdict. Bands show the mean plus or minus the recorded spread; point bands can reflect score quantization.
loop: separated-up. With skill 0.9 plus or minus 0.05; without skill 0.5875 plus or minus 0.131498.
timeline: separated-up. With skill 1 plus or minus 0; without skill 0.6125 plus or minus 0.160078.
render: separated-up. With skill 0.9 plus or minus 0.05; without skill 0.575 plus or minus 0.178341.
Three text-only tasks. Driftproof wrote the suite from the pinned skill description and README. These are not author-supplied tests. External tools, generated media and deployed services were not tested.
The eval account's configuration was read and found clean before and after each run, not during it.
