Currently, there's this check:
|
if $link-msg.ends-with: ‘07fecb52eb1fd07397659f19a5cf36dc61f84053’ { |
|
grumble ‘The result looks a bit unrealistic. Most probably the output’ |
|
~ ‘ is different on every commit (e.g. 「bisect: say rand」)’ |
However, @lizmat++ and @Altai-man++ came up with an idea of doing this check automatically by comparing .moarvm files of the final commit and its parent.
I have a suspicion that rakudo in the past did not produce the same .moarvm file reproducibly, meaning that the check won't work on old commits. However, we can still do some checks, for example we can check if all changed files in the commit were to doc files.
Currently, there's this check:
whateverable/xbin/Bisectable.p6
Lines 266 to 268 in cf9bcd0
However, @lizmat++ and @Altai-man++ came up with an idea of doing this check automatically by comparing
.moarvmfiles of the final commit and its parent.I have a suspicion that rakudo in the past did not produce the same .moarvm file reproducibly, meaning that the check won't work on old commits. However, we can still do some checks, for example we can check if all changed files in the commit were to doc files.