Skip to content

Commit

Permalink
Loosen up reduction limits due to continued flakyness
Browse files Browse the repository at this point in the history
  • Loading branch information
PragTob committed Jan 12, 2025
1 parent abb0429 commit 80329a4
Showing 1 changed file with 5 additions and 5 deletions.
10 changes: 5 additions & 5 deletions test/benchee/benchmark/collect/reductions_test.exs
Original file line number Diff line number Diff line change
Expand Up @@ -7,22 +7,22 @@ defmodule Benchee.Collect.ReductionsTest do
assert {reductions, [1, 2, 3, 4, 5, 6, 7, 8, 9]} =
Reductions.collect(fn -> Enum.to_list(1..9) end)

# it seems that the JIT may or may not interfere here with the values as we get flakyness
# on higher OTP versions
# it seems that the JIT may interfere here with the values as we get flakyness
# on higher OTP versions and so we're loosening up the boundaries here, sadly
assert reductions >= 13
assert reductions <= 71
assert reductions <= 250

assert {reductions, [1, 2, 3, 4, 5, 6, 7, 8, 9, 10]} =
Reductions.collect(fn -> Enum.to_list(1..10) end)

assert reductions >= 14
assert reductions <= 61
assert reductions <= 250

assert {reductions, [1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11]} =
Reductions.collect(fn -> Enum.to_list(1..11) end)

assert reductions >= 14
assert reductions <= 64
assert reductions <= 250
end
end
end

0 comments on commit 80329a4

Please sign in to comment.