More Permutations Do Not Always Increase Power: Non-monotonicity in Monte Carlo Permutation Tests

Suman Cha, Seongchan Lee, Antonin Schrab +1

Monte Carlo permutation tests are a cornerstone of valid, model-free statistical inference. A widely held practical intuition is that increasing the number of sampled permutations…