After several thousand fights, mathematically the luck should even out to roughly the same for everyone. It's only if you try something like a best 2 out of 3 contest that it would be a problem. If the numbers are small, you can get very lucky or very unlucky.