What would be good settings for evaluating the balance of a different armies variant? I've tried some tests with 0:30+10 and Medium variation but got conflicting results.
Your results are understandable. Although the armies are not balanced, they are close, so you need to play a *LOT* of games to get valid results that are not swallowed up by noise. At a time control of 30+1, you can't play many games. And such long controls aren't necessary since with games on an 8x8 board ChessV can reach a search depth of 10 in a fraction of a second on a modern computer. But the other thing to watch out for is that you aren't playing the same game over and over. The search variation setting helps, but I also use different pre-calculated opening lines. I will post more about this soon ...
Your results are understandable. Although the armies are not balanced, they are close, so you need to play a *LOT* of games to get valid results that are not swallowed up by noise. At a time control of 30+1, you can't play many games. And such long controls aren't necessary since with games on an 8x8 board ChessV can reach a search depth of 10 in a fraction of a second on a modern computer. But the other thing to watch out for is that you aren't playing the same game over and over. The search variation setting helps, but I also use different pre-calculated opening lines. I will post more about this soon ...