Anton Du Beke’s co-star claims judges ‘get warned’ if they disagree with change