I prefer to hold 8-10 men with good armor and weapons. I almost never hire cheapest mercenaries (except brawlers, they can be really good).
And actually I’m doing pretty good on expert difficulty. So I think this is a matter of your playing style. If I understand correctly, it’s called extensive (quantity>quality) and intensive (quantity<quality) growth, both options can be effective.
