Yes, I think a deserter group would function much like bandits or brigands. They will run from any larger group but attempt to attack caravans, peasents etc etc.
I think this is the easiest suggestion to implement to be honest. Hope the devs pick it up.
