I playing on deadly atm and i´ve killed hoggart both times I´ve started a game. Like on day 2-3 after you go get more men.
Use high ground and pray the RNG gods are in your favour. Both times it was really close fights, but both times i won.
Killing the thugs early might make a few of them run. Then you only need to deal with hoggart.
