Get solid armor +150 HP(better more) with helmet and Battle forged perk(-20% anti armor weapon effectiveness) plus kite shield and you are set.
Shield will block half the arrows and rest will have problem with penetrating armor as goblin bows have very little damage and armor effectiveness.
Having 70+ HP and 9 Lives perk also saves you from lucky dagger hit.
Still they are dodgy bastards.
