As our wiki says – difficulty scales prices in towns, first money/tools/food and size of enemy bands, and amount bands/camps on map.
This is not what’s being asked. OP’s question is not about difficulty chosen at the beginning of the game, which your answer explains. The question is, what in-game factors cause the world and enemy armies to become more dangerous.
