Currently, wearing anything heavier than Mail requires you take either Brawler or have a very high fatigue merc (Strong, Lumberjack, Hedge Knight, Iron Lungs)
And wearing plate requires you have both.
In reality, it took years of training for a man to be able to fight well in plate, and this is reflected in game.