It is precisely hiking in the mountains that is inconvenient.
If there is a lot of slippery ice, then it is very inconvenient, especially when going downhill.
Fortunately, in Skyrim, there is a horse and the Whirlwind Sprint shout; if you need to jump from a height, it negates the disadvantages.