After 20 or 30 minutes the skin becomes more taut therefore the hair shaft is more exposed making it easier.
But it doesn't hurt to use the other speeds for special occasions, you'll notice a dissimilarity. You'll need something inciting you to action.your ultimate "Why".