You are right, sometimes high expectations would only slow you down. It's better to take it slow and improve gradually.