Same thing happens to me. I've noticed that "shower time" or "bathroom break!" also tends to arrive not long after I finish the active exercise.
I practice anyway. And when it's time to shower or if I need to use the facilities, I do so. I figure a little practice and a little benefit is better than none at all.