No- not if you play the inverted song of time.
Though- granted, Exploration is done best at certain points in the game.
I'd say that good points in the game to explore is when you save (N64) and/or reset the back to the first day- and only devote those current three days to exploration. When...