How so? Both adult Link and child link have access to it. Unless you are referring to the end, where it is in possession of Zelda, who uses it to send Link back. In which case, I still don't see you point.
Though;
Or, how time travel works. This point I have to agree with, to a point. I still...