Temple of time was always supposed to be in the forest. It was only in town for OOT to show the player the devastation of Ganondorfs reign.
In TP the temple of time is in the forest as it is in all the other games. I'd say its appearance in OOT's town is something to be ignored as it was only...