This isn't entirely true. According to SS, the region of the Gerudo Dessert was the location of the original Temple of Time and thus under direct jurisdiction of the Goddess Hylia herself. The Colossus is most likely the last structural evidence of her presence by the time of OoT and TP era. We...