I had certain Plot points that needed them to go to Termina, Namely that there are a few things they Needed in Termina that is not exactly Available in Hyrule, but they took it as a banishment. Basically they are such good characters, they should have thier own show. I am pretty sure Link d most of his Missions alone with only a Fairy to help