Since Kaepora Gaebora was originally a sage. And, believe it or not, They had originally made a Wind temple just for K.G, along with a Light Temple of Raurur
Anyway, K.G wasn't annoying. Especially for me. It is your(generally speaking) own fault for continuously clicking the "A" button...