Not that weird - I've had the idea before, but for an entirely different reason. In this old thread, my idea was that the temple was completely silent at first, and throughout the dungeon you had to release instruments, and as you did so, its melody was added to the background music. Defeating the boss at the end of the dungeon would release the voice of its sage, singing the song of healing. (I may or may not have gotten the idea from Ariel's voice being in Ursula's necklace in the Little Mermaid, heh.)
I also like the idea of puzzles being in the form of music notes. Perhaps you would have to find sheet music throughout the dungeon (in the form of A ^ >) in order to learn songs that will unlock doors.
That reminded me of the room in Luigi's Mansion with the Instruments. http://www.youtube.com/watch?v=q98u_mIwYNg
Mario theme, I Love it!! <3