The Water Temple isn't really hard in my opinion, just annoying.
All of the dungeons in AoL should be banned from this thread because the whole game is hard.
Besides AoL I'd say the Stone Tower Temple is the hardest. I thought all four of the dungeons of that game were difficult enough to make...