I found the Stone Tower by far to be the most difficult. I ending up switching "gravity" you could say, several times because I had no idea where I was going or what I had to do. Finding all the fairies in that place was a huge pain too, and I finally had to resort to the ZD Fairy walk through...