Clock Town for pretty obvious reasons. No other town in the series has given this much depth to its characters and locations.
Windfall is pretty great too for similar reasons, along with the heavy implications of its connection with Kakariko.
For that matter, OoT Kakariko has some neat passive...