Your question seems more geared towards puzzle difficulty, and for me the Master Quest version of the Spirit Temple confused me the most. In terms of hardest to complete, most dungeons in Zelda 2 are harder than every other dungeon in the series with the Great Palace being the single most difficult.