If he remembered Link, he would have recognised him a member of his shop. Just saying. It makes a bit of sense--but not much... But a lot of stuff in the series make very little sense.
Think about it... They are both somewhat alternate worlds compared to the overworld of its prequel in which Link ends up ... Also, there are characters there that don't remember him; Cyclos, Beedle, et cetra...
Is there a connection? Think about the passage of time in Termina--alwats alter...