"The physical changes don't fade, no - memories act like normal memories, though."

Unless there's something particularly traumatic about them or you're the sort of being who can't forget anything coughcough.