I'm not entirely sure it's something you can answer, but for the longest time, when people would be returned to their homeworld and brought back to Prismatica, the story across the board is that no one remembered their time on the latter while they were home, but their memories were instantly present upon their return.

After we essentially cleaned up the gods' mess in that world, we were guaranteed our memories beyond it and accessibility to that planet through a prism gifted to us.

I'm not sure what this means as far as time and memory in that situation or how it connects or relates to things here, but... when a person returns under normal conditions, outside of the loops, what do you think happens without interference in that sort of situation where they're taken to and fro unnaturally from one world to another?