[Sharak nods in agreement.] I can't verify anyone else I've named, just you and Genjo.

[Neither Kainé nor Celty had anyone around Sharak could ask, as far as she could tell. Not everyone is as obvious as the Saiyuki cast.]

Either memories are being altered beyond what we already know shinki forget, or we're being taken and returned before enough time passes for anyone to notice. [... Well, those are the two most simple answers.] That or we're dealing with branching timelines, but you remembering your time as a shinki contradicts that.