I don't remember it being explained at all, was it mentioned anywhere
-
A personal theory of mine is with the witness exiting our plane of existence and entering the travellers pale heart they ether stopped holding on to them as they were not of anymore use, or their connection was slightly weakened to holding them back and they came back without their presence (Or it was only temporary)