It's pretty random, so far as I've heard. The main problem is that you don't really know for sure that they've gone home unless they come back.

I went home a couple months ago and didn't even know I'd been here until I got back, and even then I didn't remember exactly, at first.