I can't say for sure if there's any sign or warning they get before they leave, but there's no pattern to it. They just disappear with no warning for the rest of us.

[And, really, that's the part that sucks. If they all had warnings, maybe it wouldn't hurt as bad.]