Maybe it's because they can't be with their brother and have to leave Frisk soon...?