Only those with whom you have bound karmic accounts, in the past life, will be able to live with you together.