Scotland's housing crisis is being weaponised to create division over refugees and asylum seekers, a charity boss has warned.