Employment experts have warned that, without a right to work, migrants and asylum seekers will be exploited by rogue employers.