"These are folks that have been here for decades, have long standing ties to the community, family members, employment, businesses that are all being torn apart," said one attorney