One scheduled speaker has also pulled out of the New York-based event and specifically pointed to Trump’s mass deportation efforts.