Harris is scheduled to stop in El Paso, Texas on Friday, a significant intersection area for migrants traveling to the United States.
The actor says his words were "taken out of context."
The organization expressed its outrage in a heated petition.