Not actually surprised. These people are evil, not stupid. He knows he drove away the low paid immigrant workers, they just want a way to blame them anyway.
Hallmark of fascism - the enemy is so strong that they'll steal your jobs, but also is weak and cowardly and deserves the poor treatment we give them.