In the midst of the surging anti-EU tide in the UK, the issue of immigration has generated the most emotive responses