Sorry mate but people who advocate that people can come here without using a passport and stay to work without putting a viable number up that is too many are open border advocates. It's disingenuous to say otherwise.
First of all, let us be clear what an 'open border' is. An open border is like that between Greater Manchester and Yorkshire. If I decide to move to Huddersfield tomorrow then (unless I am under a court order to live at a particular address) I can, and I will have exactly the same rights and entitlements as someone born there. There is no Yorkshire Home Office to either licence my presence there or order my deportation. Even if I am a criminal of the worst kind, I cannot be deported back to Greater Manchester.
The UK has not had open borders since the first modern immigration laws passed in 1905, with the sole exception of the border with the Republic of Ireland. This latter is for historical reasons, as you know.
The former 'free movement' within the EU was not an open border. I could not have emigrated to Germany and dossed there on the dole for the rest of my life. But I could have dossed in Huddersfield. Do you mark the difference? Of course, if the German government had been as indolent and incompetent as the UK one, I might have got away with it, but that would be the fault of the German government, not the EU or freedom of movement as such.
I doubt 2% of the UK population advocates open borders. I certainly do not, and I am pretty left-wing. I do favour freedom of movement with the EU, but with the relevant controls exercised, not ignored because they are too much trouble. If that involves having ID cards, so be it.
As for asylum seekers, arguably they should not be mixed up with the immigration question at all. They are a separate case. Most (a good 70%) qualify for asylum here. The long delays in processing them and either accepting or rejecting their claims are the real problem.
The only solution is to cut a deal with the EU. We process them in France, take our agreed share of the total and return any who arrive by boat or lorry back to France. The problem is that we would have to take
some when some people would like us to take
none. But that's reality for you - you have to compromise.