A lot of people voted to leave because of the EU. Nothing to do with immigration.
It's also a lot harder for us anyway due to our lack of enforced 2nd language learning. When I lived in Sweden learning the language was a requirement. Or at least trying to!
Will coming out of the EU mean it will be harder to work abroad?
I doubt it. They wouldn't be that stupid.
I think you're burying your head in the sand mate. We won't have freedom of movement and so by default of course it will be harder for Europeans to live and work here and for us vis versa.
I hope I'm wrong and a sensible arrangement can be agreed. Just can't see this stupid government being sensible and rational though.