Yes, you are. Little Britain and Little England are not the same term in their originality.
Little Englander was originally a term meant to belittle those who denigrated the Empire and its expansionism in favour of caring for matter closer to home. It has since taken on the term to mean those who only focus on England and isolationism, but this is usually said by those who are generally anti-English in their own beliefs, which is closer to "Little Britain". The original term was meant to express dissatifaction with the Government shirking responsibility towards it's own citizens and their wellbeing and the sentiment began in Liberal Manchester and coined by Imperial Tories.
Little Englander denigrated the growth of the Empire, especially as expansionism shirked responsibility to those living in poverty in England at the time. There were those who had tried to erase the identity of England entirely and replace it with "British" identity, similarly to what they tried to do in Ireland.