I can't speak, as you do, for "most of us", but as far as I'm concerned, I'm grateful that VAR is there to, at least, keep some sort of check on the worst refereeing decisions, deliberate or not..
For example, the clear penalty on Sunday which was given by VAR but not by the ref.
Some decisions are still arguable, that's the nature of football and with the rise of fananalysis both in social and mainstream media, extreme hysterical reaction is lucrative and, therefore, omnipresent. Couple that with society educating people that they can never be wrong, that "their truth" is as valid as the reality and you get an unwillingness to accept any decision that doesn't agree with their own. To imagine that there would be less controversy without VAR is, in my opinion, fanciful.