It's the subtle disparities in decision making that gets to the players. Kev and Phil well off the boil because of the way the game was being 'managed'. Real players were emboldened, and that gave them the edge.
It's something that's often difficult to pick up on when you get wrapped up in the action, but if you take a step back and just observe the actions of the officials you'll see subtle differences that make huge differences to the outcome of games.
Anyone remember the moment in the 1st half where the referee fist bumped Modric? Our players would have picked up on that 100% and I'm sure it must have got to them big time because that would NEVER happen if the game is being moderated fairly.