Players live on their reputations, and while that can be a good thing at times, that's why a ref might hesitate to give Drogba a penalty, why Fergie and Wenger used to go on about their players not getting enough protection, though it's not supposed to, outside and other factors influence a refs call, even if they don't know they're doing it, at the end of the day they're only human and their decision can be and has been influenced by things that happen off the field or have happened in previous games.
Sadly NDJ will be living on this rep for a while. Nothing he can do but ride it out.