If only there was some consistency in these decisions. Personally, I don't think 'contact' in any way 'entitles' you to go down, but if that is how the rule is to be interpreted, then so be it.
You would think it would be a simple matter to get the refs together in summer for a week or so, study videos, and agree that such and such is a penalty and so and so isn't. Then apply the rules consistently in all matches, and at all times. The selected interpretations could and should be made known to all interested parties before the season starts. After that, failure by any referee to implement 'policy' would be met by an immediate six match suspension or relegation to a lower level of the game.
Failure to work on this sort of simple stuff makes people believe, rightly or wrongly, that refs are incompetent or corrupt or both. This cannot be good for the reputation of the game, particularly when there is a clear suspicion that some teams are unduly favoured while others are denied stonewall penalties.