Aside from it being an intentionally amusing comment, no I don't think it is a case of 'fair's fair'.
The circumstances are very different. There have been cases highlighted, where a recalcitrant horse has been witnessed getting struck with a riding crop outside of a race and that was definitely not accepted behaviour from the equine world.
As I pointed out, using the cushioned, padded whip on a 1200lb horse while racing, would probably be less painful than me getting a knock while playing football. Take the two same instances out of the sporting, competitive environment and the feeling would be different, certainly from my perspective.
I don't think the whip of today has any detrimental effect on a horse.