If you have plenty of definition to what is expected of you, or you have an almost defined workload with deadlines etc then I've no issue at all with people that 'take the piss'
For example, I know there are people at our place that take much longer to get certain things done than I do, and I've always been given pretty good feedback.
So the question is, are you paid for your time or for your output? The problem in this country is there is an inherent issue with presenteeism where working longer hours surely means working harder?
I've always seen it the complete opposite way, I'd be asking questions of those that are having to work much longer to get the work done, than those that are achieving and perhaps bending the rules slightly!