If you piss loan clubs off, it suddenly becomes a lot harder to find decent loans for your players.
This. Norwich will have completed their summer transfer window knowing they had a good player in that position (expectedly) for the season.
If we recall him (even if the agreement permits it) then it's possibly the difference between them getting promoted and not.
At a massive stretch, if they get promoted and have done right by them, they'll side with us on some voting matters in the PL.
All of this might be irrelevant and worth doing if we'd end up playing Doyle week in week out, but chances are he'd get 10 minutes as sub in a lot of matches plus some starts in dead CL games.