Whitby is brilliant for all sorts of reasons.
I'd also throw in Helmsley in Yorkshire and Cartmel in Cumbria, both have loads of character and decent pubs. With the odd crap shop thrown in for the misses.
Stopped in Helmsley today on a school trip to Sutton Bank's white horse, I agree! Whitby is a good shout also