I try and avoid the Bannered Mare because of Saadia if I'm playing an honourable character. I guess the inn I have spent the most time in is either the Sleeping Giant or Moorside Inn. Deadman's Drink is probably my favourite because the town is so gloomy it actually feels like I'm getting in out of the wet when I pass through.
Probably the Bee and Barb. It's a little busier than most of the inns, has a nice layout and open common room, and feels the most like a place where I would happily go eat. (I mean it has tables to gods' sake.)
I rather like Talen-Jei. He may well be one of my favorite Argonians in the game.