If you wear full Daedric armor in front of a Vigilant of Stendaar, he/she will attack you, mistaking you for a Daedra. But I agree, there is not nearly enough distinction. I stand in front of Tulius in stormcloak armor and swing my sword *barely* missing him, and he tells me "It's a nice day with you around"... wth?