November 21, 2011 7:10 PM EST
I know exactly what you mean. I think I have about 2 dozen on my list now. Every bloody person I glance at in-game runs up and wants me to do something.
As for declining... you CAN - just escape out of the dialog. I can't test this at the moment, but I believe that choosing the "not right now" dialog still adds the quest.