W/ me, it's not the contrast w/ fantasy and the real world. I just do not like the end result of his films since Unbreakable. I think, as I and tgreg99 stated, he did get caught up in customizing his films to fit his "shocking endings". He certainly has talent, which is why I hold out hope that he'll just make a good film.
As for the original idea remark, I am a fan of guys like Mark Pellington (Arlington Road and The Mothman Prophecies were both terrific), PT Anderson (Boogie Nights is a work of art and Magnolia is right up your alley by being unusual but very good), and, of course, the Cohens (I own just 'bout everything they've done; I think The Man Who Wasn't There is VERY underrated). None of them would qualify as run of the mill Hollywood directors.