It's hard and sometimes it's scary. It still amazes my mother. I went home for Christmas one year and there were fans all over the front lawn hoping to see me.
I really subscribe to that old adage that you should never let the audience get ahead of you for a second. So if the film's abrasive and wrongfoots people then y'know that's great. But I hope it involves an audience.