I am an atheist as well, but the feeling of fellowship that a church provides can be a good thing, plus there are studies that show that the brain behaves similarly while praying as it does in meditation, so that could be part of the reason as well.
Usually, the church environment is pretty peaceful unless you go to some radical church. For the most part, it's a good thing that church is interesting to you. Maybe you should find out why...it's not a bad idea exploring different faiths.