You don't have to be a believer to go to church. Have an open mind, don't belittle it to the people there just like you wouldn't belittle someone's interior decorating who invited you into their home, and don't hog all of the potato salad at the post-service lunch, and you'll be okay.