Turning it off cause you're not using it seems reasonable, but I'm surprised it has a big effect on performance. Sequential appends to a file are pretty easy as long as you're not doing so many writes per second that there's contention on the write.
I am doing many writes inserts/updates per second.
Fsync
I am doing many writes inserts/updates per second.