>probably due to the limits of floating point math

It's due to the integration scheme (2nd order, albeit symplectic) and time step (5e-4, ok if better scheme is used).