Fitness data tells a lot, your health status, your daily schedule, with running/cycling/... your exact whereabouts that is quite some valuable information.

A notepad also isn't enough to correlate heart rate etc to specific exercises and plotting over time