It seems like something like this should be added to the commit object/message itself, instead of git notes. Maybe as addition to Co-Authored-By trailer.

This would make sure this data is part of repository history (and commit SHA). Additional tooling can be still used to visualize it.