There's also a weird play with the prosecution.
Like if a pardon is issued before trial, under normal circumstances the prosecutor will drop charges and the pardonee does not need to accept it. Further, a prosecutor won't go after charges when someone is pardoned.
These are the cases where a pardon wouldn't imply guilt.
But generally speaking, pardons happen after a conviction and not before. Accepting a pardon ends appeals.