The way I've always thought of this is there are potentials for interactions and interactions.
Interactions act like point particles and potentials for interactions act like waves.
Arguing over the distinction is a bit like debating whether people are the things they do, or the thing that does things. There is some philosophical discussion to be had, but for the most part it doesn't really matter.