Maybe that's how Trump believes tariffs work, but they are actually a tax on imports, that the importer pays. The importer passes that along to the American consumer.
Other countries are angry about this because it discourages importing from them, and their US exports may go down, or they may have to lower their US export prices. Not because they have to pay a fee or a tax to the US.