The concept you are describing here is "tax incidence" [1].
Tariffs are taxes.
I'm sure lots of hours will be spent researching the incidences of these across many industries.
As you note, one major factor is the presence of substitutes, but there are several others.