They will not be gone, the question is will they be large enough to get power.
Several people who I know who voted for Trump (not a representative sample!) do not like what he is doing with tariffs (they are not Euro-hostile) but they are worried about the border. They would support someone else if that person "fixed the border" without raising tariffs. There is also the possibility that someone could convince them that the border isn't a problem (or something else is more important).
I know a couple people who voted for Trump the person. They don't see Vance in the same way and so won't be excited to vote for him.
Only time will tell. However remember that this too shall pass. There will be a different crisis in a few years.