Most of his actions are, to the majority of the population, merely transient actions. A few letters on an arts center are trivial to remove, a cancelled wind turbine farm easy to forget. The CECOT stuff deeply impacts only a small part of the population, so it'll at most be a few lines in a history book.
But demolishing a third of the White House? That'll be clearly visible in every single aerial shot of the building during every single political event for years. It is, quite literally, a scar on the political face of the country.
It's like turning the Pentagon into a Square, or blowing Washington's face off Mount Rushmore, or selling Alaska back to Russia: you're not going to forget when you are constantly being reminded of it.
actions might be transient but, like or not (I certainly do not) will be the President that is remembered and talked about more than just about all of previous ones combined