The fact that consecutive Republican administrations in this graph fared even worse suggests that is not the case.
Let's not omit the fact that Covid hit in Trump's last year in 2020, where he had a booming economy and lowest unemployment late historically amongst minorities.
I’d have called Reagan very conservative, am I missing something?