I hear you, but realistically the rustification of Python package internals is only going to strongly increase over the next year (I'm working on a number of such packages, myself), so systematic solutions to such annoyances are going to become increasingly necessary
Well, it did force me to work on better build caching and the like, but at the same time, it accelerated my wish to remove python where possible