Yeah, frequency and importance are different signals.
This works well for deciding what stays nearby, but not necessarily what to get rid of.
Something like a toolbox or a charger you rarely use might only get a few dots, but when you need it, you really need it.