Yes, but also no.

I have a prioritised list, it's simply that not everything fits inside the list, because my time is limited.

Instead of "Not enough time" we could say "This is not high enough a priority".