offpunk’s slowness has two main sources (while offline):
- loading modules at startup (will be solved in 3.1 with lazy loading, patch is pending)
- parsing HTML with lot of pictures (because we wait for chafa for each picture)
I’m not sure how multiprocessing could really help that much but I would be interested.
While online, sure, the blocking http calls are something that will be parallelized in the future
syncing URL lists should be done in parallel. Something like xargs+flock but under Python.