I was using postgres for embarrassingly long time before I've learned the difference between "index scans" and "index only scans".

Including relevant columns in the index can massively improve the performance, because postgres does not need to read the randomly sorted tuple in the original table.