logoalt Hacker News

muth02446today at 8:12 PM1 replyview on HN

If you are satisfied with an approximation of "DISTINCT", there is a facinating probabilistic algorithm by Flajolet and Martin

https://en.wikipedia.org/wiki/Flajolet%E2%80%93Martin_algori...

which fits on 10 lines and does not require sorting. Improved versions of it are LogLog and HyperLogLog.


Replies

esafaktoday at 8:29 PM

APPROX_COUNT_DISTINCT / APPROX_DISTINCT

https://www.sketchingbigdata.org/