logoalt Hacker News

Rapzid • today at 10:44 AM • 1 reply • view on HN

Why would an FPGA speed up joins by two orders of magnitude?


Replies

crabbone • today at 1:05 PM

Was my question too. Now, I have not tested the technology, so, I can't vouch for the veracity of the claim, but the answer I was given made sense. This is what it was: in the same way how a dedicated switch is a lot more efficient when dealing with IP packets than a general-purpose CPU is. In particular, comparison takes a lot less time because it is able to dramatically reduce the number of load operations. I found this paper: https://www.sfu.ca/~zhenman/files/C31-FCCM2023-SQL2FPGA.pdf (there's also a Github repo with some experimental code for Spark: https://github.com/SFU-HiAccel/SQL2FPGA) that does something similar.