logoalt Hacker News

moonikakissyesterday at 8:16 PM0 repliesview on HN

This is really, really exciting. I see it as the “right” way OLTP and OLAP will converge.

The OP and I built an HTAP system at SingleStore. A single database with one copy of data for both OLTP and OLAP workloads. HTAP never took off [0].

What we learned was that OLTP (Postgres) should handle OLTP, while OLAP (data warehouses/lakes) should handle OLAP, with replication between them.

Designing the 'up-to-date' replication between these systems is hard.... columnar stores just aren’t built for OLTP‑style writes, and can't keep up with your OLTP tables.

Let’s see if Databricks and Neon can pull this off

“give me up‑to‑date Postgres tables in Unity Catalog", no debezium --> kafka --> flink --> Iceberg. With Spark jobs in the back ensuring that Iceberg is an optimal state.

https://www.mooncake.dev/blog/htap-is-dead