logoalt Hacker News

dahcryntoday at 3:38 PM3 repliesview on HN

why? It's the industry standard as far as my reach goes.

What other framework would you replace it with?

No, polars or spark is not a good answer, those are optimized for data engineering performance, not a holistic approach to data science.


Replies

crystal_revengetoday at 4:45 PM

You can assert whatever you want, but Polars is a great answer. The performance improvements are secondary to me compared to the dramatic improvement in interface.

Today all serious DS work will ultimately become data engineering work anyway. The time when DS can just fiddle around in notebooks all day has passed.

show 2 replies
porkertoday at 3:52 PM

> No, polars or spark is not a good answer, those are optimized for data engineering performance, not a holistic approach to data science.

Can you expand on why Polars isn't optimised for a holistic approach to data science?

show 1 reply
minimaxirtoday at 5:33 PM

What can you do in more easily in pandas than polars?