logoalt Hacker News

bjournetoday at 7:03 PM1 replyview on HN

It's because it reduces data dimensionality. From 2d to 1d and from 1d to 0d (scalar).


Replies

sigbottletoday at 7:18 PM

It always messes with me: reducing across a specific axis always takes O(whole tensor) time, because there's no difference between "iterate over all dims, then collapse the final one" versus "iterate versus the first dim and do some cursed tensor accum" (and likewise for between)

Maybe there's just a better way to think about it and I'm still thinking about it way too much like a programmer

show 1 reply