> Another way would be some kind of 4d GS where one dimension is the focus distance.

That seems like the way to do it, someone has to be working on that.

searching...

https://dof-gaussian.github.io/