For this exact use case I used instant-ngp[0] recently and was really pleased with the results. There's an article[1] explaining how to prepare your data.
[0] https://github.com/NVlabs/instant-ngp
[1] https://github.com/NVlabs/instant-ngp/blob/master/docs/nerf_...