Any method to utilize the view dependent sh parameters in rendering

[louhz]

Hi,

I try to add the camera view dependent spherical harmonics (15 extra degree) parameters in the viewer rendering!

Is there any helpful api for me to query the camera view and update the gaussian splat bytewise encoding for this development.

[brentyi]

Are you using add_gaussian_splats()? Or a CUDA-based renderer? (like the one in gsplat)

We do have this example for getting the current camera view: https://viser.studio/main/examples/interaction/camera_poses/
But I'm not sure if Viser would be fast/responsive enough to use this for adding SH support to add_gaussian_splats-based rendering.

You could also take a look at #399!