feat(3d): Gaussian Splatting viewer with Spark integration#612
Open
feat(3d): Gaussian Splatting viewer with Spark integration#612
Conversation
- Add @sparkjsdev/spark and three dependencies for 3DGS rendering - Create useGaussianSplat hook with LoD support for scalable rendering - Create GaussianLand component for 3DGS scene display - Create ViewerSwitch component for Point Cloud / Gaussian mode toggle - Add viewerMode state to Effector store - Integrate dual viewer mode into App.tsx Resolves #551
|
The latest updates on your projects. Learn more about Vercel for GitHub.
|
- Replace Spark CDN/iframe approach with @react-three/fiber + @react-three/drei - Add Splat component from Drei for proper 3DGS rendering - Implement WASD camera-relative movement controls (flying mode) - Add OrbitControls for mouse/touch rotation and zoom - Upgrade Three.js to 0.183 for R3F compatibility - Update ViewerSwitch UI with glass morphism style at top center - Remove unused useGaussianSplat hook Sample data: Hugging Face bonsai-7k.splat Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
- Add GAUSSIAN_SCENES array with 5 outdoor/indoor scenes (Bonsai, Bicycle, Garden, Treehill, Stump) - Add scene selector UI with glass morphism style at bottom center - Store selected scene index in Effector store for persistence - Scenes sourced from HuggingFace (dylanebert/3dgs) and antimatter15 Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
- Add URL input for loading remote .splat files - Add file upload button for local .splat/.ply files - Remove non-working antimatter15 scene URLs - Keep only verified HuggingFace scenes (Bonsai, Bicycle) - Support Skyfall-GS generated files via upload Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
- Set OrbitControls minDistance=0.01, maxDistance=0.5 for FPS feel - Initialize target very close to camera position - Remove unused URL/upload features and customSplatUrl store Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
Pipeline for generating 3D city scenes from satellite imagery: - setup.sh: Environment setup (conda, CUDA, Skyfall-GS) - download_demo.sh: Download pre-trained PLY files from GDrive - fetch_satellite.py: Fetch NYC satellite imagery from Open Data - convert_to_splat.py: Convert PLY to web-compatible splat format - train.sh: Two-stage Skyfall-GS training wrapper - pipeline.sh: Unified CLI for full workflow - README.md: Documentation and usage guide Supports scalable NYC city generation with LOD Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Changes
@sparkjsdev/spark및three의존성 추가useGaussianSplathook 생성 (LoD 지원으로 scalable rendering)GaussianLand컴포넌트로 3DGS 씬 표시ViewerSwitch컴포넌트로 Point Cloud / Gaussian 모드 전환viewerMode상태 추가Architecture
Roadmap
Test plan
pnpm dev실행Known Issues
Resolves #551