Daniel Skaale (@DSkaale)
2026-01-09 | โค๏ธ 220 | ๐ 16
๐ WIP A 360ยฐ 4D Gaussian Splatting video player with a novel approach
My solution: SPAG-4D (Spherical Pixel-Aligned Gaussians for 4D)
๐ฌ Technical approach: โข Bijective pixel-to-Gaussian mapping - each pixel in equirectangular frame maps directly to a Gaussian โข AI depth estimation converts 360ยฐ frames to 3D point clouds โข No iterative optimization needed - milliseconds per frame vs minutes
๐ฆ Temporal compression format: โข Base PLY + quantized position/color deltas โข Int16 position deltas + Int8 color deltas โข 51x compression: 8.1GB โ 156MB for 241 frames
โก Browser playback: โข NPZ parsing with flate decompression โข Frame reconstruction from deltas in JS โข 500K+ Gaussians at 60fps
๐ฎ Unity plugin: โข Compute shader reconstruction on GPU โข Custom splat rendering shader (BiRP + URP) โข TemporalNpzLoader for streaming playback
GaussianSplatting 4DGS 3DGS unity3d ComputerVision
๋ฏธ๋์ด
๐ Related
Auto-generated - needs manual review