Real-world multi-camera captures often use only a few low-overlap views, leaving large areas poorly observed and causing noticeable artifacts in volumetric reconstructions. This work addresses that gap by separating background densification from human modeling: it leverages video diffusion to synthesize dense background supervision while using a robust deformable Gaussian human initialization and a recursive, motion-adaptive consistency injection to harmonize the composed result. The result is markedly improved novel-view synthesis and cleaner 4D outputs suitable for editing and re-rendering.
4D Human-Scene Reconstruction from Low-Overlap Captures
Reconstructs 4D dynamic human scenes from sparse, low-overlap multi-camera captures by decoupling background synthesis and human modeling. Synthesizes hundreds of camera-controlled background views with a video diffusion model, initializes deformable Gaussian humans via cross-view identity and triangulated keypoints, then applies motion-adaptive recursive enhancement to reduce artifacts.
Introduction
More Items
Predicts identity-preserving dense pixel correspondences between image pairs that violate spatio-temporal priors (e.g., edits and reference-guided generation). Fuses generative (FLUX2) and semantic (DINOv3) foundation representations with heterogeneous supervision and teacher-guided iterative refinement to generalize beyond classical optical-flow assumptions.
AI Video Papers2026
Converts static 3D Gaussian Splatting scenes into endlessly looping 3D cinemagraphs by inferring plausible dynamics with a vision-language model, synthesizing a reference video, lifting it to multi-view videos, and fitting a Fourier-parameterized Periodic Deformation Field with a Grounded Drift Field—mask-free capture of deformation, object motion, and illumination changes.
Dahyun Chung, Siyoon Jin +6Affiliation: Hyunsung Kim, Affiliation: [4pt] † Co-corresponding authors +2
Generates synchronized egocentric video streams for multiple interacting agents in a shared environment, enforcing cross-view action consistency, shared environment memory, and consistent propagation of interaction-induced state changes — aimed at embodied AI, VR, and multi-agent vision research.