In computer vision and computer graphics, 4D reconstruction is the process of capturing the shape and appearance of real objects along a temporal dimension.[1][2][3][4] This process can be accomplished by methods such as depth camera imaging,[1] photometric stereo, or structure from motion,[5] and is also referred to as spatio-temporal reconstruction.[4]
YouTube Encyclopedic
-
1/3Views:44114 8512 473 188
-
Creating 3D models with your mobile phone
-
The 12 Weeks Scan: 3D and 4D Ultrasound
-
Face2Face: Real-time Face Capture and Reenactment of RGB Videos (CVPR 2016 Oral)
Transcription
4D Gaussian splatting
Extending the concept of 3D Gaussian Splatting, the 4D Gaussian Splatting incorporates a time component, allowing for dynamic scene rendering. It represents and renders dynamic scenes, with a focus on modeling complex motions while maintaining efficiency.[6] The method uses a HexPlane to connect different adjacent Gaussians, providing an accurate representation of position and shape deformations. By utilizing only a single set of canonical 3D Gaussians, and predictive analytics, the 4D Gaussian splatting method models how they move over different timestamps.[7]
Achievements of this technique include real-time rendering on dynamic scenes with high resolutions, while maintaining quality. It showcases potential applications for future developments in film and other media, although there are current limitations regarding the length of motion captured.[7]See also
References
- ^ a b Dou, Mingsong, et al. "Fusion4d: Real-time performance capture of challenging scenes." ACM Transactions on Graphics (TOG) 35.4 (2016): 1-13.
- ^ Mustafa, Armin, et al. "Temporally coherent 4d reconstruction of complex dynamic scenes." Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2016.
- ^ Oswald, Martin Ralf, Jan Stühmer, and Daniel Cremers. "Generalized connectivity constraints for spatio-temporal 3d reconstruction." European Conference on Computer Vision. Springer, Cham, 2014.
- ^ a b Dong, Jing, et al. "4D crop monitoring: Spatio-temporal reconstruction for agriculture." 2017 IEEE International Conference on Robotics and Automation (ICRA). IEEE, 2017.
- ^ Kyriakaki, Georgia, et al. "4D reconstruction of tangible cultural heritage objects from web-retrieved images." International Journal of Heritage in the Digital Era 3.2 (2014): 431-451.
- ^ Guanjun Wu; Taoran Yi; Jiemin Fang; Lingxi Xie; Xiaopeng Zhang; Wei Wei; Wenyu Liu; Qi Tian; Xinggang Wang (12 Oct 2023). "4D Gaussian Splatting for Real-Time Dynamic Scene Rendering". arXiv:2310.08528 [cs.CV].
- ^ a b Franzen, Carl. "Actors' worst fears come true? New 4D Gaussian splatting method captures human motion". venturebeat.com. VentureBeat. Retrieved October 18, 2023.
External links
 | This computer graphics–related article is a stub. You can help Wikipedia by expanding it. |
This page was last edited on 23 December 2023, at 02:37