Montage4D

Montage4D presents a practical solution for real-time seamless fusion and stylization of multiview video textures.
Paper , video, and slides are available now.
The paper is published and presented at 2018 ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games (I3D), the journal version is under revision. Here lists code for sketchy stippling, relighting, and quality comparison. Additional code relies on the framework, input, and datasets of Fusion4D. Future release will depend on MSR's approval.

Video Demo

Please use full-screen and 1080p if applicable.


Cannot access Vimeo? Download here.

Paper


@inproceedings{Du2018Montage4D,
    title = "Montage4D: Interactive Seamless Fusion of Multiview Video Textures ",
    author = {Ruofei Du and Ming Chuang and Wayne Chang and Hugues Hoppe and Amitabh Varshney},
    booktitle = {Proceedings of ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games (I3D)},
    year = {2018},
    month = {May},
    day = {15 - 18},
    doi = {10.1145/3190834.3190843},
    location = {Montreal, Quebec, Canada},
    publisher = {ACM},
    keywords = {texture montage, 3d reconstruction, texture stitching, view-dependent rendering, discrete geodesics, projective texture mapping, differential geometry, temporal texture fields},
    pages = {124--133}
}

Slides

The experimental results are very compeling and convincing, which clearly demonstrate fusion output with much less visual artifacts, especially visible seams, compared to state-of-the-art systems like Fusion4D and Holoportation.
Slides Download (228.0MB PPTX)

Contact Us

Montage4D is a proof-of-concept research system in collaboration with Microsoft Research, Redmond. Feel free to contact us via emails.