Montage4D

Montage4D presents a practical solution for real-time seamless fusion and stylization of multiview video textures.
Paper , video, and slides are available now.
The paper is published and presented at 2018 ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games (I3D), with an extended version published in the Journal of Computer Graphics Techniques. Here lists code for sketchy stippling, relighting, and quality comparison. Montage4D has been leveraged by and licensed to Microsoft's Mobile Holoportation system to improve the texturing quality.

Video Demo

Please use full-screen and 1080p if applicable.


Cannot access Vimeo? Download here.

Paper


@inproceedings{Du2018Montage4D,
    title = "Montage4D: Interactive Seamless Fusion of Multiview Video Textures",
    author = {Ruofei Du and Ming Chuang and Wayne Chang and Hugues Hoppe and Amitabh Varshney},
    booktitle = {Proceedings of ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games (I3D)},
    year = {2018},
    month = {May},
    day = {15 - 18},
    doi = {10.1145/3190834.3190843},
    location = {Montreal, Quebec, Canada},
    publisher = {ACM},
    keywords = {texture montage, 3d reconstruction, texture stitching, view-dependent rendering, discrete geodesics, projective texture mapping, differential geometry, temporal texture fields},
    pages = {124--133}
}

@article{Du2019Montage4D,
    title = {{Montage4D: Real-Time Seamless Fusion and Stylization of Multiview Video Textures}},
    author = {Du, Ruofei and Chuang, Ming and Chang, Wayne and Hoppe, Hugues and Varshney, Amitabh},
    journal = {Journal of Computer Graphics Techniques},
    year = {2019},
    volume = {8},
    number = {1},
    editor = {Warren Hunt},
    publisher = {JCGT},
    month = {Jan.},
    day = {17},
    pages = {1--34},
    series = {JCGT},
    doi = {10.13140/RG.2.2.24965.09443},
}

Slides

The experimental results are very compeling and convincing, which clearly demonstrate fusion output with much less visual artifacts, especially visible seams, compared to state-of-the-art systems like Fusion4D and Holoportation.
Slides Download (228.0MB PPTX)

Contact Us

Montage4D is a rendering system collaborated with Microsoft Research, Redmond. Please feel free to contact us via emails.