Publications

Journals

• Recurrent 3D Hand Pose Estimation Using Cascaded Pose-guided 3D Alignments – X. Deng, D. Zuo, Y. Zhang, Z. Cui, J. Cheng, P. Tan, L. Chang, M. Pollefeys, S. Fanello, H. Wang. In IEEE Transactions on Pattern Analysis and Machine Learning 2022.
• Total Relighting: Learning to Relight Portraits for Background Replacement – R. Pandey*, S. Orts-Escolano*, C. LeGendre*, C. Haene, S. Bouaziz, C. Rhemann, P. Debevec, S. Fanello. In SIGGRAPH and Transactions On Graphics 2021 (Project Page).
• Neural Light Transport for Relighting and View Synthesis – X. Zhang, S. Fanello, Y.T.  Tsai, T. Sun, T. Xue, R. Pandey, S. Orts-Escolano, P. Davidson, C. Rhemann, P. Debevec, J.T. Barron, R. Ramamoorthi, W.T. Freeman. In Transactions On Graphics 2021 (Project Page).
• Deep Relightable Textures: Volumetric Performance Capture with Neural Rendering – A. Meka*, R. Pandey*, C. Haene, S. Orts-Escolano, P. Barnum, P. Davidson, D. Erickson, Y. Zhang, J. Taylor, S. Bouaziz, C. LeGendre, W. Ma, R. Overbeck, T. Beeler, P. Debevec, S. Izadi, C. Theobalt, C. Rhemann, S. Fanello.  In SIGGRAPH Asia and Transactions On Graphics 2020.
• Light Stage Super-Resolution: Continuous High-Frequency Relighting – T. Sun, Z. Xu, X. Zhang, S. Fanello, C. Rhemann, P. Debevec, Y. Tsai, J.T. Barron, R. Ramamoorthi.  In SIGGRAPH Asia and Transactions On Graphics 2020.
• State of the Art on Neural Rendering – A. Tewari, O. Fried, J. Thies, V. Sitzmann, S. Lombardi, K. Sunkavalli, R. Martin-Brualla, T. Simon, J. Saragih, M. Nießner, R. Pandey, S. Fanello, G. Wetzstein, J.Y. Zhu, C. Theobalt, M. Agrawala, E. Shechtman, D. B Goldman, M. Zollhöfer.  In STAR Report Eurographics 2020.
• The Relightables: Volumetric Performance Capture of Humans with Realistic Relighting – K. Guo, P. Lincoln, P. Davidson, J. Busch, X. Yu, M. Whalen, G. Harvey, S. Orts-Escolano, R. Pandey, J. Dourgarian, D. Tang, A. Tkach, A. Kowdle, E. Cooper, M. Dou, S. Fanello, G. Fyffe, C. Rhemann, J. Taylor, P. Debevec, S. Izadi.  In ACM SIGGRAPH Asia and Transactions On Graphics 2019.
• Deep Reflectance Fields-High-Quality Facial Reflectance Field Inference from Color Gradient Illumination – A. Meka, C. Haene, R. Pandey, M. Zollhöfer, S. Fanello, G. Fyffe, A. Kowdle, X. Yu, J. Busch, J. Dourgarian, P. Denny, S. Bouaziz, P. Lincoln, M. Whalen, G. Harvey, J. Taylor, S. Izadi, A. Tagliasacchi, P. Debevec, C. Theobalt, J. Valentin, C. Rhemann.  In ACM SIGGRAPH and Transactions On Graphics 2019.
• LookinGood: Enhancing Performance Capture with Real-Time Neural Re-Rendering – R. Martin-Brualla*, R. Pandey*, S. Yang, P. Pidlypenskyi, J. Taylor, J. Valentin, S. Khamis, P. Davidson, A. Tkach, P. Lincoln, A. Kowdle, C. Rhemann, D.B. Goldman, C. Keskin, S. Seitz, S. Izadi, S. Fanello. In ACM SIGGRAPH Asia and Transactions On Graphics 2018.
• The Need 4 Speed in Real-Time Dense Visual Tracking – A. Kowdle*, C. Rhemann*, S.R. Fanello*,  A. Tagliasacchi, J. Taylor, P. Davidson, M. Dou, K. Guo, C. Keskin, S. Khamis, D. Kim, D. Tang, V. Tankovich, J. Valentin, S. Izadi. In ACM SIGGRAPH Asia and Transactions On Graphics 2018.
• Real-time Compression and Streaming of 4D Performances –  D. Tang, M. Dou, P. Lincoln, P. Davidson, K. Guo, J. Taylor, S. Fanello, C. Keskin, A. Kowdle, S. Bouaziz, S. Izadi, A. Tagliasacchi. In ACM SIGGRAPH Asia and Transactions On Graphics 2018.
• Depth from Motion for Smartphone AR – J. Valentin, A. Kowdle, J. Barron, N. Wadhwa, M. Dzitsiuk, M. Schoenberg, V. Verma, A. Csaszar, E. Turner, I. Dryanovski, J. Afonso, J. Pascoal, K. Tsotsos, M. Leung, M. Schmidt, O. Guleryuz, S. Khamis, V. Tankovich, S. Fanello, S. Izadi, C. Rhemann. In ACM SIGGRAPH Asia and Transactions On Graphics 2018.
• Visual Recognition for Humanoid Robots – S.R. Fanello, C. Ciliberto, N. Noceti, G. Metta, F. Odone. In Robotics and Autonomous Systems 2017.
• Fusion4D: Real-time Performance Capture of Challenging Scenes – M. Dou, S. Khamis, Y. Degtyarev, P. Davidson, S.R. Fanello, A. Kowdle, S. Orts Escolano, C. Rhemann, D. Kim, J. Taylor, P. Kohli, V. Tankovich, S. Izadi. In ACM SIGGRAPH and Transactions On Graphics 2016.
• Learning to be a depth camera for close-range human capture and interaction – S.R. Fanello, C. Keskin, S. Izadi, P. Kohli, D. Kim, D. Sweeney, A. Criminisi, J. Shotton, S.B. Kang, T. Paek. In ACM SIGGRAPH and Transactions On Graphics 2014.
• Enhanced learning-based imaging with thin-film luminescent concentrators – A. Koppelhuber, S. Fanello, C. Birklbauer, D. Schedl, S. Izadi, O. Bimber. In Optics Express 2014.
• Keep It Simple And Sparse: Real-Time Action Recognition – S.R. Fanello, I. Gori, G. Metta, F. Odone. In JMLR 2013.

Conferences

• Portrait Expression Editing With Mobile Photo Sequence – Y. Zhao, R. Pandey, Y. Zhang, R. Du, F. Tan, C. Ramaiah, T. Guo, S. Fanello. In SIGAsia Technical Communications 2023.
• MonoAvatar: Learning Personalized High Quality Volumetric Head Avatars from Monocular RGB Videos – Z. Bai, F. Tan, Z. Huang, K. Sarkar, D. Tang, D. Qiu, A. Meka, R. Du, M. Dou, S. Orts-Rscolano, R. Pandey, P. Tan, T. Beeler, S. Fanello, Y. Zhang. In CVPR 2023.
• Controllable Light Diffusion for Portraits – D. Futschik, K Ritland, J. Vecore, S. Fanello, S. Orts-Escolano, B. Curless, D. Sykora, R. Pandey. In CVPR 2023.
• VoLux-GAN: A Generative Model for 3D Face Synthesis with HDRI Relighting – F Tan, S. Fanello, A. Meka, S. Orts-Escolano, D. Tang, R. Pandey, J. Taylor, P. Tan, Y. Zhang. In SIGGRAPH 2022.
• Multiresolution Deep Implicit Functions for 3D Shape Representation – Z. Chen, Y. Zhang, K. Genova, S. Fanello, S. Bouaziz, C. Häne, C. Keskin, T. Funkhouser, D. Tang. In ICCV 2021.
• Sandwiched Image Compression: Wrapping Neural Networks Around a Standard Codec – O. Guleryuz, P. Chou, H. Hoppe, D. Tang, R. Du, P. Davidson, S. Fanello. In ICIP 2021.
• HumanGPS: Geodesic PreServing Feature for Dense Human Correspondence – F. Tan, D. Tang, M. Dou, K. Guo, R. Pandey, C. Keskin, R. Du, D. Sun, S. Bouaziz, S. Fanello, P. Tan, Y. Zhang. In CVPR 2021.
• HITNet: Hierarchical Iterative Tile Refinement Network for Real-time Stereo Matching – V. Tankovich, C. Häne, Y. Zhang, A. Kowdle, S. Fanello, S. Bouaziz. In CVPR 2021  (Oral)
• Learning Illumination from Diverse Portraits – C. LeGendre, W. Ma, R. Pandey, S. Fanello, C. Rhemann, J. Dourgarian, J. Busch, P. Debevec. In SIGGRAPH Asia 2020 – Technical Communications.
• Du2Net: Learning Depth Estimation from Dual-Cameras and Dual-Pixels – Y. Zhang, N. Wadhwa, S. Orts-Escolano, C. Häne, S. Fanello, R. Garg. In ECCV 2020  (Oral).
• Deep Implicit Volume Compression – D. Tang, S. Singh, P.A. Chou, C. Häne, M. Dou, S. Fanello, J. Taylor, P. Davidson, O. G. Guleryuz, Y. Zhang, S. Izadi, A. Tagliasacchi, S. Bouaziz, C. Keskin. In CVPR 2020 (Oral).
• Volumetric Capture of Humans with a Single RGBD Camera via Semi-Parametric Learning – R. Pandey, A. Tkach, S. Yang, P. Pidlypenskyi, J. Taylor, R. Martin-Brualla, A. Tagliasacchi, G. Papandreou, P. Davidson, C. Keskin, S. Izadi, S. Fanello. In CVPR 2019.
• ActiveStereoNet: End-to-End Self-Supervised Learning for Active Stereo Systems – Y. Zhang, S. Khamis, C. Rhemann, J. Valentin, A. Kowdle, V. Tankovich, M. Schoenberg, S. Izadi, T. Funkhouser, S. Fanello. In ECCV 2018 (Oral).
• StereoNet: Guided Hierarchical Refinement for Real-Time Edge-Aware Depth Prediction – S. Khamis, S. Fanello, C. Rhemann, J. Valentin, A. Kowdle, S. Izadi. In ECCV 2018.
• SOS: Stereo Matching in O(1) with Slanted Support Windows – V. Tankovich, M. Schoenberg, S. Fanello, A. Kowdle, C. Rhemann, M. Schmidt, M. Dzitsiuk, J. Valentin, S. Izadi. In IROS 2018.
• TwinFusion: High Framerate Non-Rigid Fusion through Fast Correspondence Tracking – K. Guo, J. Taylor, S. Fanello, A Tagliasacchi, M. Dou, P. Davidson, A. Kowdle, S. Izadi. In 3DV 2018.
• Motion2Fusion: Real-time Volumetric Performance Capture – M. Dou, P. Davidson, S.R. Fanello, S. Khamis, A. Kowdle, C. Rhemann, V. Tankovich,  S. Izadi. In SIGGRAPH ASIA 2017.
• Low Compute and Fully Parallel Computer Vision with HashMatch – S.R. Fanello, J. Valentin, A. Kowdle, C. Rhemann, V. Tankovich, C. Ciliberto, P. Davidson, S. Izadi. In ICCV 2017.
• UltraStereo: Efficient Learning-based Matching for Active Stereo Systems – S.R. Fanello, J. Valentin, C. Rhemann, A. Kowdle, V. Tankovich, P. Davidson, S. Izadi. In CVPR 2017 (Spotlight).
• Holoportation: Virtual 3D Teleportation in Real-time – S. Orts Escolano, C. Rhemann, S.R. Fanello, D. Kim, A. Kowdle, W. Chang, Y. Degtyarev, P. Davidson, S. Khamis, V. Tankovich, C. Loop, Q. Cai, P. Chou, S. Mennicken, J. Valentin, P. Kohli, V. Pradeep, S. Wang, Y. Lutchyn, C. Keskin, S. Izadi. In UIST 2016.
• HyperDepth: Learning Depth from Structured Light Without Matching – S.R. Fanello, C. Rhemann, V. Tankovich, A. Kowdle, S. Orts Escolano, D. Kim, S. Izadi. In CVPR 2016 (Oral).
• The Global Patch Collider – S. Wang, S.R. Fanello, C. Rhemann, S. Izadi, P. Kohli. In CVPR 2016 (Oral).
• FlexCase: Enhancing Mobile Interaction with a Flexible Sensing and Display Cover – C. Rendl, D. Kim, P. Parzer, S. Fanello, M. Zirkl, G. Scheipl, M. Haller, S. Izadi. In SIGCHI 2016 (Best Paper Award)
• 3D Stereo Estimation and Fully Automated Learning of Eye-Hand Coordination in Humanoid Robots – S.R. Fanello, U. Pattacini, I. Gori, V. Tikhanoff, M. Randazzo, A. Roncone, F. Odone, G. Metta. In IEEE-RAS ICHR 2014.
• FlexSense: A Transparent Self-Sensing Deformable Surface – C. Rendl, D. Kim, S. Fanello, P. Parzer, C. Rhemann, J. Taylor, M. Zirkl, G. Scheipl, M. Haller, S. Izadi. In ACM UIST 2014 (Best Demo Honorable Mention).
• In-air Gestures Around Unmodified Mobile Devices – J. Song, G. Sörös, F. Pece, S. Fanello, S. Izadi, C. Keskin, O. Hilliges. In ACM UIST 2014.
• Filter Forests for Learning Data-Dependent Convolutional Kernels – S.R. Fanello, C. Keskin, P. Kholi, S. Izadi, J. Shotton, A. Criminisi, U. Pattacini, T. Paek. In CVPR 2014 (Oral).
• Ask the image: supervised pooling to preserve feature locality – S.R. Fanello, N. Noceti, C. Ciliberto, G. Metta, F. Odone. In CVPR 2014.
• RetroDepth: 3D Silhouette Sensing for High Precision Input On and Above Physical Surfaces – D. Kim, S. Izadi, J. Dostal, C. Rhemann, C. Keskin, C. Zach, J. Shotton, T. Large, S. Batiche, M. Nießner, A. Butler, S. Fanello, V. Pradeep. In SIGCHI 2014 (Best Paper Award).
• Dictionary Based Pooling for Object Categorization – S. R. Fanello, N. Noceti, G. Metta, F. Odone. In VISAPP 2014.
• On the Impact of Learning Hierarchical Representations for Visual Recognition in Robotics – C. Ciliberto, S.R. Fanello, M. Santoro, L. Natale, G. Metta,L. Rosasco. In IROS 2013.
• iCub World: Friendly Robots Help Building Good Vision Data-Sets – S.R. Fanello, C. Ciliberto, M. Santoro, L. Natale, G. Metta, L. Rosasco, F. Odone. In CVPRW 2013.
• One-Shot Learning for Real-Time Action Recognition – S.R. Fanello, I. Gori, G. Metta, F. Odone. In IbPRIA 2013 (Honorable Mention).
• Weakly Supervised Strategies for Natural Object Recognition in Robotics – S.R. Fanello, C. Ciliberto, L. Natale, G. Metta. In ICRA 2013.
• Multi-Class Image Classification: Sparsity Does It Better – S.R. Fanello, N. Noceti, G. Metta, F. Odone. In VISAPP 2013.
• A Compositional Approach for 3D Arm-Hand Action Recognition – I. Gori, S.R. Fanello, F. Odone, G. Metta, In IEEE WoRV 2013 (Best Paper Award).
• All Gestures You Can: A Memory Game Against A Humanoid Robot – I. Gori, S.R. Fanello, G. Metta, F. Odone. In IEEE-RAS ICHR 2012.
• A Heteroscedastic Approach to Independent Motion Detection for Actuated Visual Sensors – C. Ciliberto, S.R. Fanello, L. Natale, G. Metta. In IROS 2012.
• Arm-Hand behaviours modelling: from attention to imitation – S.R. Fanello, l. Gori, F. Pirri. In ISVC 2010 (Best Paper Award).
• An Approach to Projective Reconstruction from Multiple Views – A. Carrano, V. D’Angelo, S.R. Fanello, I. Gori, F. Pirri, A. Rudi. In IASTED 2010.