About me
I recently joined Google as a Research Scientist working on Project Starline.
Previously, I was a Research Scientist at Meta Reality Labs Research in Pittsburgh, PA. I worked on creating real-time photorealistic virtual humans by conducting research in the area of Neural Rendering, which combines techniques from computer graphics, computer vision, and machine learning. I completed my Ph.D. in 2016 from Drexel University, advised by Ko Nishino, and I completed my Bachelor’s degree in 2009 from The College of New Jersey.
Recent Projects
Mixture of Volumetric Primitives
MVP is a method for rendering really high-quality volumetric humans in real time.
Neural Volumes
Neural Volumes is a method for representing dynamic objects, supervised directly from 2D images from a multi-view capture stage.
Deep Appearance Models
Deep Appearance Models is a method for creating high-quality face models and driving them from a cameras mounted on a VR headset.
Full Publication List
Advances in Neural Rendering
Ayush Tewari, Justus Thies, Ben Mildenhall, Pratul Srinivasan, Edgar Tretschk, Yifan Wang, Christoph Lassner, Vincent Sitzmann, Ricardo Martin-Brualla, Stephen Lombardi, Tomas Simon, Christian Theobalt, Matthias Niessner, Jonathan T. Barron, Gordon Wetzstein, Michael Zollhoefer, and Vladislav Golyanik
[ arXiv ]
Deep Relightable Appearance Models for Animatable Faces
Sai Bi, Stephen Lombardi, Shunsuke Saito, Tomas Simon, Shih-En Wei, Kevyn Mcphail, Ravi Ramamoorthi, Yaser Sheikh, Jason Saragih
ACM Transactions on Graphics (SIGGRAPH 2021) 40, 4. Article 89
[ PDF ] [ webpage ]
Mixture of Volumetric Primitives for Efficient Neural Rendering
Stephen Lombardi, Tomas Simon, Gabriel Schwartz, Michael Zollhoefer, Yaser Sheikh, Jason Saragih
ACM Transactions on Graphics (SIGGRAPH 2021) 40, 4. Article 59
[ arXiv ] [ code ] [ supplemental video ] [ bibtex ]
Pixel-Aligned Volumetric Avatars
Amit Raj, Michael Zollhoefer, Tomas Simon, Jason Saragih, Shunsuke Saito, James Hays, Stephen Lombardi
IEEE Conference on Computer Vision and Pattern Recognition, June 2021
[ arXiv ] [ webpage ]
The Eyes Have It: An Integrated Eye and Face Model for Photorealistic Facial Animation
Gabriel Schwartz, Shih-En Wei, Te-Li Wang, Stephen Lombardi, Tomas Simon, Jason Saragih, Yaser Sheikh
ACM Transactions on Graphics (SIGGRAPH 2020) 39, 4, Article 91
[ PDF ] [ webpage ]
State of the Art on Neural Rendering
Ayush Tewari, Ohad Fried, Justus Thies, Vincent Sitzmann, Stephen Lombardi, Kalyan Sunkavalli, Ricardo Martin-Brualla, Tomas Simon, Jason Saragih, Matthias Nießner, Rohit Pandey, Sean Fanello, Gordon Wetzstein, Jun-Yan Zhu, Christian Theobalt, Maneesh Agrawala, Eli Shechtman, Dan B Goldman, Michael Zollhöfer
Computer Graphics Forum 2020 (STAR Report)
[ arXiv ]
Neural Volumes: Learning Dynamic Renderable Volumes from Images
Stephen Lombardi, Tomas Simon, Jason Saragih, Gabriel Schwartz, Andreas Lehrmann, Yaser Sheikh
ACM Transactions on Graphics (SIGGRAPH 2019) 38, 4, Article 65
[ arXiv ] [ supplemental video ] [ code & data ] [ bibtex ]
VR Facial Animation via Multiview Image Translation
Shih-En Wei, Jason Saragih, Tomas Simon, Adam W. Harley, Stephen Lombardi, Michal Perdoch, Alexander Hypes, Dawei Wang, Hernan Badino, Yaser Sheikh
ACM Transactions on Graphics (SIGGRAPH 2019) 38, 4, Article 67
[ PDF ] [ supplemental video ]
Deep Appearance Models for Face Rendering
Stephen Lombardi, Jason Saragih, Tomas Simon, Yaser Sheikh
ACM Transactions on Graphics (SIGGRAPH 2018) 37, 4, Article 68
[ arXiv ] [ supplemental video ] [ talk video ] [ bibtex ]
Radiometric Scene Decomposition: Estimating Complex Reflectance and Natural Illumination from Images
Stephen Lombardi
Ph.D. Thesis
Radiometric Scene Decomposition: Scene Reflectance, Illumination, and Geometry from RGB-D Images
Stephen Lombardi and Ko Nishino
4th International Conference on 3D Vision, October 2016
[ arXiv ]
Reflectance and Illumination Recovery in the Wild
Stephen Lombardi and Ko Nishino
IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 38, no. 1, May 2015
Two-Point Gait: Decoupling Gait from Body Shape
Stephen Lombardi, Ko Nishino, Yasushi Makihara, Yasushi Yagi
14th International Conference on Computer Vision, December 2013
Reflectance and Natural Illumination from a Single Image
Stephen Lombardi and Ko Nishino
12th European Conference on Computer Vision, October 2012
[ talk video ]
Bayesian Defogging
Ko Nishino, Louis Kratz, and Stephen Lombardi
International Journal of Computer Vision, vol. 98, no. 3, pg 263-278, July 2012
Single Image Multimaterial Estimation
Stephen Lombardi and Ko Nishino
25th IEEE Conference on Computer Vision and Pattern Recognition, June 2012
Directional Statistics-based Reflectance Model for
Isotropic Bidirectional Reflectance Distribution Functions
Ko Nishino and Stephen Lombardi
Journal of the Optical Society of America A, vol. 28, no. 1, pg 8-18, January 2011