lightform | cv | linkedin | google scholar | patents | arxiv | vimeo | github
I'm currently at Amazon Devices (Lab126) working on a zero-to-one product where I lead the software and applied science teams. Previously, I co-founded Lightform and headed the engineering and research organizations. We built and shipped three AR hardware products and content creation software, including a number of advancements in projected AR, such as Project LFX.
Early on, I spent time at Adobe Research, Microsoft Research, and a few other computer vision focused startups. I completed my PhD at UIUC advised by David Forsyth and Derek Hoiem.
Lightform was a VC backed hardware startup in San Francisco. We shipped three generations of hardware and software products. Our products enabled projected AR applications with no experience required, at a fraction of the cost of competing systems.
I managed the technical leadership team. We were responsible for developing and supporting our products, as well as company research and IP.
An Approximate Shading Model with Detail Decomposition for Object Relighting
Zicheng Liao, Kevin Karsch, Hongyi Zhang, David A. Forsyth
IJCV 2019
Lightform: Procedural Effects for Projected AR
Brittany Factura, Laura LaPerche, Phil Reyneri, Brett Jones, Kevin Karsch
SIGGRAPH (Emerging Tech) 2018
Integrating videos with LIDAR scans for virtual reality
Giang Bui, Brittany Morago, Truc Le, Kevin Karsch, Zheyu Lu, Ye Duan
VR 2016
Projectibles: Optimizing Surface Color For Projection
Brett Jones, Rajinder Sodhi, Pulkit Budhiraja, Kevin Karsch, Brian Bailey, David A. Forsyth
UIST 2015
An Approximate Shading Model for Object Relighting
Zicheng Liao, Kevin Karsch, David A. Forsyth
CVPR 2015
Inverse Rendering Techniques for Physically Grounded Image Editing
Kevin Karsch
PhD Thesis (UIUC 2015)
Where's My Drink? Enabling Peripheral Real World Interactions While Using HMDs
Pulkit Budhiraja, Rajinder Sodhi, Brett Jones, Kevin Karsch, Brian Bailey, David A. Forsyth
Tech Report (2015)
DepthTransfer: Depth extraction from video using non-parametric sampling
Kevin Karsch, Ce Liu, Sing Bing Kang
TPAMI 2014
code | video | supplemental | slides | bibtex
Automatic Scene Inference for 3D Object Compositing
Kevin Karsch, Kalyan Sunkavalli, Sunil Hadap, Nathan Carr, Hailin Jin, Raphael Fonte, Michael Sittig, David A. Forsyth
TOG 2014 (Presented at SIGGRAPH 2014)
video | supplemental | slides | data | bibtex
ConstructAide: Analyzing and Visualizing Construction Sites through Photographs and Building Models
Kevin Karsch, Mani Golparvar-Fard, David A. Forsyth
SIGGRAPH Asia 2014
video | video2 | supplemental | slides | bibtex
Blind Recovery of Spatially Varying Reflectance from a Single Image
Kevin Karsch, David A. Forsyth
SIGGRAPH Asia 2014 Workshop on Indoor Scene Understanding (best paper)
supplemental | slides | bibtex
Boundary Cues for 3D Object Shape Recovery
Kevin Karsch, Zicheng Liao, Jason Rock, Jonathan T. Barron, Derek Hoiem
CVPR 2013
code | supplemental | poster | bibtex
Depth Extraction from Video Using Non-parametric Sampling
Kevin Karsch, Ce Liu, Sing Bing Kang
ECCV 2012 (oral presentation)
This paper is subsumed by the journal version (Depth Transfer - TPAMI'14)
Rendering synthetic objects into legacy photographs
Kevin Karsch, Varsha Hedau, David A. Forsyth, Derek Hoiem
SIGGRAPH Asia 2011
Kevin Karsch, John C. Hart
NPAR 2011 (best paper honorable mention)
User interface design for military AR applications
Mark A. Livingston, Zhuming Ai, Kevin Karsch, Gregory O. Gibson
VR 2011
Semi-automatic 3D segmentation of brain structures from MRI
Qing He, Kevin Karsch, Ye Duan
Int J Data Min Bioinform
Shape analysis of corpus callosum in phenylketonuria using a new 3D correspondence algorithm
Qing He, Shawn E. Christ, Kevin Karsch, Dawn Peck, Ye Duan
SPIE Medical Imaging 2010
Detecting 3D Corpus Callosum abnormalities in autism based on anatomical landmarks
Qing He, Ye Duan, Kevin Karsch, Judith Miles
Psychiatry Res 2010
Shape analysis of corpus callosum in autism subtype using planar conformal mapping
Qing He, Ye Duan, Xiaotian Yin, Xianfeng Gu, Kevin Karsch, Judith Miles
SPIE Medical Imaging 2009
Detecting 3D Corpus Callosum abnormalities in phenylketonuria
Qing He, Shawn E. Christ, Kevin Karsch, Amanda J. Moffitt, Dawn Peck, Ye Duan
Int J Comput Biol Drug Des 2009
Detecting corpus callosum abnormalities in autism subtype using planar conformal mapping
Qing He, Ye Duan, Xiaotian Yin, Xianfeng Gu, Kevin Karsch, Judith Miles
Int J Numer Meth Biomed Engng 2009
A Fast, Semi-automatic Brain Structure Segmentation Algorithm for Magnetic Resonance Imaging
Kevin Karsch, Qing He, Ye Duan
BIBM 2009
A Novel Algorithm for Automatic Brain Structure Segmentation from MRI
Qing He, Kevin Karsch, Ye Duan
ISVC 2008
Web based brain volume calculation for magnetic resonance images
Kevin Karsch, Brian Grinstead, Qing He, Ye Duan
EMBC 2008
Abnormalities in MRI traits of corpus callosum in autism subtype
Qing He, Kevin Karsch, Ye Duan
EMBC 2008
Detecting thalamic abnormalities in autism using cylinder conformal mapping
Qing He, Kevin Karsch, Ye Duan
ISVC 2008
Kevin Karsch, Robert Drzymala
Medical Physics 2008
Import of Gamma Knife Model C treatment plans into CERR
Robert Drzymala, Kevin Karsch, James Alaly, Divya Khullar, Yu Wu, Joseph Deasy
Medical Physics 2008
Method for augmenting a scene in real space with projected visual content
Kevin Karsch, Rajinder Sodhi, Brett Jones, Pulkit Budhiraja, Phil Reyneri, Douglas Rieck, Andrew Kilkenny, Ehsan Noursalehi, Derek Nedelman, Laura LaPerche, Brittany Factura
Patent No. US10373325B1
System and methods for augmenting surfaces within spaces with projected light
Rajinder Sodhi, Brett Jones, Kevin Karsch, Pulkit Budhiraja, Phil Reyneri, Douglas Rieck, Andrew Kilkenny
Patent No. US10805585B2
4D vizualization of building design and construction modeling with photographs
David A. Forsyth, Kevin Karsch, Mani Golparvar-Fard
Patent No. US9852238B2
Mark A. Raymond, Hector Andres Porras Soto, Kevin Karsch
Patent No. US9786253B2
Relighting fragments for insertion into content
Kevin Karsch, Zicheng Liao, David A. Forsyth
Patent No. US9471967B2
Automatic 2D-to-stereoscopic video conversion
Kevin Karsch, Ce Liu, Sing Bing Kang
Patent No. US9414048B2
Inserting objects into content
Kevin Karsch, Varsha Hedau, David A. Forsyth, Derek Hoiem
Patent No. US9330500B2
Automatic geometry and lighting inference for realistic image editing
Kevin Karsch, Kalyan Sunkavalli, Sunil Hadap, Nathan Carr, Hailin Jin
Patent No. US9299188B2