Eyes for Relighting

http://www1.cs.columbia.edu/CAVE/projects/eyes_relight/ The combination of the cornea of an eye and a camera viewing the eye form a catadioptric (mirror + lens) imaging system with a very wide field of view. We show how illumination computed from eyes can be used to replace a face in an image with another one, while ensuring that the appearance of the new face is consistent with the lighting of the scene. The eye not only serves as a useful tool for relighting but also makes relighting possible in situations where current approaches are hard to use.