Multi-screen perspective altering display system

Abstract

The perception of a displayed image is altered for viewers moving relative to a display screen, thereby imparting a sense of three-dimensional immersion in the scene being displayed. A display generator generates a scene having foreground and background elements, and a display screen displaying the scene. A sensor detects the position of a viewer relative to the display screen, and a processor is operative to shift the relative position of the foreground and background elements in the displayed scene as a function of viewer position, such that the viewer's perspective of the scene changes as the viewer moves relative to the display screen. The foreground and background elements may be presented in the form of multiple superimposed graphics planes, and/or a camera may be used to record the scene through panning at sequential angles. The system may be used to implement virtual windows, virtual mirrors and other effects.

We claim: 
     
         1 . A perspective-altering display system, comprising:
 a plurality of display screens displaying different portions of the same scene;   a sensor for detecting the movement of a viewer relative to the display screens;   at least one memory for separately storing foreground and background imagery associated with the scene;   at least one processor interconnected to the memory and the sensor, the processor being operative to receive a signal from the sensor and shift the relative position of the foreground and background imagery in the displayed scene as a function of viewer movement; and wherein the foreground imagery is shifted by way of a translation to a greater extent than the background imagery as a viewer moves from side to side relative to the display screens.   
     
     
         2 . The display system of  claim 1 , wherein:
 the scene is larger than the plurality of display screens are capable of displaying such that the at least one memory stores non-visible foreground or background imagery; and   at least some of the non-visible foreground or background imagery to becomes visible as a result of the shifting in the relative position of the foreground and background imagery in the displayed scene as a function of viewer movement.   
     
     
         3 . The display system of  claim 1 , wherein the shifting of the relative position of the foreground and background imagery in the displayed scene as a function of viewer movement causes at least some of the foreground or background imagery on one display screen to become visible on another one of the display screens. 
     
     
         4 . The display system of  claim 1 , including prerecorded foreground or background imagery. 
     
     
         5 . The display system of  claim 1 , wherein at least some of the foreground or background imagery includes imagery received through a transmission medium. 
     
     
         6 . The display system of  claim 1 , wherein at least some of the foreground or background imagery includes imagery received from a camera. 
     
     
         7 . The display system of  claim 1 , further including:
 a camera that records the scene through panning at sequential angles; and   wherein the memory stores imagery obtained at the sequential angles for later recall as a function of user movement.   
     
     
         8 . The display system of  claim 7 , further including:
 an interpolator for filling in visual gaps in the scene.   
     
     
         9 . The display system of  claim 1 , wherein:
 the display screens are mounted on a wall having a backside; and   further including a camera mounted on the backside of the wall which pans as a viewer moves, thereby imaging the scene on the display screens as virtual windows through the wall.   
     
     
         10 . The display system of  claim 1 , further including:
 a camera with a zoom capability for recording the scene;   wherein the sensor is operative to detect the viewer's distance from the display screens; and   wherein the processor is further operative to zoom in the camera as the viewer moves closer to the display screens and zoom out the camera as the viewer moves away from the display screens.   
     
     
         11 . The display system of  claim 1 , wherein:
 the sensor is operative to detect the viewer's distance from the display screens; and   the processor is operative to increase the resolution of the scene as the viewer moves closer to the display screens and decrease the resolution of the scene as the viewer moves away from the display screens.   
     
     
         12 . The display system of  claim 1 , further including:
 a camera with a tilt capability for recording the scene;   the sensor being operative to detect the viewer's up/down movement relative to the display screens; and   wherein the processor is further operative to tilt the camera in response to the viewer's up/down movement.   
     
     
         13 . The display system of  claim 1 , further including:
 a camera for recording the scene, the camera having a field of view including a viewer of the display screen; and   wherein the processor is further operative to flip the scene horizontally such that the display functions as a virtual mirror.   
     
     
         14 . The display system of  claim 1 , further including:
 a plurality of cameras for recording the scene; and   wherein the processor is further operative to construct a three-dimensional image for display on the screens.   
     
     
         15 . The display system of  claim 1 , further including:
 a plurality of cameras for recording the scene;   the processor being further operative to construct a three-dimensional image for display on the screens; and   a user control a viewer to select a specific camera or cameras to see how others would view the user from different perspectives.   
     
     
         16 . The display system of  claim 1 , wherein:
 the sensor is a camera having an image sensor; and   an image of a viewer is focused onto the image sensor as a spot or group of pixels, allowing the movements of the viewer to be tracked with no moving parts.   
     
     
         17 . The display system of  claim 1 , wherein:
 the sensor is a camera having at least a pan mount that tracks the movement of a viewer; and   the processor is operative to shift the relative position of the foreground and background imagery as a function of the tracking.   
     
     
         18 . The display system of  claim 1 , wherein:
 the sensor is operative to sense a whether an individual is looking toward the display screens; and   the processor is operative to shift the relative position of the foreground and background imagery by favoring individuals looking toward the display screens.   
     
     
         19 . The display of  claim 1 , wherein the display screens are contiguous. he display of  claim 1 , wherein the display screens are not contiguous. 
     
     
         20 . The display of  claim 1 , wherein the display screens are not contiguous.