Systems and methods for video communication using a virtual camera

Abstract

A method for using a virtual camera location to display image data to one device from another device associated with a plurality of cameras. The method includes receiving image data from a plurality of cameras associated with a second user device associated with a second user. The method further includes establishing a virtual camera location different from positions of the plurality of cameras. The method further includes providing an image using the image data on a first user display of a first user device based at least on a viewpoint of the virtual camera location.

What is claimed is: 
     
         1 . A method comprising:
 determining a gaze vector of a user based on data received from a plurality of sensors of a device of the user;   setting one or more angles of a virtual camera based on the gaze vector using a position of the virtual camera associated with the device, the position of the virtual camera being different from positions of the plurality of sensors; and   providing an image using the data from the plurality of sensors on a display of another device based at least on the position and the one or more angles of the virtual camera.   
     
     
         2 . The method of  claim 1 , further comprising:
 receiving position data associated with at least one body part of the user,   wherein the image is further provided using the position data.   
     
     
         3 . The method of  claim 2 , wherein the position data indicates a position of a feature of a head of the user. 
     
     
         4 . The method of  claim 1 , wherein determining the gaze vector of the user includes determining a gaze location, a first gaze angle, and a second gaze angle, wherein the position of the virtual camera is established by setting the position of the virtual camera to correspond to the gaze location, and wherein the one or more angles of the virtual camera comprise a first virtual camera angle set based at least on the first gaze angle and a second virtual camera angle set based at least on the second gaze angle. 
     
     
         5 . The method of  claim 1 , wherein the position of the virtual camera is established one of continuously or responsive to changes in imagery captured by the plurality of sensors. 
     
     
         6 . The method of  claim 1 , wherein providing the image comprises combining the data received from the plurality of sensors to render the image from the position and the one or more angles of the virtual camera. 
     
     
         7 . The method of  claim 1 , wherein the position of the virtual camera is selectively movable by the user. 
     
     
         8 . A system comprising:
 first device associated with a first user and in communication with a second device via a network, the first device having a plurality of sensors, and processing circuitry configured to:
 determine a gaze vector of the first user based on data received from the plurality of sensors; 
 set one or more angles of a virtual camera based on the gaze vector using a position of the virtual camera associated with the first device, the position of the virtual camera being different from positions of the plurality of sensors; and 
 provide image data using the data from the plurality of sensors on the second device based at least on the position and the one or more angles of the virtual camera. 
   
     
     
         9 . The system of  claim 8 , wherein the processing circuitry is further configured to:
 receive position data associated with at least one body part of the first user,   wherein the image data is further provided using the position data.   
     
     
         10 . The system of  claim 9 , wherein the position data indicates a position of a feature of a head of the first user. 
     
     
         11 . The system of  claim 8 , wherein determining the gaze vector of the first user includes determining a gaze location, a first gaze angle, and a second gaze angle, wherein the position of the virtual camera is established by setting the position of the virtual camera to correspond to the gaze location, and wherein the one or more angles of the virtual camera comprise a first virtual camera angle set based at least on the first gaze angle and a second virtual camera angle set based at least on the second gaze angle. 
     
     
         12 . The system of  claim 8 , wherein the position of the virtual camera is established one of continuously or responsive to changes in imagery captured by the plurality of sensors. 
     
     
         13 . The system of  claim 8 , wherein providing the image data comprises combining the data received from the plurality of sensors to render an image from the position and the one or more angles of the virtual camera. 
     
     
         14 . The system of  claim 8 , wherein the position of the virtual camera is selectively movable by the first user. 
     
     
         15 . A device associated with a user comprising:
 a plurality of sensors;   a display disposed between at least two of the plurality of sensors;   processing circuitry in communication with a network, the processing circuitry configured to:
 determine a gaze vector of the user based on data received from the plurality of sensors; 
 establish, based at least on the gaze vector, a position of a virtual camera associated with the device and different from positions of the plurality of sensors; 
 set one or more angles of the virtual camera based on the gaze vector; and 
 provide a image data using the data from the plurality of sensors on a display of another device based at least on the position and the one or more angles of the virtual camera; and 
   communications circuitry configured to transmit the image data to a receiving user device via the network.   
     
     
         16 . The device of  claim 15 , wherein the processing circuitry is further configured to:
 receive position data associated with at least one body part of the user, wherein the image data is further provided using the position data.   
     
     
         17 . The device of  claim 16 , wherein the position data indicates a position of a feature of a head of the user. 
     
     
         18 . The device of  claim 15 , wherein determining the gaze vector of the user includes determining a gaze location, a first gaze angle, and a second gaze angle, wherein the position of the virtual camera is established by setting the position of the virtual camera to correspond to the gaze location, and wherein the one or more angles of the virtual camera comprise a first virtual camera angle set based at least on the first gaze angle and a second virtual camera angle set based at least on the second gaze angle. 
     
     
         19 . The device of  claim 15 , wherein providing the image data comprises combining the data received from the plurality of sensors to render an image from the position and the one or more angles of the virtual camera. 
     
     
         20 . The device of  claim 15 , wherein the position of the virtual camera is selectively movable by the user.