Apparatus and method for stereoscopic video with motion sensors

Abstract

An apparatus and method for a video capture device for recording 3 Dimensional (3D) stereoscopic video with motion sensors is provided are provided. The apparatus includes includes a camera unit having one lens for capturing video, a video encoder/decoder for encoding the captured video, a motion sensor for capturing motion data of the video capture device corresponding to the captured video, and a controller for controlling the video encoder/decoder and motion sensor to encode the captured video with the captured motion data.

What is claimed is: 
     
       1. A video capture device for recording 3 Dimensional (3D) stereoscopic video with motion sensors, the video capture device comprising:
 a camera; 
 a video encoder/decoder; 
 a motion sensor; 
 a memory; and 
 at least one processor configured to:
 control the camera to capture a video using only one lens of the camera, the captured video including a plurality of frames, 
 receive, from the motion sensor, motion data including information corresponding to movement of the video capture device that occurred while the camera was capturing the video, 
 determine a distance in which the video capture device is moved between a first frame and a second frame of the video captured by the camera based on the motion data, and 
 provide, to the video encoder/decoder, the determined distance in which the video capture device is moved between a first frame and a second frame of the captured video, 
 
 wherein the video encoder/decoder tags the second frame of the captured video with the determined distance in which the video capture device is moved between the first frame and the second frame, and 
 wherein a 3D stereoscopic video is reproduced by selecting a subgroup of the plurality of frames of the captured video based on information included in the tag of the second frame. 
 
     
     
       2. The video capture device of  claim 1 , wherein the motion sensor is at least one of an accelerometer, a compass, a magnetometer, and a gyroscope. 
     
     
       3. The video capture device of  claim 1 , wherein the at least one processor is further configured to:
 simultaneously control the camera to capture the video and the motion sensor to capture the motion data. 
 
     
     
       4. The video capture device of  claim 1 , wherein the at least one processor is further configured to:
 correlate frames of the captured video with information corresponding to movement of the video capture device that occurred while the plurality of frames is captured. 
 
     
     
       5. The video capture device of  claim 4 , wherein the at least one processor is further configured to:
 correlate each frame of the captured video with information corresponding to the movement of the video capture device that occurred while each of the plurality of frames is captured. 
 
     
     
       6. A method for recording a 3 Dimensional (3D) video using a video capture device, the method comprising:
 receiving an indication to initialize a video capture feature of the video capture device; 
 simultaneously capturing video data as a plurality of video frames and motion data of movement of the video capture device, the video data being captured by only one lens of a camera of the video capture device and the motion data being detected by a motion sensor of the video capture device; 
 determining a distance in which the video capture device is moved between a first video frame and a second video frame of the plurality of captured video frames based on the motion data detected by the motion sensor; 
 encoding the plurality of captured video frames and information associated with the determined distance the video capture device is moved between the first video frame and the second video frame in the second video frame of the plurality of captured video frames using a video encoder/decoder of the video capture device; and 
 storing the encoded plurality of captured video frames and information associated with the determined distance as a recorded 3D video in a memory of the video capture device, 
 wherein the encoding of the information associated with the determined distance in which the video capture device is moved between the first video frame and the second video frame comprises tagging the second frame with the determined distance in which the video capture device is moved between the first video frame and the second video frame, and 
 wherein a 3D stereoscopic video is reproduced by selecting a subgroup of the plurality of captured video frames based on information included in the tag of the second frame. 
 
     
     
       7. The method of  claim 6 , wherein the method further comprises:
 determining whether the indication to initialize the video capture feature is associated with capturing a 2D video or a 3D video; and 
 initializing the motion sensor if the indication to initialize the video capture feature is associated with capturing the 3D video, 
 wherein the motion sensor is not initialized if the indication to initialize the video capture feature is associated with capturing the 2D video. 
 
     
     
       8. The method of  claim 6 , wherein the simultaneous capturing of the video data and the motion data comprises:
 capturing the motion data of the movement of the video capture device when the camera of the video capture device is capturing the video data as the video frames. 
 
     
     
       9. The method of  claim 6 , wherein the distance the video capture device is moved is a distance between a position of the video capture device at a time of recording a reference video frame and a position of the video capture device at a time of recording the second video frame of the 3D video. 
     
     
       10. The method of  claim 6 , further comprising:
 determining a view angle between the first video frame and the second video frame of the plurality of captured video frames; and 
 further encoding information associated with the view angle between the first video frame and the second video frame in the second video frame of the captured video frames. 
 
     
     
       11. The method of  claim 10 , wherein the view angle is an angular distance between a viewing direction of the video capture device at a time of recording the first video frame and a viewing direction of the video capture device at a time of recording the second video frame. 
     
     
       12. The method of  claim 6 , further comprising:
 determining a distance in which the video capture device is moved between each of the plurality of captured video frames of the recorded 3D video. 
 
     
     
       13. The method of  claim 6 , wherein the determining of the distance in which the video capture device is moved occurs according to a predetermine time period. 
     
     
       14. The method of  claim 6 , further comprising:
 determining a distance in which the video capture device is moved at every N th  frame of the 3D video, 
 wherein N is an integer value. 
 
     
     
       15. A method for reproducing a 3 Dimensional (3D) video using a video display device, the method comprising:
 determining whether a 3D video is to be reproduced based on an indication to initialize a video playback feature received at the video display device; 
 detecting, by the video display device, a distance between a viewing entity and the video display device after receiving the indication to initialize the video playback feature; 
 determining, at the video display device, a correlation distance for displaying of a left eye view and a right eye view of the 3D video based on the detected distance between the viewing entity and the video display device; 
 selecting, by the video display device, a first frame of the 3D video for the left eye view and a second frame different from the first frame of the 3D video for the right eye view based on the correlation distance and motion data of respective frames of the 3D video; and 
 simultaneously displaying the first frame and the second frame, 
 wherein the 3D video includes video data that was captured using only one lens of a camera, 
 wherein the first frame and the second frame are selected from among a plurality of 3D video frames, and 
 wherein the plurality of 3D video frames includes three or more 3D video frames. 
 
     
     
       16. The method of  claim 15 , wherein the simultaneous displaying of the first frame and the second frame corresponds to a first lens and a second lens of a pair of stereoscopic glasses, respectively. 
     
     
       17. The method of  claim 15 , wherein the selecting of the first frame and the second frame of the 3D video performed after decoding the 3D video. 
     
     
       18. The method of  claim 15 , wherein the selecting of the first frame and the second frame of the 3D video is performed before decoding the 3D video according to the motion data tagged with respective frames of the 3D video. 
     
     
       19. The method of  claim 15 , further comprising:
 receiving an input to adjust the correlation distance between the left eye view and the right eye view of the 3D video; 
 determining an adjusted correlation distance between the left eye view and the right eye view of the 3D video based on the input; 
 selecting a third frame of the 3D video for the left eye view and a fourth frame of the 3D video for the right eye view based on the determined adjusted correlation distance; and 
 simultaneously displaying the third frame and the fourth frame, 
 wherein simultaneously displaying the third frame and the fourth frame results in a stereographic image that provides an illusion of depth. 
 
     
     
       20. The method of  claim 15 , wherein the determining of the correlation distance comprises selecting the correlation distance from among predetermined correlation distances. 
     
     
       21. The method of  claim 15 , further comprising:
 determining a view angle corresponding to the determined correlation distance, 
 wherein the first frame of the 3D video for the left eye view and the second frame of the 3D video for the right eye view are selected based on the correlation distance, the motion data of respective frames of the 3D video, and the view angle. 
 
     
     
       22. The method of  claim 21 , wherein the determining of the view angle comprises:
 determining an angular distance between a viewing direction of the video capture device at a time of recording the first frame and a viewing direction of the video capture device at a time of recording the second frame.