US10511824B2ActiveUtilityA1

System device and methods for assistance in capturing stereoscopic video or images

38
Assignee: 2SENS LTDPriority: Jan 17, 2017Filed: Jan 12, 2018Granted: Dec 17, 2019
Est. expiryJan 17, 2037(~10.5 yrs left)· nominal 20-yr term from priority
H04N 23/63H04N 23/64G06T 7/0002H04N 13/167H04N 13/239G06T 2207/10021H04N 13/117G06T 7/85H04N 2213/002H04N 2013/0081H04N 13/128H04N 2013/0085G06T 7/285H04N 13/122H04N 13/344G06T 7/97H04N 13/133G06T 2207/10024G06T 2207/30168H04N 5/23293
38
PatentIndex Score
0
Cited by
7
References
20
Claims

Abstract

A device system and methods comprising receiving a stereoscopic video or image of a scene including two perspective data streams (e.g. left and right) captured for example by a stereoscopic sensing device and analyzing the received stereoscopic video or image to yield stereoscopic discomfort data to assist a user to capture a stereoscopic 3D video of the scene, the stereoscopic discomfort data associated with discomfort effects such as dizziness, nausea, and eye stress.

Claims

exact text as granted — not AI-modified
The invention claimed is: 
     
       1. A device connectable to a portable computing platform having a processor, the device comprising:
 a stereoscopic camera comprising two cameras, the cameras located at a distance from one another, wherein the stereoscopic camera is configured to provide two perspective data streams of a scene, and wherein the processor is configured to:
 analyze the two perspective data streams based on predefined stereoscopic discomfort data rules to yield one or more stereoscopic discomfort parameters, wherein the predefined stereoscopic discomfort data rules are related to the cause of dizziness or nausea or eye stress in a captured stereoscopic image; 
 provide a depth map of said scene based on the two perspective data streams; 
 provide a stereoscopic discomfort module, said stereoscopic discomfort module is configured to:
 analyze said depth map to detect the movement of said stereoscopic camera; 
 identify at least one item of stereoscopic discomfort data related respectively to said detected movement and said one or more stereoscopic discomfort parameters; and 
 alert a user in real time based on said at least one item of identified stereoscopic discomfort data while said user captures a stereoscopic 3D video of said scene that includes the two perspective data streams. 
 
 
 
     
     
       2. The device of  claim 1  wherein the device is connectable to a display and wherein the at least one item of stereoscopic discomfort data is displayed on said display. 
     
     
       3. The device of  claim 2  wherein said at least one item of stereoscopic discomfort data comprise one or more alerts, said alerts indicating one or more predicted discomfort artifacts. 
     
     
       4. The device of  claim 2 , wherein the display is a headset display. 
     
     
       5. The device of  claim 4  wherein the display is a virtual reality headset. 
     
     
       6. The device of  claim 1  comprising one or more measurements units configured to measure the position of the stereoscopic camera and yield location measurement data, and wherein the processor is configured to process the location measurement data from the two perspective data streams to extract for each frame of the data streams the position and orientation of the stereoscopic camera, and wherein said at least one item of stereoscopic discomfort data is identified based on said extracted position and orientation of the stereoscopic camera and said one or more stereoscopic discomfort parameters. 
     
     
       7. The device of  claim 6  wherein said one or more measurement units are Inertial Measurement Units (IMU) configured to detect and provide said location measurement data, and wherein said location measurements data comprise the device linear acceleration and rotational rate. 
     
     
       8. The device of  claim 6  comprising a prioritization module configured and enabled to:
 receive the depth map of the captured scene, the measured position of the stereoscopic camera and said one or more stereoscopic discomfort parameters and rank one or more frames of two perspective data streams of a scene based on the type of said at least one identified discomfort effect and the discomfort level. 
 
     
     
       9. The device of  claim 8  wherein said prioritization module is configured and enabled to prioritize which discomfort effect to be notified the user and which discomfort effect to be corrected. 
     
     
       10. The device of  claim 1  wherein said stereoscopic discomfort module is configured to:
 detect a movement of one or more objects in the scene towards or away from the stereoscopic camera in the respective optical axis; 
 identify at least one item of stereoscopic discomfort data related respectively to said detected movement of one or more objects and said one or more stereoscopic discomfort parameters; and 
 detect whether the movement is caused by the stereoscopic camera or if it is caused only by one or more captured objects in the scene. 
 
     
     
       11. The device of  claim 10  wherein said movement of one or more objects in the scene is a movement towards or away from the stereoscopic camera, and wherein the movement is detected by analyzing the rate of change in the depth map within consecutive frames of said two perspective data streams of the scene. 
     
     
       12. The device of  claim 1  wherein said stereoscopic discomfort module is configured to:
 compute shakes or vibrations of the stereoscopic camera; and 
 identify said at least one item of stereoscopic discomfort data based on said computed shakes or vibrations of the stereoscopic camera and said one or more stereoscopic discomfort parameters. 
 
     
     
       13. The device of  claim 1  wherein said at least one item of stereoscopic discomfort data comprises one or more guidelines. 
     
     
       14. The device of  claim 13  wherein said guidelines comprise one or more visual indicators or voice indicators. 
     
     
       15. The device of  claim 14  wherein said visual indicators are selected from the group consisting of: arrows; speed scale; textual alerts; or guidance. 
     
     
       16. The device of  claim 1  wherein said detected movement is a fast horizontal movement of said stereoscopic camera and said identified at least one stereoscopic discomfort effect is dizziness, and wherein the stereoscopic discomfort module is configured and enabled to alert said user in real time on expected of said dizziness while said user captures a stereoscopic 3D video of said scene. 
     
     
       17. The device of  claim 16  wherein the stereoscopic discomfort module is further configured and enabled to:
 detect a distance of close object in the captured scene from the stereoscopic sensing device; 
 analyze the two perspective data streams to detect if the movement is caused by the stereoscopic camera and direct the user to move slower or if it is caused by the close object and therefore direct the user to step back or zoom out. 
 
     
     
       18. The device of  claim 1  wherein said detected movement is a fast vertical movement of said stereoscopic camera and said identified at least one stereoscopic discomfort effect is nausea, and wherein the stereoscopic discomfort module is configured and enabled to alert said user in real time on expected of said nausea while said user captures a stereoscopic 3D video of said scene. 
     
     
       19. The device of  claim 1  wherein the predefined stereoscopic discomfort data rules include maximum speed of objects in pixels or frame relative to the object's size. 
     
     
       20. The device of  claim 19  wherein the predefined stereoscopic discomfort data rules are extracted by analyzing one or more of the stereoscopic camera resolution, light conditions and focus condition.

Cited by (0)

No later patents cite this yet.

References (0)

No backward citations on record.