US10511824B2ActiveUtilityA1
System device and methods for assistance in capturing stereoscopic video or images
Est. expiryJan 17, 2037(~10.5 yrs left)· nominal 20-yr term from priority
H04N 23/63H04N 23/64G06T 7/0002H04N 13/167H04N 13/239G06T 2207/10021H04N 13/117G06T 7/85H04N 2213/002H04N 2013/0081H04N 13/128H04N 2013/0085G06T 7/285H04N 13/122H04N 13/344G06T 7/97H04N 13/133G06T 2207/10024G06T 2207/30168H04N 5/23293
38
PatentIndex Score
0
Cited by
7
References
20
Claims
Abstract
A device system and methods comprising receiving a stereoscopic video or image of a scene including two perspective data streams (e.g. left and right) captured for example by a stereoscopic sensing device and analyzing the received stereoscopic video or image to yield stereoscopic discomfort data to assist a user to capture a stereoscopic 3D video of the scene, the stereoscopic discomfort data associated with discomfort effects such as dizziness, nausea, and eye stress.
Claims
exact text as granted — not AI-modifiedThe invention claimed is:
1. A device connectable to a portable computing platform having a processor, the device comprising:
a stereoscopic camera comprising two cameras, the cameras located at a distance from one another, wherein the stereoscopic camera is configured to provide two perspective data streams of a scene, and wherein the processor is configured to:
analyze the two perspective data streams based on predefined stereoscopic discomfort data rules to yield one or more stereoscopic discomfort parameters, wherein the predefined stereoscopic discomfort data rules are related to the cause of dizziness or nausea or eye stress in a captured stereoscopic image;
provide a depth map of said scene based on the two perspective data streams;
provide a stereoscopic discomfort module, said stereoscopic discomfort module is configured to:
analyze said depth map to detect the movement of said stereoscopic camera;
identify at least one item of stereoscopic discomfort data related respectively to said detected movement and said one or more stereoscopic discomfort parameters; and
alert a user in real time based on said at least one item of identified stereoscopic discomfort data while said user captures a stereoscopic 3D video of said scene that includes the two perspective data streams.
2. The device of claim 1 wherein the device is connectable to a display and wherein the at least one item of stereoscopic discomfort data is displayed on said display.
3. The device of claim 2 wherein said at least one item of stereoscopic discomfort data comprise one or more alerts, said alerts indicating one or more predicted discomfort artifacts.
4. The device of claim 2 , wherein the display is a headset display.
5. The device of claim 4 wherein the display is a virtual reality headset.
6. The device of claim 1 comprising one or more measurements units configured to measure the position of the stereoscopic camera and yield location measurement data, and wherein the processor is configured to process the location measurement data from the two perspective data streams to extract for each frame of the data streams the position and orientation of the stereoscopic camera, and wherein said at least one item of stereoscopic discomfort data is identified based on said extracted position and orientation of the stereoscopic camera and said one or more stereoscopic discomfort parameters.
7. The device of claim 6 wherein said one or more measurement units are Inertial Measurement Units (IMU) configured to detect and provide said location measurement data, and wherein said location measurements data comprise the device linear acceleration and rotational rate.
8. The device of claim 6 comprising a prioritization module configured and enabled to:
receive the depth map of the captured scene, the measured position of the stereoscopic camera and said one or more stereoscopic discomfort parameters and rank one or more frames of two perspective data streams of a scene based on the type of said at least one identified discomfort effect and the discomfort level.
9. The device of claim 8 wherein said prioritization module is configured and enabled to prioritize which discomfort effect to be notified the user and which discomfort effect to be corrected.
10. The device of claim 1 wherein said stereoscopic discomfort module is configured to:
detect a movement of one or more objects in the scene towards or away from the stereoscopic camera in the respective optical axis;
identify at least one item of stereoscopic discomfort data related respectively to said detected movement of one or more objects and said one or more stereoscopic discomfort parameters; and
detect whether the movement is caused by the stereoscopic camera or if it is caused only by one or more captured objects in the scene.
11. The device of claim 10 wherein said movement of one or more objects in the scene is a movement towards or away from the stereoscopic camera, and wherein the movement is detected by analyzing the rate of change in the depth map within consecutive frames of said two perspective data streams of the scene.
12. The device of claim 1 wherein said stereoscopic discomfort module is configured to:
compute shakes or vibrations of the stereoscopic camera; and
identify said at least one item of stereoscopic discomfort data based on said computed shakes or vibrations of the stereoscopic camera and said one or more stereoscopic discomfort parameters.
13. The device of claim 1 wherein said at least one item of stereoscopic discomfort data comprises one or more guidelines.
14. The device of claim 13 wherein said guidelines comprise one or more visual indicators or voice indicators.
15. The device of claim 14 wherein said visual indicators are selected from the group consisting of: arrows; speed scale; textual alerts; or guidance.
16. The device of claim 1 wherein said detected movement is a fast horizontal movement of said stereoscopic camera and said identified at least one stereoscopic discomfort effect is dizziness, and wherein the stereoscopic discomfort module is configured and enabled to alert said user in real time on expected of said dizziness while said user captures a stereoscopic 3D video of said scene.
17. The device of claim 16 wherein the stereoscopic discomfort module is further configured and enabled to:
detect a distance of close object in the captured scene from the stereoscopic sensing device;
analyze the two perspective data streams to detect if the movement is caused by the stereoscopic camera and direct the user to move slower or if it is caused by the close object and therefore direct the user to step back or zoom out.
18. The device of claim 1 wherein said detected movement is a fast vertical movement of said stereoscopic camera and said identified at least one stereoscopic discomfort effect is nausea, and wherein the stereoscopic discomfort module is configured and enabled to alert said user in real time on expected of said nausea while said user captures a stereoscopic 3D video of said scene.
19. The device of claim 1 wherein the predefined stereoscopic discomfort data rules include maximum speed of objects in pixels or frame relative to the object's size.
20. The device of claim 19 wherein the predefined stereoscopic discomfort data rules are extracted by analyzing one or more of the stereoscopic camera resolution, light conditions and focus condition.Cited by (0)
No later patents cite this yet.
References (0)
No backward citations on record.