Augmentation modification based on user interaction with augmented reality scene
Abstract
Apparatuses, methods, and storage media for modifying augmented reality in response to user interaction are described. In one instance, the apparatus for modifying augmented reality may include a processor, a scene capture camera coupled with the processor to capture a physical scene, and an augmentation management module to be operated by the processor. The augmentation management module may obtain and analyze the physical scene, generate one or more virtual articles to augment a rendering of the physical scene based on a result of the analysis, track user interaction with the rendered augmented scene, and modify or complement the virtual articles in response to the tracked user interaction. Other embodiments may be described and claimed.
Claims
exact text as granted — not AI-modified1 . (canceled)
2 - 20 . (canceled)
21 . A mobile computing device, comprising:
at least one camera to capture one or more images of a scene including one or more objects in an environment of the mobile computing device; at least one screen to display an augmented scene representative of the scene; at least one storage device to store instructions; and at least one processor to execute the instructions to:
generate a virtual article to display on the at least one screen within the augmented scene to simulate a presence of the virtual article within the environment; and
simulate at least one of a first manipulation type or a second manipulation type of the virtual article within the augmented scene based on data representative of a corresponding pointing gesture or a waving gesture of a user hand in the environment.
22 . The mobile computing device as defined in claim 21 , wherein the processor is to simulate the first manipulation type of the virtual article by causing the virtual article to move in response to detecting the pointing gesture of the user hand in the environment based on the one or more images.
23 . The mobile computing device as defined in claim 21 , wherein the at least one processor is to track at least one of the pointing gesture or the waving gesture of the user hand interacting with the virtual article based on the one or more images.
24 . The mobile computing device as defined in claim 21 , wherein the mobile computing device includes at least one of a laptop, a tablet, or a mobile telephone.
25 . The mobile computing device as defined in claim 21 , wherein the at least one processor is to simulate the at least one of the first or second manipulation type of the virtual article in response to at least one of a change of facial expression, a verbal command, a change in eye gaze, a change in posture, or a change of a head position.
26 . The mobile computing device as defined in claim 21 , wherein the at least one processor is to generate the virtual article in response to detection of one or more markers associated with the scene.
27 . The mobile computing device as defined in claim 21 , further including one or more sensors to generate data associated with at least one of the environment or the mobile computing device.
28 . The mobile computing device as defined in claim 27 , wherein the one or more sensors include at least one of a proximity sensor, an inertial sensor, an optical sensor, an audio sensor, a temperature sensor, a motion sensor, or a microphone.
29 . At least one computer-readable storage device or storage disk comprising machine-readable instructions that, when executed, cause at least one processor to, at least:
cause at least one camera to capture one or more images of a scene, the scene including one or more objects in an environment of a mobile computing device; cause at least one screen to display an augmented scene representative of the scene; generate a virtual article to display on the at least one screen within the augmented scene to simulate presence of the virtual article within the environment; and simulate at least one of a first manipulation type or a second manipulation type of the virtual article within the augmented scene based on data representative of a corresponding pointing gesture or a waving gesture of a user hand in the environment.
30 . The at least one computer-readable storage device or storage disk as defined in claim 29 , wherein the machine-readable instructions, when executed, cause the at least one processor to move the virtual article in response to detecting the pointing gesture of the user hand in the environment.
31 . The at least one computer-readable storage device or storage disk as defined in claim 30 , wherein the machine-readable instructions, when executed, cause the at least one processor to track at least one of the pointing gesture or the waving gesture of the user hand interacting with the virtual article.
32 . The at least one computer-readable storage device or storage disk as defined in claim 29 , wherein the machine-readable instructions, when executed, cause the at least one processor to simulate the at least one of the first or second manipulation type of the virtual article in response to at least one of a change of facial expression, a verbal command, a change in eye gaze, a change in posture, or a change of a head position.
33 . The at least one computer-readable storage device or storage disk as defined in claim 29 , wherein the machine-readable instructions, when executed, cause the at least one processor to generate the virtual article in response to one or more markers associated with the scene.
34 . The at least one computer-readable storage device or storage disk as defined in claim 30 , wherein the machine-readable instructions, when executed, cause the at least one processor to generate data from one or more sensors, the generated data associated with the environment.
35 . A mobile computing device to manipulate a virtual article, the mobile computing device comprising:
means for capturing one or more images of a scene, the scene including one or more objects in an environment of the mobile computing device; means for displaying an augmented scene representative of the captured one or more images; and means for generating the virtual article to display on the displaying means, the generating means to cause the virtual article to be presented within the augmented scene to simulate presence of the virtual article within the environment, the generating means to simulate at least one of a first manipulation type or a second manipulation type of the virtual article within the augmented scene based on data representative of a corresponding pointing gesture or a waving gesture of a hand in the environment.
36 . The mobile computing device as defined in claim 35 , wherein the generating means is to cause the virtual article to move in response to the pointing gesture of the user hand in the environment.
37 . The mobile computing device as defined in claim 35 , further including means for tracking the at least one of the pointing gesture or the waving gesture of the hand to facilitate simulating interaction with the virtual article.
38 . The mobile computing device as defined in claim 35 , wherein the mobile computing device includes at least one of a laptop, a tablet or a mobile telephone.
39 . The mobile computing device as defined in claim 35 , wherein the generating means is to simulate the at least one of the first or second manipulation type of the virtual article in response to at least one of a change of facial expression, a verbal command, a change in eye gaze, a change in posture, or a change of a head position.
40 . The mobile computing device as defined in claim 35 , wherein the generating means is to generate the virtual article in response to one or more markers associated with the scene.
41 . The mobile computing device as defined in claim 35 , further including means for sensing the one or more objects in the environment.
42 . The mobile computing device as defined in claim 41 , wherein the sensing means includes at least one of a proximity sensor, an inertial sensor, an optical sensor, an audio sensor, a temperature sensor, a motion sensor, or a microphone.Join the waitlist — get patent alerts
Track US2020166987A1 — get alerts on status changes and closely related new filings.
We store only your email — no account needed. See our privacy policy.