US2020193712A1PendingUtilityA1

Method for Representing Virtual Information in a Real Environment

Assignee: APPLE INCPriority: Aug 18, 2009Filed: Dec 16, 2019Published: Jun 18, 2020
Est. expiryAug 18, 2029(~3 yrs left)· nominal 20-yr term from priority
G01C 23/00G06F 3/147G09G 2354/00G06T 19/006G06F 3/011G06T 19/00G06T 15/20
64
PatentIndex Score
0
Cited by
0
References
0
Claims

Abstract

The invention relates to a method for ergonomically representing virtual information in a real environment, including the following steps: providing at least one view of a real environment and of a system setup for blending in virtual information for superimposing with the real environment in at least part of the view, the system setup comprising at least one display device, ascertaining a position and orientation of at least one part of the system setup relative to at least one component of the real environment, subdividing at least part of the view of the real environment into a plurality of regions comprising a first region and a second region, with objects of the real environment within the first region being placed closer to the system setup than objects of the real environment within the second region, and blending in at least one item of virtual information on the display device in at least part of the view of the real environment, considering the position and orientation of said at least one part of the system setup, wherein the virtual information is shown differently in the first region than in the second region with respect to the type of blending in the view of the real environment.

Claims

exact text as granted — not AI-modified
1 . A method for representing virtual information in a real environment, comprising:
 determining a position and orientation of a system setup for superimposing virtual information into a view of a real environment;   obtaining a plurality of items of virtual information each associated with a component of the real environment of a plurality of components;   determining a cluster comprising a subset of the plurality of components of the real environment based on location information for the subset of the plurality of components and the position and orientation of the system setup;   presenting a cluster representation associated with the cluster,   wherein the cluster representation is selectable to cause a subset of the plurality of items of virtual information associated with the plurality of components of the cluster to be presented.   
     
     
         2 . The method of  claim 1 , wherein the cluster is comprised in a first region of view of the real environment of a plurality of regions, wherein each of the plurality of regions is associated with one of a plurality of levels of detail. 
     
     
         3 . The method of  claim 2 , wherein the items of virtual information are presented according to a level of detail associated with the first region. 
     
     
         4 . The method of  claim 2 , wherein the items of virtual information are presented as a selectable label, and wherein the selectable label is selectable to present a particular item of virtual information according to a level of detail associated with the first region. 
     
     
         5 . The method of  claim 4 , wherein each of the items of virtual information are selectable to present an additional level of detail for the particular item of virtual information. 
     
     
         6 . The method of  claim 1 , wherein the cluster representation is selectable based on a determination that the cluster representation is viewed by a user according to an eye tracking mechanism of the system setup. 
     
     
         7 . The method of  claim 1 , wherein the cluster is further determined according to a determination that each of the subset of the plurality of components are associated with items of virtual information of a same type. 
     
     
         8 . A non-transitory computer readable medium comprising computer code for representing virtual information in a real environment, executable by one or more processors to:
 determine a position and orientation of a system setup for superimposing virtual information into a view of a real environment;   obtain a plurality of items of virtual information each associated with a component of the real environment of a plurality of components;   determine a cluster comprising a subset of the plurality of components of the real environment based on location information for the subset of the plurality of components and the position and orientation of the system setup; and   present a cluster representation associated with the cluster,   wherein the cluster representation is selectable to cause a subset of the plurality of items of virtual information associated with the plurality of components of the cluster to be presented.   
     
     
         9 . The non-transitory computer readable medium of  claim 8 , wherein the cluster is comprised in a first region of view of the real environment of a plurality of regions, wherein each of the plurality of regions is associated with one of a plurality of levels of detail. 
     
     
         10 . The non-transitory computer readable medium of  claim 9 , wherein the items of virtual information are presented according to a level of detail associated with the first region. 
     
     
         11 . The non-transitory computer readable medium of  claim 9 , wherein the items of virtual information are presented as a selectable label, and wherein the selectable label is selectable to present a particular item of virtual information according to a level of detail associated with the first region. 
     
     
         12 . The non-transitory computer readable medium of  claim 11 , wherein each of the items of virtual information are selectable to present an additional level of detail for the particular item of virtual information. 
     
     
         13 . The non-transitory computer readable medium of  claim 8 , wherein the cluster representation is selectable based on a determination that the cluster representation is viewed by a user according to an eye tracking mechanism of the system setup. 
     
     
         14 . The non-transitory computer readable medium of  claim 8 , wherein the cluster is further determined according to a determination that each of the subset of the plurality of components are associated with items of virtual information of a same type. 
     
     
         15 . A system for representing virtual information in a real environment, comprising:
 one or more processors;   one or more computer readable media comprising computer readable code executable by one or more processors to:
 determine a position and orientation of a system setup for superimposing virtual information into a view of a real environment; 
 obtain a plurality of items of virtual information each associated with a component of the real environment of a plurality of components; 
 determine a cluster comprising a subset of the plurality of components of the real environment based on location information for the subset of the plurality of components and the position and orientation of the system setup; and 
 present a cluster representation associated with the cluster, 
 wherein the cluster representation is selectable to cause a subset of the plurality of items of virtual information associated with the plurality of components of the cluster to be presented. 
   
     
     
         16 . The system of  claim 15 , wherein the cluster is comprised in a first region of view of the real environment of a plurality of regions, wherein each of the plurality of regions is associated with one of a plurality of levels of detail. 
     
     
         17 . The system of  claim 16 , wherein the items of virtual information are presented according to a level of detail associated with the first region. 
     
     
         18 . The system of  claim 16 , wherein the items of virtual information are presented as a selectable label, and wherein the selectable label is selectable to present a particular item of virtual information according to a level of detail associated with the first region. 
     
     
         19 . The system of  claim 18 , wherein each of the items of virtual information are selectable to present an additional level of detail for the particular item of virtual information. 
     
     
         20 . The system of  claim 15 , wherein the cluster representation is selectable based on a determination that the cluster representation is viewed by a user according to an eye tracking mechanism of the system setup.

Join the waitlist — get patent alerts

Track US2020193712A1 — get alerts on status changes and closely related new filings.

We store only your email — no account needed. See our privacy policy.