US12159360B2ActiveUtilityA1

Discovery, management and processing of virtual real estate content

42
Assignee: GOOGLE LLCPriority: Aug 10, 2020Filed: Aug 10, 2020Granted: Dec 3, 2024
Est. expiryAug 10, 2040(~14.1 yrs left)· nominal 20-yr term from priority
G06T 2219/2004G06T 2219/024G06T 2200/24G06T 17/05G06T 19/20G06Q 30/0261
42
PatentIndex Score
0
Cited by
7
References
17
Claims

Abstract

Virtual spaces can be added to both 2D and 3D representations of physical spaces allowing for enhancements of those spaces. The virtual spaces can belong to business locations, such as a bakery or coffee shop, and content for those spaces can be controlled by the owner or user of that location. Virtual spaces belonging to public spaces can be provided as digital space for content providers. Valuation of the virtual space can occur based on various requests and use metrics of that virtual space and provide a marketplace for the addition of virtual content. Layers or groups of virtual spaces can be created and enabled or disabled by a user viewing the representation with the virtual space.

Claims

exact text as granted — not AI-modified
The invention claimed is: 
     
       1. A method comprising:
 receiving one or more static images of a real world environment; 
 generating a representation image based on the one or more static images received using an image content analysis machine learning model trained on two-dimensional or three-dimensional models of physical locations other than the real world environment; 
 outputting, by the image content analysis machine learning model, a plurality of virtual spaces, wherein each virtual space is based upon at least a characteristic of the representation image; 
 selecting a subset of the plurality of virtual spaces for addition to the representation image based on one or more predetermined rules regulating an amount of content to be displayed in the representation image; 
 providing, to a first user, an interface for uploading content for display in the subset of virtual spaces; 
 receiving, from the first user, the content for display at the subset of virtual spaces added as an overlay to the representation image; 
 displaying, to a second user, the representation image with the content for display at the subset of virtual spaces, wherein the content comprises one or more interactive objects based on the at least a characteristic of the representation image; and 
 displaying, to the second user, additional information based on the one or more interactive objects when the one or more interactive objects are selected, wherein the additional information includes annotations the first user created. 
 
     
     
       2. The method of  claim 1 , wherein the characteristic is one of relative visibility, viewshed, prominence of a space, elevation, unused physical space, proximity to a marker, a storefront, or the presence of signage. 
     
     
       3. The method of  claim 1 , wherein outputting the plurality of virtual spaces comprises outputting a respective confidence metric for each of the plurality of virtual spaces, and
 wherein, for a given virtual space having a confidence metric below a predetermined threshold, before including the given virtual space in the interface for uploading, outputting the given virtual space for manual verification. 
 
     
     
       4. The method of  claim 1 , further comprising receiving, from one or more editing users, an updated set of boundaries of at least one of the plurality of virtual spaces. 
     
     
       5. The method of  claim 1 , wherein the content received from the first user is interactive. 
     
     
       6. The method of  claim 5 , wherein the content is further configured to send a notification to the second user uploading the content upon receiving an input on the provided interactive content. 
     
     
       7. The method of  claim 1 , further comprising verifying the first user as an owner of a physical space associated with respective ones of the one or more of the subset of virtual spaces. 
     
     
       8. The method of  claim 1 , wherein the one or more predetermined rules include at least one of:
 (a) a threshold number of virtual spaces within a predetermined distance along a road of the real world environment; or 
 (b) a threshold number of virtual spaces associated with each image of the one or more static images. 
 
     
     
       9. A system comprising one or more processors configured to:
 receive one or more static images of a real world environment; 
 generate a representation image based on the one or more static images received using an image content analysis machine learning model trained on two-dimensional or three-dimensional models of physical locations other than the real world environment; 
 output, by the image content analysis machine learning model, one or more virtual spaces, wherein each virtual space is based upon at least a characteristic of the representation image; 
 select a subset of the plurality of virtual spaces for addition to the representation image based on one or more predetermined rules regulating an amount of content to be displayed in the representation image; 
 provide, to a first user, an interface for uploading content for display in the subset of virtual spaces; 
 receive, from the first user, the content for display at the subset of virtual spaces added as an overlay to the representation image; 
 display, to the second user, the representation image with the content for display at the subset of virtual spaces, wherein the content comprises one or more interactive objects based on the at least a characteristic of the representation image; and 
 displaying, to the second user, additional information based on the one or more interactive objects when the one or more interactive objects are selected, wherein the additional information includes annotations the first user created. 
 
     
     
       10. The system of  claim 9 , wherein the characteristic is one of relative visibility, viewshed, prominence of a space, elevation, unused physical space, proximity to a marker, a storefront, or the presence of signage. 
     
     
       11. The system of  claim 9 , wherein the one or more processors are configured to:
 output a respective confidence metric for each virtual space; and 
 for a given virtual space having a confidence metric below a predetermined threshold, before including the given virtual space in the interface for uploading, output the given virtual space for manual verification. 
 
     
     
       12. The system of  claim 9 , further comprising configuring at least one of the subset of virtual spaces to be editable by the first user. 
     
     
       13. The system of  claim 9 , wherein the content received from the first user is interactive. 
     
     
       14. The system of  claim 9 , wherein the content is further configured to send a notification to the second user uploading the content upon receiving an input on the provided interactive content. 
     
     
       15. The system of  claim 9 , wherein the one or more processors are configured to verify the first user as an owner of a physical space associated with respective ones of the subset of virtual spaces. 
     
     
       16. The system of  claim 9 , wherein the machine learning algorithm is configured to reject any of the plurality of virtual spaces for which a characteristic of the rejected virtual space is under or over a predefined parameter. 
     
     
       17. The system of  claim 9 , wherein the one or more predetermined rules include at least one of:
 (a) a threshold number of virtual spaces within a predetermined distance along a road of the real world environment; or 
 (b) a threshold number of virtual spaces associated with each image of the one or more static images.

Cited by (0)

No later patents cite this yet.

References (0)

No backward citations on record.