Virtual item display simulations

Abstract

A planar placement system can generate virtual surfaces (e.g., floors, walls) to simulate items in an augmented reality display. The system can generate the virtual surfaces using image feature tracking and plane intersection approaches that create an accurate visual simulation. The items simulated can be variable items that have unit data (e.g., rolls of wallpaper) that can be simulated on the virtual surfaces, and unit data can be displayed and updated in real time or near real time on a mobile device, such as a user's smartphone.

1 . A method comprising:
 generating, on a mobile device, a video depicting a ground;   generating a virtual ground that corresponds to the ground as depicted in the video;   generating, in the video, a moveable virtual edge that moves along the virtual ground in response to movement of the mobile device;   detecting, using one or more inertial sensors, movement of the mobile device as the moveable virtual edge is projected in the video;   in response to the movement, moving the moveable virtual edge from a closer position on the virtual ground to a farther position on the virtual ground that is farther from the mobile device as viewed in the video on the mobile device;   generating, on the mobile device, a virtual vertical plane at the farther position of the moveable virtual edge;   displaying, on the mobile device, renders of one or more virtual items on the virtual vertical plane.   
     
     
         2 . The method of  claim 1 , wherein the one or more virtual items comprise a planar item. 
     
     
         3 . The method of  claim 1 , wherein the renders are generated on the mobile device by applying one or more modeling texture to the one or more virtual items. 
     
     
         4 . The method of  claim 1 , wherein generating the virtual ground comprises:
 detecting a plurality of image features on the ground depicted in the video.   
     
     
         5 . The method of  claim 4 , wherein the virtual ground is generated to coincide with the plurality of image features detected on the ground. 
     
     
         6 . The method of  claim 1 , wherein the vertical virtual plane is generated such that it extends perpendicularly from the virtual ground. 
     
     
         7 . The method of  claim 1 , wherein the moveable virtual edge is a bottom side of a movable vertical plane. 
     
     
         8 . The method of  claim 1 , wherein the moveable virtual edge is a bottom side of a virtual door. 
     
     
         9 . The method of  claim 8 , wherein the virtual door comprises renders to a virtual room that is projected in the video on the mobile device. 
     
     
         10 . The method of  claim 1 , further comprising:
 tracking image features across images of the video;   generating transformation data describing transformations of the image features across images in the video; and   continuously updating a position of a virtual camera based on transformation data.   
     
     
         11 . The method of  claim 10 , wherein the one or more inertial sensors comprise a gyroscope. 
     
     
         12 . A mobile device comprising
 one or more processors;   (New) a memory storing instructions that, when executed by the one or more processors, cause the mobile device to perform operations comprising:   generating, on a mobile device, a video depicting a ground;   generating a virtual ground that corresponds to the ground as depicted in the video;   generating, in the video, a moveable virtual edge that moves along the virtual ground in response to movement of the mobile device;   detecting, using one or more inertial sensors, movement of the mobile device as the moveable virtual edge is projected in the video;   in response to the movement, moving the moveable virtual edge from a closer position on the virtual ground to a farther position on the virtual ground that is farther from the mobile device as viewed in the video on the mobile device;   generating, on the mobile device, a virtual vertical plane at the farther position of the moveable virtual edge;   displaying, on the mobile device, renders of one or more virtual items on the virtual vertical plane.   
     
     
         13 . The mobile device of  claim 12 , wherein the one or more virtual items comprise a planar item. 
     
     
         14 . The mobile device of  claim 13 , wherein generating the renders of the one or more virtual items comprise: applying one or more modeling texture to the one or more virtual items. 
     
     
         15 . The mobile device of  claim 12 , wherein generating the virtual ground comprises:
 detecting a plurality of image features on the ground depicted in the video.   
     
     
         16 . The mobile device of  claim 15 , wherein the virtual ground is generated to coincide with the plurality of image features detected on the ground. 
     
     
         17 . The mobile device of  claim 12 , wherein the vertical virtual plane is generated such that it extends perpendicularly from the virtual ground. 
     
     
         18 . The mobile device of  claim 12 , wherein the moveable virtual edge is a bottom side of a movable vertical plane. 
     
     
         19 . The mobile device of  claim 12 , wherein the moveable virtual edge is a bottom side of a virtual door. 
     
     
         20 . A machine storage medium embodying instructions that, when executed by a machine, cause the machine to perform operations comprising:
 generating, on a mobile device, a video depicting a ground;   generating a virtual ground that corresponds to the ground as depicted in the video;   generating, in the video, a moveable virtual edge that moves along the virtual ground in response to movement of the mobile device;   detecting, using one or more inertial sensors, movement of the mobile device as the moveable virtual edge is projected in the video;   in response to the movement, moving the moveable virtual edge from a closer position on the virtual ground to a farther position on the virtual ground that is farther from the mobile device as viewed in the video on the mobile device;   generating, on the mobile device, a virtual vertical plane at the farther position of the moveable virtual edge;   displaying, on the mobile device, renders of one or more virtual items on the virtual vertical plane.