Automatic translation of user interface elements from wireframe tools to production augmented reality framework

Abstract

Systems and methods for generating an extended reality (XR) user interface are disclosed. A two-dimensional data set is imported. The two-dimensional data set defines a two-dimensional user interface design layout. The two-dimensional data set includes a transition data set corresponding to a user interface element included in the design layout. The two-dimensional data set is converted into a three-dimensional data set. The three-dimensional data set defines a three-dimensional user interface design layout corresponding to the two-dimensional design layout. The converting includes identifying three-dimensional art for each of a plurality of phases corresponding to the transition data set. An XR representation of the three-dimensional data set is provided for editing using an editing application associated with one or more XR devices. Based on the editing, the three-dimensional data set is exported as one or more files that are compatible with an XR development environment.

1 . A system comprising:
 one or more computer processors;   one or more computer memories;   a set of instructions incorporated into the one or more computer memories, the set of instructions configuring the one or more computer processors to perform operations, the operations comprising:   importing a two-dimensional data set, the two-dimensional data set defining a two-dimensional user interface design layout, the two-dimensional data set including a transition data set corresponding to a user interface element included in the user interface design layout; and   converting the two-dimensional data set into a three-dimensional data set, the three-dimensional data set defining a three-dimensional user interface design layout corresponding to the two-dimensional design layout, the converting including identifying three-dimensional content for each of a plurality of phases corresponding to the transition data set.   
     
     
         2 . The system of  claim 1 , the operations further comprising:
 providing a representation of the three-dimensional data set for editing using an editing application associated with one or more devices; and   based on the editing, exporting the three-dimensional data set in a format compatible with a development environment, wherein the editing application associated with the one or more devices is a lightweight editing application that uses less of at least one computing resource than the development environment.   
     
     
         3 . The system of  claim 2 , wherein the computing resource is one of processing power, memory, or network bandwidth. 
     
     
         4 . The system of  claim 1 , wherein the two-dimensional data set is exported from a two-dimensional user interface design tool using a plug-in for generating the two-dimensional data in a format that is compatible with an editing application. 
     
     
         5 . The system of  claim 1 , further comprising converting the three-dimensional data set into an additional two-dimensional data set, the additional two-dimensional data set being importable into the two-dimensional design tool using the plug-in or an additional plug-in. 
     
     
         6 . The system of  claim 1 , wherein the converting of the two-dimensional data set into a three-dimensional data set includes using statistics of previous content manipulation to determine the three-dimensional user interface design layout. 
     
     
         7 . The system of  claim 6 , wherein the converting of the two-dimensional data set includes applying a machine learning model to the statistics to determine the three-dimensional user interface design layout. 
     
     
         8 . The system of  claim 1 , wherein providing of the representation of the three-dimensional data set includes rendering the three-dimensional content according to the plurality of the phases. 
     
     
         9 . A non-transitory computer-readable storage medium storing a set of instructions that, when executed by one or more computer processors, causes the one or more computer processors to perform operations, the operations comprising:
 importing a two-dimensional data set, the two-dimensional data set defining a two-dimensional user interface design layout, the two-dimensional data set including a transition data set corresponding to a user interface element included in the user interface design layout; and   converting the two-dimensional data set into a three-dimensional data set, the three-dimensional data set defining a three-dimensional user interface design layout corresponding to the two-dimensional design layout, the converting including identifying three-dimensional content for each of a plurality of phases corresponding to the transition data set.   
     
     
         10 . The non-transitory computer-readable storage medium of  claim 9 , the operations further comprising:
 providing a representation of the three-dimensional data set for editing using an editing application associated with one or more devices; and   based on the editing, exporting the three-dimensional data set in a format compatible with a development environment, wherein the editing application associated with the one or more devices is a lightweight editing application that uses less of at least one computing resource than the development environment.   
     
     
         11 . The non-transitory computer-readable storage medium of  claim 10 , wherein the computing resource is one of processing power, memory, or network bandwidth. 
     
     
         12 . The non-transitory computer-readable storage medium of  claim 9 , wherein the two-dimensional data set is exported from a two-dimensional user interface design tool using a plug-in for generating the two-dimensional data in a format that is compatible with an editing application. 
     
     
         13 . The non-transitory computer-readable storage medium of  claim 9 , further comprising converting the three-dimensional data set into an additional two-dimensional data set, the additional two-dimensional data set being importable into the two-dimensional design tool using the plug-in or an additional plug-in. 
     
     
         14 . The non-transitory computer-readable storage medium of  claim 9 , wherein the converting of the two-dimensional data set into a three-dimensional data set includes using statistics of previous content manipulation to determine the three-dimensional user interface design layout. 
     
     
         15 . The non-transitory computer-readable storage medium of  claim 14 , wherein the converting of the two-dimensional data set includes applying a machine learning model to the statistics to determine the three-dimensional user interface design layout. 
     
     
         16 . The non-transitory computer-readable storage medium of  claim 9 , wherein providing of the representation of the three-dimensional data set includes rendering the three-dimensional content according to the plurality of the phases. 
     
     
         17 . A method comprising:
 importing a two-dimensional data set, the two-dimensional data set defining a two-dimensional user interface design layout, the two-dimensional data set including a transition data set corresponding to a user interface element included in the user interface design layout; and   converting the two-dimensional data set into a three-dimensional data set, the three-dimensional data set defining a three-dimensional user interface design layout corresponding to the two-dimensional design layout, the converting including identifying three-dimensional content for each of a plurality of phases corresponding to the transition data set.   
     
     
         18 . The method of  claim 17 , further comprising:
 providing a representation of the three-dimensional data set for editing using an editing application associated with one or more devices; and   based on the editing, exporting the three-dimensional data set in a format compatible with a development environment, wherein the editing application associated with the one or more devices is a lightweight editing application that uses less of at least one computing resource than the development environment.   
     
     
         19 . The method of  claim 18 , wherein the computing resource is one of processing power, memory, or network bandwidth. 
     
     
         20 . The method of  claim 17 , wherein the two-dimensional data set is exported from a two-dimensional user interface design tool using a plug-in for generating the two-dimensional data in a format that is compatible with an editing application.