Moving an avatar based on real-world data

Abstract

In some implementations, a method is performed by a device including a non-transitory memory and one or more processors coupled with the non-transitory memory. In some implementations, the method includes obtaining user movement information. In some implementations, the user movement information characterizes a first body pose of the user at a first time and a second body pose of the user at a second time. In some implementations, the method includes determining whether a transition from the first body pose to the second body pose satisfies an acceptability threshold. In some implementations, the method includes in response to determining that the transition from the first body pose to the second body pose satisfies the acceptability threshold, generating a sequence of movements for a synthesized reality (SR) representation of the user.

What is claimed is: 
     
       1. A method comprising:
 at a device including a non-transitory memory and one or more processors coupled with the non-transitory memory:
 obtaining movement information, wherein the movement information characterizes a first body pose of a user at a first time and a second body pose of the user at a second time; 
 determining an acceptability threshold based on a skill level of the user; 
 determining whether a transition from the first body pose to the second body pose satisfies the acceptability threshold; 
 in response to determining that the transition from the first body pose to the second body pose breaches the acceptability threshold, displaying a template body movement that shows another transition from the first body pose to the second body pose, wherein the other transition satisfies the acceptability threshold; and 
 in response to determining that the transition from the first body pose to the second body pose satisfies the acceptability threshold, generating a sequence of movements for a representation of the user. 
 
 
     
     
       2. The method of  claim 1 , wherein determining whether the transition from the first body pose to the second body pose satisfies the acceptability threshold comprises:
 determining whether the transition from the first body pose to the second body pose includes a first movement that is within the acceptability threshold of a second movement defined by a template body movement. 
 
     
     
       3. The method of  claim 2 , wherein the first movement is characterized by a first set of joint positions and the second movement is characterized by a second set of joint positions; and
 wherein determining whether the first movement is within the acceptability threshold of the second movement comprises determining whether the first set of joint positions are within the acceptability threshold of the second set of joint positions. 
 
     
     
       4. The method of  claim 2 , wherein the first movement is characterized by a first set of joint orientations and the second movement is characterized by a second set of joint orientations; and
 wherein determining whether the first movement is within the acceptability threshold of the second movement comprises determining whether the first set of joint orientations are within the acceptability threshold of the second set of joint orientations. 
 
     
     
       5. The method of  claim 1 , wherein determining whether the transition from the first body pose to the second body pose satisfies the acceptability threshold comprises:
 determining whether a time difference between the first time and the second time is within the acceptability threshold of an amount of time associated with a template body movement. 
 
     
     
       6. The method of  claim 1 , further comprising:
 narrowing the acceptability threshold in response to a number of previous transitions satisfying the acceptability threshold. 
 
     
     
       7. The method of  claim 1 , further comprising:
 widening the acceptability threshold in response to a number of previous transitions breaching the acceptability threshold. 
 
     
     
       8. The method of  claim 1 , further comprising:
 displaying the representation of the user in a computer-created setting. 
 
     
     
       9. The method of  claim 1 , further comprising:
 in response to determining that the transition from the first body pose to the second body pose satisfies the acceptability threshold, displaying movement of the representation of the user in accordance with the sequence of movements. 
 
     
     
       10. The method of  claim 1 , wherein obtaining the movement information comprises obtaining the movement information from external sensors. 
     
     
       11. The method of  claim 1 , wherein obtaining the movement information comprises:
 capturing one or more images via one or more cameras coupled with the device; and 
 performing instant segmentation and feature extraction on the one or more images to obtain the first body pose and the second body pose. 
 
     
     
       12. A device comprising:
 a non-transitory memory; and 
 one or more processors to:
 obtain movement information, wherein the movement information characterizes a first body pose of a user at a first time and a second body pose of the user at a second time; 
 determine an acceptability threshold based on a skill level of the user; 
 determine whether a transition from the first body pose to the second body pose satisfies the acceptability threshold; 
 in response to determining that the transition from the first body pose to the second body pose breaches the acceptability threshold, display a template body movement that shows another transition from the first body pose to the second body pose, wherein the other transition satisfies the acceptability threshold; and 
 in response to determining that the transition from the first body pose to the second body pose satisfies the acceptability threshold, generate a sequence of movements for a representation of the user. 
 
 
     
     
       13. The device of  claim 12 , wherein the one or more processors are to determine whether the transition from the first body pose to the second body pose satisfies the acceptability threshold by determining whether the transition from the first body pose to the second body pose includes a first movement that is within the acceptability threshold of a second movement defined by a template body movement. 
     
     
       14. The device of  claim 12 , wherein the one or more processors are to determine whether the transition from the first body pose to the second body pose satisfies the acceptability threshold by determining whether a time difference between the first time and the second time is within the acceptability threshold of an amount of time associated with a template body movement. 
     
     
       15. The device of  claim 12 , wherein the one or more processors are further to narrow the acceptability threshold in response to a number of previous transitions satisfying the acceptability threshold. 
     
     
       16. The device of  claim 12 , wherein the one or more processors are further to widen the acceptability threshold in response to a number of previous transitions breaching the acceptability threshold. 
     
     
       17. The device of  claim 12 , wherein the one or more processors are further to, in response to determining that the transition from the first body pose to the second body pose satisfies the acceptability threshold, display movement of the representation of the user in accordance with the sequence of movements. 
     
     
       18. A non-transitory memory having instructions encoded thereon which, when executed by one or more processors of a device, cause the device to:
 obtain movement information, wherein the movement information characterizes a first body pose of a user at a first time and a second body pose of the user at a second time; 
 determine an acceptability threshold based on a skill level of the user; 
 determine whether a transition from the first body pose to the second body pose satisfies the acceptability threshold; 
 in response to determining that the transition from the first body pose to the second body pose breaches the acceptability threshold, display a template body movement that shows another transition from the first body pose to the second body pose, wherein the other transition satisfies the acceptability threshold; and 
 in response to determining that the transition from the first body pose to the second body pose satisfies the acceptability threshold, generate a sequence of movements for a representation of the user.