Object modeling and movement method and apparatus, and device

Abstract

The present invention discloses an object modeling and movement method. The method is applied to a mobile terminal, and the mobile terminal includes a color camera and a TOF module. The method includes: performing panoramic scanning on a target object by using the color camera and the TOF module, to obtain a 3D model of the target object; obtaining a target skeletal model; fusing the target skeletal model and the 3D model of the target object; obtaining a target movement manner; and controlling the target skeletal model in the target movement manner, to animate the 3D model of the target object in the target movement manner. This can implement integration from scanning, 3D reconstruction, skeletal rigging, to preset animation display for an object on one terminal, thereby implementing dynamization of a static object, and increasing interest in using the mobile terminal by a user.

What is claimed is: 
     
         1 . An object modeling and movement method, comprising:
 performing panoramic scanning on a target object using a color camera and a time of flight (TOF) module of a mobile terminal, to obtain a sequence of color images and a sequence of depth maps, wherein the color camera and the TOF module are located on one side of the mobile terminal;   obtaining a 3D model of the target object based on the sequence of color images and the sequence of depth maps;   obtaining a current movement manner of a first object; and   animating the 3D model of the target object to move in the current movement manner of the first object.   
     
     
         2 . The method according to  claim 1 , wherein the obtaining a current movement manner of a first object comprises:
 capturing a real-time action of the first object; and   using a movement manner of the real-time action of the first object as the current movement manner of the first object.   
     
     
         3 . The method according to  claim 1 , further comprising:
 when the 3D model of the target object moves in the current movement manner of the first object, using a captured image of a real-time action of the first object as a background of a movement of the target object.   
     
     
         4 . The method according to  claim 1 , wherein the target object is a static object, and the first object is a character. 
     
     
         5 . The method according to  claim 1 , wherein the performing panoramic scanning on a target object comprises:
 synchronously invoking the color camera and the TOF module to scan the target object, wherein a shooting frame rate of the color camera and a shooting frame rate of the TOF module are both greater than or equal to 25 frames per second (fps).   
     
     
         6 . The method according to  claim 1 , wherein before performing panoramic scanning on a target object, the method further comprises:
 displaying a preview image, wherein an identifier in the preview image prompts whether the target object is suitable to be scanned.   
     
     
         7 . The method according to  claim 1 , wherein performing panoramic scanning on a target object further comprises:
 presenting scanning progress for the target object on a display interface of the mobile terminal.   
     
     
         8 . The method according to  claim 1 , wherein animating the 3D model of the target object to move in the current movement manner of the first object further comprises:
 displaying a shadow of the 3D model of the target object on a display interface, or adding a special effect to the 3D model of the target object.   
     
     
         9 . The method according to  claim 1 , wherein after obtaining a 3D model of the target object, the method further comprises:
 obtaining a target skeletal model; and   fusing the target skeletal model and the 3D model of the target object; and   wherein animating the 3D model of the target object to move in the current movement manner of the first object comprises:   controlling the target skeletal model to move in the current movement manner of the first object, to animate the 3D model, obtained through fusion, of the target object to move in the current movement manner of the first object.   
     
     
         10 . The method according  claim 1 , wherein the obtaining a target skeletal model comprises:
 receiving an operation instruction of a user, wherein the operation instruction is used to combine at least two line segments and at least one point into a skeletal model, wherein the at least two line segments represent a skeleton in the skeletal model and the at least one point represents a joint node in the skeletal model; or   obtaining a skeletal model that matches an outline of the target object, and using the skeletal model as the target skeletal model.   
     
     
         11 . The method according to  claim 1 , further comprising:
 performing a skinning operation on a target skeletal model and the 3D model of the target object to determine a position change of a point on a surface of the 3D model of the target object based on movement of the target skeletal model, to enable the 3D model of the target object to move along with the target skeletal model.   
     
     
         12 . An object modeling and movement apparatus, wherein the apparatus is applied to a mobile terminal, the mobile terminal comprises a color camera and a time of flight (TOF) module, and the color camera and the TOF module are located on one side of the mobile terminal; and the apparatus comprises:
 a scanning module configured to perform panoramic scanning on a target object by using the color camera and the TOF module of the mobile terminal, to obtain a sequence of color images and a sequence of depth maps; and obtain a 3D model of the target object based on the sequence of color images and the sequence of depth maps, wherein the color camera and the TOF module are located on one side of the mobile terminal;   a second obtaining module configured to obtain a current movement manner of a first object; and   a movement module configured to animate the 3D model of the target object to move in the current movement manner of the first object.   
     
     
         13 . The apparatus according to  claim 12 , wherein the second obtaining module is configured to:
 capture a real-time action of the first object; and   use a movement manner of the real-time action of the first object as the current movement manner of the first object.   
     
     
         14 . The apparatus according to  claim 12 , wherein the movement module is further configured to:
 when the 3D model of the target object moves in the current movement manner of the first object, use a captured image of a real-time action of the first object as a background of the movement of the target object.   
     
     
         15 . The apparatus according to  claim 12 , wherein the target object is a static object, and the first object is a character. 
     
     
         16 . The apparatus according to  claim 12 , wherein the scanning module is further configured to:
 display a preview image, wherein an identifier in the preview image prompts whether the target object is suitable to be scanned.   
     
     
         17 . The apparatus according to  claim 12 , wherein the movement module is further configured to:
 display a shadow of the 3D model of the target object on a display interface of the mobile terminal, or add a special effect to the 3D model of the target object.   
     
     
         18 . The apparatus according to  claim 12 , further comprising:
 a first obtaining module configured to obtain a target skeletal model;   a fusion module configured to fuse the target skeletal model and the 3D model of the target object; wherein   the movement module is configured to control the target skeletal model to move in the current movement manner of the first object, to animate the 3D model, obtained through fusion, of the target object to move in the current movement manner of the first object; and   the first obtaining module is configured to:   receive an operation instruction of a user, wherein the operation instruction is used to combine at least two line segments and at least one point into a skeletal model, wherein the at least two line segments represent a skeleton in the skeletal model and the at least one point represents a joint node in the skeletal model; or   obtain a skeletal model that matches an outline of the target object, and use the skeletal model as the target skeletal model.   
     
     
         19 . A terminal device, wherein the terminal device comprises a memory, a processor, a bus, a time of flight (TOF) module, and a color camera coupled via the bus, wherein the memory is configured to store a computer program and an instruction; and the processor is configured to invoke the computer program and the instruction, to enable the terminal device to perform operations, comprising:
 performing panoramic scanning on a target object using the color camera and the TOF module, to obtain a sequence of color images and a sequence of depth maps, wherein the color camera and the TOF module are located on one side of the terminal device;   obtaining a 3D model of the target object based on the sequence of color images and the sequence of depth maps;   obtaining a current movement manner of a first object; and   animating the 3D model of the target object to move in the current movement manner of the first object.   
     
     
         20 . The terminal device according to  claim 19 , wherein the terminal device further comprises an antenna system, and the antenna system sends and receives a wireless communication signal under control of the processor, to implement wireless communication with a mobile communications network, wherein the mobile communications network comprises one or more of the following: a GSM network, a CDMA network, a 3G network, a 4G network, a 5G network, FDMA, TDMA, PDC, TACS, AMPS, WCDMA, TDSCDMA, Wi-Fi, and an LTE network.