Electronic device and object measurement method thereof

Abstract

According to an embodiment, an electronic device includes a display, a memory, and a processor operatively connected to the display and the memory. The memory stores instructions that cause the processor to generate first depth information in a first direction from an object, generate a first point cloud of the object based on the first depth information, generate a first bounding box containing one or more points of the first point cloud, generate second depth information in a second direction from the object, the second direction being different from the first direction, generate a second point cloud of the object based on the second depth information, generate a second bounding box containing one or more points of the second point cloud, generate a third bounding box by combining the first and second bounding boxes, and display the third bounding box on the display. Certain other embodiments are also possible.

What is claimed is: 
     
         1 . An electronic device comprising:
 a display;   a memory; and   a processor operatively connected to the display and the memory,   wherein the memory stores instructions that, when executed by the processor, cause the processor to:
 receive an user input for selecting 2-dimensional measurement or 3-dimensional measurement of an object; 
 generate point clouds of the object based on depth information of the object in response to identifying the object being arranged in a screen of the display, 
 generate a bounding box based on analysis of the point clouds of the object, wherein the bounding box is overlapped with a region of an object image extracted from a red, green, and blue (RGB) image of the object, 
 display, on the display, the object image with the bounding box overlapped with the region of the object image. 
   
     
     
         2 . The electronic device of  claim 1 , wherein the instructions further cause the processor to provide a measurement result of the object on the display. 
     
     
         3 . The electronic device of  claim 1 , wherein the measurement result includes numeric information of a length of at least one side of the bounding box or an area or a volume of the bounding box. 
     
     
         4 . The electronic device of  claim 1 , wherein the instructions further cause the processor to generate and display the bounding box overlapped with the object image on the display in response to another user input for executing the measurement of the object. 
     
     
         5 . The electronic device of  claim 4 , wherein the instructions further cause the processor to provide the measurement result of the object on the display in response to the another user input. 
     
     
         6 . The electronic device of  claim 1 , wherein the instructions further cause the processor to display guide information, on the display, for guiding arrangement of the object in the screen of the display by moving the electronic device. 
     
     
         7 . The electronic device of  claim 6 , wherein the instructions further cause the processor to cause the processor generate and display the bounding box overlapped with the object image on the display in response to a touch input after the object is arranged in the screen of the display by moving the electronic device. 
     
     
         8 . The electronic device of  claim 1 , wherein the instructions further cause the processor to display guide information, on the display, for guiding a shift in a location of the electronic device if a part of the object image is out of a screen of the display. 
     
     
         9 . The electronic device of  claim 8 , wherein the instructions further cause the processor to:
 generate second point clouds of the object based on second depth information of the object at a shifted location of the electronic device in response to the guide information,   generate second point clouds of the object based on the second depth information,   generate a second bounding box based on analysis of the second point clouds of the object, wherein the second bounding box is overlapped with a region of a second object image extracted from a red, green, and blue (RGB) image of the object at the shifted location of the electronic device,   generate a third bounding box by combining the bounding boxes, and   display the third bounding box on the display.   
     
     
         10 . The electronic device of  claim 1 , further comprising a time of flight (ToF) sensor,
 wherein the instructions further cause the processor to generate the depth information based on a ToF frame taken by the ToF sensor from the object.   
     
     
         11 . A method of an electronic device comprising:
 receiving an user input for selecting 2-dimensional measurement or 3-dimensional measurement of an object;   generating point clouds of the object based on depth information of the object if the object is identified and arranged in a screen of the display,   generating a bounding box based on analysis of the point clouds of the object, wherein the bounding box is overlapped with a region of an object image extracted from a red, green, and blue (RGB) image of the object,   displaying, on the display, the object image with the bounding box overlapped with the region of the object image.   
     
     
         12 . The method of  claim 11 , further comprising providing a measurement result of the object on the display. 
     
     
         13 . The method of  claim 11 , wherein the measurement result includes numeric information of a length of at least one side of the bounding box or an area or a volume of the bounding box. 
     
     
         14 . The method of  claim 11 , wherein the bounding box is generated and displayed as being overlapped with the object image on the display in response to another user input for executing the measurement of the object. 
     
     
         15 . The method of  claim 14 , wherein further comprising providing the measurement result of the object on the display in response to the another user input. 
     
     
         16 . The method of  claim 11 , wherein further comprising displaying guide information, on the display, for guiding arrangement of the object in the screen of the display by moving the electronic device. 
     
     
         17 . The method of  claim 16 , wherein the bounding box is generated and displayed as being overlapped with the object image on the display in response to a touch input after the object is arranged in the screen of the display by moving the electronic device. 
     
     
         18 . The method of  claim 11 , further comprising displaying guide information, on the display, for guiding a shift in a location of the electronic device if a part of the object image is out of a screen of the display. 
     
     
         19 . The method of  claim 18 , further comprising:
 generating second point clouds of the object based on second depth information of the object at a shifted location of the electronic device in response to the guide information,   generating second point clouds of the object based on the second depth information,   generate a second bounding box based on analysis of the second point clouds of the object, wherein the second bounding box is overlapped with a region of a second object image extracted from a red, green, and blue (RGB) image of the object at the shifted location of the electronic device,   generating a third bounding box by combining the bounding boxes, and   displaying the third bounding box on the display.   
     
     
         20 . The method of  claim 11 , further comprising a time of flight (ToF) sensor,
 wherein the depth information is generated using a time of flight (ToF) sensor based on a ToF frame taken by the ToF sensor.