US10380782B2ActiveUtilityA1

Method for transmitting and displaying object tracking information and system thereof

36
Assignee: VIVOTEK INCPriority: Mar 18, 2016Filed: Feb 7, 2017Granted: Aug 13, 2019
Est. expiryMar 18, 2036(~9.7 yrs left)· nominal 20-yr term from priority
G06T 17/00H04N 7/18G06T 15/00H04N 2013/0081G06T 15/20
36
PatentIndex Score
0
Cited by
16
References
12
Claims

Abstract

A method for transmitting and displaying an object tracking information includes steps of capturing an image by a camera, wherein an object exists in the image; analyzing the image by the camera to obtain a 3D world coordinate information of the object; transmitting a projection matrix and the 3D world coordinate information to a display device by the camera; using the projection matrix to convert the 3D world coordinate information into a 2D image coordinate information by the display device; and displaying a pattern corresponding to the object according to the 2D image coordinate information by the display device.

Claims

exact text as granted — not AI-modified
What is claimed is: 
     
       1. A method for transmitting and displaying an object tracking information comprising steps of:
 capturing an image by a camera, wherein an object exists in the image; 
 analyzing the image by the camera to obtain a 3D world coordinate information of the object; 
 transmitting a projection matrix and the 3D world coordinate information to a display device by the camera; 
 using the projection matrix to convert the 3D world coordinate information into a 2D image coordinate information by the display device through 
 
       
         
           
             
               
                 
                   ( 
                   
                     
                       
                         x 
                       
                     
                     
                       
                         y 
                       
                     
                     
                       
                         w 
                       
                     
                   
                   ) 
                 
                 = 
                 
                   
                     P 
                     
                       3 
                       × 
                       4 
                     
                   
                   ⁡ 
                   
                     ( 
                     
                       
                         
                           X 
                         
                       
                       
                         
                           Y 
                         
                       
                       
                         
                           Z 
                         
                       
                       
                         
                           T 
                         
                       
                     
                     ) 
                   
                 
               
               , 
             
           
         
       
       wherein P 3×4  represents the projection matrix of the camera, (x, y, w) represents a 2D homogeneous coordinate, and (X, Y, Z, T) represents a 3D homogeneous coordinate, X, Y and Z of (X, Y, Z, T) are the 3D world coordinate information, x and y of (x, y, w) are the 2D image coordinate information, and T of (X, Y, Z, T) and w of (x, y, w) are scaling factors for homogeneous coordinate; and
 displaying a pattern corresponding to the object according to the 2D image coordinate information by the display device. 
 
     
     
       2. The method of  claim 1 , further comprising step of:
 expanding the 2D image coordinate information into a frame with a predetermined real length by the display device. 
 
     
     
       3. The method of  claim 1 , further comprising step of:
 displaying the pattern on a top or a bottom of the object by the display device. 
 
     
     
       4. The method of  claim 1 , wherein the 3D world coordinate information comprises a height of the object and the method further comprises steps of:
 when the height is larger than or equal to a predetermined height, displaying the pattern with a first size by the display device; and 
 when the height is smaller than the predetermined height, displaying the pattern with a second size by the display device, wherein the second size is smaller than the first size. 
 
     
     
       5. The method of  claim 1 , wherein the 3D world coordinate information comprises a height of the object and the method further comprises steps of:
 when the height is larger than or equal to a predetermined height, displaying the pattern with a first shape by the display device; and 
 when the height is smaller than the predetermined height, displaying the pattern with a second shape by the display device, wherein the second shape is different from the first shape. 
 
     
     
       6. The method of  claim 1 , further comprising step of:
 transmitting the image to the display device by the camera; and 
 displaying the image by the display device; 
 wherein the pattern is displayed on the image. 
 
     
     
       7. A system for transmitting and displaying an object tracking information comprising:
 a camera capturing an image, an object existing in the image, the camera analyzing the image to obtain a 3D world coordinate information of the object; and 
 a display device communicating with the camera, the camera transmitting a projection matrix and the 3D world coordinate information to the display device, the display device using the projection matrix to convert the 3D world coordinate information into a 2D image coordinate information through 
 
       
         
           
             
               
                 
                   ( 
                   
                     
                       
                         x 
                       
                     
                     
                       
                         y 
                       
                     
                     
                       
                         w 
                       
                     
                   
                   ) 
                 
                 = 
                 
                   
                     P 
                     
                       3 
                       × 
                       4 
                     
                   
                   ⁡ 
                   
                     ( 
                     
                       
                         
                           X 
                         
                       
                       
                         
                           Y 
                         
                       
                       
                         
                           Z 
                         
                       
                       
                         
                           T 
                         
                       
                     
                     ) 
                   
                 
               
               , 
             
           
         
       
       wherein P 3×4  represents the projection matrix of the camera, (x, y, w) represents a 2D homogeneous coordinate, and (X, Y, Z, T) represents a 3D homogeneous coordinate, X, Y and Z of (X, Y, Z, T) are the 3D world coordinate information, x and y of (x, y, w) are the 2D image coordinate information, and T of (X, Y, Z, T) and w of (x, y, w) are scaling factors for homogeneous coordinate, the display device displaying a pattern corresponding to the object according to the 2D image coordinate information. 
     
     
       8. The system of  claim 7 , wherein the display device expands the 2D image coordinate information into a frame with a predetermined real length. 
     
     
       9. The system of  claim 7 , wherein the display device displays the pattern on a top or a bottom of the object. 
     
     
       10. The system of  claim 7 , wherein the 3D world coordinate information comprises a height of the object; when the height is larger than or equal to a predetermined height, the display device displays the pattern with a first size; when the height is smaller than the predetermined height, the display device displays the pattern with a second size; and the second size is smaller than the first size. 
     
     
       11. The system of  claim 7 , wherein the 3D world coordinate information comprises a height of the object; when the height is larger than or equal to a predetermined height, the display device displays the pattern with a first shape; when the height is smaller than the predetermined height, the display device displays the pattern with a second shape; and the second shape is different from the first shape. 
     
     
       12. The system of  claim 7 , wherein the camera transmits the image to the display device, the display device displays the image, and the display device displays the pattern on the image.

Cited by (0)

No later patents cite this yet.

References (0)

No backward citations on record.