System and method of real-time video overlaying or superimposing display

Abstract

Technologies relating to system and method of real-time video overlaying or superimposing display from multiple mutually synchronous cameras. are disclosed. An example method of real-time video overlaying includes the steps of: synchronizing frame rates of a depth data, a face meta data, and a video data of a first camera video output captured by a first camera; determining a first depth between a user face and the first camera; using a cutoff depth to determine a user body contour; generating a binary mask of the user body contour based on the first depth and the cutoff depth; smoothing an edge of the binary mask; merging the binary mask with the first camera video output and generating a merged first camera video output; and overlaying the merged first camera video output onto a second camera video output.

1 . A real-time video overlaying system comprising:
 a user device comprising a device body having a first side and a second side;   a first camera formed on the first side;   a second camera formed on the second side;   a depth sensor formed on the first side; and   an image processor, wherein the image processor comprises:
 a synchronizer unit configured to synchronize a first video data captured by the first camera, a face meta data captured by the first camera, and a depth data captured by the depth sensor; 
 a binary mask generator unit configured to generate a binary mask from the first video data captured by the first camera; 
 a video merger unit configured to merge the binary mask into the first video data, and generating a merged first video data; and 
 a video overlaying unit configured to overlay the merged first video data onto a second video data captured by the second camera. 
   
     
     
         2 . The system as claimed in  claim 1 , wherein the user device comprises a mobile phone or a wearable device. 
     
     
         3 . The system as claimed in  claim 1 , further comprising:
 an image sensor; and   a memory.   
     
     
         4 . The system as claimed in  claim 3 , wherein the image sensor comprises a CCD or a CMOS sensor. 
     
     
         5 . The system as claimed in  claim 1 , further comprising a video smoothing unit configured to smooth an edge of the binary mask. 
     
     
         6 . The system as claimed in  claim 1 , further comprising a video transforming unit configured to transform the binary mask to allow a drag-and-zoom feature. 
     
     
         7 . The system as claimed in  claim 1 , wherein the binary mask generator unit is configured to generate the binary mask of a user's body contour. 
     
     
         8 . The system as claimed in  claim 1 , wherein the first camera, the second camera, and the depth sensor are clocked differently. 
     
     
         9 . The system as claimed in  claim 5 , wherein the first camera and the depth sensor have different frame rates. 
     
     
         10 . The system as claimed in  claim 1 , wherein the depth sensor is embedded in the first camera. 
     
     
         11 . The system as claimed in  claim 1 , wherein the first video data is a selfie video. 
     
     
         12 . The system as claimed in  claim 3 , wherein the memory comprises a hard drive or a flash memory.