Multipoint video conference device and controlling method thereof

Abstract

According to the present invention, by receiving, by a transceiver, videos from each of a plurality of clients, decoding, by a first processor, the plurality of videos, mixing, by a second processor, the plurality of decoded videos into a multipoint video, encoding, by the first processor, the multipoint video, multiplexing, by the first processor, the encoded multipoint video into a plurality of multipoint videos, and transmitting, by a transceiver, each of the plurality of multipoint videos to the plurality of clients, it is possible to dramatically reduce a CPU load for video quality calibration and mixing for large capacity videos, reduce video a processing delay time, and provide a higher quality multipoint conference video to a user by performing the video quality correction function, which is performed in the CPU, by using a higher-grade GPU in video processing.

What is claimed is: 
     
       1. A multipoint video conference device comprising:
 a transceiver configured to receive videos from each of a plurality of clients; 
 a first processor configured to decode the plurality of videos; and 
 a second processor configured to mix the plurality of decoded videos into a multipoint video, 
 wherein the first processor encodes the multipoint video, multiplexes the encoded multipoint video into a plurality of multipoint videos, and transmits each of the plurality of multipoint videos to each of the plurality of clients, and 
 wherein the second processor reduces each of the plurality of decoded videos of a first size into a plurality of divided videos of a second size, and mixes the plurality of divided videos of the second size into the multipoint video of the first size. 
 
     
     
       2. The device of  claim 1 , wherein the second processor applies denoising for each of the plurality of divided videos of the second size. 
     
     
       3. The device of  claim 1 , wherein the second processor applies sharpening for each of the plurality of divided videos of the second size. 
     
     
       4. The device of  claim 1 , wherein:
 the first processor transmits YUV values of each of the plurality of decoded videos to the second processor, and 
 the second processor generates the multipoint video using the YLTV values of each of the plurality of decoded videos. 
 
     
     
       5. The device of  claim 4 , wherein:
 the second processor transmits YUV value of the multipoint video to the first processor, and 
 the first processor encodes the multipoint video using the YUV value of the multipoint video. 
 
     
     
       6. The device, of  claim 4 , wherein:
 the first processor includes a plurality of first memories, and 
 the first processor configures a first region in the plurality of first memories for transmitting the YUV values of each of the plurality of decoded videos to the second processor. 
 
     
     
       7. The device, of  claim 5 , wherein:
 the second processor further includes a plurality of second memories, and 
 the second processor configures a second region in the plurality of second memories for receiving the YUV values of each of the plurality of decoded videos from the first processor. 
 
     
     
       8. The device of  claim 4 , wherein the first processor transmits the YUV values of each of the plurality of decoded videos asynchronously. 
     
     
       9. The device of  claim 8 , wherein the second processor transmits the YUV value of the multipoint video to the first processor asynchronously. 
     
     
       10. The device of  claim 1 , wherein a mixing speed of the second processor is faster than a mixing speed of the first processor. 
     
     
       11. A multipoint video conference controlling method comprising:
 receiving, by a transceiver, videos from each of a plurality of clients; 
 decoding, by a first processor, the plurality of videos; 
 mixing, by a second processor, the plurality of decoded videos into a multipoint video; 
 encoding, by the first processor, the multipoint video; 
 multiplexing, by the first processor, the encoded multipoint video into a plurality of multipoint videos; and 
 transmitting, by a transceiver, each of the plurality of multipoint videos to the plurality of clients, 
 wherein the mixing includes: 
 reducing, by the second processor, each of the plurality of decoded videos of a first size to a plurality of divided videos of a second size, and 
 mixing, by the second processor, the plurality of divided videos of the second size into the multipoint video of the first size. 
 
     
     
       12. The method of  claim 11 , wherein the mixing includes applying denoising, by the second processor, for each of the plurality of divided videos of the second size. 
     
     
       13. The method of  claim 11 , wherein the mixing includes applying sharpening, by the second processor, for each of the plurality of divided videos of the second size. 
     
     
       14. The method of  claim 11 , wherein the mixing includes:
 transmitting, by the first processor, YUV values of each of the plurality of decoded videos to the second processor, and 
 mixing, by the second processor, the plurality of decoded videos into the multipoint video using the YUV values of each of the plurality of decoded videos. 
 
     
     
       15. The method of  claim 14 , further comprising:
 transmitting, by the second processor, the YUV value of the multipoint video to the first processor, and 
 the encoding includes encoding, by the first processor, the multipoint video using the YUV value of the multipoint video. 
 
     
     
       16. The method of  claim 14 , wherein the transmitting of the YUV values of each of the plurality of decoded videos includes:
 transmitting, by the first processor, the YUV values of each of the plurality of decoded videos asynchronously. 
 
     
     
       17. The method of  claim 16 , further comprising:
 transmitting, by the second processor, the YUV value of the multipoint video to the first processor asynchronously. 
 
     
     
       18. A multipoint video conference device comprising:
 a transceiver configured to receive videos from each of a plurality of clients; 
 a main processing unit (CPU) configured to decode the plurality of videos; and 
 a graphics processing unit (GPU) configured to mix the plurality of decoded videos into a multipoint video, 
 wherein the main processing unit (CPU) encodes the multipoint video, multiplexes the encoded multipoint video into a plurality of multipoint videos, and transmits each of the plurality of multipoint videos to each of the plurality of clients, and 
 wherein the graphics processing unit (GPU) reduces each of the plurality of decoded videos of a first size into a plurality of divided videos of a second size, and mixes the plurality of divided videos of the second size into the multipoint video of the first size.