US11032510B2ActiveUtilityA1

Video processing method, computer device, and storage medium

79
Assignee: TENCENT TECH SHENZHEN CO LTDPriority: Oct 27, 2017Filed: Oct 2, 2019Granted: Jun 8, 2021
Est. expiryOct 27, 2037(~11.3 yrs left)· nominal 20-yr term from priority
Inventors:Yang Zhou
H04N 9/64H04N 21/816H04N 21/44218H04N 13/167H04N 21/44008H04N 13/383G02B 2027/014H04N 21/440245H04N 13/398G09G 2320/0666H04N 13/373H04N 13/133G09G 5/026G06F 3/013H04N 19/597H04N 13/15G02B 27/0093H04N 13/344G06F 3/012H04N 21/6587H04N 13/376H04N 13/324H04N 7/0137G09G 2340/16H04N 13/122
79
PatentIndex Score
2
Cited by
18
References
20
Claims

Abstract

A video processing method is provided. In the method, circuitry of a terminal determines a second video frame portion associated with a second time point that is after a first time point associated with a first video frame portion of a video. The circuitry generates a transitional video frame based on the first video frame portion and the second video frame portion. A color value of a pixel at a target pixel location in the transitional video frame is within a target color interval. The target color interval is determined according to a color value of a pixel at the target pixel location in the first video frame portion and a color value of a pixel at the target pixel location in the second video frame portion. The circuitry performs display control of the video according to the transitional video frame.

Claims

exact text as granted — not AI-modified
What is claimed is: 
     
       1. A video processing method, comprising:
 determining, by circuitry of a terminal, a second video frame portion associated with a second time point that is after a first time point associated with a first video frame portion of a video; 
 generating a transitional video frame based on differences between first color values of pixels in the first video frame portion and second color values of pixels in the second video frame portion, a transitional color value of a pixel at a target pixel location in the transitional video frame being within a target color interval, and the target color interval being determined according to a first color value of the first color values that corresponds to the pixel at the target pixel location in the first video frame portion and a second color value of the second color values that corresponds to the pixel at the target pixel location in the second video frame portion; and 
 performing, by the circuitry, display control of the video according to the transitional video frame, 
 wherein the first color value that corresponds to the pixel at the target pixel location in the first video frame portion is one of black and white, and the second color value that corresponds to the pixel at the target pixel location in the second video frame portion is the other one of black and white. 
 
     
     
       2. The method according to  claim 1 , wherein the determining comprises:
 obtaining, by the circuitry, motion speed information; 
 obtaining, by the circuitry, second pose information of the second time point according to first pose information of the first time point, the motion speed information, and a difference between the first time point and the second time point; 
 obtaining, by the circuitry, a second video frame of the video to be displayed at the second time point; and 
 obtaining, by the circuitry, the second video frame portion from the second video frame according to the second pose information. 
 
     
     
       3. The method according to  claim 2 , wherein
 a width of the second video frame portion obtained from the second video frame is greater than a width of a video image that is displayed; and 
 the displayed video image is a partial image of the second video frame. 
 
     
     
       4. The method according to  claim 3 , wherein
 a height of the second video frame portion obtained from the second video frame is greater than a height of the displayed video image. 
 
     
     
       5. The method according to  claim 2 , wherein
 the motion speed information indicates rotation angular velocity values in at least two different motion directions, 
 the second pose information is visual field orientation angle information, and 
 a plurality of different motion directions is associated with initial video frame groups, and each initial video frame group includes a candidate second video frame portion and a candidate transitional video frame generated based on the second video frame portion. 
 
     
     
       6. The method according to  claim 1 , further comprising:
 obtaining, by the circuitry, a video frame refresh frequency of the terminal; 
 obtaining, by the circuitry, a video frame play frequency during playing of the video; and 
 determining, by the circuitry, a number of transitional video frames according to the video frame refresh frequency and the video frame play frequency, wherein 
 the generating includes generating the determined number of transitional video frames. 
 
     
     
       7. The method according to  claim 1 , wherein the generating comprises:
 obtaining, by the circuitry, the first color value of the pixel of the target pixel location in the first video frame portion; 
 obtaining, by the circuitry, the second color value of the pixel of the target pixel location in the second video frame portion; 
 obtaining, by the circuitry, the transitional color value of the transitional pixel at the target pixel location based on an interpolation according to the first color value and the second color value; and 
 generating, by the circuitry, the transitional video frame according to pixel values of a plurality of transitional pixels, the plurality of transitional pixels including the transitional pixel. 
 
     
     
       8. The method according to  claim 7 , wherein the generating the transitional video frame comprises:
 performing, by the circuitry, differential calculation between color channel components in the first color value and color channel components in the second color value, to obtain component differences of the color channel components; 
 obtaining, by the circuitry, change amounts of the color channel components according to a number of transitional video frames that need to be generated; and 
 obtaining, by the circuitry, the transitional color value of the transitional pixel of the target pixel location of each of the number of transitional video frames according to the color channel components of the first color value, the number of the transitional video frames that need to be generated, and the change amounts of the color channel components. 
 
     
     
       9. The method according to  claim 7 , wherein the generating comprises:
 generating the transitional video frame based on all pixels of the first video frame portion and all pixels of the second video frame portion. 
 
     
     
       10. The method according to  claim 5 , wherein the performing comprises:
 detecting, by the circuitry, a motion direction; 
 selecting, by the circuitry, an initial video frame group associated with the motion direction, to obtain a target initial video frame group; and 
 performing, by the circuitry, the display control of the video according to the target initial video frame group. 
 
     
     
       11. The method according to  claim 10 , wherein the performing comprises:
 obtaining, by the circuitry, a visual field angle parameter of the terminal; 
 determining, by the circuitry according to the visual field angle parameter, a pixel range to be displayed; 
 performing, by the circuitry, pixel coordinate matching on each video frame portion in the target initial video frame group according to the pixel range, to form a transitional play video frame and a second play video frame; and 
 sequentially playing, by the terminal, the transitional play video frame and the second play video frame. 
 
     
     
       12. A computer device, comprising:
 circuitry configured to
 determine a second video frame portion associated with a second time point that is after a first time point associated with a first video frame portion of a video; 
 generate a transitional video frame based on differences between first color values of pixels in the first video frame portion and second color values of pixels in the second video frame portion, a transitional color value of a pixel at a target pixel location in the transitional video frame being within a target color interval, and the target color interval being determined according to a first color value of the first color values that corresponds to the pixel at the target pixel location in the first video frame portion and a second color value of the second color values that corresponds to the pixel at the target pixel location in the second video frame portion; and 
 perform display control of the video according to the transitional video frame 
 
 wherein the first color value that corresponds to the pixel at the target pixel location in the first video frame portion is one of black and white, and the second color value that corresponds to the pixel at the target pixel location in the second video frame portion is the other one of black and white. 
 
     
     
       13. The computer device according to  claim 12 , wherein the circuitry is configured to
 obtain motion speed information; 
 obtain second pose information of the second time point according to first pose information of the first time point, the motion speed information, and a difference between the first time point and the second time point; 
 obtain a second video frame of the video to be displayed at the second time point; and 
 obtain the second video frame portion from the second video frame according to the second pose information. 
 
     
     
       14. The computer device according to  claim 13 , wherein
 a width of the second video frame portion obtained from the second video frame is greater than a width of a video image that is displayed; and 
 the displayed video image is a partial image of the second video frame. 
 
     
     
       15. The computer device according to  claim 14 , wherein a height of the second video frame portion obtained from the second video frame is greater than a height of the displayed video image. 
     
     
       16. The computer device according to  claim 13 , wherein
 the motion speed information indicates rotation angular velocity values in at least two different motion directions, 
 the second pose information is visual field orientation angle information, and 
 a plurality of different motion directions is associated with initial video frame groups, and each initial video frame group includes a candidate second video frame portion and a candidate transitional video frame generated based on the second video frame portion. 
 
     
     
       17. The computer device according to  claim 12 , wherein the circuitry is configured to
 obtain a video frame refresh frequency of the computer device; 
 obtain a video frame play frequency during playing of the video; 
 determine a number of transitional video frames according to the video frame refresh frequency and the video frame play frequency; and 
 generate the determined number of transitional video frames. 
 
     
     
       18. The computer device according to  claim 12 , wherein the circuitry is configured to
 obtain the first color value of the pixel of the target pixel location in the first video frame portion; 
 obtain the second color value of the pixel of the target pixel location in the second video frame portion; 
 obtain the transitional color value of the transitional pixel at the target pixel location based on an interpolation according to the first color value and the second color value; and 
 generate the transitional video frame according to pixel values of a plurality of transitional pixels, the plurality of transitional pixels including the transitional pixel. 
 
     
     
       19. At least one non-transitory computer-readable storage medium storing instructions which when executed by one or more processors cause the one or more processors to perform:
 determining a second video frame portion associated with a second time point that is after a first time point associated with a first video frame portion of a video; 
 generating a transitional video frame based on differences between first color values of pixels in the first video frame portion and second color values of pixels in the second video frame portion, a transitional color value of a pixel at a target pixel location in the transitional video frame being within a target color interval, and the target color interval being determined according to a first color value of the first color values that corresponds to the pixel at the target pixel location in the first video frame portion and a second color value of the second color values that corresponds to the pixel at the target pixel location in the second video frame portion; and 
 performing display control of the video according to the transitional video frame, 
 wherein the first color value that corresponds to the pixel at the target pixel location in the first video frame portion is one of black and white, and the second color value that corresponds to the pixel at the target pixel location in the second video frame portion is the other one of black and white. 
 
     
     
       20. The method according to  claim 1 , wherein
 the video is a virtual reality video, and 
 the first video frame portion and the second video frame portion correspond to different viewpoints within the virtual reality video.

Cited by (0)

No later patents cite this yet.

References (0)

No backward citations on record.