US2024276025A1PendingUtilityA1

Video hardware decoder circuit and a control method and a control system for bit stream parsing error detection therein

Assignee: GLENFLY TECH CO LTD SHANGHAIPriority: Feb 14, 2023Filed: Feb 14, 2024Published: Aug 15, 2024
Est. expiryFeb 14, 2043(~16.6 yrs left)· nominal 20-yr term from priority
H04N 19/174H04N 19/91H04N 19/80H04N 19/70H04N 19/188H04N 19/172H04N 19/89H04N 17/00H04N 19/44H04N 19/85
37
PatentIndex Score
0
Cited by
0
References
0
Claims

Abstract

A control method/system for bit stream parsing error detection in a video hardware decoder including performing a bit stream security range detection on the obtained video stream to obtain a first detection result, performing a bit stream extremum detection on the obtained video stream to obtain a second detection result, an performing an anomaly detection on the process of bit stream parsing on the video stream, and performing an exception handling or a frame reset on the video stream according to the results of the anomaly detection based on the first detection result and the second detection result.

Claims

exact text as granted — not AI-modified
What is claimed is: 
     
         1 . A control method for bit stream parsing error detection in a video hardware decoder, performed by a computer device, comprising:
 performing a bit stream security range detection on the obtained video stream to obtain a first detection result;   performing a bit stream extremum detection on the obtained video stream to obtain a second detection result; and   performing an anomaly detection on the process of bit stream parsing on the video stream, and performing an exception handling or a frame reset on the video stream according to the results of the anomaly detection based on the first detection result and the second detection result.   
     
     
         2 . The control method according to  claim 1 , wherein performing the bit stream security range detection on the obtained video stream comprises:
 obtaining the configuration information of the video stream from the driving end, and obtaining the bit stream length of the video stream contained in the configuration information;   setting a bit stream pointer to record the current consumption length of the video stream;   determining whether the video stream has experienced bit stream out-of-bounds behaviors by comparing the current consumption length with the bit stream length;   based on a determination that the video stream has not experienced the bit stream out-of-bounds behaviors, returning a duplicate determination; and   based on a determination that the video stream has experienced the bit stream out-of-bounds behaviors, outputting a bit stream out-of-bounds flag as a first detection result.   
     
     
         3 . The control method according to  claim 2 , wherein the bit stream pointer comprises a byte-align bit stream pointer and a bit-level bit stream pointer;
 wherein the byte-align bit stream pointer determines whether the bit stream out-of-bounds behaviors occurs by determining whether the record of the byte counter that counts the byte consumption of the video stream is zero, and based on the record of the byte counter being zero and the length of the current operating byte-align bit stream pointer exceeding the length of the previous frame bit stream, the byte-align bit stream pointer determines that the bit stream out-of-bounds behaviors have occurred; and   wherein the bit-level bit stream pointer determines whether the bit stream out-of-bounds behaviors occurs by determining whether the length of the current bit stream calculated by the bit stream counter is greater than the rated total length of the current bit stream, and based on the length of the current bit stream being greater than the rated total length of the current bit stream, the bit-level bit stream pointer determines that the bit stream out-of-bounds behaviors have occurred.   
     
     
         4 . The control method according to  claim 1 , wherein performing the bit stream extremum detection on the obtained video stream comprises:
 obtaining the configuration information of the video stream from the driving end, and   obtaining the different syntax elements contained in the configuration information;   obtaining an effective range of the values corresponding to each syntax element according to the bit stream analysis of the syntax elements of the video stream;   determining whether the video stream has experienced the bit stream out-of-bounds behavior by detecting whether the values of each syntax element are within the effective range based on the effective range of the values corresponding to each syntax element;   based on the value of a syntax element being within the effective range, returning a duplicate determination;   based on the value of a syntax element being outside the effective range, outputting a value out-of-bounds flag as a second detection result.   
     
     
         5 . The control method according to  claim 1 , wherein performing the bit stream extremum detection on the obtained video stream comprises:
 obtaining the configuration information of the video stream from the driving end, and   obtaining the different syntax elements contained in the configuration information;   obtaining an arithmetic code corresponding to each syntax element according to the bit stream analysis of the syntax elements of the video stream;   determining whether the video stream has experienced the bit stream out-of-bounds behavior by detecting whether the number of the leading zero of the video stream is greater than a corresponding standard value based on the arithmetic code corresponding to each syntax element;   based on the number of the leading zero being not more than the corresponding standard value, returning a duplicate determination;   based on the number of the leading zero being more than the corresponding standard value, outputting a leading zero anomaly flag as a second detection result.   
     
     
         6 . The control method according to  claim 1 , wherein performing the anomaly detection on the process of bit stream parsing on the video stream, and performing the exception handling or the frame reset on the video stream according to the results of the anomaly detection based on the first detection result and the second detection result comprises:
 recording the error information generated during the process of the bit stream parsing on the video stream based on the first detection result and the second detection result;   determining the error level recorded in the error information and perform an exception handling on the video stream;   based on the error level being level zero, ignoring the error information and continuing decoding normally;   based on the error level being level one, the current frame consisting of a single slice, ending the decoding of the current slice, moving the screen information from adjacent frames of the current frame to fill the current frame based on the coordinate information of the current frame recorded in the error information, and beginning the decoding of the next slice;   based on the error level being level two, the current frame consisting of multiple slices, ending the decoding of the current frame, moving the screen information from adjacent frames of the current frame to fill the current frame based on the coordinate information of the current frame recorded in the error information, and beginning the decoding of the next frame; and   performing a frame reset after each subsequent module parses the video stream separately to the error point where the error was found according to broadcasting the information that an error was found of the current parsing position of the video stream recorded in the error information to subsequent modules.   
     
     
         7 . A control system for bit stream parsing error detection in a video hardware decoder comprising:
 at least one memory configured to store program code; and   at least one processor configured to read the program code and operate as instructed by the program code, the program code comprising:   bit stream security range detection code configured to cause at least one of the at least one processor to perform a bit stream security range detection on the obtained video stream to obtain a first detection result;   extremum detection code configured to cause at least one of the at least one processor to perform a bit stream extremum detection on the obtained video stream to obtain a second detection result; and   anomaly recognition and reset code configured to cause at least one of the at least one processor to perform an anomaly detection on the process of bit stream parsing on the video stream, and perform an exception handling or a frame reset on the video stream according to the results of the anomaly detection based on the first detection result and the second detection result.   
     
     
         8 . The control system according to  claim 7 , wherein the bit stream security range detection code is further configured to cause at least one of the at least one processor to:
 obtain the configuration information of the video stream from the driving end, and obtaining the bit stream length of the video stream contained in the configuration information;   set a bit stream pointer to record the current consumption length of the video stream;   determine whether the video stream has experienced bit stream out-of-bounds behaviors by comparing the current consumption length with the bit stream length;   based on a determination that the video stream has not experienced the bit stream out-of-bounds behaviors, return a duplicate determination; and   based on a determination that the video stream has experienced the bit stream out-of-bounds behaviors, output a bit stream out-of-bounds flag as a first detection result.   
     
     
         9 . The control system according to  claim 8 , wherein the bit stream pointer comprises a byte-align bit stream pointer and a bit-level bit stream pointer;
 wherein the byte-align bit stream pointer determines whether the bit stream out-of-bounds behaviors occurs by determining whether the record of the byte counter that counts the byte consumption of the video stream is zero, and based on the record of the byte counter being zero and the length of the current operating byte-align bit stream pointer exceeding the length of the previous frame bit stream, the byte-align bit stream pointer determines that the bit stream out-of-bounds behaviors have occurred; and   wherein the bit-level bit stream pointer determines whether the bit stream out-of-bounds behaviors occurs by determining whether the length of the current bit stream calculated by the bit stream counter is greater than the rated total length of the current bit stream, and based on the length of the current bit stream being greater than the rated total length of the current bit stream, the bit-level bit stream pointer determines that the bit stream out-of-bounds behaviors have occurred.   
     
     
         10 . The control system according to  claim 7 , wherein the extremum detection code is further configured to cause at least one of the at least one processor to:
 obtain the configuration information of the video stream from the driving end, and obtain   the different syntax elements contained in the configuration information;   obtain an effective range of the values corresponding to each syntax element according to the bit stream analysis of the syntax elements of the video stream;   determine whether the video stream has experienced the bit stream out-of-bounds behavior by detecting whether the values of each syntax element are within the effective range based on the effective range of the values corresponding to each syntax element;   based on the value of a syntax element being within the effective range, return a duplicate determination;   based on the value of a syntax element being outside the effective range, output a value out-of-bounds flag as a second detection result.   
     
     
         11 . The control system according to  claim 7 , wherein the extremum detection code is further configured to cause at least one of the at least one processor to:
 obtain the configuration information of the video stream from the driving end, and obtain   the different syntax elements contained in the configuration information;   obtain an arithmetic code corresponding to each syntax element according to the bit stream analysis of the syntax elements of the video stream;   determine whether the video stream has experienced the bit stream out-of-bounds behavior by detecting whether the number of the leading zero of the video stream is greater than a corresponding standard value based on the arithmetic code corresponding to each syntax element;   based on the number of the leading zero being not more than the corresponding standard value, return a duplicate determination;   based on the number of the leading zero being more than the corresponding standard value, output a leading zero anomaly flag as a second detection result.   
     
     
         12 . The control system according to  claim 7 , wherein the anomaly recognition and reset code is further configured to cause at least one of the at least one processor to:
 record the error information generated during the process of the bit stream parsing on the video stream based on the first detection result and the second detection result;   determine the error level recorded in the error information and perform an exception handling on the video stream;   based on the error level being level zero, ignore the error information and continuing decoding normally;   based on the error level being level one, the current frame consisting of a single slice, ending the decoding of the current slice, move the screen information from adjacent frames of the current frame to fill the current frame based on the coordinate information of the current frame recorded in the error information, and beginning the decoding of the next slice;   based on the error level being level two, the current frame consisting of multiple slices, ending the decoding of the current frame, move the screen information from adjacent frames of the current frame to fill the current frame based on the coordinate information of the current frame recorded in the error information, and begin the decoding of the next frame;   performing a frame reset after each subsequent module parses the video stream separately to the error point where the error was found according to broadcasting the information that an error was found of the current parsing position of the video stream recorded in the error information to subsequent modules.   
     
     
         13 . A non-transitory computer-readable storage medium storing computer code which, when executed by at least one processor, causes the at least one processor to at least:
 perform a bit stream security range detection on the obtained video stream to obtain a first detection result;   perform a bit stream extremum detection on the obtained video stream to obtain a second detection result; and   perform an anomaly detection on the process of bit stream parsing on the video stream, and perform an exception handling or a frame reset on the video stream according to the results of the anomaly detection based on the first detection result and the second detection result.   
     
     
         14 . The non-transitory computer-readable storage medium according to  claim 13 , wherein the perform the bit stream security range detection on the obtained video stream comprises:
 obtaining the configuration information of the video stream from the driving end, and obtaining the bit stream length of the video stream contained in the configuration information;   setting a bit stream pointer to record the current consumption length of the video stream;   determining whether the video stream has experienced bit stream out-of-bounds behaviors by comparing the current consumption length with the bit stream length;   based on a determination that the video stream has not experienced the bit stream out-of-bounds behaviors, returning a duplicate determination; and   based on a determination that the video stream has experienced the bit stream out-of-bounds behaviors, outputting a bit stream out-of-bounds flag as a first detection result.   
     
     
         15 . The non-transitory computer-readable storage medium according to  claim 14 , wherein the bit stream pointer comprises a byte-align bit stream pointer and a bit-level bit stream pointer;
 wherein the byte-align bit stream pointer determines whether the bit stream out-of-bounds behaviors occurs by determining whether the record of the byte counter that counts the byte consumption of the video stream is zero, and based on the record of the byte counter being zero and the length of the current operating byte-align bit stream pointer exceeding the length of the previous frame bit stream, the byte-align bit stream pointer determines that the bit stream out-of-bounds behaviors have occurred; and   wherein the bit-level bit stream pointer determines whether the bit stream out-of-bounds behaviors occurs by determining whether the length of the current bit stream calculated by the bit stream counter is greater than the rated total length of the current bit stream, and based on the length of the current bit stream being greater than the rated total length of the current bit stream, the bit-level bit stream pointer determines that the bit stream out-of-bounds behaviors have occurred.   
     
     
         16 . The non-transitory computer-readable storage medium according to  claim 13 , wherein the perform the bit stream extremum detection on the obtained video stream comprises:
 obtaining the configuration information of the video stream from the driving end, and   obtaining the different syntax elements contained in the configuration information;   obtaining an effective range of the values corresponding to each syntax element according to the bit stream analysis of the syntax elements of the video stream;   determining whether the video stream has experienced the bit stream out-of-bounds behavior by detecting whether the values of each syntax element are within the effective range based on the effective range of the values corresponding to each syntax element;   based on the value of a syntax element being within the effective range, returning a duplicate determination;   based on the value of a syntax element being outside the effective range, outputting a value out-of-bounds flag as a second detection result.   
     
     
         17 . The non-transitory computer-readable storage medium according to  claim 13 , wherein the perform the bit stream extremum detection on the obtained video stream comprises:
 obtaining the configuration information of the video stream from the driving end, and   obtaining the different syntax elements contained in the configuration information;   obtaining an arithmetic code corresponding to each syntax element according to the bit stream analysis of the syntax elements of the video stream;   determining whether the video stream has experienced the bit stream out-of-bounds behavior by detecting whether the number of the leading zero of the video stream is greater than a corresponding standard value based on the arithmetic code corresponding to each syntax element;   based on the number of the leading zero being not more than the corresponding standard value, returning a duplicate determination;   based on the number of the leading zero being more than the corresponding standard value, outputting a leading zero anomaly flag as a second detection result.   
     
     
         18 . The non-transitory computer-readable storage medium according to  claim 13 , wherein the perform the anomaly detection on the process of bit stream parsing on the video stream, and the perform the exception handling or the frame reset on the video stream according to the results of the anomaly detection based on the first detection result and the second detection result comprises:
 recording the error information generated during the process of the bit stream parsing on the video stream based on the first detection result and the second detection result;   determining the error level recorded in the error information and perform an exception handling on the video stream;   based on the error level being level zero, ignoring the error information and continuing decoding normally;   based on the error level being level one, the current frame consisting of a single slice, ending the decoding of the current slice, moving the screen information from adjacent frames of the current frame to fill the current frame based on the coordinate information of the current frame recorded in the error information, and beginning the decoding of the next slice;   based on the error level being level two, the current frame consisting of multiple slices, ending the decoding of the current frame, moving the screen information from adjacent frames of the current frame to fill the current frame based on the coordinate information of the current frame recorded in the error information, and beginning the decoding of the next frame; and   performing a frame reset after each subsequent module parses the video stream separately to the error point where the error was found according to broadcasting the information that an error was found of the current parsing position of the video stream recorded in the error information to subsequent modules.   
     
     
         19 . A video hardware decoder circuit comprising:
 a bit stream preprocessing module configured to preprocess the video stream inputted from the network abstraction layer;   an entropy decoding module configured to perform entropy decoding on the video stream preprocessed by the bit stream preprocessing module;   a video decoding module configured to decode and filter the video stream processed by the entropy decoding module;   a frame reconstruction module configured to perform frame reconstruction of the video stream processed by the video decoding module; and   a driving end and the control system for bit stream parsing error detection as claimed in  claim 7 .

Join the waitlist — get patent alerts

Track US2024276025A1 — get alerts on status changes and closely related new filings.

We store only your email — no account needed. See our privacy policy.