Multimedia data processing method and apparatus, computer device, computer-readable storage medium, and computer program product

Abstract

Example embodiments provide a multimedia data processing method and apparatus, a computer device, a computer-readable storage medium, and a computer program product. The method includes: obtaining a global reference data block set and a local reference data block set, the global reference data block set and the local reference data block set being associated with a first data block in a multimedia data frame, the global reference data block set including a coded data block having no adjacent relationship with the first data block in the multimedia data frame, and the local reference data block set including a coded data block having an adjacent relationship with the first data block in the multimedia data frame; and determining a reference data block for coding or decoding of the first data block from the global reference data block set and the local reference data block set.

What is claimed is: 
     
         1 . A method for processing multimedia data, the method being executed by at least one processor, the method comprising:
 obtaining a global reference data block set and a local reference data block set, wherein the global reference data block set and the local reference data block set are associated with a first data block in a multimedia data frame, wherein the global reference data block set comprises a first coded data block being non-adjacent to the first data block, and wherein the local reference data block set comprises a second coded data block being adjacent to the first data block, wherein the global reference data block set and the local reference data block set are both adjacent to at least one non-reference data block set comprising at least one data block that is not referenceable by the first data block; and   determining a reference data block for coding or decoding of the first data block based on the global reference data block set and the local reference data block set.   
     
     
         2 . The method according to  claim 1 , wherein the determining the reference data block comprises:
 obtaining a coding mode of the first data block; and   determining, based on the coding mode of the first data block being an intra block copy (IBC) mode or an intra string copy (ISC) mode, the reference data block for coding or decoding of the first data block by using the global reference data block set and the local reference data block set.   
     
     
         3 . The method according to  claim 2 , wherein the determining the reference data block based on the coding mode of the first data block comprises:
 obtaining, based on the coding mode of the first data block being an IBC mode or an ISC mode, a pixel difference between one data block in the local reference data block set and the first data block;   based on a target data block having the pixel difference less than a pixel difference threshold in the local reference data block set, selecting the target data block as the reference data block; and   based on the target data block having the pixel difference greater than or equal to the pixel difference threshold in the local reference data block set, determining the reference data block based on the global reference data block set.   
     
     
         4 . The method according to  claim 2 , wherein the determining the reference data block based on the coding mode of the first data block comprises:
 based on the coding mode of the first data block being an IBC mode or an ISC mode, obtaining a target coded data block that is spatially adjacent to the first data block; and   obtaining the reference data block for coding or decoding of the first data block by searching regions corresponding to the global reference data block set and the local reference data block set is based on moving parameters based on a reference data block of the target coded data block belonging to the global reference data block set and the local reference data block set, wherein the moving parameters comprise a moving window and a moving step length, a size of the moving window being same as a size of the first data block, and the moving step length being less than a width of the moving window.   
     
     
         5 . The method according to  claim 4 , wherein the global reference data block set comprises at least one first reference data block;
 wherein, when a coding mode of the multimedia data frame is a serial coding mode, the at least one first reference data block is a coded data block having a parameter association relationship meeting one or more writing-back restriction conditions in the multimedia data frame and belonging to a same tile as the first data block;   wherein the parameter association relationship indicates a first association relationship between a first position information and a size information of a superblock (SB) and a second association relationship between the first position information and a second position information, the first position information being position information of the coded data block in the multimedia data frame, and the second position information being position information of the first data block in the multimedia data frame; and   wherein, the one or more writing-back restriction conditions indicate a restricted delay of writing the coded data block to the global reference data block set.   
     
     
         6 . The method according to  claim 4 , wherein the global reference data block set comprises at least one second reference data block;
 wherein the at least one second reference data block is a coded data block belonging to a same tile as the first data block and having a parameter association relationship meeting one or more writing-back restriction conditions in the multimedia data frame and meeting one or more coding processing conditions;   wherein the parameter association relationship reflects a third association relationship between a position information of the coded data block in the multimedia data frame, a position information of the first data block in the multimedia data frame, and a size information of an SB; and   wherein the one or more writing-back restriction conditions indicate a restricted delay of writing the coded data block to the global reference data block set.   
     
     
         7 . The method according to  claim 4 , wherein the obtaining the global reference data block set comprises:
 obtaining, based on a coding mode of the multimedia data frame being a serial coding mode, a first position information, a size information of an SB and a second position information, wherein the first position information being position information of a coded data block in the multimedia data frame, and the second position information being position information of the first data block in the multimedia data frame;   obtaining one or more writing-back restriction conditions, wherein the one or more writing-back restriction conditions indicate a restricted delay of writing the coded data block to the global reference data block set;   selecting, the coded data block having a parameter association relationship meeting the one or more writing-back restriction conditions and belonging to a same tile as the first data block from the multimedia data frame, as a first reference data block, wherein the parameter association relationship indicates a first association relationship between the first position information and the size information of the SB and a second association relationship between the first position information and the second position information; and   adding the first reference data block to the global reference data block set.   
     
     
         8 . The method according to  claim 7 , wherein the selecting the coded data block having the parameter association relationship as the first reference data block comprises:
 selecting the coded data block belonging to a same tile as the first data block from the multimedia data frame as a first candidate reference data block based on the first position information and the second position information;   determining a restricted number of spaced data blocks between the coded data block and the first data block in the multimedia data frame under the one or more writing-back restriction conditions;   determining a number of spaced data blocks between the first candidate reference data block and the first data block based on the first position information, the size information of the SB and the second position information; and   determining the first candidate reference data block with the number of spaced data blocks greater than the restricted number of spaced data blocks as the first reference data block.   
     
     
         9 . The method according to  claim 8 , wherein the determining the number of spaced data blocks comprises:
 determining a first row identifier and a first column identifier of the first candidate reference data block based on the first position information and the size information of the SB;   determining a second row identifier and a second column identifier of the first data block based on the second position information and the size information of the SB;   determining a number of data blocks in each row in the multimedia data frame based on a size information of the first data block; and   determining the number of spaced data blocks between the first candidate reference data block and the first data block based on the number of data blocks in each row, the first row identifier, the first column identifier, the second row identifier, and the second column identifier.   
     
     
         10 . The method according to  claim 4 , wherein the obtaining the global reference data block set comprises:
 obtaining a first position information, a size information of an SB and a second position information, wherein the first position information being position information of a coded data block in the multimedia data frame, and the second position information being position information of the first data block in the multimedia data frame;   obtaining one or more writing-back restriction conditions and one or more coding processing conditions, wherein the one or more writing-back restriction conditions indicate a restricted delay of writing the coded data block to the global reference data block set;   selecting the coded data block having a parameter association relationship meeting the one or more writing-back restriction conditions and the one or more coding processing conditions and belonging to a same tile as the first data block from the multimedia data frame as a second reference data block, wherein the parameter association relationship indicates a first association relationship between the first position information and a size information of the first data block and a second association relationship between the first position information and the second position information; and   adding the second reference data block to the global reference data block set.   
     
     
         11 . The method according to  claim 10 , wherein the selecting the coded data block having the parameter association relationship as the second reference data block comprises:
 selecting one or more coded data blocks belonging to a same tile from the multimedia data frame as first candidate reference data blocks based on the first position information and the second position information;   selecting one or more candidate reference data blocks having a parameter association relationship meeting the one or more writing-back restriction conditions from the first candidate reference data blocks as second candidate reference data blocks;   determining a first data block restriction distance between the coded data block and the first data block in the multimedia data frame based on the one or more writing-back restriction conditions;   determining a second data block restriction distance between the coded data block and the first data block in the multimedia data frame based on the one or more coding processing conditions; and   determining a second candidate reference data block meeting the one or more coding processing conditions from the second candidate reference data block as the second reference data block based on the first position information, the size information of the SB, the second position information, the first data block restriction distance, and the second data block restriction distance.   
     
     
         12 . The method according to  claim 11 , wherein the determining the second candidate reference data block meeting the one or more coding processing conditions from the second candidate reference data blocks comprises:
 determining a third row identifier and a third column identifier of the second candidate reference data block based on the first position information and the size information of the SB;   determining a fourth row identifier and a fourth column identifier of the first data block based on the second position information and the size information of the SB;   selecting, from the second candidate reference data blocks as a third candidate reference data block, the second candidate reference data block with a row identifier not greater than the fourth row identifier of the first data block;   determining a row distance between the third candidate reference data block and the first data block based on a fifth row identifier of the third candidate reference data block and the fourth row identifier;   determining a column distance between the third candidate reference data block and the first data block based on a column identifier of the third candidate reference data block and the fourth column identifier; and   determining the third candidate reference data block with the column distance less than a first distance threshold among one or more third candidate reference data blocks as the second reference data block, wherein the first distance threshold is determined based on the first data block restriction distance, the second data block restriction distance, and the row distance between the third candidate reference data block and the first data block.   
     
     
         13 . The method according to  claim 4 , wherein the local reference data block set comprises at least one third reference data block, and the at least one third reference data block is a coded data block located in a same coding processing unit as the first data block in the multimedia data frame. 
     
     
         14 . The method according to  claim 4 , wherein the local reference data block set comprises at least one fourth reference data block, and the at least one fourth reference data block is a coded data block adjacent to the first data block in the multimedia data frame and belonging to a same tile as the first data block. 
     
     
         15 . The method according to  claim 14 , wherein the at least one fourth reference data block being adjacent to the first data block comprises the at least one fourth reference data block and the first data block belonging to a same SB. 
     
     
         16 . The method according to  claim 14 , wherein the at least one fourth reference data block being adjacent to the first data block comprises the at least one fourth reference data block being located in a first number of SBs adjacent to the first data block, wherein a size of an SB is not greater than a size threshold, and wherein the first number of SBs is determined based on a size information of the SB. 
     
     
         17 . The method according to  claim 14 , wherein the at least one fourth reference data block being adjacent to the first data block comprises the at least one fourth reference data block being located in a first number of SBs adjacent to the first data block, wherein a size of an SB is not less than a size threshold, wherein a first data block at an upper left corner of a target region is not reconstructed, wherein the target region is a region where the at least one fourth reference data block in the multimedia data frame moves to the right by one SB, and wherein position information when the at least one fourth reference data block moves by a distance of one SB is different from the position information of the first data block, and wherein the first number of SBs is based on a size information of the SB. 
     
     
         18 . An apparatus for processing multimedia data, the apparatus comprising:
 at least one memory configured to store computer program code; and   at least one processor configured to access the computer program code and operate as instructed by the computer program code, the computer program code including:   first obtaining code configured to cause the at least one processor to obtain a global reference data block set and a local reference data block set, wherein the global reference data block set and the local reference data block set are associated with a first data block in a multimedia data frame, wherein the global reference data block set comprises a first coded data block being non-adjacent to the first data block, and wherein the local reference data block set comprises a second coded data block being adjacent to the first data block, wherein the global reference data block set and the local reference data block set are both adjacent to at least one non-reference data block set comprising at least one data block that is not referenceable by the first data block; and
 first determining code configured to cause the at least one processor to determine a reference data block for coding or decoding of the first data block based on the global reference data block set and the local reference data block set. 
   
     
     
         19 . The apparatus of  claim 18 , further comprising:
 second obtaining code configured to cause the at least one processor to obtain a coding mode of the first data block; and   second determining code configured to cause the at least one processor to determine, based on the coding mode of the first data block being an intra block copy (IBC) mode or an intra string copy (ISC) mode, the reference data block for coding or decoding of the first data block by using the global reference data block set and the local reference data block set.   
     
     
         20 . A non-transitory computer-readable medium storing instructions, the instructions comprising: one or more instructions that, when executed by one or more processors of a device for processing multimedia data, cause the one or more processors to:
 obtain a global reference data block set and a local reference data block set, wherein the global reference data block set and the local reference data block set are associated with a first data block in a multimedia data frame, wherein the global reference data block set comprises a first coded data block being non-adjacent to the first data block, and wherein the local reference data block set comprises a second coded data block being adjacent to the first data block, wherein the global reference data block set and the local reference data block set are both adjacent to at least one non-reference data block set comprising at least one data block that is not referenceable by the first data block; and   determine a reference data block for coding or decoding of the first data block based on the global reference data block set and the local reference data block set.