Multi-room audio synchronous playback method, system, device, and storage medium

Abstract

A multi-room audio synchronous playback method, a system, a device and a storage medium are provided. The multi-room audio synchronous playback method includes: creating an ad-hoc network using a plurality of audio devices supporting a target wireless communication protocol via point-to-point connection, the ad-hoc network covering a plurality of rooms, the target wireless communication protocol operating at a frequency band of 5 GHz to 7 GHz; dynamically analyzing link quality to select an optimum transmission path, and dynamically optimizing a network topology of the ad-hoc network via multi-hop relay; transmitting target audio data between the audio devices of the ad-hoc network based on the optimum transmission path, and performing real-time interaction and dynamic compensation based on a synchronization signal to obtain a synchronization parameter; and controlling each audio device of the ad-hoc network based on the synchronization parameter to synchronously play the target audio data.

What is claimed is: 
     
       1. A multi-room audio synchronous playback method, comprising:
 creating an ad-hoc network using a plurality of audio devices supporting a target wireless communication protocol via point-to-point connection, wherein the ad-hoc network covers a plurality of rooms, and the target wireless communication protocol operates at a frequency band of 5 GHz to 7 GHz; 
 dynamically analyzing a link quality to select an optimum transmission path, and dynamically optimizing a network topology of the ad-hoc network via a multi-hop relay; 
 transmitting target audio data between the plurality of audio devices of the ad-hoc network based on the optimum transmission path, and performing a real-time interaction and a dynamic compensation based on a synchronization signal to obtain a synchronization parameter; and 
 controlling each of the plurality of audio devices of the ad-hoc network based on the synchronization parameter to synchronously play the target audio data; 
 wherein transmitting the target audio data between the plurality of audio devices of the ad-hoc network based on the optimum transmission path and performing the real-time interaction and the dynamic compensation based on the synchronization signal to obtain the synchronization parameter comprise:
 encoding and decoding to-be-played audio data to obtain the target audio data; 
 transmitting the target audio data to a next audio device based on the optimum transmission path so that the next audio device determines whether or not the target audio data is to be forwarded based on a current number of hops corresponding to the target audio data until the target audio data is transmitted to a destination audio device in the optimum transmission path; 
 determining any audio device of the ad-hoc network as a reference clock device, and broadcasting the synchronization signal based on a predetermined clock synchronization period, wherein the synchronization signal comprises a reference playback time stamp; and 
 performing a clock synchronization on a target audio device and the reference clock device based on a predetermined target filtration algorithm, and determining a target playback time stamp corresponding to the target audio device based on the reference playback time stamp, wherein the target audio device is an audio device of the ad-hoc network for receiving the synchronization signal; 
 wherein performing the clock synchronization on the target audio device and the reference clock device based on the predetermined target filtration algorithm comprises:
 creating a state transition equation and an observation equation using a clock offset between each target audio device and the reference clock device, a clock drift rate, a network delay time and an audio buffer occupation rate as state variables; 
 controlling the reference clock device to exchange time stamp data with each target audio device based on the predetermined clock synchronization period to obtain a clock offset observed value corresponding to each target audio device; 
 predicting a clock offset within a next clock synchronization period based on a current state variable matrix and the state transition equation to obtain a clock offset predicted value corresponding to each target audio device; 
 updating the current state variable matrix based on the observation equation, the clock offset observed value corresponding to each target audio device and the clock offset predicted value corresponding to each target audio device to obtain an updated state variable matrix, and performing a prediction based on the updated state variable matrix to obtain an optimum clock offset estimated value corresponding to each target audio device; and 
 performing the clock synchronization on each target audio device of the ad-hoc network based on the optimum clock offset estimated value corresponding to each target audio device. 
 
 
 
     
     
       2. The multi-room audio synchronous playback method according to  claim 1 , wherein a format of the target audio data is a 24 bit/192 kHz pulse code modulation (PCM) format. 
     
     
       3. The multi-room audio synchronous playback method according to  claim 1 , wherein the ad-hoc network comprises a primary audio device and a plurality of secondary audio devices; and
 the primary audio device is configured to distribute the target audio data and the synchronization signal to the plurality of secondary audio devices and dynamically maintain the network topology. 
 
     
     
       4. The multi-room audio synchronous playback method according to  claim 1 , wherein the target wireless communication protocol is a wireless fidelity-6 extended (WIFI-6E) protocol. 
     
     
       5. The multi-room audio synchronous playback method according to  claim 1 , wherein dynamically analyzing the link quality to select the optimum transmission path and dynamically optimizing the network topology of the ad-hoc network via the multi-hop relay comprise:
 determining any audio device of the ad-hoc network as a primary audio device; 
 detecting, by the primary audio device, neighboring audio devices based on a first predetermined period to obtain network information about each of a plurality of secondary audio devices, and broadcasting network information about the primary audio device to the neighboring audio devices; 
 determining a link quality score between any two audio devices based on network information about each of the plurality of audio devices using an equation L i (X i ,X j )=α*Q ij +β*D ij , wherein L i (X i ,X j ) represents a link quality score between an audio device X i  and an audio device X j , Q ij  represents a signal strength of a link between the audio device X i  and the audio device X j , D ij  represents a link delay, and α and β are weighting coefficients; 
 creating a weighted connected graph based on the link quality score, and determining a transmission path with a maximum sum of the link quality scores from the primary audio device to each of the plurality of secondary audio devices as the optimum transmission path; and 
 in a case that the network topology of the ad-hoc network changes, updating the optimum transmission path for the primary audio device and each of the plurality of secondary audio devices. 
 
     
     
       6. The multi-room audio synchronous playback method according to  claim 1 , wherein determining the target playback time stamp corresponding to the target audio device based on the reference playback time stamp comprises:
 determining a transmission time value between a sound card and a loudspeaker in the target audio device to obtain a delay calibration value of the target audio device; and 
 determining the target playback time stamp corresponding to the target audio device based on the reference playback time stamp and the delay calibration value of the target audio device. 
 
     
     
       7. The multi-room audio synchronous playback method according to  claim 1 , wherein transmitting the target audio data to the next audio device based on the optimum transmission path so that the next audio device determines whether or not the target audio data is to be forwarded based on the current number of hops corresponding to the target audio data until the target audio data is transmitted to the destination audio device in the optimum transmission path comprises:
 transmitting, by a primary audio device, the target audio data to the next audio device based on the optimum transmission path; 
 determining an audio device receiving the target audio data as a first audio device, and determining, by the first audio device, whether or not the current number of hops corresponding to the target audio data is smaller than a predetermined number of hops for the optimum transmission path;
 in a case that the current number of hops corresponding to the target audio data is smaller than the predetermined number of hops for the optimum transmission path, sending, by the first audio device, the target audio data to a second audio device based on the optimum transmission path, incrementing the current number of hops corresponding to the target audio data by one, and determining, by the second audio device, whether or not the target audio data is to be forwarded; and 
 in a case that the current number of hops corresponding to the target audio data is greater than or equal to the predetermined number of hops for the optimum transmission path, determining the first audio device as the destination audio device in the optimum transmission path. 
 
 
     
     
       8. The multi-room audio synchronous playback method according to  claim 1 , wherein encoding and decoding the to-be-played audio data to obtain the target audio data comprises:
 obtaining, by a primary audio device of the ad-hoc network, the to-be-played audio data, and parsing the to-be-played audio data to obtain an audio type of the to-be-played audio data; 
 determining a target encoding algorithm based on the audio type of the to-be-played audio data and network bandwidth information; and 
 dividing, by the primary audio device, the to-be-played audio data into a plurality of original audio segments based on a predetermined frame-segmentation period of a predetermined I2S interface, and encoding each of the plurality of original audio segments using the target encoding algorithm to obtain the target audio data. 
 
     
     
       9. The multi-room audio synchronous playback method according to  claim 1 , wherein controlling each of the plurality of audio devices of the ad-hoc network based on the synchronization parameter to synchronously play the target audio data comprises:
 determining a playback time stamp corresponding to each of the plurality of audio devices of the ad-hoc network based on the synchronization parameter; and 
 playing, by each of the plurality of audio devices of the ad-hoc network, the target audio data based on a local clock after synchronization and the playback time stamp corresponding to each of the plurality of audio devices. 
 
     
     
       10. A multi-room audio synchronous playback system, comprising a plurality of audio devices supporting a target wireless communication protocol, wherein the plurality of audio devices forms an ad-hoc network covering a plurality of rooms via point-to-point connection, and the target wireless communication protocol operates at a frequency band of 5 GHz to 7 GHZ,
 wherein each of the plurality of audio devices comprises: 
 a network module configured to dynamically analyze a link quality to select an optimum transmission path, and dynamically optimize a network topology of the ad-hoc network via a multi-hop relay; 
 a synchronization module configured to transmit target audio data between the plurality of audio devices of the ad-hoc network based on the optimum transmission path, and perform a real-time interaction and a dynamic compensation based on a synchronization signal to obtain a synchronization parameter; and 
 a playback module configured to synchronously play the target audio data based on a playback time stamp carried in the synchronization signal; 
 wherein the synchronization module is further configured to:
 encode and decode to-be-played audio data to obtain the target audio data; 
 transmit the target audio data to a next audio device based on the optimum transmission path so that the next audio device determines whether or not the target audio data is to be forwarded based on a current number of hops corresponding to the target audio data until the target audio data is transmitted to a destination audio device in the optimum transmission path; 
 determine any audio device of the ad-hoc network as a reference clock device, and broadcast the synchronization signal based on a predetermined clock synchronization period, wherein the synchronization signal comprises a reference playback time stamp; and 
 perform a clock synchronization on a target audio device and the reference clock device based on a predetermined target filtration algorithm, and determine a target playback time stamp corresponding to the target audio device based on the reference playback time stamp, wherein the target audio device is an audio device of the ad-hoc network for receiving the synchronization signal; 
 wherein performing the clock synchronization on the target audio device and the reference clock device based on the predetermined target filtration algorithm comprises:
 creating a state transition equation and an observation equation using a clock offset between each target audio device and the reference clock device, a clock drift rate, a network delay time and an audio buffer occupation rate as state variables; 
 controlling the reference clock device to exchange time stamp data with each target audio device based on the predetermined clock synchronization period to obtain a clock offset observed value corresponding to each target audio device; 
 predicting a clock offset within a next clock synchronization period based on a current state variable matrix and the state transition equation to obtain a clock offset predicted value corresponding to each target audio device; 
 updating the current state variable matrix based on the observation equation, the clock offset observed value corresponding to each target audio device and the clock offset predicted value corresponding to each target audio device to obtain an updated state variable matrix, and performing a prediction based on the updated state variable matrix to obtain an optimum clock offset estimated value corresponding to each target audio device; and 
 performing the clock synchronization on each target audio device of the ad-hoc network based on the optimum clock offset estimated value corresponding to each target audio device. 
 
 
 
     
     
       11. The multi-room audio synchronous playback system according to  claim 10 , wherein the plurality of audio devices comprises one or more of a television, a projector, a surround sound speaker, a bass speaker or a soundbar. 
     
     
       12. A computer device, comprising a memory, a processor and a computer program stored in the memory and executed by the processor, wherein the computer program is executed by the processor to implement the multi-room audio synchronous playback method according to  claim 1 . 
     
     
       13. A computer-readable storage medium, storing a computer program, wherein the computer program is executed by a processor to implement the multi-room audio synchronous playback method according to  claim 1 .