System and method of video capture and search optimization for creating an acoustic voiceprint

Abstract

Systems and method of diarization of audio files use an acoustic voiceprint model. A plurality of audio files are analyzed to arrive at an acoustic voiceprint model associated to an identified speaker. Metadata associate with an audio file is used to select an acoustic voiceprint model. The selected acoustic voiceprint model is applied in a diarization to identify audio data of the identified speaker.

What is claimed is: 
     
       1. A method for creating a background acoustic voiceprint, the method comprising:
 receiving, by a processor, a plurality of audio files from an audio database server; 
 diarizing, by the processor, each of the plurality of audio files by:
 separating the audio file into a plurality of speaker segments, wherein each speaker segment is a segment of speech separated by non-speech; 
 clustering each of the speaker segments for the audio file into groups of similar speaker segments, wherein each group of similar speaker segments has a high likelihood of containing speech from a single speaker; and 
 classifying each of the clustered groups of speaker segments as belonging to agents or as belonging to an other speaker, wherein the other speaker is not an agent; 
 
 generating, by the processor, the background acoustic voiceprint based on the clustered speaker segments classified as belonging to the other speaker; 
 receiving, by the processor, a new audio file; 
 separating the new audio file into a new plurality of speaker segments, wherein each new speaker segment is a segment of speech separated by non-speech; 
 applying, by the processor, the background acoustic voiceprint to each new speaker segment for the new audio file to determine which new speaker segments match the acoustic voiceprint; and 
 labeling, by the processor, each new speaker segments of the new audio file that de does not match the acoustic voiceprint as belonging to an agent. 
 
     
     
       2. The method of  claim 1 , further comprising
 clustering each of the new plurality of speaker segments for the new audio file into groups of similar speaker segments; and 
 classifying each group of speaker segments as belonging to a first speaker audio file or a second speaker audio file, 
 wherein the acoustic voiceprint is applied to the first speaker audio file and the second speaker audio file to determine if one of the speaker audio files is the other speaker. 
 
     
     
       3. The method of  claim 1 , further comprising providing a diarization system for creating and applying acoustic voiceprints to audio data. 
     
     
       4. The method of  claim 3 , wherein the diarization system includes the audio database server, a voiceprint database server, the processor, and an audio source. 
     
     
       5. The method of  claim 4 , wherein the processor is operably connected to the audio database server and the voiceprint database server. 
     
     
       6. The method of  claim 4 , wherein the audio source is operably connected to the audio database server, wherein the audio data stored in the audio database server was generated from the audio source. 
     
     
       7. The method of  claim 4 , further comprising saving the acoustic voiceprint to the voiceprint database server. 
     
     
       8. A system for creating a background acoustic voiceprint, the system comprising:
 an audio database server including a plurality of audio files; 
 a processor; and 
 a memory storing instructions, which when executed by the processor causes the processor to:
 receive a plurality of audio files from the audio database server; 
 diarize each of the plurality of audio files by:
 separate the audio file into a plurality of speaker segments, wherein each speaker segment is a segment of speech separated by non-speech; 
 cluster each of the speaker segments for the audio filed into groups of similar speaker segments, wherein each group of similar speaker segments has high likelihood of containing speech from a single speaker; and 
 classify each of the clustered groups of speaker segments as belonging to agents or as belonging to an other speaker, wherein the other speaker is not an agent; 
 
 generate the background acoustic voiceprint based on the clustered speaker segments classified as belonging to the other speaker; 
 receive a new audio file; 
 separate the new audio file into a new plurality of speaker segments, wherein each new speaker segment is a segment of speech separated by non-speech; 
 apply the background acoustic voiceprint to each new speaker segment for the new audio file to determine which new speaker segments match the acoustic voiceprint; and 
 
 label each new speaker segments of the new audio file that do not match the acoustic voiceprint as belonging to an agent. 
 
     
     
       9. The system of  claim 8 , wherein the processor is further instructed to:
 cluster each of the new plurality of speaker segments for the new audio file into groups of similar speaker segments; and 
 classify each group of speaker segments as belonging to a first speaker audio file or a second speaker audio file 
 wherein the acoustic voiceprint is applied to the first speaker audio file and the second speaker audio file to determine if one of the speaker audio files is the other speaker. 
 
     
     
       10. The system of  claim 8 , the system comprising a diarization system for creating and applying acoustic voiceprints to audio data. 
     
     
       11. The system of  claim 10 , wherein the diarization system includes the audio database server, a voiceprint database server, the processor, the memory, and an audio source. 
     
     
       12. The system of  claim 11 , wherein the processor is operably connected to the audio database server and the voiceprint database server. 
     
     
       13. The system of  claim 11 , wherein the audio source is operably connected to the audio database server, wherein the audio data stored in the audio database server was generated from the audio source. 
     
     
       14. The system of  claim 11 , wherein the processor is further instructed to save the acoustic voiceprint to the voiceprint database server. 
     
     
       15. A non-transitory computer-readable medium having instructions stored thereon for facilitating diarization of audio files, wherein the instructions, when executed by a processing system, direct the processing system to:
 receive a plurality of audio files from the audio database server; 
 diarize each of the plurality of audio files by:
 separate the audio file into a plurality of speaker segments, wherein each speaker segment is a segment of speech separated by non-speech; 
 cluster each of the speaker segments for the audio file into groups of similar speaker segments, wherein each group of similar speaker segments has a high likelihood of containing speech from a single speaker; and 
 classify each of the clustered groups of speaker segments as belonging to agents or as belonging to an other speaker, wherein the other speaker is not an agent; 
 
 build a background acoustic voiceprint based on the clustered speaker segments classified as belonging to the other speaker; 
 receive a new audio file; 
 separate the new audio file into a new plurality of speaker segments, wherein each new speaker segment is a segment of speech separated by non-speech; 
 apply the background acoustic voiceprint to each new speaker segment for the new audio file to determine which new speaker segments match the acoustic voiceprint; and 
 label each new speaker segments of the new audio file that does not match the acoustic voiceprint as belonging to an agent. 
 
     
     
       16. The non-transitory computer-readable medium of  claim 15 , wherein the non-transitory computer-readable medium is provided within a diarization system for creating and applying acoustic voiceprints to audio data. 
     
     
       17. The non-transitory computer-readable medium of  claim 16 , wherein the diarization system includes the audio database server, a voiceprint database server, the processor, and an audio source. 
     
     
       18. The non-transitory computer-readable medium of  claim 17 , wherein the processor is operably connected to the audio database server and the voiceprint database server. 
     
     
       19. The non-transitory computer-readable medium of  claim 17 , wherein the audio source is operably connected to the audio database server, wherein the audio data stored in the audio database server was generated from the audio source. 
     
     
       20. The non-transitory computer-readable medium of  claim 17 , wherein the processing system is further instructed to save the acoustic voiceprint to the voiceprint database server.