System and method of performing automatic speech recognition using local private data

Abstract

A method of providing hybrid speech recognition between a local embedded speech recognition system and a remote speech recognition system relates to receiving speech from a user at a device communicating with a remote speech recognition system. The system recognizes a first part of speech by performing a first recognition of the first part of the speech with the embedded speech recognition system that accesses private user data, wherein the private user data is not available to the remote speech recognition system. The system recognizes the second part of the speech by performing a second recognition of the second part of the speech with the remote speech recognition system. The final recognition result is a combination of these two recognition processes. The private data can be such local information as a user location, a playlist, frequently dialed numbers or texted people, user contact list information, and so forth.

I claim: 
     
         1 . A method comprising:
 receiving speech from a user at a device communicating with a network-based speech recognition system, wherein the device comprises an embedded speech recognition system that accesses private user data local to the device;   recognizing a first part of the speech by performing a first recognition of the first part of the speech with the embedded speech recognition system that accesses the private user data, wherein the private user data is not available to the network-based speech recognition system; and   recognizing a second part of the speech by performing a second recognition of the second part of the speech with the network-based speech recognition system.   
     
     
         2 . The method of  claim 1 , further comprising:
 outputting a recognition result associated with the first recognition or the second recognition, the recognition result comprising text representing the speech, the text being viewed on a display.   
     
     
         3 . The method of  claim 1 , further comprising:
 identifying a location of the device.   
     
     
         4 . The method of  claim 3 , further comprising:
 determining a privacy level of the private user data according to the location of the device.   
     
     
         5 . The method of  claim 1 , wherein individual names from a user contact list are from the private user data. 
     
     
         6 . The method of  claim 1 , wherein the private user data comprises one of data in a user contact list, frequently dialed phone numbers, frequently used texted names, data associated with a user location, data associated with a playlist, user history, and multiple hypothesis associated with private information. 
     
     
         7 . A computer-readable storage device storing instructions which, when executed by a processor, cause the processor to perform operations comprising:
 receiving speech from a user at a device communicating with a network-based speech recognition system, wherein the device comprises an embedded speech recognition system that accesses private user data local to the device;   recognizing a first part of the speech by performing a first recognition of the first part of the speech with the embedded speech recognition system that accesses the private user data, wherein the private user data is not available to the network-based speech recognition system; and   recognizing a second part of the speech by performing a second recognition of the second part of the speech with the network-based speech recognition system.   
     
     
         8 . The computer-readable storage device of  claim 7 , wherein the computer-readable storage device stores additional instructions which, when executed by the processor, cause the processor to perform operations further comprising:
 outputting a recognition result associated with the first recognition or the second recognition, the recognition result comprising text representing the speech, the text being viewed on a display.   
     
     
         9 . The computer-readable storage device of  claim 7 , wherein the computer-readable storage device stores additional instructions which, when executed by the processor, cause the processor to perform operations further comprising:
 identifying a location of the computing device.   
     
     
         10 . The computer-readable storage device of  claim 9 , wherein the computer-readable storage device stores additional instructions which, when executed by the processor, cause the processor to perform operations further comprising:
 determining a privacy level of the private user data according to the location of the computing device.   
     
     
         11 . The computer-readable storage device of  claim 7 , wherein individual names from a user contact list are from the private user data. 
     
     
         12 . The computer-readable storage device of  claim 7 , wherein the private user data comprises one of data in a user contact list, frequently dialed phone numbers, frequently used texted names, data associated with a user location, data associated with a playlist, user history, and multiple hypothesis associated with private information. 
     
     
         13 . A system comprising:
 a processor; and   a computer-readable storage medium storing instructions which, when executed by the processor, cause the processor to perform operations comprising:   receiving speech from a user at a device communicating with a network-based speech recognition system, wherein the device comprises an embedded speech recognition system that accesses private user data local to the device;   recognizing a first part of the speech by performing a first recognition of the first part of the speech with the embedded speech recognition system that accesses the private user data, wherein the private user data is not available to the network-based speech recognition system; and   recognizing a second part of the speech by performing a second recognition of the second part of the speech with the network-based speech recognition system.   
     
     
         14 . The system of  claim 13 , wherein the computer-readable storage medium stores additional instructions which, when executed by the processor, cause the processor to perform operations further comprising:
 outputting a recognition result associated with the first recognition or the second recognition, the recognition result comprising text representing the speech, the text being viewed on a display.   
     
     
         15 . The system of  claim 13 , wherein the computer-readable storage medium stores additional instructions which, when executed by the processor, cause the processor to perform operations further comprising:
 identifying a location of the system.   
     
     
         16 . The system of  claim 15 , wherein the computer-readable storage medium stores additional instructions which, when executed by the processor, cause the processor to perform operations further comprising:
 determining a privacy level of the private user data according to the location of the system.   
     
     
         17 . The system of  claim 13 , wherein individual names from a user contact list are from the private user data. 
     
     
         18 . The system of  claim 13 , wherein the private user data comprises one of data in a user contact list, frequently dialed phone numbers, frequently used texted names, data associated with a user location, data associated with a playlist, user history, and multiple hypothesis associated with private information.