System and method for using sound to monitor the operation of a washing machine appliance

Abstract

A washing machine appliance includes a microphone for monitoring sound generated during operation of the washing machine appliance and a controller is operably coupled to the microphone. The controller is configured for obtaining a sound signal generated during operation of the washing machine appliance and converting the sound signal into a spectrogram that represents a sound frequency and a sound amplitude over time. An artificial intelligence image recognition process is used to analyze the spectrogram to identify one or more sound signatures that are associated with particular operating conditions, and operation of the washing machine appliance is adjusted based at least in part on the identification of the sound signature.

What is claimed is: 
     
         1 . A washing machine appliance comprising:
 a wash tub positioned within a cabinet and defining a wash chamber;   a wash basket rotatably mounted within the wash tub and being configured for receiving of a load of articles for washing;   a motor operably coupled to the wash basket for selectively rotating the wash basket;   a microphone for monitoring sound generated during operation of the washing machine appliance; and   a controller operably coupled to the microphone, the controller being configured for:
 obtaining a sound signal generated during operation of the washing machine appliance using the microphone; 
 generating a spectrogram from the sound signal, the spectrogram representing a sound frequency and a sound amplitude over time; 
 identifying a sound signature by analyzing the spectrogram using an image recognition process; and 
 adjusting at least one operating parameter of the washing machine appliance based at least in part on the identification of the sound signature. 
   
     
     
         2 . The washing machine appliance of  claim 1 , wherein the image recognition process uses artificial intelligence (AI) to analyze the spectrogram. 
     
     
         3 . The washing machine appliance of  claim 1 , wherein the image recognition process comprises a convolution neural network (CNN). 
     
     
         4 . The washing machine appliance of  claim 1 , wherein the controller is further configured for:
 learning a plurality of sound signatures associated with various operating conditions.   
     
     
         5 . The washing machine appliance of  claim 1 , wherein the sound signature is associated with sounds generated from at least one of a bearing, a belt, the motor, a water valve, a pump, a suspension system, harmonics of structural components, or undesirable contact between components or subsystems. 
     
     
         6 . The washing machine appliance of  claim 1 , wherein adjusting the at least one operating parameter comprises:
 adjusting an agitation time or profile, adjusting a water level, limiting a spin speed, identifying service needs, or providing a user with operating guidance.   
     
     
         7 . The washing machine appliance of  claim 1 , wherein adjusting the at least one operating parameter comprises:
 selecting an operating cycle based on the sound signature.   
     
     
         8 . The washing machine appliance of  claim 1 , wherein the controller is further configured for:
 providing a user notification when the sound signature indicates that a predetermined operating characteristic exists.   
     
     
         9 . The washing machine appliance of  claim 1 , wherein the sound signature is associated with the presence of an unwashable item, and wherein adjusting the at least one operating parameter comprises stopping the wash cycle. 
     
     
         10 . The washing machine appliance of  claim 1 , wherein the controller is further configured for:
 transmitting the spectrogram to a remote server for analysis; and   receiving analytic feedback from the remote server.   
     
     
         11 . The washing machine appliance of  claim 1 , wherein the microphone is positioned outside the cabinet and remote from the washing machine appliance. 
     
     
         12 . A method of operating a washing machine appliance, the washing machine appliance comprising a wash basket rotatably mounted within a wash tub, a motor operably coupled to the wash basket for selectively rotating the wash basket, and a microphone for monitoring sound generated by the washing machine appliance, the method comprising:
 obtaining a sound signal generated during operation of the washing machine appliance using the microphone;   generating a spectrogram from the sound signal, the spectrogram representing a sound frequency and a sound amplitude over time;   identifying a sound signature by analyzing the spectrogram using an image recognition process; and   adjusting at least one operating parameter of the washing machine appliance based at least in part on the identification of the sound signature.   
     
     
         13 . The method of  claim 12 , wherein the image recognition process uses artificial intelligence (AI) to analyze the spectrogram. 
     
     
         14 . The method of  claim 12 , wherein the image recognition process comprises a convolution neural network (CNN). 
     
     
         15 . The method of  claim 12 , further comprising:
 learning a plurality of sound signatures associated with various operating conditions.   
     
     
         16 . The method of  claim 12 , wherein the sound signature is associated with the presence of an unwashable item, and wherein adjusting the at least one operating parameter comprises stopping the wash cycle. 
     
     
         17 . The method of  claim 12 , further comprising:
 transmitting the spectrogram to a remote server for analysis; and   receiving analytic feedback from the remote server.   
     
     
         18 . An appliance comprising:
 a microphone for monitoring sound generated during operation of the appliance; and   a controller operably coupled to the microphone, the controller being configured for:
 obtaining a sound signal generated during operation of the appliance using the microphone; 
 generating a spectrogram from the sound signal, the spectrogram representing a sound frequency and a sound amplitude over time; 
 identifying a sound signature by analyzing the spectrogram using an image processing technique; and 
 adjusting at least one operating parameter of the appliance based at least in part on the identification of the sound signature. 
   
     
     
         19 . The appliance of  claim 18 , wherein the image recognition process uses artificial intelligence (AI) to analyze the spectrogram. 
     
     
         20 . The appliance of  claim 18 , wherein the image recognition process comprises a convolution neural network (CNN).