Method and Apparatus for Communication Between Humans and Devices

Abstract

This invention relates to methods and apparatus for improving communications between humans and devices. The invention provides a method of modulating operation of a device, comprising: providing an attentive user interface for obtaining information about an attentive state of a user; and modulating operation of a device on the basis of the obtained information, wherein the operation that is modulated is initiated by the device. Preferably, the information about the user's attentive state is eye contact of the user with the device that is sensed by the attentive user interface.

1 - 44 . (canceled) 
     
     
         45 . A method of controlling operation of a device, comprising:
 using at least one sensor coupled to the device to output a sensor signal;   processing the sensor signal to produce a user state signal that is indicative of user attention toward a screen of the device; and   using the user state signal as a basis for controlling operation of the device;   wherein the controlling operation includes determining whether to output visual information to the user.   
     
     
         46 . The method of  claim 45 , wherein the outputting visual information includes the device soliciting user input. 
     
     
         47 . The method of  claim 45 , wherein the outputting visual information is initiated by the device. 
     
     
         48 . The method of  claim 45 , including outputting the visual information on the screen of the device. 
     
     
         49 . The method of  claim 45 , wherein the controlling operation comprises notifying the user when the user state signal indicates that the user attention toward the screen is at least at a selected level. 
     
     
         50 . The method of  claim 49 , wherein notifying the user comprises using a less interruptive notification and progressing to a more interruptive notification. 
     
     
         51 . The method of  claim 45 , wherein the user state signal is based on user head or face orientation. 
     
     
         52 . The method of  claim 45 , wherein the user state signal is based on user body presence. 
     
     
         53 . The method of  claim 45 , wherein the user state signal is based on user activity. 
     
     
         54 . The method of  claim 45 , wherein the user state signal is based on user body orientation. 
     
     
         55 . The method of  claim 45 , wherein the sensor is an infrared sensor. 
     
     
         56 . The method of  claim 45 , wherein the sensor is electronically coupled to the device. 
     
     
         57 . The method of  claim 56 , wherein the sensor is wirelessly coupled to the device. 
     
     
         58 . The method of  claim 45 , wherein the sensor is physically coupled to the device. 
     
     
         59 . The method of  claim 58 , wherein the sensor is attached to or embedded in the screen. 
     
     
         60 . The method of  claim 45 , wherein the device is selected from the group consisting of a personal computer, a cellular telephone, a telephone, a personal digital assistant (PDA), an electronic device, a machine, and an appliance. 
     
     
         61 . The method of  claim 45 , wherein the device comprises furniture. 
     
     
         62 . The method of  claim 45 , further comprising the user communicating with the device using a keyboard. 
     
     
         63 . The method of  claim 45 , further comprising the user communicating with the device using manual interactions. 
     
     
         64 . The method of  claim 45 , further comprising the device using speech recognition responsive to user communication. 
     
     
         65 . The method of  claim 45 , wherein the screen is a video screen. 
     
     
         66 . The method of  claim 45 , wherein the screen is a computer screen. 
     
     
         67 . A method of controlling operation of a device, comprising:
 using at least one sensor coupled to the device to output a sensor signal;   processing the sensor signal to produce a user state signal that is indicative of user attention toward a screen of the device; and   using the user state signal as a basis for controlling operation of the device;   wherein the controlling operation includes determining whether to output audible information to the user.   
     
     
         68 . The method of  claim 67 , wherein the outputting audible information includes the device soliciting user input. 
     
     
         69 . The method of  claim 67 , wherein the outputting audible information is initiated by the device. 
     
     
         70 . The method of  claim 67 , wherein the controlling operation comprises notifying the user when the user state signal indicates that the user attention toward the screen is at least at a selected level. 
     
     
         71 . The method of  claim 70 , wherein notifying the user comprises using a less interruptive notification and progressing to a more interruptive notification. 
     
     
         72 . The method of  claim 67 , wherein the user state signal is based on user head or face orientation. 
     
     
         73 . The method of  claim 67 , wherein the user state signal is based on user body presence. 
     
     
         74 . The method of  claim 67 , wherein the user state signal is based on user activity. 
     
     
         75 . The method of  claim 67 , wherein the user state signal is based on user body orientation. 
     
     
         76 . The method of  claim 67 , wherein the sensor is an infrared sensor. 
     
     
         77 . The method of  claim 67 , wherein the sensor is electronically coupled to the device. 
     
     
         78 . The method of  claim 77 , wherein the sensor is wirelessly coupled to the device. 
     
     
         79 . The method of  claim 67 , wherein the sensor is physically coupled to the device. 
     
     
         80 . The method of  claim 79 , wherein the sensor is attached to or embedded in the screen. 
     
     
         81 . The method of  claim 67 , wherein the device is selected from the group consisting of a personal computer, a cellular telephone, a telephone, a personal digital assistant (PDA), an electronic device, a machine, and an appliance. 
     
     
         82 . The method of  claim 67 , wherein the device comprises furniture. 
     
     
         83 . The method of  claim 67 , further comprising the user communicating with the device using a keyboard. 
     
     
         84 . The method of  claim 67 , further comprising the user communicating with the device using manual interactions. 
     
     
         85 . The method of  claim 67 , further comprising the device using speech recognition responsive to user communication. 
     
     
         86 . The method of  claim 67 , wherein the screen is a video screen. 
     
     
         87 . The method of  claim 67 , wherein the screen is a computer screen. 
     
     
         88 . A method of controlling operation of a device, comprising:
 using at least one sensor coupled to the device to output a sensor signal;   processing the sensor signal to produce a user state signal that is indicative of user attention toward a screen of the device; and   using the user state signal as a basis for controlling operation of the device;   wherein the controlling operation includes determining whether to output visual and audible information to the user.   
     
     
         89 . The method of  claim 88 , wherein the outputting visual and audible information includes the device soliciting user input. 
     
     
         90 . The method of  claim 88 , wherein the outputting visual and audible information is initiated by the device. 
     
     
         91 . The method of  claim 88 , including outputting the visual information on the screen of the device. 
     
     
         92 . The method of  claim 88 , wherein the controlling operation comprises notifying the user when the user state signal indicates that the user attention toward the screen is at least at a selected level. 
     
     
         93 . The method of  claim 92 , wherein notifying the user comprises using a less interruptive notification and progressing to a more interruptive notification. 
     
     
         94 . The method of  claim 88 , wherein the user state signal is based on user head or face orientation. 
     
     
         95 . The method of  claim 88 , wherein the user state signal is based on user body presence. 
     
     
         96 . The method of  claim 88 , wherein the user state signal is based on user activity. 
     
     
         97 . The method of  claim 88 , wherein the user state signal is based on user body orientation. 
     
     
         98 . The method of  claim 88 , wherein the sensor is an infrared sensor. 
     
     
         99 . The method of  claim 88 , wherein the sensor is electronically coupled to the device. 
     
     
         100 . The method of  claim 99 , wherein the sensor is wirelessly coupled to the device. 
     
     
         101 . The method of  claim 88 , wherein the sensor is physically coupled to the device. 
     
     
         102 . The method of  claim 101 , wherein the sensor is attached to or embedded in the screen. 
     
     
         103 . The method of  claim 88 , wherein the device is selected from the group consisting of a personal computer, a cellular telephone, a telephone, a personal digital assistant (PDA), an electronic device, a machine, and an appliance. 
     
     
         104 . The method of  claim 88 , wherein the device comprises furniture. 
     
     
         105 . The method of  claim 88 , further comprising the user communicating with the device using a keyboard. 
     
     
         106 . The method of  claim 88 , further comprising the user communicating with the device using manual interactions. 
     
     
         107 . The method of  claim 88 , further comprising the device using speech recognition responsive to user communication. 
     
     
         108 . The method of  claim 88 , wherein the screen is a video screen. 
     
     
         109 . The method of  claim 88 , wherein the screen is a computer screen.