Environment-aware computerized information and display apparatus

Abstract

Computerized apparatus useful for obtaining and displaying information obtained from multiple sources. In one embodiment, the computerized apparatus is part of a transport device or apparatus, and includes a display device and speech recognition apparatus configured to receive user speech input and enable performance of various tasks, such as obtaining desired information relating to an entity, images thereof, maps or directions, or any number of other topics. The apparatus in one variant further includes sensor apparatus in communication with the computerized apparatus, and which enables for example display of data derived from one or more sensors exposed to an environment of the transport device on the display device.

What is claimed is: 
     
         1 .- 40 . (canceled) 
     
     
         41 . Computerized information and display apparatus, comprising:
 a wireless network interface;   processing apparatus in data communication with the network interface;   speech processing apparatus in data communication with the processing apparatus;   speech synthesis apparatus in data communication with the processing apparatus;   an input device in communication with the processing apparatus and configured to, when actuated, cause the computerized information and display apparatus to enter a mode whereby a user can provide a speech input to the speech processing apparatus;   a display device viewable by the user while providing the speech input;   video data apparatus in data communication with the processing apparatus and the display device and configured to enable digital video data to be displayed on the display device; and   a storage apparatus comprising at least one computer program in data communication with at least the processing apparatus;   wherein said computerized information and display apparatus is configured to:
 after entry into the mode, obtain digitized speech from the speech processing apparatus, the digitized speech generated based on the speech input received from the user, the received speech input comprising at least part of a name of a business entity; 
 cause, based at least in part on the digitized speech, identification of a match to the at least part of the name; 
 cause retrieval of content associated with the match from a remote network entity via the wireless network interface; and 
 display the content associated with the match on the display device, the content aiding the user in finding the business entity, the content comprising at least an image showing a location of the business entity and at least its immediate surroundings. 
   
     
     
         42 . The computerized information and display apparatus of  claim 41 , wherein the computerized information and display apparatus is integral with an apparatus configured to transport multiple persons, and the digital video data is generated by a plurality of cameras in data communication with the computerized information and display apparatus and displayed on the display device in corresponding ones of portions of the display device so as to enable simultaneous monitoring of multiple portions of an area proximate an exterior of the apparatus configured to transport. 
     
     
         43 . The computerized information and display apparatus of  claim 41 , wherein the computerized information and display apparatus is integral with an apparatus configured to transport multiple persons, and the computerized information and display apparatus further comprises at least one motion detection apparatus configured to alert the user of motion occurring outside of the a passenger compartment of the apparatus configured to transport. 
     
     
         44 . The computerized information and display apparatus of  claim 41 , wherein the computerized information and display apparatus is integral with an apparatus configured to transport multiple persons, and the computerized information and display apparatus further comprises at least one motion detector configured to alert the user of motion occurring outside of the apparatus configured to transport, the alert comprising display of visually perceptible information on the display device. 
     
     
         45 . The computerized information and display apparatus of  claim 41 , wherein the image showing the location of the business entity and at least its immediate surroundings further shows one or more other entities immediately proximate to the location, so as to facilitate the user orienting themselves as they approach the business entity. 
     
     
         46 . The computerized information and display apparatus of  claim 41 , wherein the computerized information and display apparatus is configured to prompt the user to provide the speech input, the prompt comprising a synthesized voice prompt requesting the user to provide the speech input. 
     
     
         47 . The computerized information and display apparatus of  claim 41 , wherein the causation of identification of the match comprises:
 identifying a plurality of possible matches to the at least part of the name;   presenting at least a portion of the plurality of possible matches to the user;   receiving a subsequent user speech input identifying one of the at least portion of the plurality of matches which the user desires; and   wherein the display of the content associated with the match on the display device comprises display of the content associated with the identified one of the at least portion of the plurality of matches which the user desires.   
     
     
         48 . The computerized information and display apparatus of  claim 47 , wherein the computerized information and display apparatus is further configured to revert to a mode where the user cannot enter the speech input after a prescribed period of time expires without the user providing the speech input, unless the input device is again actuated. 
     
     
         49 . The computerized information and display apparatus of  claim 41 , wherein the computerized information and display apparatus is further configured to provide at least a portion of information obtained via the network interface in response to a speech query of the user to a portable electronic device via a data interface of the computerized information and display apparatus. 
     
     
         50 . The computerized information and display apparatus of  claim 49 , wherein the computerized information and display apparatus is substantially integral with an apparatus configured to transport multiple persons, and the at least portion of information obtained via the network interface comprises at least map data relating to an area local to the apparatus configured to transport. 
     
     
         51 . The computerized information and display apparatus of  claim 50 , wherein the data interface comprises an interface utilizing a Universal Serial Bus (USB) protocol and a physical connection between the computerized information and display apparatus and the portable electronic device. 
     
     
         52 . The computerized information and display apparatus of  claim 51 , wherein the physical connection between the computerized information and display apparatus and the portable electronic device comprises a physical connector that is fixedly part of the computerized information and display apparatus and which is at least partly recessed with a slot or enclosure of the apparatus configured to transport multiple persons. 
     
     
         53 . The computerized information and display apparatus of  claim 50 , wherein the computerized information and display apparatus is configured such that provision of at least a portion of information obtained via the network interface in response to a speech query of the user to a portable electronic device via a data interface can be invoked by application software present on the portable electronic device, the application software present on the portable electronic device configured to receive and store the at least portion of information for subsequent use by the user in navigating an area local to the apparatus configured to transport. 
     
     
         54 . The computerized information and display apparatus of  claim 41 , wherein the wireless network interface comprises a wireless interface compliant with an IEEE 802.11 WLAN standard. 
     
     
         55 . The computerized information and display apparatus of  claim 41 , wherein the computerized information and display apparatus is further configured to display a plurality of icons corresponding to respective ones of topical areas, selection of the topical areas by the user causing access of an Internet entity via at least the wireless network interface in order to retrieve information relevant to the user and relating to the selected topical area. 
     
     
         56 . The computerized information and display apparatus of  claim 55 , wherein the topical areas include weather information, and the information relevant to the user comprises a weather forecast for a prescribed geographic area, the area selected by the user via the computerized information and display apparatus. 
     
     
         57 . The computerized information and display apparatus of  claim 55 , wherein the icons are selected to facilitate rapid access to and display of a limited collection of data in order to reduce the amount of time needed by the user to locate and be cognitive of information that the user desires to a few seconds. 
     
     
         58 . The computerized information and display apparatus of  claim 57 , wherein the display device comprises a touch-screen input and display device, and the topical areas are selectable by the user via touching the screen of the touch screen input and display device in a region of an icon corresponding with a respective one of the topical areas. 
     
     
         59 . The computerized information and display apparatus of  claim 55 , wherein the display device comprises a touch-screen input and display device, and the topical areas are selectable by the user via touching the screen of the touch screen input and display device in a region of an icon corresponding with a respective one of the topical areas. 
     
     
         60 . The computerized information and display apparatus of  claim 41 , wherein the computerized information and display apparatus is substantially integral with an apparatus configured to transport one or more persons between various locations, and the information and display apparatus further comprises:
 a touch input device configured to allow the user to provide input to the information and display apparatus by touching a touch-sensitive portion of the touch input device, the touch input device not having a display screen; and   at least one of (i) ultrasonic sensing apparatus in data communication with at least a portion of the processing apparatus and configured to detect at least motion external to the apparatus configured to transport, and provide the user an alert relating thereto; and/or (ii) infrared sensing apparatus configured to detect the presence of at least a human external to the apparatus configured to transport, and provide the user with an indication thereof.   
     
     
         61 . The computerized information and display apparatus of  claim 60 , wherein the computerized information and display apparatus is further configured to revert to a mode where the user cannot enter the speech input after a prescribed period of time expires without the user providing the speech input, unless the input device is again actuated. 
     
     
         62 . The computerized information and display apparatus of  claim 41 , wherein the computerized information and display apparatus is further configured to transfer a plurality of data to a portable electronic device via a data interface of the computerized information and display apparatus, the data interface comprising an interface utilizing a Universal Serial Bus (USB) protocol and a physical connection between the computerized information and display apparatus and the portable electronic device. 
     
     
         63 . The computerized information and display apparatus of  claim 62 , wherein the plurality of data transferred comprises data having been configured at least in part based on a plurality of inputs previously provided by the user, the inputs previously provided by the user to the computerized information and display apparatus. 
     
     
         64 . The computerized information and display apparatus of  claim 62 , wherein the information system further comprises a short-range wireless interface configured to obtain data from a portable user radio frequency device when the portable user radio frequency device is within sufficient range of the short-range interface, the information configured to use the obtained data so as to configure one or more functions of the computerized information apparatus according to a previously supplied user preference or profile. 
     
     
         65 . The computerized information and display apparatus of  claim 41 , further comprising a short-range wireless interface configured to obtain data from a portable user radio frequency device when the portable user radio frequency device is within sufficient range of the short-range interface, the information configured to use the obtained data so as to configure one or more functions of the computerized information apparatus according to a previously supplied user preference or profile. 
     
     
         66 . The computerized information and display apparatus of  claim 41 , further comprising a short-range wireless interface configured to obtain data from a portable user radio frequency device when the portable user radio frequency device is within sufficient range of the short-range interface, the information system configured to use the obtained data so as to selectively enable only a portion of a plurality of functions of the computerized information system according to a pre-existing profile or preference associated with the user. 
     
     
         67 . The computerized information and display apparatus of  claim 41 , wherein the computerized information and display apparatus is substantially integral with an apparatus configured to transport multiple persons, and further comprises at least one sensing apparatus in data communication with at least the processing apparatus and configured to sense occupancy of the transport apparatus. 
     
     
         68 . The computerized information and display apparatus of  claim 67 , wherein the at least one sensing apparatus comprises a plurality of pressure sensors configured to sense a force applied thereto, the force generated by the weight of a person, and wherein the sensing of the occupancy of the transport apparatus comprises determining a number of persons within the transport apparatus based at least in part on one or more of the sensors indicating that a force is being applied thereto corresponding to a person. 
     
     
         69 . The computerized information and display apparatus of  claim 67 , wherein the at least one sensing apparatus comprises a plurality of pressure sensors configured to determine that a force is being applied thereto, and computerized logic configured to determine said occupancy by counting a number of occupants based on outputs from said plurality of pressure sensors. 
     
     
         70 . The computerized information and display apparatus of  claim 41 , wherein the digital video data is generated remotely from the computerized information and display apparatus, and is received by the computerized information and display apparatus via at least a wireless interface thereof. 
     
     
         71 . The computerized information and display apparatus of  claim 70 , wherein the digital video data comprises data that has been compressed in the digital domain using an algorithm which compresses data prior to transmission to the computerized information and display apparatus. 
     
     
         72 . The computerized information and display apparatus of  claim 70 , wherein the remote location comprises a destination to which the user intends to travel. 
     
     
         73 . The computerized information and display apparatus of  claim 41 , further comprising voice communication apparatus, the voice communication apparatus enabling the user to contact a monitoring station or service remotely disposed from the user, the contact to cause the monitoring station or service to invoke one or more security features relevant to at least one of: (i) a current location of the user, and/or (ii) a future destination of the user. 
     
     
         74 . The computerized information and display apparatus of  claim 72 , wherein the one or more security features comprise at least one of (i) additional lighting, and/or (ii) monitoring via a video camera. 
     
     
         75 . The computerized information and display apparatus of  claim 41 , further configured to: (i) receive via a wireless interface a plurality of images of a remote location, the remote location comprising the business entity; and (ii) display the plurality of images substantially simultaneously on the display device, the display of the plurality of images comprising display of a first of the plurality of images at least partly contiguous to a second of the plurality of images, and a third of the plurality of images at least partly contiguous to the second of the plurality of images. 
     
     
         76 . The computerized information and display apparatus of  claim 41 , further configured to: (i) receive via a wireless interface a plurality of images of a remote location, the remote location comprising the business entity, the plurality of images comprising images corresponding to respective ones of portions of the location, the portions being at least partly contiguous with others of the portions at the location; and (ii) display the plurality of images substantially simultaneously on the display device. 
     
     
         77 . The computerized information and display apparatus of  claim 76 , wherein the plurality of images are each derived from a camera that visually observed the respective one of the portion of the location. 
     
     
         78 . The computerized information and display apparatus of  claim 41 , further configured to selectively adjust lighting associated with at least a portion of a path of travel of the user as a safety precaution. 
     
     
         79 . The computerized information and display apparatus of  claim 78 , wherein the selective adjustment of lighting as a safety precaution comprises increasing at least one of the intensity or number of lights activated in order to enhance user visibility, the enhanced visibility enabling the user to better avoid one or more hazards. 
     
     
         80 . Computerized information and display apparatus, comprising:
 a wireless network interface;   processing apparatus in data communication with the network interface;   speech processing apparatus in data communication with the processing apparatus;   speech synthesis apparatus in data communication with the processing apparatus;   an input device in communication with the processing apparatus and configured to, when actuated, cause the computerized information and display apparatus to enter a mode whereby a user can provide a speech input to the speech processing apparatus;   a display device viewable by the user while providing the speech input;   video data apparatus in data communication with the processing apparatus and the display device;   sensor apparatus in data communication with the computerized information and display apparatus; and   a storage apparatus comprising at least one computer program in data communication with at least the processing apparatus;   wherein said computerized information and display apparatus is configured to provide information derived from multiple sources to the user by at least:   (1) receiving, upon actuation of the input device by the user, a signal from the input device;
 based at least on the signal, entering the mode; 
 obtaining digitized speech from the speech processing apparatus, the digitized speech generated based on the speech input received from the user, the received speech input comprising at least part of a name of a business entity; 
 causing, based at least in part on the digitized speech, identification of a match to the at least part of the name; 
 causing retrieval of content associated with the match from a remote network entity via the wireless network interface; and 
 displaying the content associated with the match on the display device, the content aiding the user in finding the business entity, the content comprising at least an image showing a location of the business entity and at least its immediate surroundings; 
   (2) receiving data from the sensor apparatus; and
 generating, based at least on the received data, at least one of an audible and/or visual alert, the at least one alert relating to at least one of: 
 (i) motion sensed by the sensor apparatus; and/or 
 (ii) infrared radiation corresponding to a living being detected by the sensor apparatus; and 
   (3) receiving digital video data from the video data apparatus, the digital video data generated based on video signals obtained from at least one camera apparatus; and
 displaying the received digital video data on the display device. 
   
     
     
         81 . The computerized information and display apparatus of  claim 80 , wherein the at least one camera apparatus comprises a plurality of camera apparatus disposed so as to view a plurality of different areas, and the displaying the digital video data on the display device comprises displaying video data derived from respective ones of the plurality of the camera apparatus on respective ones of substantially contiguous display regions on the display device such that the user can substantially simultaneously view each of the video data on the display device. 
     
     
         82 . The computerized information and display apparatus of  claim 81 , wherein each of the plurality of different areas are substantially contiguous with at least a portion of at least one other of the plurality of different areas. 
     
     
         83 . The computerized information and display apparatus of  claim 80 , wherein the sensor apparatus comprises at least one infrared radiation detector, the at least one alert relates to infrared radiation corresponding to a living being detected by the at least one infrared detector, and the at least one alert comprises a visual alert, the visual alert comprising a light-modulated indication. 
     
     
         84 . The computerized information and display apparatus of  claim 83 , wherein the light-modulated indication comprises a flashing or blinking indication rendered on the display device. 
     
     
         85 . The computerized information and display apparatus of  claim 80 , further comprising voice communication apparatus, the voice communication apparatus enabling the user to contact a monitoring station or service remotely disposed from the user via the wireless network interface, the contact to cause the monitoring station or service to invoke one or more security features relevant to at least one of: (i) a current location of the user, and/or (ii) a future destination of the user. 
     
     
         86 . The computerized information and display apparatus of  claim 80 , further configured to: (i) receive a user input, the input invoking a function of the computerized information and display apparatus; (ii) based at least on the receipt of the user input, transmit data to a remote monitoring station indicative that the function has been invoked by the user; and (iii) cause establishment of a voice communication channel with the remote monitoring station via the wireless network interface. 
     
     
         87 . The computerized information and display apparatus of  claim 80 , further configured to: (i) automatically transmit data from computerized information and display apparatus via the wireless network interface to a remote monitoring station, the data indicative that a function of the computerized information and display apparatus has been activated, and (ii) enable establishment of a voice communication channel with the remote monitoring station via the wireless network interface. 
     
     
         88 . The computerized information and display apparatus of  claim 87 , wherein the activated function comprises a function related to enhancing the safety or security of the user. 
     
     
         89 . The computerized information and display apparatus of  claim 80 , wherein the computerized information and display apparatus is further configured to permit the user to select a destination of travel, and based at least in part on the selection, enable one or more functions relevant to at least one of (i) the destination, and/or (ii) a route of travel taken to the destination. 
     
     
         90 . The computerized information and display apparatus of  claim 89 , wherein the display device comprises a touch screen input and display device, and the selection of a destination of travel comprises selection of a particular point on a map of an area via the user touching a screen of the touch screen input and display device. 
     
     
         91 . The computerized information and display apparatus of  claim 90 , wherein the computerized information and display device is further configured to: (i) calculate coordinates for the selected particular point on the map of the area; and (ii) correlate the calculated coordinates to the enabled one or more relevant functions. 
     
     
         92 . The computerized information and display apparatus of  claim 80 , wherein the computerized information and display apparatus is further configured to permit the user to control at least one of an HVAC function and/or lighting function associated with a building or structure which the user frequents via at least the wireless network interface of the computerized information and display apparatus. 
     
     
         93 . The computerized information and display apparatus of  claim 92 , wherein the display device comprises a touch screen input and display device, and the user control of the at least one of an HVAC function and/or lighting function associated with a building or structure which the user frequents comprises actuation of the at least one function via one or more soft function keys generated on the display device and selectable by the user via touching a screen of the display device. 
     
     
         94 . Computerized information and display apparatus, comprising:
 data processing apparatus comprising a central processor and at least one digital signal processor;   speech processing apparatus in data communication with at least a portion of the data processing apparatus;   speech synthesis apparatus in data communication with at least a portion of the data processing apparatus;   an input device in communication with at least a portion of the data processing apparatus and configured to, when actuated, cause the computerized information and display apparatus to enter a mode whereby a user can provide a speech input to the speech processing apparatus;   a display device viewable by the user while providing the speech input;   video data apparatus in data communication with at least a portion of the data processing apparatus and the display device and configured to enable digital video data to be displayed on the display device, the digital video data generated based on video signals obtained from at least one camera apparatus;   sensor apparatus in data communication with the computerized information and display apparatus;   data storage apparatus in data communication with at least a portion of the data processing apparatus; and   a storage apparatus comprising at least one computer program and in data communication with at least a portion of the data processing apparatus;   wherein said computerized information and display apparatus is configured to provide information to the user by at least:   (1) receiving, upon actuation of the input device by the user, a signal from the input device;
 based at least on the signal from the input device, entering the mode; 
 obtaining digitized speech from the speech processing apparatus, the digitized speech generated based on the speech input received from the user, the received speech input comprising at least part of a name of a business entity; 
 causing, based at least in part on the digitized speech, identification of a match to the at least part of the name; 
 causing retrieval of content associated with the match from the data storage apparatus; and 
 displaying the content associated with the match on the display device, the content aiding the user in finding the business entity, the content comprising at least a graphical representation showing a rendering of a location of the business entity and at least its immediate surroundings; and 
   (2) receiving data from the sensor apparatus; and
 generating, based at least on the received data, at least one of an audible and/or visual alert, the at least one alert relating to at least one of: 
 (i) motion sensed by the sensor apparatus; and/or 
   
       infrared radiation corresponding to a living being detected by the sensor apparatus.