User interface controlled by environmental cues

Abstract

A method comprises receiving a signal containing an environmental cue; correlating the environmental cue to a user interface control element; and generating a user interface control command based on the environmental cue, A device may be controlled by receiving a visual image, processing the image to identify a visual cue, correlating the visual cue with a user interface control, and controlling the device using the user interface control. The visual image may be received from a camera that is part of an automobile, and the user interface control may include a control for a radio to tune to a radio station; a speed control for controlling a speed of the automobile corresponding to a speed sign visual cue; or a navigation system control for controlling a navigation system based on traffic signs. Other variations include an apparatus and computer-readable media including instructions for performing the methods.

What is claimed is: 
     
         1 . A method on a mobile device, comprising:
 receiving a visual image of a sign captured by a camera module of the mobile device;   obtaining position information of said mobile device;   processing said visual image to identify an information element contained on said visual image; and   accessing a timetable when said information element relates to a transportation service, wherein said timetable is relative to said position information.   
     
     
         2 . The method of  claim 1 , further comprising:
 dialing a phone number when said information element relates to a phone number.   
     
     
         3 . The method of  claim 1 , further comprising:
 accessing a web page when said information element relates to a website address.   
     
     
         4 . The method of  claim 1 , wherein processing said visual image to identify said information element comprises:
 storing a cue database; and   correlating said visual image to one or more cues of said activated cue database.   
     
     
         5 . A mobile device, comprising:
 a display configured to display a graphical user interface;   a camera module configured to capture visual images;   a GPS receiver configured to determine a current geographic location of said mobile device; and   a processor configured to:
 receive a visual image of a sign captured by said camera module of said mobile device; 
 obtain said current geographic location of said mobile device from said GPS receiver; 
 process said visual image to identify an information element contained on said visual image; and 
 access a timetable when said information element relates to a transportation service, wherein said timetable is relative to said current geographic position. 
   
     
     
         6 . The mobile device of  claim 5 , wherein said processor is further configured to dial a phone number when said information element relates to a phone number. 
     
     
         7 . The mobile device of  claim 5 , wherein said processor is further configured to access a web page when said information element relates to a website address. 
     
     
         8 . The mobile device of  claim 5 , further comprising a storage device, wherein said processor is further configured to, when processing said visual image to identify said information element:
 store a cue database in the storage device; and   correlate the visual image to one or more cues of said cue database.   
     
     
         9 . A non-transitory computer-readable medium storing executable instructions configured to, when executed, cause a processor to:
 receive a visual image of a sign captured by a camera module of a mobile device;   obtain position information of said mobile device;   process said visual image to identify an information element contained on said visual image; and   access a timetable when said information element relates to a transportation service, wherein said timetable is relative to said position information.   
     
     
         10 . The computer-readable medium of  claim 9 , wherein said executable instructions are further configured to cause said processor to dial a phone number when said information element relates to a phone number. 
     
     
         11 . The computer-readable medium of  claim 9 , wherein the executable instructions are configured to cause said processor to access a web page when said information element relates to a website address. 
     
     
         12 . The computer-readable medium of  claim 9 , wherein for processing said visual image to identify said information element, the executable instructions further cause said processor to:
 store a cue database; and   correlate said visual image to one or more cues of said activated cue database.