Wearable Computer with Superimposed Controls and Instructions for External Device

Abstract

A wearable computing device includes a head-mounted display (HMD) that provides a field of view in which at least a portion of the environment of the wearable computing device is viewable. The HMD is operable to display images superimposed over the field of view. When the wearable computing device determines that a target device is within its environment, the wearable computing device obtains target device information related to the target device. The target device information may include information that defines a virtual control interface for controlling the target device and an identification of a defined area of the target device on which the virtual control image is to be provided. The wearable computing device controls the HMD to display the virtual control image as an image superimposed over the defined area of the target device in the field of view.

What is claimed is: 
     
         1 . A method comprising:
 determining that a remotely controllable target device is within an environment of a wearable computing device, wherein the determination is based, at least in part, on a proximity between the wearable computing device and the remotely controllable target device, wherein the wearable computing device comprises a wireless communication interface; and   in response to the determination that the remotely controllable target device is within the environment of the wearable computing device, automatically transmitting, by the wireless communication interface of the wearable computing device, control instructions to the remotely controllable target device.   
     
     
         2 . The method of  claim 1 , wherein the wearable computing device further comprises a scanner, and wherein determining that the remotely controllable target device is within the environment of the wearable computing device comprises:
 scanning, by the scanner, for an optical identification corresponding to the remotely controllable target device; and   recognizing the optical identification.   
     
     
         3 . The method of  claim 2 , wherein scanning for the optical identification corresponding to the remotely controllable target device is performed responsive to receiving a beacon signal transmitted by the remotely controllable target device. 
     
     
         4 . The method of  claim 2 , wherein the wherein the optical identification comprises a barcode or a quick response (QR) code. 
     
     
         5 . The method of  claim 1 , wherein determining that the remotely controllable target device is within the environment of the wearable computing device comprises determining a current location of the wearable computing device and comparing the current location to a location of the remotely controllable target device. 
     
     
         6 . The method of  claim 1 , further comprising recording a sequence of control instructions for performing a task at the remotely controllable target device, wherein automatically transmitting the control instructions comprises automatically transmitting the recorded sequence of control instructions. 
     
     
         7 . The method of  claim 1 , wherein the determination is further based on a current location of the wearable computing device. 
     
     
         8 . The method of  claim 7 , wherein the determination is further based on a lighting condition of the environment, wherein the remotely controllable target device comprises a light source, and wherein the control instructions cause the light source to operate based on at least one of: a proximity between wearable computing device and the light, the current location of the wearable computing device, and the lighting condition of the environment. 
     
     
         9 . The method of  claim 7 , wherein the determination is further based on an in-vehicle status, wherein the remotely controllable target device comprises a garage door, and wherein the control instructions comprise causing the garage door to operate based on at least one of: the proximity between wearable computing device, the current location of the wearable computing device, and the in-vehicle status of the wearable computing device. 
     
     
         10 . A wearable computing device comprising:
 a wireless communication interface; and   a controller, wherein the controller is configured to perform operations comprising:
 determining that a remotely controllable target device is within an environment of the wearable computing device, and wherein the determination is based, at least in part, on a proximity between the wearable computing device and the remotely controllable target device; and 
 in response to the determination that the remotely controllable target device is within the environment of the wearable computing device, automatically transmitting control instructions to the remotely controllable target device. 
   
     
     
         11 . The wearable computing device of  claim 10 , further comprising a scanner, wherein the operations further comprise causing the scanner to scan the environment for an optical identification corresponding to the remotely controllable target device, and wherein the operations further comprise recognizing the optical identification. 
     
     
         12 . The wearable computing device of  claim 10 , further comprising a camera configured to image a portion of the environment, wherein the operations further comprise identifying the remotely controllable target device based on one or more images obtained by the camera. 
     
     
         13 . The wearable computing device of  claim 10 , further comprising a global positioning system (GPS) configured to sense a current location of the wearable computing device, wherein the operations further comprise determining the proximity between the wearable computing device and the remotely controllable target device based on a current GPS location of the wearable computing device as sensed by the GPS and a location of the remotely controllable target device. 
     
     
         14 . The wearable computing device of  claim 10 , further comprising a user interface, wherein the operations further comprise recognizing an input by the user interface. 
     
     
         15 . The wearable computing device of  claim 14 , wherein the user interface comprises a touchpad on the wearable computing device, and wherein the input comprises a touch interaction with the touchpad. 
     
     
         16 . The wearable computing device of  claim 14 , wherein the user interface comprises a microphone, and wherein the input comprises a voice command. 
     
     
         17 . The wearable computing device of  claim 14 , wherein recognizing the input comprises recognizing a gesture. 
     
     
         18 . The wearable computing device of  claim 14 , wherein the operations further comprise recording the input as a sequence of control instructions for performing a task at the remotely controllable target device, wherein automatically transmitting the control instructions comprises automatically transmitting the recorded sequence of control instructions. 
     
     
         19 . A non-transitory computer readable medium having stored thereon instructions executable by one or more processors to cause the one or more processors to perform functions comprising:
 determining that a remotely controllable target device is within an environment of a wearable computing device, wherein the determination is based, at least in part, on a proximity between the wearable computing device and the remotely controllable target device, wherein the wearable computing device comprises a wireless communication interface; and   in response to the determination that the remotely controllable target device is within the environment of the wearable computing device, automatically transmitting, by the wireless communication interface of the wearable computing device, control instructions to the remotely controllable target device.   
     
     
         20 . The non-transitory computer readable medium of  claim 19 , wherein the instructions are further executable by the one or more processors to determine a current location of the wearable computing device and compare the current location of the wearable computing device to a location of the remotely controllable target device.