Methods and apparatuses for using a mobile device to provide remote assistance

Abstract

Systems and methods for providing remote assistance to a user are disclosed. A remote assistance system may communicate with a mobile device operated by the user and may manipulate devices configured on the mobile device, such as a camera, an illumination device, a projection device, or any other types of devices. Images may be captured with a camera of the mobile phone and transmitted by the mobile phone to the remote assistance system. A remote assistant may transmit images or other visual data to the mobile phone that are then overlaid upon images presented on the mobile phone. Various image manipulation and stabilization means and methods are disclosed, as well as various ways of obtaining and providing remote assistance.

1 - 20 . (canceled) 
     
     
         21 . A mobile device for use in a remote assistance system, comprising:
 an image capture device configured to capture images of a first area;   a projection device configured to project images onto a second area, wherein the first area and the second area substantially overlap; and   a transceiver configured to transmit and receive communications signals and receive an instruction to adjust the image capture device from a remote assistance system, and wherein the mobile device is configured to adjust the image capture device responsive to the transceiver receiving the instruction.   
     
     
         22 . The mobile device of  claim 21 , wherein the instruction comprises one or more instructions to adjust at least one of a focus, a zoom, an image capture area, an orientation, and a direction of the image capture device. 
     
     
         23 . The mobile device of  claim 21 , further comprising a display device, wherein the transceiver is further configured to receive visual data from a remote assistance system, and wherein the mobile device is configured to display the visual data on the display device. 
     
     
         24 . The mobile device of  claim 23 , wherein the visual data comprises at least one of text instructions, graphics, and an indicator. 
     
     
         25 . The mobile device of  claim 21 , wherein the transceiver is further configured to receive a projection instruction, and wherein the mobile device is configured to manipulate the projection device responsive to the transceiver receiving the projection instruction. 
     
     
         26 . The mobile device of  claim 25 , wherein the projection instruction comprises visual data, and wherein the mobile device is further configured to manipulate the projection device to project the visual data onto the second area. 
     
     
         27 . The mobile device of  claim 21 , wherein the transceiver is further configured to transmit a request to activate a remote assistance session to a server of the remote assistance system and to receive remote assistance data from the remote assistance server. 
     
     
         28 . The mobile device of  claim 21 , further comprising an image stabilization means configured to generate stabilized image data, wherein the transceiver is further configured to transmit the stabilized image data to a remote assistance system. 
     
     
         29 . The mobile device of  claim 21 , wherein the transceiver is further configured to transmit voice communications signals to a remote assistance system while receiving data communications signals from the remote assistance system. 
     
     
         30 . The mobile device of  claim 21 , further comprising an illumination device. 
     
     
         31 . The mobile device of  claim 21 , wherein the first area is associated with a physical object. 
     
     
         32 . The mobile device of  claim 31 , wherein the second area is associated with an area of the physical object. 
     
     
         33 . The mobile device of  claim 21 , wherein projecting the images onto the second area comprises projecting visual data onto a physical object. 
     
     
         34 . The mobile device of  claim 33 , wherein the visual data comprises a graphical indicator. 
     
     
         35 . The mobile device of  claim 33 , wherein the visual data comprises a graphical indicator associated with a physical object. 
     
     
         36 . The mobile device of  claim 26 , wherein manipulating the projection device to project the visual data onto the second area comprises projecting a graphical indicator associated with an area of a physical object. 
     
     
         37 . The mobile device of  claim 26 , wherein manipulating the projection device to project the visual data onto the second area comprises projecting the visual data onto a physical object. 
     
     
         38 . The mobile device of  claim 21 , wherein the images of the first area comprise real-time images of the first area and the images projected onto the second area comprise historical images of the first area. 
     
     
         39 . The mobile device of  claim 21 , wherein the images of the first area comprise historical images of the first area and the images projected onto the second area comprise real-time images of the first area. 
     
     
         40 . A remote assistance system, comprising:
 a processor configured to generate remote assistance data;   a transceiver configured to transmit the remote assistance data to a mobile device and receive mobile device data from the mobile device; and   a display configured to present the received mobile device data,   wherein the processor is further configured to establish a remote assistance session with the mobile device via the transceiver, and   wherein the transceiver is further configured to communicate with a server configured to track the remote assistance session.   
     
     
         41 . The remote assistance system of  claim 40 , wherein the mobile device data comprises at least one image captured by a camera configured on the mobile device. 
     
     
         42 . The remote assistance system of  claim 41 , wherein the remote assistance data comprises a layer of visual data, wherein the layer of visual data is overlaid on the at least one image. 
     
     
         43 . The remote assistance system of  claim 40 , wherein the remote assistance data comprises a layer of visual data that is overlaid on an image presented on a display of the mobile device. 
     
     
         44 . The remote assistance system of  claim 40 , wherein the remote assistance data comprises instructions to manipulate a component of the mobile device. 
     
     
         45 . The remote assistance system of  claim 44 , wherein the instructions comprise instructions to adjust at least one of a camera of the mobile device, a projection device of the mobile device, and an illumination device of the mobile device. 
     
     
         46 . The remote assistance system of  claim 40 , wherein the processor is further configured to generate remote assistance session data, and wherein the transceiver is further configured to transmit the remote assistance session data to a billing server. 
     
     
         47 . The remote assistance system of  claim 40 , wherein the processor is further configured to execute instructions to coordinate remote assistance activities among a plurality of remote assistance providers. 
     
     
         48 . The remote assistance system of  claim 40 , wherein the remote assistance data comprises a plurality of layers of visual data. 
     
     
         49 . The remote assistance system of  claim 48 , wherein the plurality of layers of visual data are overlaid on an image presented on a display of the mobile device. 
     
     
         50 . The remote assistance system of  claim 48 , wherein at least one of the plurality of layers of visual data is overlaid on an area comprising a physical object. 
     
     
         51 . The remote assistance system of  claim 50 , wherein the image of the area comprising the physical object is presented on a display of the mobile device. 
     
     
         52 . The remote assistance system of  claim 50 , wherein the image of the area comprising the physical object is captured by an image capture device of the mobile device. 
     
     
         53 . The remote assistance system of  claim 50 , wherein the at least one of the plurality of layers of visual data is overlaid on an area of the image that corresponds to a respective area of the physical object. 
     
     
         54 . The remote assistance system of  claim 50 , wherein the at least one of the plurality of layers of visual data is overlaid on the image and output for display to a user of the mobile device such that, as viewed by the user, the visual data is overlaid on an area of the image that corresponds to a respective area of the physical object.