System and Method for Initiating Actions and Providing Feedback by Pointing at Object of Interest

Abstract

A system and method as described for compiling feedback in command statements that relate to applications or services associated with spatial objects or features, pointing at such spatial object or feature order to identify the object of interest, and executing the command statements on a system server and attaching feedback information to their representation of this object or feature in a database of the system server.

1 . A computer-implemented method for identifying an object in a real-world scene by pointing at the object with an electronic pointing device and electronically linking information to the object in a digital representation of the object stored in system storage, comprising the steps of:
 (A) mapping a three-dimensional representation of a real-world scene containing at least one object and transmitting the three-dimensional representation of the scene to a system server;   (B) generating a two-dimensional representation of the three-dimensional representation with the system server;   (C) pointing the pointing device at the at least one object and collecting a current geodetic position and pointing direction for the pointing device and creating a ray that intersects with a two-dimensional representation according to the geodetic position and pointing direction of the of the pointing device;   (D) selecting at the pointing device command statements and compiling feedback associated with the at least one object for identifying the at least one object;   (F) transmitting from the pointing device to the system server at least three segments of information, with the three segments including (1) the geodetic position and pointing direction of the pointing device, (2) command statements, and (3) compiled feedback;   (G) the system server separating the segments and (1) using the current position and pointing direction of the pointing device to identify the at least one object, (2) identifying the types of commands and compiled feedback, and (3) dispatching the command statements for execution and attaching the compiled feedback to the at least one object;   (H) identifying the at least one object of interest at the system server and transmitting the identity of the object of interest to the pointing device, with the command statements being executed respect to the at least one object of interest, and the compiled feedback being attached to the at least one object of interest.   
     
     
         2 . The method as recited in  claim 1 , wherein command statements include actions that relates to appliances, applications, or services on the system server relate information to the at least one object. 
     
     
         3 . The method as recited in  claim 2 , wherein appliances include at least automated teller machines, meters, automated door systems, lights, displays, devices, or electrical/mechanical instruments. 
     
     
         4 . The method as recited in  claim 2 , wherein applications include at least information systems, database management systems, web applications, dedicated and embedded applications, or any tool that functions and is operated by a computer. 
     
     
         5 . The method as recited in  claim 2 , wherein services include web services, bookmarking and registration services, electronic counter services, automated teller services, vending and ticketing services, or any software system for supporting interoperable machine-to-machine interaction over a network. 
     
     
         6 . A computer-implemented method for identifying an object in a real-world scene by pointing at the object with an electronic pointing device and electronically linking information to the object in a digital representation of the object stored in system storage, comprising the steps of:
 (A) inputting from the pointing device to a system server a geodetic position and pointing direction of the pointing device with command statements generated by the system user on the pointing device and feedback associated with the at least one object of interest;   (B) mapping a three-dimensional representation of a real-world scene containing at least the one object and transmitting the three-dimensional representation of the scene to a system server;   (C) generating a two-dimensional representation of the three-dimensional representation with the system server;   (D) identifying with the system server the at least one object and transmitting an identity of the at least one object to the pointing device and if a predetermined level of accuracy in identifying the at least one object of interest is not achieved, then step (A), otherwise step (E);   (E) inputting from the pointing device to the system server contextual information;   (F) determining if what was input at step (A) was a command statement or feedback and if what was input at step (A) was a command statement then step (G), otherwise step (H);   (G) the system server parsing and executing the command statement with respect to the at least one object; and   (H) linking the feedback to the at least one object and storing the feedback in the system database with respect to the at least one object.   
     
     
         7 . The method as recited in  claim 6 , wherein command statements include actions that relates to appliances, applications, or services on the system server relate information to the at least one object. 
     
     
         8 . The method as recited in  claim 7 , wherein appliances include at least automated teller machines, meters, automated door systems, lights, displays, devices, or electrical/mechanical instruments. 
     
     
         9 . The method as recited in  claim 7 , wherein applications include at least information systems, database management systems, web applications, dedicated and embedded applications, or any tool that functions and is operated by a computer. 
     
     
         10 . The method as recited in  claim 7 , wherein services include web services, bookmarking and registration services, electronic counter services, automated teller services, vending and ticketing services, or any software system for supporting interoperable machine-to-machine interaction over a network.