Facilitating user input via head-mounted display device and arm-mounted peripheral device

Abstract

An apparatus for performing data entry by a user includes a first electronic device configured to be attached to a person's head and including a display for viewing by the person; and a second electronic device configured to be attached to a person's forearm and used in combination with the first electronic device. The first and second electronic devices are configured for wirelessly communications with each other, at least some of the wireless communications representing user input by the person for interfacing with a user interface displayed to the person on the display of the first electronic device, whereby data entry by the person is accomplished. The first electronic device is configured to wirelessly transmit data entered by the person to a computer system for electronic storage in a non-transitory computer readable medium.

What is claimed is: 
     
         1 . An apparatus for performing data entry by a user, comprising:
 (a) a first electronic device configured to be attached to a user's head and comprising a display for viewing by the user; and   (b) a second electronic device configured to be attached to a user's arm and used in combination with the first electronic device, the first and the second electronic devices being configured to wirelessly communicate with each other, at least some of the wireless communications representing user input by the user for interfacing with a user interface displayed to the user on the display of the first electronic device, whereby data entry by the user is accomplished;   (c) wherein the first electronic device is configured to use the user interface of the display to visually prompt a user wearing the first electronic device to enter data regarding an object of observation, interaction, or both by the user; and   (d) wherein the first electronic device is configured to receive from the second electronic device the data and wirelessly transmit the received data to a computer system over a computer network.   
     
     
         2 . The apparatus of  claim 1 , wherein the observed data wirelessly transmitted to the computer system comprises healthcare information relating to a patient, and wherein the healthcare information is stored in an electronic healthcare record of the patient. 
     
     
         3 . The apparatus of  claim 1 , wherein the second electronic device comprises:
 (i) an attachment portion configured for attachment of the device to an arm;   (ii) palm control portion containing circuitry and electronic components for performing functions and providing electronic capabilities of the device; and   (iii) an adjustable extension arm extending between and supporting the palm control portion relative to the attachment portion.   
     
     
         4 . The apparatus of  claim 3 , wherein the palm control portion comprises a contoured surface for generally abutting a palm of a hand when in use, and an opposite surface that is generally planar. 
     
     
         5 . The apparatus of  claim 4 , wherein the contoured surface of the palm control portion comprises surface areas that are touch-sensitive, whereby user input is received when a finger or thumb touches or taps a particular touch-sensitive area. 
     
     
         6 . The apparatus of  claim 3 , wherein the extension arm is retained to the attachment portion by a support that defines an opening through which the extension arm slides. 
     
     
         7 . The apparatus of  claim 6 , wherein an end of the extension arm comprises an enlarged peripheral area that exceeds the dimensions of the opening defined by the support such that the peripheral area acts as a stop limiting the extent to which the extension arm slides relative to the support. 
     
     
         8 . The apparatus of  claim 3 , wherein the extension arm is secured to the attachment portion and able to swivel or rotate relative to the attachment portion for minor angular adjustment of the control portion relative to the attachment portion. 
     
     
         9 . The apparatus of  claim 3 , wherein the palm control portion is movable between an extended position and a retracted position relative to the attachment portion. 
     
     
         10 . The apparatus of  claim 3 , wherein the extension arm includes a hinge mechanism providing hinge type articulation by which the control portion can be rotated about 180 degrees, the extension arm folding back on itself from an extended, “in use” position to a folded, stowed position. 
     
     
         11 . The apparatus of  claim 10 , wherein the hinge mechanism is located near a base of the palm control portion. 
     
     
         12 . The apparatus of  claim 10 , wherein the attachment portion comprises one or more magnets that attract and retain the palm control portion to the attachment portion when the extension arm is in the folded, stowed position. 
     
     
         13 . The apparatus of  claim 12 , wherein the one or more magnets deactivate input controls of the palm control portion when the palm control portion is retained to the attachment portion by the one or more magnets. 
     
     
         14 . The apparatus of  claim 3 , wherein the second electronic device comprises an optical device configured to read a bar code. 
     
     
         15 . The apparatus of  claim 3 , wherein the second electronic device comprises a wireless transceiver or receiver for reading a wireless electronic identification device. 
     
     
         16 . The apparatus of  claim 1 , wherein the first electronic device comprise a camera configured to capture one or more images of the object of observation or of the interaction of the user with the object, and wherein the wireless communication components are further configured to wirelessly transmit the captured one or more images to the computer system. 
     
     
         17 . The apparatus of  claim 1 , wherein the first electronic device comprises eyewear. 
     
     
         18 . The apparatus of  claim 1 , wherein the first electronic device comprises a rechargeable power supply; one or more wireless receivers and one or more wireless transmitters, or one or more wireless transceivers; an integrated microphone for receiving and processing the voice of the user wearing the device; a gyroscope sensor for detecting spacial orientation of the device; and an auditory communication component for providing audible communications to a user wearing the device. 
     
     
         19 . The apparatus of  claim 1 , wherein the first electronic device comprises telecommunication capabilities—including voice and data. 
     
     
         20 . The apparatus of  claim 1 , wherein the first electronic device is configured such that the act of inverting the device locks the device from use until a user is authenticated for data entry. 
     
     
         21 . A method for performing data entry, by a user, of data regarding an observation of, or intervention or interaction with, an object while the observation, intervention, or interaction is occurring, comprising the steps of:
 (a) while the observation, intervention, or interaction is occurring,
 (i) displaying, to the user on a display of a head-mounted electronic display device having a rechargeable power supply and mechanically attached to the user's head, a user interface including a visual prompt for the user to enter data regarding the observation, intervention, or interaction, 
 (ii) wirelessly communicating, to the head-mounted electronic display device, by an arm-mounted peripheral electronic device having a rechargeable power supply and mechanically attached to the user's arm, a signal representing user input received from the user by the arm-mounted peripheral electronic device, and 
 (iii) wirelessly receiving, by the head-mounted electronic display device, the signal as user input that is responsive to the visual prompt for the user to enter data regarding the observation, intervention, or interaction; and 
   (b) wirelessly communicating, to a computer system over a computer network, by the head-mounted electronic display device, data corresponding to the responsive user input as regarding the observation, intervention, or interaction;   (c) wherein the arm-mounted peripheral electronic device comprises,
 (i) an attachment portion by which the arm-mounted peripheral electronic device is mechanically attached to the user's arm, 
 (ii) a palm control portion comprising a user input area at which the user input is received, and 
 (iii) an adjustable extension arm secured to the attachment portion and extending between and supporting the palm control portion relative to the attachment portion and mechanically transitionable between,
 (A) an extended position spanning the user's wrist in order to support the palm control portion adjacent the user's palm, and 
 (B) a stowed position spanning the user's wrist to support the palm control portion adjacent a user's forearm, 
 
 (iv) wherein the extension arm is mechanically configured to swivel relative to the attachment portion for minor angular adjustment of the palm control portion when the extension arm is in the extended position. 
   
     
     
         22 . The method of  claim 21 , wherein the head-mounted electronic display device wirelessly transmits the data regarding the observation, intervention, or interaction as healthcare information relating to a patient for storing in an electronic healthcare record of the patient. 
     
     
         23 . The method of  claim 21 , further comprising storing the data regarding the observation, intervention, or interaction as healthcare information in an electronic healthcare record. 
     
     
         24 . The method of  claim 21 , further comprising receiving, by the arm-mounted peripheral electronic device, user input from the user when a finger or thumb of the user touches or taps a touch-sensitive area of the palm portion. 
     
     
         25 . The method of  claim 21 , further comprising retaining the extension arm of the arm-mounted peripheral electronic device to the attachment portion of the arm-mounted peripheral electronic device by a support that defines an opening through which the extension arm slides, an end of the extension arm comprising an enlarged peripheral area that exceeds the dimensions of the opening defined by the support such that the peripheral area limits the extent to which the extension arm slides relative to the support. 
     
     
         26 . The method of  claim 21 , wherein the head-mounted electronic display device comprises eyewear. 
     
     
         27 . The method of  claim 21 , wherein the head-mounted electronic display device comprises telecommunication capabilities—including voice and data capabilities. 
     
     
         28 . The method of  claim 21 , further comprising locking the head-mounted electronic display device from being used by inverting the head-mounted electronic display device. 
     
     
         29 . The method of  claim 21 , wherein one or more wireless transceivers comprise the one or more wireless receivers and one or more wireless transmitters. 
     
     
         30 . The method of  claim 21 , wherein the palm control portion of the arm-mounted peripheral electronic device comprises a plurality of touch-sensitive user input areas, each user input area having tactile characteristics by which the user input areas are differentiable by touch. 
     
     
         31 . The method of  claim 21 , wherein the palm control portion of the arm-mounted peripheral electronic device further comprises a scroll wheel by which user input is received by the arm-mounted peripheral electronic device. 
     
     
         32 . The method of  claim 21 , further comprising using an optical device of the arm-mounted peripheral electronic device to read a bar code associated with the object of the observation, intervention, or interaction. 
     
     
         33 . The method of  claim 21 , further comprising using a wireless transceiver or receiver of the arm-mounted peripheral electronic device to read a wireless electronic identification device associated with the object of the observation, intervention, or interaction for reading. 
     
     
         34 . The method of  claim 21 , further comprising capturing one or more images of the object of the observation, intervention, or interaction using a camera of the head-mounted electronic display device, and wirelessly communicating the captured one or more images to the computer system over the computer network. 
     
     
         35 . A method for performing data entry by a user of data regarding an observation of, or intervention or interaction with, an object while the observation, intervention, or interaction is occurring, comprising the steps of:
 (a) while the observation, intervention, or interaction is occurring,
 (i) displaying, to the user on a display of a head-mounted electronic display device having a rechargeable power supply and mechanically attached to the user's head, a user interface including a visual prompt for the user to enter data regarding the observation, intervention, or interaction, 
 (ii) wirelessly communicating, to the head-mounted electronic display device, by an arm-mounted peripheral electronic device having a rechargeable power supply and mechanically attached to the user's arm, a signal representing user input received from the user by the arm-mounted peripheral electronic device, and 
 (iii) wirelessly receiving, by the head-mounted electronic display device, the signal as user input that is responsive to the visual prompt for the user to enter data regarding the observation, intervention, or interaction; and 
   (b) wirelessly communicating, to a computer system over a computer network, by the head-mounted electronic display device, data corresponding to the responsive user input as regarding the observation, intervention, or interaction;   (c) wherein the arm-mounted peripheral electronic device comprises,
 (i) an attachment portion by which the arm-mounted peripheral electronic device is mechanically attached to the user's arm, 
 (ii) a palm control portion comprising a user input area at which the user input is received, and 
 (iii) an adjustable extension arm secured to the attachment portion and supporting the palm control portion, the extension arm comprising a hinge mechanism providing hinge type articulation by which the palm control portion is transitionable between being adjacent a user's palm and being adjacent a user's forearm. 
   
     
     
         36 . The method of  claim 35 , wherein the hinge mechanism is located near a base of the palm control portion. 
     
     
         37 . The method of  claim 35 , wherein the palm control portion is retained to the attachment portion by one or more magnets of the attachment portion when the palm control portion arm is adjacent a user's forearm. 
     
     
         38 . The method of  claim 37 , wherein the user input area of the palm control portion is deactivated by the one or more magnets when the palm control portion is retained to the attachment portion by the one or more magnets. 
     
     
         39 . A method for performing data entry by a user regarding an observation of, or intervention or interaction with, a patient while the observation, intervention, or interaction is occurring, comprising the steps of:
 (a) while the observation, intervention, or interaction is occurring,
 (i) displaying, to the user on a display of a head-mounted electronic display device having a rechargeable power supply and mechanically attached to the user's head, a user interface including a visual prompt for the user to enter data regarding the observation, intervention, or interaction, 
 (ii) wirelessly communicating, to the head-mounted electronic display device, by an arm-mounted peripheral electronic device having a rechargeable power supply and mechanically attached to the user's arm, a signal representing user input received from the user by the arm-mounted peripheral electronic device, and 
 (iii) wirelessly receiving, by the head-mounted electronic display device, the signal as user input that is responsive to the visual prompt for the user to enter data regarding the observation, intervention, or interaction; and 
   (b) wirelessly communicating, to a computer system over a computer network, by the head-mounted electronic display device, data corresponding to the responsive user input as healthcare information relating to a patient for storing in an electronic healthcare record of the patient;   (c) wherein the arm-mounted peripheral electronic device comprises,
 (i) an attachment portion by which the arm-mounted peripheral electronic device is mechanically attached to the user's arm, 
 (ii) a palm control portion comprising a user input area at which the user input is received, and 
 (iii) an extension arm secured to the attachment portion and supporting the palm control portion, wherein the extension arm is movable between a first position for supporting the palm control portion adjacent a user's palm, and a second position for supporting the palm control portion adjacent a user's forearm. 
   
     
     
         40 . The method of  claim 39 , further comprising storing the data as healthcare information in an electronic healthcare record. 
     
     
         41 . A method for performing user data entry, comprising:
 (a) authenticating a first user to enter data using an apparatus for performing data entry by the first user, the apparatus comprising, a head-mountable electronic display device configured to be attached to a user's head and comprising a display for viewing by the user information displayed thereon, wherein the head-mountable electronic display device is configured to receive user input by the user for interfacing with a user interface displayed to the user on the display of the head-mountable electronic display device, such that data entry is accomplished by the user regarding an object of observation, intervention, or interaction by the user, and wherein the head-mountable electronic display device is configured to transmit data entered by the user to a computer system over a computer network for recording in a data record; and   (b) after a successful authentication of the first user to enter data using the apparatus, facilitating user data entry by the first user by:
 (i) displaying, on the display of the head-mountable electronic display device, a user interface including script, the displayed script including a user-selectable placeholder representative of data to be entered regarding an object of observation, intervention, or interaction by the user; 
 (ii) receiving a cue from the user indicating selection of the displayed user-selectable placeholder, and based thereon, receiving subsequently thereto user input representing data for which the user-selectable placeholder is representative; and 
 (iii) transmitting the received data represented by the user input to the computer system over a computer network for recording in the data record. 
   
     
     
         42 . The method of  claim 41 , wherein authenticating the first user comprises a two-factor authentication process. 
     
     
         43 . The method of  claim 41 , wherein authenticating the first user comprises receiving nonverbal user input representing a password entered without use of a keyboard. 
     
     
         44 . The method of  claim 41 , wherein authenticating the first user comprises analysis of a mirror image of the first user acquired through a camera of the head-mountable electronic display device. 
     
     
         45 . The method of  claim 41 , further comprising visually distinguishing the displayed user-selectable placeholder by causing the displayed placeholder to blink. 
     
     
         46 . The method of  claim 41 , further comprising visually distinguishing the displayed user-selectable placeholder by displaying the placeholder in a different color from other displayed portions of the scrip. 
     
     
         47 . The method of  claim 41 , further comprising recording the data represented by the user input in a record of a database maintained on a server. 
     
     
         48 . The method of  claim 47 , wherein the database contains electronic healthcare records of patients, and the data represented by the user input is healthcare information of a patient. 
     
     
         49 . The method of  claim 47 , further comprising recording in the database, with the data represented by the user input, a timestamp and identification of the user such that data entered by the user and recorded in the database, and corresponding time and date thereof, are later accessible for audit and analysis. 
     
     
         50 . The method of  claim 41 , wherein the cue from the user is a verbal cue received by the head-mountable electronic display device. 
     
     
         51 . The method of  claim 41 , wherein the cue from the user is a nonverbal cue received by the head-mountable electronic display device. 
     
     
         52 . The method of  claim 51 , further comprising monitoring eye movement of the user by the head-mountable electronic display device. 
     
     
         53 . The method of  claim 52 , wherein the nonverbal cue comprises a predefined sequence of eye movements. 
     
     
         54 . The method of  claim 52 , wherein the nonverbal cue comprises a predefined glance. 
     
     
         55 . The method of  claim 41 , wherein the cue from the user is received via a wireless peripheral electronic device with which the head-mountable electronic display device communicates. 
     
     
         56 . The method of  claim 55 , further comprising mounting the wireless hand-operated peripheral electronic device to an arm of the user. 
     
     
         57 . The method of  claim 41 , wherein the user input is verbally received by the head-mountable electronic display device. 
     
     
         58 . The method of  claim 57 , wherein the user input of data that is verbally received by the head-mountable electronic display device is interpreted based on the context of data that is represented by the placeholder. 
     
     
         59 . The method of  claim 57 , further comprising providing an alert to the user by the head-mountable electronic device when the user input of data that is verbally received is unrecognized. 
     
     
         60 . The method of  claim 59 , wherein the alert is provided on the display. 
     
     
         61 . The method of  claim 57 , wherein a verbal pause indicates the end of the user input of data that is verbally received by the head-mountable electronic display device. 
     
     
         62 . The method of  claim 61 , wherein the verbal pause is about three seconds. 
     
     
         63 . The method of  claim 41 , wherein the user input is received via a wireless hand-operated peripheral electronic device with which the head-mountable electronic display device communicates. 
     
     
         64 . The method of  claim 63 , further comprising mounting the wireless hand-operated peripheral electronic device to an arm of the user. 
     
     
         65 . The method of  claim 41 , wherein the database contains electronic healthcare records of patients, and the data represented by the user input is healthcare information of a patient. 
     
     
         66 . The method of  claim 41 , wherein the script is part of a protocol for performing a first task by the first user, in which task data is recorded regarding the object of observation, intervention, or interaction. 
     
     
         67 . The method of  claim 66 , further comprising displaying, on the head-mountable electronic display device, observations that currently need to be taken or actions that currently need to be performed in accordance with the protocol. 
     
     
         68 . The method of  claim 66 , wherein the task represents a medical procedure. 
     
     
         69 . The method of  claim 68 , wherein the script is read aloud by the user as the procedure is performed, and further comprising changing the textual format of the displayed text by the head-mountable electronic display device as text is read aloud by the user. 
     
     
         70 . The method of  claim 68 , wherein user data entry is performed while performing the medical procedure. 
     
     
         71 . The method of  claim 68 , wherein the script that is displayed reflects a current point of progress of the medical procedure, and further comprising receiving user input for displaying script reflecting an advanced point of progress of the medical procedure, or displaying script reflecting an earlier point of progress in the medical procedure, whereby a user may navigate through the script during the medical procedure. 
     
     
         72 . The method of  claim 66 , wherein the database contains electronic healthcare records of patients, and the data represented by the user input is healthcare information of a patient. 
     
     
         73 . The method of  claim 72 , further comprising selecting one or more protocols upon admission of a patient. 
     
     
         74 . The method of  claim 72 , further comprisingselecting one or more protocols upon diagnosis of a patient. 
     
     
         75 . The method of  claim 72 , further comprising selecting one or more protocols upon implementing a treatment plan for a patient. 
     
     
         76 . The method of  claim 66 , wherein recording the data for the task results in the initiation of a workflow for a subsequent task by a second user in accordance with the protocol. 
     
     
         77 . The method of  claim 76 , further comprising recording in the database, with the data represented by the user input, a timestamp, and wherein the workflow is triggered, based in part, on the recorded timestamp. 
     
     
         78 . The method of  claim 66 , wherein the protocol further comprising an additional script for performing a task by a second user, and wherein the method further comprises:
 (a) communicating the additional script to a second head-mountable electronic display device of the second user;   (b) displaying, on a display of the second head-mountable electronic display device, a user interface including the second script, the displayed second script including a user-selectable placeholder representative of data to be entered regarding an object of observation, intervention, or interaction by the second user;   (c) receiving a cue from the second user indicating selection of the displayed user-selectable placeholder, and based thereon, receiving subsequently thereto user input of the second user representing data for which the user-selectable placeholder is representative; and   (d) transmitting the received data represented by the user input of the second user to the computer system over a computer network for recording in the data record.   
     
     
         79 . The method of  claim 78 , wherein the additional script is communicated to the second head-mountable electronic display device of the second user after user data entry is performed by the first user, whereby the first task is performed by the first user before the second task is performed by the second user. 
     
     
         80 . The method of  claim 78 , the additional script is communicated to the second head-mountable electronic display device of the second user while the first task is performed by the first user, whereby the first task and the second task are performed in parallel. 
     
     
         81 . The method of  claim 80 , wherein the database contains electronic healthcare records of patients, and where the data represented by the user input of the second user is healthcare information of a patient, whereby an electronic healthcare record is concurrently updated in real time by multiple users. 
     
     
         82 . The method of  claim 78 , wherein the protocol coordinates tasks of the first and second user so as to avoid redundant actions that are unnecessary. 
     
     
         83 . The method of  claim 66 , further comprising taking sequential still images of the object of observation, interaction, or intervention with a camera of the head-mountable electronic display device for documenting the observation, interaction, or intervention during performance of the task of the protocol. 
     
     
         84 . The method of  claim 83 , further comprising recording the still images in the data record. 
     
     
         85 . The method of  claim 66 , further comprising taking video of the object of observation, interaction, or intervention with a camera of the head-mountable electronic display device for documenting the observation, interaction, or intervention, and streaming the video from the head-mountable electronic display device during performance of the task of the protocol. 
     
     
         86 . The method of  claim 85 , further comprising recording the video in the data record. 
     
     
         87 . The method of  claim 85 , wherein the video is of the object of observation, interaction, or intervention as seen by the first user, including that which is displayed by the head-mountable electronic display device. 
     
     
         88 . A method for performing user data entry, comprising:
 (a) authenticating a first user to enter data using an apparatus for performing data entry by the first user, the apparatus comprising, a head-mountable electronic display device configured to be attached to a user's head and comprising a display for viewing by the user information displayed thereon; and a hand-operated wireless peripheral electronic device configured to be used in combination with the first electronic device and comprising at least one user input area for receiving user input via a hand of the user, wherein the head-mountable electronic display device and the hand-operated wireless peripheral electronic device are configured to wirelessly communicate with each other, at least some of the wireless communications representing user input by the user for interfacing with a user interface displayed to the user on the display of the head-mountable electronic display device, such that data entry is accomplished by the user regardingan object of observation, intervention, or interaction by the user, and wherein the head-mountable electronic display device is configured to wirelessly transmit data entered by the user to a computer system over a computer network for recording in a data record; and   (b) after a successful authentication of the first user to enter data using the apparatus, facilitating user data entry by the first user by:
 (i) displaying, on the display of the head-mountable electronic display device, a user interface including script, the displayed script including a user-selectable placeholder representative of data to be entered regarding an object of observation, intervention, or interaction by the user; 
 (ii) receiving a cue from the user indicating selection of the displayed user-selectable placeholder, and based thereon, receiving subsequently thereto user input representing data for which the user-selectable placeholder is representative; and 
 (iii) transmitting the received data represented by the user input to the computer system over a computer network for recording in the data record. 
   
     
     
         89 . The method of  claim 88 , wherein the hand-operated wireless peripheral electronic device is configured to be attached to a user's arm.