Rapid prototyping and machine vision for reconfigurable interfaces

Abstract

A system and method including software to aid in generation of panels and control instruments rapidly generates a station that can support a variety of control interfaces. Rapid-Prototyped Panels, or RP-Panels, replicate existing systems (for simulation, training, gaming, etc.) or from new designs (for human factors testing, as functional product, etc.). The controls have tactile and visual characteristics similar or identical to their functional component counterparts such as buttons, knobs, switches, pedals, joysticks, steering wheels, and touch panels but are modular and use alternative data transfer modes (potentiometers, fiber optics, RFID, machine vision, etc.) to track and analyze the response of the controls. The response is then transmitted to the host programs. With this method a user can design and fabricate a reconfigurable interface to interact with virtual environments for various applications such as simulation, training, virtual instrumentation, gaming, human factors testing, etc.

We claim:  
     
         1 . A reconfigurable human-machine interface, comprising:
 a plurality of user-input devices fabricated with a rapid prototyping technology;   a scaffold having a plurality of locations configured to receive the user-input devices;   at least one video camera having a field of view including the scaffold and the user-input devices;   wherein the camera optically determines the interaction between a user and the user-input devices, thereby controlling a machine without the need for wiring between the user-input devices and the machine.   
     
     
         2 . The reconfigurable human-machine interface of  claim 1 , wherein:
 the scaffold and user-input devices form a touch panel; and   one or more cameras are used to determine where a user touches the panel.   
     
     
         3 . The reconfigurable human-machine interface of  claim 1 , wherein at least some of the user input devices include physical features that are sized, shaped or composed to simulate the controls of a particular machine. 
     
     
         4 . The reconfigurable human-machine interface of  claim 3 , wherein:
 the particular machine is an aircraft; and   the controls simulate a cockpit.   
     
     
         5 . The reconfigurable human-machine interface of  claim 1 , wherein the user-input devices snap into the scaffold at different locations. 
     
     
         6 . The reconfigurable human-machine interface of  claim 1 , wherein the user-input devices are buttons, knobs, switches, pedals, joysticks, or steering wheels. 
     
     
         7 . The reconfigurable human-machine interface of  claim 1 , wherein at least some of the user input devices are fabricated to provide a desired haptic response. 
     
     
         8 . The reconfigurable human-machine interface of  claim 1 , wherein:
 the user-input device is a pushbutton; and   the desired haptic response includes the depth of travel or the stiffness of the pushbutton.   
     
     
         9 . The reconfigurable human-machine interface of  claim 1 , wherein the rapid prototyping technology includes Stereolithography (SLA); Photopolymer Laminated Object Manufacturing (LOM), or 3D Printing (3DP).