Display device and control method thereof, gesture recognition method, and head-mounted display device

Abstract

The present invention provides a display device and a control method thereof, a gesture recognition method and a head-mounted display device. The display device of the present invention comprises a display unit, an open type head-mounted display, an image acquisition unit and a gesture recognition unit. The control method thereof comprises steps of: providing, by the open type head-mounted display, a virtual 3D control picture to a user; acquiring, by the image acquisition unit, an image of action of touching the virtual 3D control picture by the user; judging, by the gesture recognition unit, a touch position of the user in the virtual 3D control picture according to the image acquired by the image acquisition unit, and sending a control instruction corresponding to the touch position to a corresponding execution unit. The present invention may be used for controlling a display device.

The invention claimed is: 
     
       1. A control method of a display device, wherein the display device comprises a display, an open type head-mounted display, a camera and a gesture recognition processor, both the camera and the gesture recognition processor are provided on the open type head-mounted display, the control method of the display device comprises steps of: providing, by the open type head-mounted display, a virtual 3D control picture to a user distance from the virtual 3D control picture to eyes of the user is a first distance, the first distance is less than a distance from the display to the eyes of the user, and the virtual 3D control picture is located on an edge or a corner of the display; acquiring, by the camera, an image of action of touching the virtual 3D control picture by the user, and transmitting the image acquired by the camera to the gesture recognition processor in a wired manner; judging, by the gesture recognition processor, a touch position of the user in the virtual 3D control picture according to the image acquired by the camera, and sending a control instruction corresponding to the touch position to a corresponding executor in a wireless manner; and displaying, by the display, a conventional picture to avow the user to watch, wherein the virtual 3D control picture is different from the conventional picture, the virtual 3D control picture is a picture used for control operations of the display device, and in a case where the operations of the display device is controlled by the user, the display stops displaying so that only the virtual 3D control picture is watched by the user. 
     
     
       2. The control method of a display device according to  claim 1 , wherein
 a distance from the virtual 3D control picture to eyes of the user is a first distance, and the first distance is less than or equal to 0.5 m but greater than or equal to 0.25 m. 
 
     
     
       3. The control method of a display device according to  claim 1 , wherein
 the virtual 3D control picture is divided into at least two regions, each of which corresponds to one control instruction. 
 
     
     
       4. The control method of a display device according to  claim 1 , wherein
 the step of judging, by the gesture recognition processor, a touch position of the user in the virtual 3D control picture according to the image acquired by the camera comprises: judging, by the gesture recognition processor, a touch position of the user in the virtual 3D control picture according to position of a hand of the user in the image acquired by the camera. 
 
     
     
       5. A display device, comprising a display, an open type head-mounted display, a camera, and a gesture recognition processor, both the camera and the gesture recognition processor are provided on the open type head-mounted display, wherein the display is configured to perform display; the open type head-mounted display is configured to provide a virtual 3D control picture to a user, a distance from the virtual 3D control picture to eyes of the user is a first distance, the first distance is less than a distance from the display to the eyes of the user, and the virtual 3D control picture is located on an edge or a corner of the display; the camera is configured to acquire an image of action of touching the virtual 3D control picture by the user and transmit the acquired image to the gesture recognition processor in a wired manner; the gesture recognition processor is configured to judge a touch position of the user in the virtual 3D control picture according to the image acquired by the camera and send a control instruction corresponding to the touch position to a corresponding executor in a wireless manner; and the display is configured to display a conventional picture to allow the user to watch, wherein the virtual 3D control picture is different from the conventional picture, the virtual 3D control picture is a picture used for control operations of the display device, and in a case where the operations of the display device is controlled by the user, the display stops displaying so that only the virtual 3D control picture is watched by the user. 
     
     
       6. The display device according to  claim 5 , further comprising:
 a wireless communication unit connected to the display and the open type head-mounted display, respectively, and configured to perform information interaction between the display and the open type head-mounted display. 
 
     
     
       7. The display device according to  claim 5 , wherein
 the gesture recognition processor is configured to judge a touch position of the user in the virtual 3D control picture according to position of a hand of the user in the image acquired by the camera.