Display system, control program for information processing device, and method for controlling information processing device

Abstract

A display system includes an HMD mounted on a head of a user, and a smartphone to which the HMD is coupled, and the smartphone includes a touch sensor that accepts a position input operation and detects coordinates of an operating position with reference to set coordinate axes, a magnetic sensor that detects an orientation of the touch sensor, and an adjustment unit that adjusts an orientation of the coordinate axes, based on a detection result of the magnetic sensor.

What is claimed is: 
     
       1. A display system comprising:
 a display device that is mounted on a user; and 
 an information processing device including:
 a position input unit that accepts a touch operation by the user; 
 a coupling portion that communicates with the display device; and 
 a processor that is configured to:
 determine whether the information processing device is communicating with the display device, 
 accept the touch operation as an input in a relative coordinate when the information processing device is determined to be communicating with the display device, and 
 accept the touch operation as an input in an absolute coordinate when the information processing device is determined not to be communicating with the display device, wherein 
 
 
 the display device includes an imaging sensor that detects a position of the information processing device, and 
 the processor is further configured to:
 adjust an orientation of the coordinate based on the position of the information processing device, 
 determine the position of the information processing device in a visual field of the user detected by the imaging sensor, 
 adjust the orientation of the coordinate when the information processing device is in the visual field of the user, and 
 regulate an adjustment of the orientation of the coordinate when the information processing device is not in the visual field of the user. 
 
 
     
     
       2. The display system according to  claim 1 , wherein
 the information processing device including a first sensor that detects an orientation of the position input unit, wherein 
 the processor is configured to adjust an orientation of the coordinate based on the orientation of the position input unit. 
 
     
     
       3. The display system according to  claim 2 , wherein
 the first sensor includes at least one of an acceleration sensor, a gyro sensor, and a geomagnetic sensor. 
 
     
     
       4. The display system according to  claim 1 , wherein
 the display device including:
 a display that displays an image, and 
 a second sensor that detects an orientation of the display 
 
 
       wherein
 the processor is configured to adjust an orientation of the coordinate based on the orientation of display. 
 
     
     
       5. The display system according to  claim 4 , wherein
 the second sensor includes at least one of an acceleration sensor, a gyro sensor, and a geomagnetic sensor. 
 
     
     
       6. The display system according to  claim 1 , wherein
 the processor is configured to adjust an orientation of the coordinate axis in a stepwise manner. 
 
     
     
       7. An information processing device communicating with a display device that is mounted on a user and detects a position of the information processing device, the information processing device comprising:
 a position input unit that accepts a touch operation by the user, and 
 a processor that is configured to:
 determine whether the information processing device is communicating with the display device, 
 accept the touch operation as an input in a relative coordinate when the information processing device is determined to be communicating with the display device, 
 accept the touch operation as an input in an absolute coordinate when the information processing device is determined not to be communicating with the display device, 
 adjust an orientation of the coordinate based on the position of the information processing device, 
 determine the position of the information processing device in a visual field of the user detected by an imaging sensor of the display device, 
 adjust the orientation of the coordinate when the information processing device is in the visual field of the user, and 
 regulate an adjustment of the orientation of the coordinate when the information processing device is not in the visual field of the user. 
 
 
     
     
       8. A method for controlling an information processing device communicating with a display device that is mounted on a user and detects a position of the information processing device, the method for controlling comprising:
 determining whether the information processing device is communicating with the display device, 
 accepting the touch operation as an input in a relative coordinate when the information processing device is determined to be communicating with the display device, 
 accepting the touch operation as an input in an absolute coordinate when the information processing device is determined not to be communicating with the display device, 
 adjusting an orientation of the coordinate based on the position of the information processing device, 
 determining the position of the information processing device in a visual field of the user detected by an imaging sensor of the display device, 
 adjusting the orientation of the coordinate when the information processing device is in the visual field of the user, and 
 regulating an adjustment of the orientation of the coordinate when the information processing device is not in the visual field of the user.