JP2017099608A - Control system and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an operation method of an object in a game, which is suitable to the case where two controllers which are for a right hand and for a left hand, are used.SOLUTION: A control system comprises: a controller for a right hand which is gripped by a right hand of a user; a controller for a left hand which is gripped by a left hand of the user; detection means for detecting orientations of the controller for a right hand and the controller for a left hand, and detecting positions of the controller for a right hand and the controller for a left hand; determination means for determining relative orientations of the controller for a right hand and the controller for a left hand on the basis of the detection result of the orientations, and determining relative positions of the controller for a right hand and the controller for a left hand on the basis of the detection result of the positions; and control means for, based on the relative orientations of the controller for a right hand and the controller for a left hand, and the relative positions of the controller for a right hand and the controller for a left hand, controlling movement of an operation target object.SELECTED DRAWING: Figure 6

Description

  The present invention relates to a control system and a program. The present invention particularly relates to controlling the movement of an object in a computer game using a controller.

  A game device is known in which a computer game player can operate an object (for example, a car or a human character) in a game by tilting two controllers for right hand and left hand to the left and right (for example, Patent Documents). 1, Patent Document 2 and Non-Patent Document 1).

JP 2011-030709 A JP 2013-013739 A

“Oculus Touch”, [online], [October 14, 2015 search], Internet <https://www.oculus.com/en-us/rift/#oculus-touch>

  In view of the prior art as described above, one of the objects of the present invention is to provide a method for operating an in-game object that is suitable when two controllers for right hand and left hand are used.

  In order to solve the above-described problems, an embodiment of the present invention includes a right-hand controller that is gripped by a user's right hand, a left-hand controller that is gripped by the user's left hand, the orientation of the right-hand controller, and the left hand. Detecting means for detecting the orientation of the right-hand controller and detecting the position of the right-hand controller and the position of the left-hand controller, respectively, and the relative relationship between the right-hand controller and the left-hand controller based on the detection result of the orientation. Determination means for determining a relative position between the right-hand controller and the left-hand controller based on the position detection result, and a relative position between the right-hand controller and the left-hand controller. Orientation and the relative position of the right hand controller and the left hand controller. And control means for controlling the movement of the operation target object have been, a control system comprising a.

  According to another aspect of the present invention, the computer detects a direction of a right-hand controller gripped by a user's right hand and a direction of a left-hand controller gripped by the user's left hand, respectively, Detecting a position of the controller and a position of the left-hand controller, determining a relative direction of the right-hand controller and the left-hand controller based on the detection result of the orientation, and a detection result of the position Determining a relative position of the right-hand controller and the left-hand controller based on: a relative orientation of the right-hand controller and the left-hand controller, and a relative position of the right-hand controller and the left-hand controller. Step to control the movement of the operation target object based on the specific position When a program for execution.

  According to the present invention, an object in a game can be operated using two controllers for a right hand and a left hand.

It is a hardware block diagram of the game system 100 which concerns on one Embodiment of this invention. 2 is a diagram illustrating an example of an outer shape of a controller 300. FIG. It is a block diagram which shows the functional structure of the game machine 200 which concerns on one Embodiment of this invention. It is a figure which shows the 1st example of control of the motion of the operation target object. It is a figure which shows the 2nd example of control of a motion of the operation target object. It is a figure which shows the 3rd example of control of the motion of the operation target object. It is a flowchart which shows the process sequence of the game machine 200 which concerns on one Embodiment of this invention.

[Description of Embodiment of the Present Invention]
First, the contents of the embodiment of the present invention will be listed and described. One embodiment of the present invention has the following configuration.

  (Item 1) A right-hand controller gripped by the user's right hand, a left-hand controller gripped by the user's left hand, the orientation of the right-hand controller and the orientation of the left-hand controller, and the right hand Detecting means for detecting the position of the controller for the left hand and the position of the controller for the left hand, respectively, determining the relative orientation of the controller for the right hand and the controller for the left hand based on the detection result of the orientation, and detecting the position Determination means for determining a relative position between the right-hand controller and the left-hand controller based on a result, a relative orientation between the right-hand controller and the left-hand controller, and the right-hand controller and the left-hand controller Control the movement of the operation target object based on the relative position of Control system comprising a controller, the that.

  (Item 2) When the right-hand controller and the left-hand controller are tilted to the right with respect to the user, and the right-hand controller is disposed below the left-hand controller, the control means is The control is performed to move the operation target object in the right direction, the right-hand controller and the left-hand controller are tilted to the left with respect to the user, and the right-hand controller is located above the left-hand controller. Item 2. The control system according to Item 1, wherein when arranged, the control target object is controlled to move leftward.

  (Item 3) In the control means, the right-hand controller and the left-hand controller are tilted to the right with respect to the user, and the right-hand controller and the left-hand controller move clockwise on the same circumference. The right-hand controller and the left-hand controller are tilted to the left with respect to the user, and the right-hand controller and the left-hand controller are moved to the right. Item 3. The control system according to Item 2, wherein when the controller is moved counterclockwise on the same circumference, the operation target object is controlled to move leftward.

  (Item 4) The control means, when the right-hand controller and the left-hand controller are tilted in different directions with respect to the user, causes a change in the movement in the front-rear direction of the operation target object. The control system according to any one of 1 to 3.

  (Item 5) The operation target object is an object that can be steered by the user in a computer game, and the control means controls the movement of the operation target object with respect to the right hand controller and the left hand. 7. The control system according to any one of items 1 to 6, which is a process of generating an image of a computer game so as to move in the computer game in accordance with a relative orientation and a relative position of the controller.

  (Item 6) The control system according to item 5, further comprising: a head mounted display worn by the user; and an image output means for outputting an image of the computer game to the head mounted display.

(Item 7) The control system according to any one of Items 1 to 6, wherein at least one of the right-hand controller and the left-hand controller includes an operation button for invalidating control on the operation target object.
(Item 8) Any one of Items 1 to 7, wherein at least one of the right-hand controller and the left-hand controller includes an operation button for calibrating the orientation or position of the right-hand controller or the left-hand controller. The control system according to item 1.

  (Item 9) A step of detecting, in the computer, the orientation of the right-hand controller gripped by the user's right hand and the orientation of the left-hand controller gripped by the user's left hand, and the position of the right-hand controller and the left-hand controller Respectively detecting a position of the controller; determining a relative orientation of the right-hand controller and the left-hand controller based on the detection result of the orientation; and controlling the right-hand controller based on the detection result of the position And a step of determining a relative position of the left-hand controller, a relative orientation of the right-hand controller and the left-hand controller, and a relative position of the right-hand controller and the left-hand controller. Controlling the movement of the target object. Because of the program.

[Details of the embodiment of the present invention]
Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

  FIG. 1 is a hardware configuration diagram of a game system (control system) 100 according to an embodiment of the present invention. Game system 100 is configured to provide a gaming experience to user 160 by executing a computer game. This embodiment relates to controlling the movement of an object in a computer game in response to an instruction from a user 160. As illustrated, the game system 100 includes a game machine 200, a display device 120, a controller 300, and a tracking sensor 130. As an example, the game machine 200 and the display device 120 are electrically connected by a wired cable 150 and can communicate with each other. Instead of the wired cable 150, a wireless connection may be used. Similarly, the game machine 200 and the controller 300 and the game machine 200 and the tracking sensor 130 are also connected by wire or wirelessly.

  The game machine 200 is a device that generates game images and game sounds based on a computer game program. The game machine 200 includes at least a processor 202, a memory 204, and a peripheral device interface 206. The game machine 200 further includes, as other components, a network interface (not shown) for communicating with other devices via a network (for example, the Internet) and a user input for receiving an operation input to the game machine 200 from the user 160. An interface (eg, keyboard, mouse, etc.) (not shown) may be provided. The game machine 200 can be realized as, for example, a general-purpose personal computer, a tablet terminal, a smartphone, or the like, in addition to a game console dedicated to computer games.

  The memory 204 stores at least an operating system and a computer game program. The operating system is a computer program for controlling the overall operation of the game machine 200. The computer game program is a program for the game machine 200 to realize each function of game processing described later. The memory 204 may also store data generated by the operation of the game machine 200 temporarily or permanently. Specific examples of the memory 204 include a ROM (Read Only Memory), a RAM (Random Access Memory), a hard disk, a flash memory, and an optical disk.

  The processor 202 is configured to read a program stored in the memory 204 and execute processing according to the program. When the processor 202 executes a computer game program stored in the memory 204, each function of game processing described later is realized. The processor 202 includes a CPU (Central Processing Unit) and a GPU (Graphics Processing Unit).

  Peripheral device interface 206 provides game machine 200 with the ability to communicate with peripheral devices. As described above, the game machine 200 includes the display device 120, the controller 300, and the tracking sensor 130 as peripheral devices. The game machine 200 can transmit predetermined data to and from the display device 120, the controller 300, and the tracking sensor 130 via the peripheral device interface 206. Connection methods supported by the peripheral device interface 206 include wired connection and wireless connection.

  The display device 120 is a device for providing the user 160 with the game image generated in the game machine 200 as visual information. For example, the display device 120 may be configured as a head mounted display (hereinafter referred to as HMD) as shown in FIG. Alternatively, the display device 120 may be configured as a normal stationary display that is not an HMD.

  When the display device 120 is an HMD, the HMD 120 is mounted on the head of the user 160 so as to cover the field of view of the user 160 as illustrated. The HMD 120 includes a display 122 arranged in front of the user 160 wearing the HMD 120. The display 122 displays a game image sent from the game machine 200. The display 122 may be configured as a non-transmissive display, for example. In this case, the external scene of the HMD 120 is blocked from the view of the user 160 and only the game image displayed on the display 122 is delivered to the eyes of the user 160. The game image displayed on the display 122 of the HMD 120 may be an image representing a virtual reality space by a computer game, for example. The HMD 120 to which a non-transmissive display is applied as the display 122 can allow the user 160 to experience a feeling (immersive feeling) as if entering the virtual reality space of the computer game by using such a virtual reality space image.

  The HMD 120 is also a sensor (not shown) for detecting which direction the head of the user 160 wearing the HMD 120 is facing (for example, one of a magnetic sensor, an angular velocity sensor, an acceleration sensor, or a combination thereof). May be provided. The detected head orientation of the user 160 may be used to change the display image of the display 122 so as to follow the movement when the user 160 moves the head. Thereby, the feeling of immersion in the virtual reality space experienced by the user 160 can be further enhanced. The HMD 120 may further include a speaker (headphone) (not shown) for outputting game sound generated in the game machine 200.

  The controller 300 is a device used by the user 160 to control the movement of objects in a computer game. FIG. 2 is a diagram illustrating an example of the outer shape of the controller 300, and FIG. 2 will be referred to in the following description. The controller 300 includes a right-hand controller 320 that the user 160 uses with the right hand and a left-hand controller 330 that the user 160 uses with the left hand. The right hand controller 320 and the left hand controller 330 are configured as separate devices. Therefore, the user 160 can freely move the right hand holding the right hand controller 320 and the left hand holding the left hand controller 330 to each other. The right hand controller 320 and the left hand controller 330 each include an operation button 302, an infrared LED (Light Emitting Diode) 304, a sensor 306, and a transceiver 308. As will be described later, only one of the infrared LED 304 and the sensor 306 may be provided alternatively.

  The operation buttons 302 are a plurality of button groups configured to receive operation inputs from the user 160. For example, the operation button 302 includes a push button, a trigger button, and an analog stick. The push-type button is a button configured to be operated by an operation of pressing with a finger (for example, a thumb). For example, two push buttons 302 a and 302 b are provided on the top surface 322 of the right hand controller 320, and two push buttons 302 c and 302 d are provided on the top surface 332 of the left hand controller 330. The trigger type button is a button configured to be operated by an operation such as pulling a trigger with an index finger or a middle finger. For example, the right hand controller 320 is provided with a trigger button 302e on the front portion of the grip 324 and a trigger button 302f on the side surface portion of the grip 324, and the left hand controller 330 has a trigger type on the front portion of the grip 334. Trigger buttons 302h are provided on the side portions of the button 302g and the grip 334, respectively. The trigger buttons 302e, 302f, 302g, and 302h are assumed to be operated by the index finger of the right hand, the middle finger of the right hand, the index finger of the left hand, and the middle finger of the left hand, respectively. The analog stick is a stick-type button that can be operated by being tilted 360 degrees from a predetermined neutral position. For example, an analog stick 302 i is provided on the top surface 322 of the right-hand controller 320, and an analog stick 302 j is provided on the top surface 332 of the left-hand controller 330. The analog sticks 302i and 302j are assumed to be operated using the thumbs of the right hand and the left hand, respectively.

  The right-hand controller 320 and the left-hand controller 330 each have a frame 326 extending from both sides of the grips (324 and 334) in a direction opposite to the top surface (322 and 332) to form a semicircular ring, 336. A plurality of infrared LEDs 304 are embedded on the outer surfaces of the frames 326 and 336. For example, a plurality of (for example, about 10) infrared LEDs 304 are provided in a line along the circumferential direction of the frames 326 and 336. A plurality of rows (for example, two rows) of infrared LEDs 304 may be arranged along the circumferential direction of the frames 326 and 336. When the user 160 grips the controller 300, the user's 160 finger is between the grip (324 or 334) and the frame (326 or 336). Therefore, the infrared LEDs 304 arranged on the outer surfaces of the frames 326 and 336 are not covered by the user's 160 hand or finger. In addition to the outer surfaces of the frames 326 and 336, the infrared LEDs 304 may be embedded in portions of the surfaces of the grips 324 and 334 that are not hidden by the finger of the user 160. These infrared LEDs 304 emit infrared light while playing a computer game. Infrared light emitted from the infrared LED 304 can be used to detect the positions and postures (tilt and orientation) of the right-hand controller 320 and the left-hand controller 330.

  In order to enable detection of the position and orientation of each controller 320, 330, the right hand controller 320 and the left hand controller 330 incorporate a sensor 306 instead of or in addition to the infrared LED 304. For example, the sensor 306 may be a magnetic sensor, an angular velocity sensor, an acceleration sensor, or a combination thereof. The sensor 306 outputs a value (magnetism, angular velocity, or acceleration value) according to the direction and movement of each controller 320, 330 when the user 160 moves the controller 320, 330 with the right hand and the left hand, respectively. To do. By processing the output value from the sensor 306 by an appropriate method, the positions and postures of the right-hand controller 320 and the left-hand controller 330 can be detected.

  The transceiver 308 is configured to transmit and receive data between the controllers 320 and 330 and the game machine 200. For example, the transceiver 308 transmits data based on the operation input given to the controller by the user 160 via the operation button 302 to the game machine 200. Further, the transceiver 308 receives a command for instructing the controller to emit the infrared LED 304 from the game machine 200. Furthermore, the transceiver 308 transmits data corresponding to various values detected by the sensor 306 to the game machine 200. In addition to transmission / reception of these data, when each controller includes a vibrator for transmitting tactile feedback by vibration to the user's 160 hand, the transceiver 308 receives a command for causing the vibrator to perform tactile feedback from the game machine 200. It is good to do. The transceiver 308 is preferably configured to transmit and receive data via wireless communication so that the user 160 can freely move the hand holding each controller 320, 330.

  The tracking sensor 130 is a device that detects the infrared light emitted from the infrared LEDs 304 of the right-hand controller 320 and the left-hand controller 330 and tracks the movement of each controller. For example, the tracking sensor 130 may be configured as an infrared camera that captures an image in the infrared wavelength region, and may transmit the captured image data to the game machine 200. The image picked up by the infrared camera is a bright and dark image reflecting the arrangement of a large number of infrared LEDs 304 embedded in the surfaces of the controllers 320 and 330. Based on this bright and dark image, the respective positions and postures (tilt and orientation) of the right hand controller 320 and the left hand controller 330 are detected. As an example, a plurality of infrared LEDs 304 are arranged in a row on the frames 326 and 336 of each controller. The position and orientation of each controller can be detected by identifying the arrangement of bright spots corresponding to this one row of infrared LEDs 304 in the image captured by the infrared camera.

  FIG. 3 is a block diagram showing a functional configuration of the game machine 200 according to the embodiment of the present invention. The game machine 200 includes a storage unit 220 and a processing unit 230. The processing unit 230 further includes a controller detection unit (detection unit) 231, a controller relative determination unit (determination unit) 232, an image generation unit (control unit) 233, and an image output unit 234. The storage unit 220 corresponds to the memory 204 shown in FIG. The processing unit 230 and the units 231 to 234 included in the processing unit 230 are game processes according to the present invention realized by the processor 202 shown in FIG. 1 reading out and executing the computer game program in the memory 204. Represents a function.

  The controller detection unit 231 detects the postures (tilt and orientation) of the right hand controller 320 and the left hand controller 330. For example, the right-hand controller 320 and the left-hand controller 330 are held at home positions in which the top surfaces 322 and 332 are horizontally oriented in an initial state such as when a computer game is started. When the computer game is started, the user 160 tilts the right-hand controller 320 and the left-hand controller 330 in various directions in order to control the movement of the object in the computer game. As an example, the computer game may be a racing game that runs on a circuit in a racing car. In this case, the operation target object is a racing car. For example, the user 160 may tilt both the right-hand controller 320 and the left-hand controller 330 to the right in order to turn the traveling direction of the racing car to the right. Also, the user 160 may tilt both the right hand controller 320 and the left hand controller 330 to the left in order to turn the traveling direction of the racing car to the left.

  The controller detection unit 231 detects the inclination of each of the controllers 320 and 330 separately. For example, the controller detection unit 231 may use captured image data received from the tracking sensor (infrared camera) 130. The controller detection unit 231 identifies a bright point in the captured image. As described above, the bright point in the image captured by the infrared camera corresponds to the infrared LED 304 provided on the controller. The controller detection unit 231 detects the posture of the right-hand controller 320 and the posture of the left-hand controller 330 based on the direction in which the identified plurality of bright spots are arranged in the captured image. As an example, a certain captured image may include a group of two bright spots separated from each other on the left and right. Of the two groups, the left group corresponds to the infrared LED 304 of the right hand controller 320 that the user 160 has with the right hand, and the right group corresponds to the infrared LED 304 of the left hand controller 330 that the user 160 has with the left hand. Will correspond. The controller detection unit 231 determines the posture (tilt, orientation) of the right-hand controller 320 from the direction in which the bright spots constituting the left group are arranged. For example, when the bright spots are arranged in the horizontal direction (that is, in the horizontal direction) in the captured image, the right hand controller 320 may determine that the frame 326 is in a posture in which it is held horizontally. Further, for example, when the direction in which the bright spots are arranged in the captured image is inclined by a certain angle from the horizontal direction, the right-hand controller 320 determines that the frame 326 is in a posture inclined by the angle from the horizontal. It's okay. Similarly, the controller detection unit 231 determines the posture (tilt and orientation) of the left-hand controller 330 from the direction in which the bright spots constituting the right group are arranged.

  The controller detection unit 231 may use detection data of the sensor 306 received from each of the controllers 320 and 330 instead of the captured image data from the tracking sensor 130 for detecting the posture of each controller. For example, the three-axis angular velocity sensor (sensor 306) of the right-hand controller 320 detects rotations about the three orthogonal axes of the right-hand controller 320. Based on this detection data, the controller detection unit 231 determines how much the right-hand controller 320 has rotated in which direction, and further accumulates the sequentially determined rotation direction and rotation amount to thereby determine the right-hand controller. 320 postures may be calculated. Similarly, the controller detection unit 231 may calculate the attitude of the left-hand controller 330 using detection data from the triaxial angular velocity sensor of the left-hand controller 330. The controller detection unit 231 may use detection data from, for example, a triaxial magnetic sensor and / or a triaxial acceleration sensor in addition to the detection data of the triaxial angular velocity sensor.

  The controller detection unit 231 further detects the positions of the right-hand controller 320 and the left-hand controller 330. For example, in order to operate a racing car in a computer game, the user 160 may change the positions of the controllers 320 and 330 in addition to the operation of tilting the controllers to the right and left. As an example, the user 160 rotates the right hand and the left hand holding the controllers 320 and 330 clockwise or counterclockwise by an operation such as turning the steering wheel of an actual car. The controller detection unit 231, for example, for the right hand held by the user 160 by identifying a bright point (infrared LED 304) in the captured image acquired from the tracking sensor 130 as in the above-described detection of the attitude of the controller. It may be detected where the controller 320 and the left-hand controller 330 are located. As an example, the controller detection unit 231 determines the position of the center of gravity of a plurality of bright points constituting the left group of two bright point groups identified from the captured image as the position of the right-hand controller 320, The position of the center of gravity of a plurality of bright spots constituting the right group may be determined as the position of the left-hand controller 330. Or the controller detection part 231 is good also as detecting the position of each controller 320,330 using the detection data by the sensor 306 (for example, acceleration sensor) of each controller 320,330.

  The controller relative determination unit 232 determines the relative orientations of the right hand controller 320 and the left hand controller 330 based on the respective postures of the right hand controller 320 and the left hand controller 330 detected by the controller detection unit 231. For example, the controller relative determination unit 232 determines whether the right-hand controller 320 and the left-hand controller 330 are tilted in the same direction as viewed from the user 160 or in different directions as viewed from the user 160. The case of being tilted in the same direction includes the case where both the right-hand controller 320 and the left-hand controller 330 are tilted to the right and the case where both are tilted to the left. The degree of tilting the two controllers 320 and 330 in the right or left direction may be the same angle or a different angle. When tilted in a different direction, one controller is tilted to the right and the other controller is tilted to the left.

  The controller relative determination unit 232 further determines the relative positions of the right hand controller 320 and the left hand controller 330 based on the respective positions of the right hand controller 320 and the left hand controller 330 detected by the controller detection unit 231. To do. For example, the controller relative determination unit 232 determines which of the right hand controller 320 and the left hand controller 330 is located above the other. Also, for example, the controller relative determination unit 232 rotates clockwise or counterclockwise so that the right-hand controller 320 and the left-hand controller 330 draw a circle while keeping the relative distance between each other constant (by turning the handle). It is good also as determining whether it moved.

  The image generation unit 233 generates a game image of a computer game. For example, the image generation unit 233 acquires predetermined data from the storage unit 220, and generates a game image by computer graphics processing based on the acquired data. An example of the game image is a race game image. The race game image includes an operation target racing car (operation target object) that is a target to be operated by the user 160 in the race game, another racing car that is running on the course while competing with the operation target racing car for the race order, Including road surface and surrounding scenery. The race game image may further include display of various types of information for assisting the user 160 in running the race, such as a running speed of the operation target racing car and a course map displaying the current position. As an example other than the racing game, the game image may be, for example, an image of a flight simulation game in which an aircraft is operated. In this case, the aircraft is the operation target object. As yet another example, a game character (avatar) operated by the user 160 in the computer game may be set as the operation target object.

  The image generation unit 233 controls the movement of the operation target object in the game image based on the relative orientations of the right hand controller 320 and the left hand controller 330 determined by the controller relative determination unit 232. In other words, the image generation unit 233 generates a game image so that the operation target object moves in the computer game according to the relative orientations of the right-hand controller 320 and the left-hand controller 330. The generated game image is output to the display device 120 via the image output unit 234 and displayed on the display device 120.

  FIG. 4 shows a first example of control of the movement of the operation target object. In FIG. 4A, the right hand controller 320 is tilted to the right at a certain angle as viewed from the user 160, and the left hand controller 330 is also tilted to the right at the same angle. The positions of the right-hand controller 320 and the left-hand controller 330 are on the horizontal line 450 that is the initial position. This example represents a case where the user 160 changes only the inclinations to the right without moving the positions of the controllers 320 and 330. When the right-hand controller 320 and the left-hand controller 330 are in such a relative orientation, the image generation unit 233 causes the operation target object (for example, a racing car) to proceed to the right in a computer game (for example, a racing game). Generate a game image to go.

  In FIG. 4B, the right-hand controller 320 is tilted leftward at an angle as viewed from the user 160, and the left-hand controller 330 is tilted leftward at the same angle. The right hand controller 320 and the left hand controller 330 are in the initial positions (on the horizontal line 450). This example represents a case where the user 160 changes only the inclination to the left without moving the positions of the controllers 320 and 330. When the right-hand controller 320 and the left-hand controller 330 are in such a relative orientation, the image generation unit 233 generates a game image in which the operation target object progresses leftward in the computer game.

  In FIG. 4C, the right hand controller 320 is tilted to the left at a certain angle when viewed from the user 160, and the left hand controller 330 is tilted to the opposite (right) direction at a certain angle. The right hand controller 320 and the left hand controller 330 are in the initial positions (on the horizontal line 450). This example represents a case where the user 160 changes only the inclination in different directions without moving the positions of the controllers 320 and 330. When the right-hand controller 320 and the left-hand controller 330 are in such a relative orientation, the image generation unit 233 changes the speed of movement of the operation target object in the computer game (for example, acceleration or deceleration of the racing car ( A game image that includes a stop) is generated.

  4A and 4B, the angle at which the right-hand controller 320 is tilted to the right or left and the angle at which the left-hand controller 330 is tilted to the right or left are different angles. It may be. That is, the two controllers 320 and 330 that are tilted rightward or leftward are not necessarily held parallel to each other. Further, in the example of FIG. 4C, the two controllers 320 and 330 are tilted in the opposite directions (that is, the right-hand controller 320 is moved to the right and the left-hand controller 330 is moved to the left). There may be. Further, in the example of FIG. 4C, when the right-hand controller 320 is tilted to the right and the left-hand controller 330 is tilted to the left, the operation target object is accelerated. On the contrary, the right-hand controller The operation target object may be decelerated when 320 is tilted to the left and the left hand controller 330 is tilted to the right.

  In this manner, the user 160 can move the operation target object in the computer game to the right or left by the operation of tilting the right hand controller 320 and the left hand controller 330 in the same direction. Further, the user 160 can adjust the moving speed of the operation target object in the computer game by tilting the right hand controller 320 and the left hand controller 330 in different directions.

  FIG. 5 shows a second example of the movement control of the operation target object. In FIG. 5A, the right-hand controller 320 is tilted to the right by an angle as viewed from the user 160, and the left-hand controller 330 is also tilted to the right by the same angle. Further, the right hand controller 320 is at a position below the horizontal line 550 which is the initial position, and the left hand controller 330 is at a position above the horizontal line 550. In this example, the user 160 moves the position downward and upward while tilting the controllers 320 and 330 to the right. When the right-hand controller 320 and the left-hand controller 330 are in such relative orientation and relative position, the image generation unit 233 generates a game image in which the operation target object progresses in the right direction in the computer game. To do.

  In FIG. 5B, the right hand controller 320 is tilted to the left at an angle as viewed from the user 160, and the left hand controller 330 is also tilted to the left at the same angle. Furthermore, the right hand controller 320 is at a position above the initial position (horizontal line 550), and the left hand controller 330 is at a position below the initial position. This example represents a case where the user 160 moves the positions upward and downward while tilting the controllers 320 and 330 to the left. When the right-hand controller 320 and the left-hand controller 330 are in such a relative orientation and relative position, the image generation unit 233 generates a game image in which the operation target object proceeds to the left in the computer game. To do.

  FIG. 6 shows a third example of control of the movement of the operation target object. In FIG. 6A, the right hand controller 320 is tilted to the right at a certain angle as viewed from the user 160, and the left hand controller 330 is also tilted to the right at the same angle. Further, the right hand controller 320 is in a position rotated by a distance clockwise from the initial position 620 on the circumference 660 along the circumference 660, and the left hand controller 330 is arranged along the same circumference 660. It is at a position rotated from the initial position 630 on the circumference 660 by the same distance in the same rotational direction (clockwise). This example represents a case where the position and orientation of each of the controllers 320 and 330 are changed by an operation in which the user 160 turns an actual vehicle steering wheel clockwise. When the right hand controller 320 and the left hand controller 330 are moved to such a relative orientation and relative position, the image generation unit 233 displays a game image in which the operation target object progresses in the right direction in the computer game. Is generated.

  In FIG. 6B, the right hand controller 320 is tilted leftward at an angle as viewed from the user 160, and the left hand controller 330 is tilted leftward at the same angle. Furthermore, the right-hand controller 320 is in a position rotated by a distance counterclockwise from the initial position 620 on the circumference 660 along the circumference 660, and the left-hand controller 330 is arranged along the same circumference 660. It is at a position rotated from the initial position 630 on the circumference 660 by the same distance in the same rotational direction (counterclockwise). This example represents a case where the position and orientation of the controllers 320 and 330 are changed by an operation in which the user 160 turns the steering wheel of an actual automobile counterclockwise. When the right hand controller 320 and the left hand controller 330 are moved to such a relative orientation and relative position, the image generation unit 233 displays a game image in which the operation target object progresses leftward in the computer game. Is generated.

  As described above, in the third example, the user 160 moves the right hand that holds the right hand controller 320 and the left hand that holds the left hand controller 330 as if they were an actual handle operation. Can be moved to the right or left. In the second example, the movement of the right-hand controller 320 and the left-hand controller 330 does not draw an accurate circle, but the user 160 moves the operation target object to the right or left even in such a motion. Can do.

  FIG. 7 is a flowchart showing a processing procedure of the game machine 200 according to the embodiment of the present invention. This flowchart represents a process in which the game machine 200 generates a one-frame game image. When the process from the beginning (step S1) to the end (step S5) of the flowchart is completed, a game image is generated for one frame, and then the same from the beginning of the flowchart again to generate the next frame of the game image. The process is repeated.

  In step S <b> 1, captured image data captured by the tracking sensor 130 or detection data detected by the sensors 306 of the right-hand controller 320 and the left-hand controller 330 is received by the game machine 200.

  In step S <b> 2, the controller detection unit 231 detects the postures of the right-hand controller 320 and the left-hand controller 330 based on the received captured image data or detection data. The controller detection unit 231 may further detect the positions of the right-hand controller 320 and the left-hand controller 330 based on the captured image data or the detection data.

  In step S <b> 3, the controller relative determination unit 232 determines the relative orientations of the right hand controller 320 and the left hand controller 330 based on the respective postures of the right hand controller 320 and the left hand controller 330. The controller relative determination unit 232 may further determine the relative positions of the right hand controller 320 and the left hand controller 330.

  In step S <b> 4, the image generation unit 233 determines whether the right hand controller 320 and the left hand controller 330 are based on the relative orientation or both the relative orientation and the relative position of the right hand controller 320 and the left hand controller 330. Based on the above, a game image in which the operation target object in the game image moves is generated.

  In step S <b> 5, the image output unit 234 outputs the generated game image to the display device (for example, the HMD) 120. Thus, a game image in which the movement of the operation target object in the computer game is controlled by the right-hand controller 320 and the left-hand controller 330 is displayed on the display device 120. The user 160 can move the operation target object in the computer game by tilting the right hand controller 320 held in the right hand and the left hand controller 330 held in the left hand to the right or left, respectively.

  As mentioned above, although embodiment of this invention was described, this invention is not limited to this, A various change is possible within the range which does not deviate from the summary.

  For example, any one of the operation buttons 302 is assigned as a “control off button”, and the operation target object is controlled based on the movement of the right hand controller 320 and the left hand controller 330 while the control off button is pressed. It may not be performed. As an example, the image generation unit 233 may generate a game image in which the operation target object goes straight (regardless of the direction and position of the controllers 320 and 330) while the control off button is pressed. Thereby, the user 160 can perform various operations (for example, changing a game setting, operating a game menu, etc.) while playing a computer game. For example, the orientation and position of the right hand controller 320 and the left hand controller 330 may be calibrated when the user 160 releases his / her finger from the pressed control-off button. As an example, the controller detection unit 231 recognizes and stores the orientation and position of each controller 320 and 330 at the time when the control off button is released as a neutral position (home position), and thereafter the orientation of each controller 320 and 330. And the position may be identified with reference to the neutral position. If the user 160 takes a favorite posture (for example, a posture sitting on a chair, a posture leaning on the sofa and facing up slightly, a posture lying on the sofa and lying directly on the body), the calibration is performed. The orientation and position of each controller 320, 330 held in the hand in that posture is the neutral position. Thereby, the user 160 can play a computer game with various attitude | positions.

100 game system (control system)
DESCRIPTION OF SYMBOLS 120 Display apparatus 122 Display 130 Tracking sensor 200 Game machine 202 Processor 204 Memory 206 Peripheral device interface 220 Memory | storage part 230 Processing part 231 Controller detection part (detection means)
232 Controller relative determination unit (determination means)
233 Image generation unit (control means)
234 Image output unit 300 Controller 302 Operation button 304 Infrared LED
306 Sensor 308 Transceiver 320 Right-hand controller 330 Left-hand controller

Claims (9)

A right hand controller held by the user's right hand;
A left-hand controller held by the user's left hand;
Detecting means for detecting the orientation of the right-hand controller and the orientation of the left-hand controller, respectively, and detecting the position of the right-hand controller and the position of the left-hand controller, respectively;
A relative direction between the right hand controller and the left hand controller is determined based on the detection result of the orientation, and a relative position between the right hand controller and the left hand controller is determined based on the detection result of the position. Determination means for determining;
Control means for controlling the movement of the operation target object based on the relative orientation of the right hand controller and the left hand controller and the relative position of the right hand controller and the left hand controller;
A control system comprising:   When the right hand controller and the left hand controller are tilted to the right with respect to the user, and the right hand controller is arranged below the left hand controller, the control means is configured to operate the object to be operated. The right-hand controller and the left-hand controller are tilted to the left with respect to the user, and the right-hand controller is disposed above the left-hand controller. The control system according to claim 1, wherein control is performed so as to move the operation target object to the left.   The control means is provided when the right-hand controller and the left-hand controller are tilted to the right with respect to the user, and the right-hand controller and the left-hand controller are moved clockwise on the same circumference. The control is performed so that the operation target object is moved in the right direction, the right-hand controller and the left-hand controller are tilted leftward with respect to the user, and the right-hand controller and the left-hand controller are the same circle. The control system according to claim 2, wherein when the object is moved counterclockwise around the circumference, control is performed so that the operation target object is moved leftward.   The control means causes a change in the movement of the operation target object in the front-rear direction when the right-hand controller and the left-hand controller are tilted in different directions with respect to the user. The control system according to any one of the above. The operation target object is an object that can be operated by the user in a computer game,
Control of the movement of the operation target object by the control means is such that the operation target object moves in the computer game according to the relative orientation and relative position of the right hand controller and the left hand controller. Is a process of generating an image of
The control system according to any one of claims 1 to 4. A head mounted display worn by the user;
Image output means for outputting an image of the computer game to the head mounted display;
The control system according to claim 5, further comprising:   7. The control system according to claim 1, wherein at least one of the right-hand controller and the left-hand controller includes an operation button for invalidating control of the operation target object.   8. The apparatus according to claim 1, wherein at least one of the right-hand controller and the left-hand controller includes an operation button for calibrating the orientation or position of the right-hand controller or the left-hand controller. The described control system. On the computer,
Detecting the orientation of the right-hand controller gripped by the user's right hand and the orientation of the left-hand controller gripped by the user's left hand;
Detecting the position of the right-hand controller and the position of the left-hand controller, respectively.
Determining a relative orientation of the right-hand controller and the left-hand controller based on the detection result of the orientation;
Determining a relative position of the right hand controller and the left hand controller based on the detection result of the position;
Controlling the movement of the operation target object based on the relative orientation of the right-hand controller and the left-hand controller and the relative position of the right-hand controller and the left-hand controller;
A program for running

Images