JP6623431B2 - Information processing apparatus, information processing apparatus program, head mounted display, and display system - Google Patents

Description

  The present invention relates to an information processing device, a program for the information processing device, a head-mounted display, and a display system.

  In recent years, a head mounted display (HMD) has been widely spread. The HMD is, for example, an image obtained by capturing a virtual space with a virtual camera and displaying a stereoscopic image or the like using binocular parallax on a display unit mounted on the user's head and provided in front of the user's eyes. It is displayed (for example, see Patent Document 1). In such an HMD, in general, the user can visually recognize various directions in the virtual space by changing the posture of the virtual camera in the virtual space based on the change in the posture of the HMD.

JP-A-2006-115122

  By the way, since the user wearing the HMD looks at the display unit provided in front of the user, it may be difficult to see parts other than the display unit. Therefore, for example, an operation of a controller or the like held in a hand may be burdensome for a user wearing the HMD. For this reason, for example, in a game using the HMD, it is preferable to receive various instructions from the user by changing the posture of the HMD so as not to place an excessive burden on the user wearing the HMD. However, when receiving an instruction from the user due to a change in the posture of the HMD, it is difficult to perform an operation other than a change in the posture of the virtual camera in the virtual space. For example, an operation such as a change in the position of the virtual camera in the virtual space is difficult. Sometimes it was difficult.

  The present invention has been made in view of the above-described circumstances, and provides a technology that enables an operation other than a change in the posture of a virtual camera in a virtual space to be performed by a change in the posture of an HMD. One.

  In order to solve the above problem, a program for an information processing device according to one embodiment of the present invention is a program for an information processing device including a processor, wherein the processor is an image obtained by capturing an image of a virtual space with a virtual camera. There is a display control unit that displays a stereoscopic image using binocular parallax on a display unit provided in a head-mounted display, and an acquisition unit that acquires posture information on the posture of the head-mounted display. The display control unit changes the position of the virtual camera in the virtual space, based on the posture information, about a virtual point set in the virtual space, and changes the position of the virtual camera in the virtual space. And a first control mode for changing the position of the virtual point in the virtual space based on the posture information. And a second control mode for changing the position of the virtual camera in the virtual space based on the posture information, and displaying images in a plurality of control modes. Switching the control mode from the first control mode to the second control mode when an amount of change in posture indicated by the posture information is equal to or more than a reference amount when displaying an image. It is characterized by.

FIG. 1 is an explanatory diagram illustrating an example of an outline of a head mounted display 1 according to an embodiment of the present invention. FIG. 4 is an explanatory diagram showing a usage example of the head mounted display 1. FIG. 4 is an explanatory diagram illustrating an example of a virtual space SP-V. FIG. 4 is an explanatory diagram illustrating an example of a virtual camera CM in a virtual space SP-V. FIG. 9 is an explanatory diagram illustrating an example of a display image GH. FIG. 9 is an explanatory diagram illustrating an example of a visual recognition image GS. FIG. 4 is an explanatory diagram illustrating an example of a virtual camera CM in a virtual space SP-V. FIG. 2 is a block diagram illustrating an example of a configuration of a terminal device 10. FIG. 2 is a block diagram illustrating an example of a hardware configuration of a terminal device 10. 5 is a flowchart illustrating an example of an operation of the terminal device 10. 5 is a flowchart illustrating an example of an operation of the terminal device 10. 5 is a flowchart illustrating an example of an operation of the terminal device 10. FIG. 9 is an explanatory diagram illustrating an example of an operation of the virtual camera CM in a normal control mode. FIG. 9 is an explanatory diagram illustrating an example of a visual recognition image GS. FIG. 9 is an explanatory diagram illustrating an example of an operation of the virtual camera CM in a posture control mode. FIG. 9 is an explanatory diagram illustrating an example of a visual recognition image GS. FIG. 9 is an explanatory diagram illustrating an example of an operation of the virtual camera CM in the position control mode. FIG. 9 is an explanatory diagram illustrating an example of a visual recognition image GS. 9 is a flowchart illustrating an example of an operation of the terminal device 10 according to Modification 1. 9 is a flowchart illustrating an example of an operation of the terminal device 10 according to Modification 1. FIG. 15 is a block diagram illustrating an example of a configuration of a display system SYS according to Modification 6.

  Hereinafter, embodiments for carrying out the present invention will be described with reference to the drawings. In each drawing, the size and scale of each part are appropriately different from actual ones. In addition, the embodiments described below are preferred specific examples of the present invention, and therefore, various technically preferable limitations are added. However, the scope of the present invention particularly limits the present invention in the following description. It is not limited to these forms unless otherwise stated.

[1. Embodiment]
Hereinafter, embodiments of the present invention will be described.

[1.1. Overview of head mounted display]
Hereinafter, an example of the outline of the head mounted display 1 (hereinafter, referred to as “HMD1”) according to the present embodiment will be described with reference to FIGS. 1 to 7.

  FIG. 1 is an exploded perspective view for explaining an example of the outline of the HMD 1 according to the present embodiment. FIG. 2 is an explanatory diagram illustrating an example of a usage image of the HMD 1 according to the embodiment.

As shown in FIG. 1, the HMD 1 according to the present embodiment includes a terminal device 10 and a mounting device 90.
The terminal device 10 includes a display unit 12 for displaying an image. In the present embodiment, a case where a smartphone is adopted as the terminal device 10 is assumed as an example. However, the terminal device 10 may be a dedicated display device provided in the HMD 1.

The mounting device 90 is a component for mounting the HMD 1 on the head of the user U, as shown in FIG.
As shown in FIG. 1, the mounting device 90 includes a pair of temples 91L and 91R for mounting the HMD1 on the head of the user U, a mounting hole 92 for mounting the terminal device 10 to the HMD1, and And a pair of through holes 92L and 92R provided so as to correspond to positions where both eyes of the user U are present when is mounted on the head. Note that a lens may be provided in each of the through holes 92L and 92R. Then, when the user U wears the HMD 1 on the head, the left eye of the user U is inserted into the mounting hole 92 via the through-hole 92L or via a lens provided in the mounting hole 92. The display unit 12 of the terminal device 10 can be visually recognized, and the right eye of the user U is inserted into the mounting hole 92 through the through hole 92R or through a lens provided in the through hole 92R. The display unit 12 of the terminal device 10 can be visually recognized.

As shown in FIG. 2, the user U wearing the HMD 1 on the head can change the posture of the HMD 1 by changing the posture of the head. For convenience of explanation, introducing device coordinate system sigma _S is a coordinate system fixed to the HMD 1.
The device coordinate system sigma _S, for example, has an origin at a predetermined position of the HMD 1, _{X S} axis orthogonal to each other, _{Y S} axis, and an orthogonal coordinate system of the three axes having a _{Z S} axis. In the present embodiment, as shown in FIG. 2, when the user U wearing the HMD 1, + X _S direction is the forward direction viewed from the user U, it becomes left direction + Y _S direction as viewed from the user U, + Z _S direction such that the upward direction as viewed from the user U, the case where the apparatus coordinate system sigma _S is set, it is assumed as an example.

As shown in FIG. 2, the user U wearing the HMD1 the head, by changing the posture of the head, the direction of rotation about X _S axis, i.e., as HMD1 in the roll direction Q _X rotates, it is possible to change the attitude of HMD1, the direction of rotation about _{Y S} axis, i.e., as HMD1 the pitch direction _{Q Y} is rotated, it is possible to change the attitude of HMD1, also, _{Z S} direction of rotation about the axis, i.e., as HMD1 in the yaw direction Q _Z is rotated, it is possible to change the attitude of HMD1. That is, the user U wearing the HMD1 the head, by changing the posture of the head, roll direction Q _X, the pitch direction Q _Y, and any rotation to synthesize some or all of the yaw direction Q _Z direction, i.e., so HMD1 is rotated in the rotating direction _{Q W} around any rotational axis _{W S,} it is possible to change the attitude of HMD1.

  The terminal device 10 captures an image of the virtual space SP-V with the virtual camera CM, which is a virtual camera existing in the virtual space SP-V, and displays a display image GH, which is an image showing the imaging result, on the display unit 12. Let it.

  FIG. 3 is an explanatory diagram for explaining the virtual space SP-V and the virtual camera CM.

In the present embodiment, as shown in FIG. 3, it is assumed as an example that a virtual character V (an example of a “predetermined object”) exists in the virtual space SP-V. Further, in the present embodiment, as shown in FIG. 3, as an example, a case where the virtual camera CM includes a left-eye virtual camera CM-L and a right-eye virtual camera CM-R is assumed.
In the following, for convenience of description, a virtual space coordinate system _ＶV , which is a coordinate system fixed to the virtual space SP-V, is introduced as shown in FIG. A virtual space coordinate system sigma _V, for example, has an origin at a predetermined position in the virtual space SP-V, X _V axes perpendicular to one another, Y _V axis, and, in the orthogonal coordinate system of the three axes having a Z _V axis is there.

4, the virtual space SP-V, when viewed in plan from the + Z _V direction is an explanatory view for explaining the positional relationship between the virtual camera CM and the character V. FIG. 4 illustrates a case where the virtual camera CM captures an image of the character V from the front of the character V.

Hereinafter, as shown in FIG. 4, the position of the virtual camera CM-L in the virtual space SP-V is referred to as a position PC-L, and the position of the virtual camera CM-R in the virtual space SP-V is referred to as a position PC-L. R, and the midpoint between the position PC-L and the position PC-R is referred to as a position PC.
In the following, as shown in FIG. 4, the optical axis direction of the virtual camera CM-L is referred to as an imaging direction LC-L, and the optical axis direction of the virtual camera CM-R is referred to as an imaging direction LC-R. The direction indicated by the sum of the vector indicating the imaging direction LC-L and the vector indicating the imaging direction LC-R is referred to as the imaging direction LC. In the present embodiment, it is assumed that the imaging direction LC-L and the imaging direction LC-R are the same direction. Therefore, in the present embodiment, the imaging direction LC is the same as the imaging direction LC-L and the imaging direction LC-R.
Note that a straight line that intersects the position PC and extends in the imaging direction LC is an example of a “reference straight line”.

  FIG. 5 is a diagram illustrating an example of a display image GH that is a result of capturing the virtual space SP-V by the virtual camera CM. In FIG. 5, it is assumed that the virtual camera CM captures an image of the character V from the front direction of the character V as shown in FIG.

As shown in FIG. 5, in the display unit 12, the imaging result by the virtual camera CM-L, for example, the virtual camera CM-L is provided in the left-eye viewing area 12 -L that can be visually recognized through the through hole 92 </ b> L. A character image GV-L as a result of capturing the character V is displayed. Further, in the right-eye viewing area 12-R, which can be viewed through the through-hole 92R, of the display unit 12, the result of imaging by the virtual camera CM-R, for example, the character V is imaged by the virtual camera CM-R. The resulting character image GV-R is displayed.
That is, the user U can visually recognize the character image GV-L with the left eye and can visually recognize the character image GV-R with the right eye. For this reason, as illustrated in FIG. 6, the user U visually recognizes a virtual object such as the character V existing in the virtual space SP-V as a three-dimensional three-dimensional object on the display unit 12. The image GS can be visually recognized.

In the following, a screen coordinate system _ＤD , which is a coordinate system fixed to the display unit 12, as shown in FIG. Here, the screen coordinate system _ＤD is a coordinate system for expressing a position in the display unit 12 when the user U is viewing the viewing image GS. More specifically, the screen coordinate system sigma _D, for example, has an origin at a predetermined position of the display unit 12, a two-axis orthogonal coordinate system having Y _D axis and Z _D axis orthogonal to each other. In the present embodiment, when the terminal device 10 is inserted into the mounting hole 92, Y _D axis and Y _S axis is parallel, also, it is assumed that Z _D axis and Z _S axis is parallel.
In the following, for the sake of convenience of description, as illustrated in FIG. 7, when describing the relative positional relationship between the virtual camera CM and the character V in the virtual space SP-V, two virtual cameras CM- L and CM-R are represented as one virtual camera CM. In the following, it is assumed that the position of the virtual camera CM in the virtual space SP-V is the position PC, and the optical axis direction of the virtual camera CM is the imaging direction LC.
In the following, for convenience of explanation, as shown in FIG. 7, to introduce the camera coordinate system sigma _C is a coordinate system fixed to the virtual camera CM in the virtual space SP-V. The camera coordinate system sigma _C, for example, has an origin at the position PC of the virtual camera CM of the virtual space SP-V, X _C axes perpendicular to one another, Y _C-axis, and, the three axes having a Z _C axis It is a rectangular coordinate system. In the present embodiment, as viewed from the user U wearing the HMD 1, a _{X C-axis X S} axis in the same direction, _{Y C} axis is the same direction as the _{Y S} axis, _{Z C} axis _{Z S} axis It is assumed as an example that the direction is the same as. That is, in this embodiment, X _C-axis, a case extending in the optical axis direction of the virtual camera CM, it is assumed as an example. In FIG. 7, is shown as position different origin of the camera coordinate system sigma _C and position PC, this is a on for convenience of illustration, the same is the origin and the position PC of the camera coordinate system sigma _C Position (the same applies to FIGS. 13, 15, and 17 described later).

[1.2. Configuration of Terminal Device]
Hereinafter, an example of the configuration of the terminal device 10 will be described with reference to FIGS. 8 and 9.

  FIG. 8 is a functional block diagram illustrating an example of the configuration of the terminal device 10.

  As illustrated in FIG. 8, the terminal device 10 includes a control unit 11 that controls each unit of the terminal device 10, a display unit 12 that displays an image, and an operation unit that receives an operation performed by the user U of the terminal device 10. 13, a posture information generation unit 14 that detects a posture change of the terminal device 10 and outputs posture information B indicating a detection result, and a storage unit 15 that stores various information including a control program PRG of the terminal device 10. Prepare.

In the present embodiment, for example, a three-axis angular velocity sensor 1002 (see FIG. 9) is employed as the posture information generation unit 14. Specifically, the posture information generation unit 14 includes an X-axis angular velocity sensor for detecting a change in the attitude of the roll direction Q _X per unit time, and Y-axis angular velocity sensor for detecting a posture change in the pitch direction Q _Y per unit time, comprises a Z-axis angular velocity sensor for detecting a posture change in the yaw direction Q _Z in the unit time, the. Then, the posture information generation unit 14 periodically outputs posture information B indicating detection results by the X-axis angular velocity sensor, the Y-axis angular velocity sensor, and the Z-axis angular velocity sensor.

  The control unit 11 includes a posture information acquisition unit 114 (an example of an “acquisition unit”) that acquires posture information B, and a display control unit 110 that generates a display image GH based on the posture information B.

  The display control unit 110 includes a mode designation unit 111, a virtual camera control unit 112, and a display information generation unit 113.

The virtual camera control unit 112 controls the virtual camera CM in the virtual space SP-V based on the posture information B. In this embodiment, the virtual camera control unit 112 can control the virtual camera CM in a plurality of control modes. Specifically, the virtual camera control unit 112 can control the virtual camera CM in the normal control mode, control the virtual camera CM in the posture control mode, and control the virtual camera CM in the position control mode.
Here, the normal control mode is a control mode in which the virtual camera CM is controlled so that the attitude of the virtual camera CM is changed while the position PC of the virtual camera CM in the virtual space SP-V is fixed.
In the attitude control mode, the virtual camera CM is rotated around a virtual point K in the virtual space SP-V to change the attitude of the virtual camera CM in the virtual space SP-V. This is a control mode for controlling.
The position control mode is a control mode for controlling the virtual camera CM so as to change the position PC of the virtual camera CM while keeping the attitude of the virtual camera CM in the virtual space SP-V fixed.

The mode specifying unit 111 specifies a control mode of the virtual camera control unit 112 based on the posture information B.
The display information generation unit 113 generates display information DS representing the imaging result of the virtual space SP-V by the virtual camera CM, and supplies the display information DS to the display unit 12, thereby displaying the display image on the display unit 12. Display GH.

  FIG. 9 is a hardware configuration diagram illustrating an example of a hardware configuration of the terminal device 10.

  As illustrated in FIG. 9, the terminal device 10 includes a processor 1000 (an example of an “information processing device”) that controls each unit of the terminal device 10, a memory 1001 that stores various information, and detects a change in attitude of the terminal device 10. An angular velocity sensor 1002 that outputs posture information B indicating the detection result, a display device 1003 that can display various images, and an input device 1004 that accepts an operation by the user U of the terminal device 10.

The memory 1001 is, for example, a volatile memory such as a RAM (Random Access Memory) that functions as a work area of the processor 1000 and an EEPROM (Electrically Erasable Programmable Read-Only Memory) that stores various information such as a control program PRG of the terminal device 10. ), And functions as the storage unit 15.
The processor 1000 is, for example, a CPU (Central Processing Unit), executes the control program PRG stored in the memory 1001, and operates according to the control program PRG to function as the control unit 11.
As described above, the angular velocity sensor 1002 includes the X-axis angular velocity sensor, the Y-axis angular velocity sensor, and the Z-axis angular velocity sensor, and functions as the posture information generation unit 14.
The display device 1003 and the input device 1004 are, for example, touch panels, and function as the display unit 12 and the operation unit 13. Note that the display device 1003 and the input device 1004 may be configured separately. Further, the input device 1004 may be configured by one or a plurality of devices including a touch panel, operation buttons, a keyboard, a joystick, and a part or all of a pointing device such as a mouse.

  Note that the processor 1000 includes hardware such as a GPU (Graphics Processing Unit), a DSP (Digital Signal Processor), or an FPGA (Field Programmable Gate Array) in addition to or instead of the CPU. May be performed. In this case, part or all of the control unit 11 realized by the processor 1000 may be realized by hardware such as a DSP.

[1.3. Operation of Terminal Device]
Hereinafter, an example of the operation of the terminal device 10 will be described with reference to FIGS.

  10 to 12 are flowcharts illustrating an example of the operation of the terminal device 10 when the terminal device 10 performs a display process of displaying the display image GH on the display unit 12. In the present embodiment, when the user U inputs a predetermined start operation to start the display process from the operation unit 13, the terminal device 10 starts the display process.

[1.3.1. Normal control mode]
As shown in FIG. 10, when the display processing is started, the virtual camera control unit 112 initializes the attitude of the virtual camera CM in the virtual space SP-V (S100).
For example, in step S100, the virtual camera control unit 112 sets the imaging direction LC of the virtual camera CM in the virtual space SP-V to the + _XV direction, as shown in FIG. In other words, the virtual camera control section 112, in step S100, + _{X C} as the direction and the + _{X V} direction is the same direction, to set the camera coordinate system sigma _C.
Note that the virtual camera control unit 112 may initialize the position PC of the virtual camera CM in the virtual space SP-V in step S100. For example, in step S100, the virtual camera control unit 112 sets the position PC of the virtual camera CM in the virtual space SP-V at -X when viewed from the front of the character V, that is, as shown in FIG. _It may be set at a position in the _V direction. In other words, the virtual camera control section 112, in step S100, as the camera coordinate system sigma _C of X _C axis on the character V is present, it may be set the camera coordinate system sigma _C.

  Next, the display information generation unit 113 generates display information DS indicating a result of imaging the virtual space SP-V with the virtual camera CM, and supplies the display information DS to the display unit 12 so that the display unit 12 On the other hand, the display image GH is displayed (S102).

Next, the mode specifying unit 111 sets the control mode to the normal control mode (S104).
In addition, the virtual camera control unit 112 determines the posture of the HMD 1 when the mode specifying unit 111 sets the control mode to the normal control mode as an “initial posture” (S106).
In the following, a device coordinate system sigma _S when HMD1 is the initial position, referred to as "initial coordinate system sigma _S0". In the following, as shown in FIG. 13 described later, the position PC of the virtual camera CM when the HMD 1 is in the initial posture is referred to as “initial position PC0”, and the imaging direction LC when the HMD 1 is in the initial posture. , referred to as "initial imaging direction LC0", the camera coordinate system sigma _C when HMD1 is the initial position, referred to as "initial camera coordinate system sigma _C0".

Next, the posture information acquisition unit 114 acquires posture information B from the posture information generation unit 14 (S108).
Then, the virtual camera control unit 112 calculates a posture change dB0 from the initial posture of the HMD 1 based on the posture information B acquired by the posture information acquisition unit 114 in step S108 (S110).
In the present embodiment, the virtual camera control section 112, as an example, the posture change DB0, a rotary shaft W _S which defines the direction of rotation Q _W as seen from the initial coordinate system sigma _S0, around the rotation axis W _S a rotation angle theta _W, and be represented by. That is, the direction indicated in the present embodiment, if HMD1 viewed from the initial coordinate system sigma _S0 is rotated by the rotation angle theta _W about an axis of rotation W _S, the posture change DB0, the rotation axis W _S in the initial coordinate system sigma _S0 A vector and a value indicating the rotation angle θ _W are included.
However, the posture change dB0 may be expressed by another arbitrary expression method. For example, the posture change dB0 shows the posture change from the initial coordinate system sigma _S0 to the apparatus coordinate system sigma _S, may be those represented by the posture converting a 3 × 3 matrix, the initial coordinate system sigma _S0 shows the change in the posture of the device coordinate system sigma _S from or may be expressed by the quaternion.
In the following, HMD 1 is, when rotated by the rotation angle theta _W about an axis of rotation W _S, the rotation angle theta _W, sometimes referred to as "the attitude change amount".

Next, the virtual camera control unit 112 determines the posture of the virtual camera CM in the virtual space SP-V based on the posture change dB0 calculated in step S110 (S112).
Specifically, in step S112, the virtual camera control unit 112 changes the imaging direction LC from the initial imaging direction LC0 by the amount of posture change corresponding to the posture change dB0 in the virtual space SP-V, and The attitude of the virtual camera CM in the space SP-V is determined. That is, in step S112, the virtual camera control section 112 in the initial camera coordinate system sigma _C0, the camera coordinate system sigma _C, by changing in response to a change in posture DB0, of the virtual camera CM in the virtual space SP-V Determine your posture.
More specifically, as an example, the virtual camera control unit 112 sets the virtual rotation axis _WSC0 in the virtual space SP-V so as to intersect the initial position PC0 of the virtual camera CM, as shown in FIG. By determining the camera coordinate system Σ _C as a coordinate system obtained by rotating the initial camera coordinate system Σ _C0 around the virtual rotation axis W _SC0 by the rotation angle θ _W , the posture of the virtual camera CM in the virtual space SP-V is determined. decide. Here, the virtual rotation axis W _SC0 is a straight line in the virtual space SP-V that intersects the initial position PC0, and is a component of a vector representing the direction of the virtual rotation axis W _SC0 viewed from the initial camera coordinate system Σ _C0. When the components of the vector representing the direction of the axis of rotation W _S viewed from the initial coordinate system sigma _S0 is a straight line as the same.
For example, HMD 1 is from the initial position, it rotates by the rotation angle theta _W with respect to the yaw direction Q _Z around Z _S axis, the virtual camera control section 112, so as to cross to the initial position PC0, initial camera coordinate system _姿勢 After setting a virtual rotation axis W _SC0 parallel to the Z _C axis of _C0 , the camera coordinate system Σ _C is rotated by the rotation angle θ _W around the initial camera coordinate system Σ _C0 around the virtual rotation axis W _SC0. Is determined as a coordinate system having the following, the posture of the virtual camera CM is determined.
Further, for example, HMD 1 is from the initial position, it rotates by the rotation angle theta _W with respect to the pitch direction Q _Y around Y _S axis, the virtual camera control section 112, so as to cross to the initial position PC0, initial camera After setting the virtual rotation axis W _SC0 parallel to the Y _C axis of the coordinate system Σ _C0 , the camera coordinate system Σ _C is rotated by the rotation angle θ _W about the initial camera coordinate system Σ _C0 around the virtual rotation axis W _SC0. The posture of the virtual camera CM is determined by determining the coordinate system having the changed posture.
For example, as HMD1 found from the initial position, it rotates by the rotation angle theta _W with respect to the roll direction Q _X around X _S axis, the virtual camera control section 112, intersects the initial position PC0, initial camera After setting a virtual rotation axis W _SC0 parallel to the X _C axis of the coordinate system Σ _C0 , the camera coordinate system Σ _C is rotated by the rotation angle θ _W around the initial camera coordinate system Σ _C0 around the virtual rotation axis W _SC0. The posture of the virtual camera CM is determined by determining the coordinate system having the changed posture.

  Next, the display information generation unit 113 generates display information DS indicating a result of imaging the virtual space SP-V with the virtual camera CM, and supplies the display information DS to the display unit 12 so that the display unit 12 On the other hand, the display image GH is displayed (S114).

FIG. 13 is an explanatory diagram illustrating an example of a change in the attitude of the virtual camera CM in the normal control mode. FIG. 14 is a diagram illustrating an example of the visual recognition image GS displayed on the display unit 12 in the normal control mode.
In Figure 13, as an example, at time t1, HMD 1 becomes the initial position at time t2, the HMD 1, comprising the initial position, the rotation angle theta _W by the rotation position with respect to the yaw direction _{Q Z} around _{Z S} axis Assume the case.
Thus, for example, as shown in FIG. 13, the virtual camera CM is, at time t1, if the initial imaging direction LC0 imaging direction LC (t1) becomes the posture facing + X _V direction, the virtual camera CM is at time t2, the imaging direction LC (t1), and around the Z _C parallel imaginary rotation axis to axis W _SC0 initial camera coordinate system sigma _C0 intersects the initial position PC0 is rotated by the rotation angle theta _W, imaging The posture is such that it has the direction LC (t2). In other words, the camera coordinate system sigma _C at time t2, the initial camera coordinate system sigma _C0 is a camera coordinate system sigma _C at time t1, the initial camera coordinate system sigma _C0 intersects the origin of the initial camera coordinate system sigma _C0 It becomes the coordinate system is rotated by the rotation angle theta _W around the Z _C imaginary axis of rotation which is parallel to the axis W _SC0.
Therefore, at time t1, as shown in FIG. 6, when the character image GV is displayed at the center Ymid of the display unit 12, at time t2, as shown in FIG. It will be displayed in than the central portion Ymid of the display section 12 + Y _D direction position Y (t2).

As shown in FIG. 10, the mode specifying unit 111 determines whether to shift the control mode to the attitude control mode based on the attitude information B acquired in step S108 or the attitude change dB0 calculated in step S110. Is determined (S116).
In the present embodiment, as an example, when the posture change amount of the HMD 1 in the determination period from the time before the current time by a predetermined time to the current time is equal to or less than a predetermined threshold, the mode specifying unit 111 changes the control mode. Assume that the mode is shifted from the normal control mode to the attitude control mode. For this reason, in step S116, for example, the mode specifying unit 111 determines whether or not the posture change amount of the HMD 1 during the determination period is equal to or less than a predetermined threshold, thereby shifting the control mode to the posture control mode. It is determined whether or not. In step S116, for example, the mode specifying unit 111 determines whether the difference between the attitude of the HMD 1 at the start time of the determination period and the attitude of the HMD 1 at any time during the determination period is smaller than a predetermined threshold. May be determined to determine whether to shift the control mode to the attitude control mode.
If the result of the determination in step S116 is affirmative, the mode specifying unit 111 advances the process to step S120, and if the result of the determination in step S116 is negative, advances the process to step S118.

  Thereafter, the control unit 11 determines whether or not the user U has input a predetermined end operation for terminating the display process from the operation unit 13 (S118). Then, when the result of the determination in step S118 is negative, the control unit 11 advances the process to step S108, and when the result of the determination in step S118 is positive, ends the display process.

[1.3.2. Attitude control mode]
As shown in FIG. 11, the mode specifying unit 111 sets the control mode to the posture control mode (S120).

Next, the virtual camera control unit 112 determines the attitude of the HMD 1 when the mode specifying unit 111 sets the control mode to the attitude control mode as a “reference attitude” (S122).
Hereinafter, the device coordinate system sigma _S when HMD1 is the reference posture is referred to as a "reference coordinate system sigma _S1". Further, hereinafter, as shown in FIG. 15 described later, the position PC of the virtual camera CM when the HMD 1 is in the reference posture is referred to as a “reference position PC1”, and the imaging direction LC when the HMD 1 is in the reference posture. , it referred to as "reference imaging direction LC1", the camera coordinate system sigma _C when HMD1 is the reference posture is referred to as a "reference camera coordinate system sigma _C1".

Next, the virtual camera control unit 112 sets a virtual point K in the virtual space SP-V based on the reference imaging direction LC1 of the virtual camera CM when the HMD 1 is in the reference posture (S124).
Specifically, in step S124, the virtual camera control unit 112, for example, is on a straight line that intersects the reference position PC1 of the virtual camera CM and extends in the reference imaging direction LC1 and exists in the virtual space SP-V. A virtual point K is set in a setting area corresponding to the area where the character V exists.
Here, the presence area of the character V is, for example, an area in the virtual space SP-V, and is an area including the surface of the character V and the inside of the character V. The setting area is, for example, a part or all of the existing area. However, the setting area may be an area including an area outside the existence area. For example, the setting area may be an area where the distance from the existence area is equal to or less than a predetermined distance, or may be an area where the distance from a point in the existence area is equal to or less than the predetermined distance.
Hereinafter, as shown in FIG. 15 described later, the position PK of the virtual point K in the virtual space SP-V set in step S124 is referred to as a “reference position PK1”.
In the present embodiment, the virtual camera control unit 112 determines the virtual point K based on the reference imaging direction LC1, but the present invention is not limited to such an embodiment. For example, the virtual camera control unit 112 may set the virtual point K at a predetermined position in the virtual space SP-V. Further, for example, the virtual camera control unit 112 sets the virtual point K at a position corresponding to a specific part of the character V such as the face of the character V in the region where the character V exists in the virtual space SP-V. You may.

Next, the posture information acquisition unit 114 acquires the posture information B from the posture information generation unit 14 (S126).
Then, the virtual camera control unit 112 calculates a posture change dB1 from the reference posture of the HMD 1 based on the posture information B acquired by the posture information acquisition unit 114 in step S126 (S128).
In the present embodiment, when viewed in the reference coordinate system sigma _S1, rotation HMD1 is, from the reference position, it rotates by the rotation angle theta _W about an axis of rotation W _S, the posture change dB1, in the reference coordinate system sigma _S1 the direction vector showing the axial W _S, and include, a value indicating the rotation angle theta _W.

As shown in FIG. 11, the mode specifying unit 111 determines whether to shift the control mode to the position control mode based on the posture information B acquired in step S126 or the posture change dB1 calculated in step S128. Is determined (S130).
In the present embodiment, as an example, when the amount of posture change from the reference posture of the HMD 1 is equal to or more than the reference amount θth (an example of “reference angle”), the mode specifying unit 111 changes the control mode from the posture control mode to the posture control mode. It is assumed that the mode is shifted to the position control mode. For this reason, in step S130, for example, the mode specifying unit 111 determines whether or not the amount of change in the posture of the HMD 1 from the reference posture is equal to or more than the reference amount θth, thereby shifting the control mode to the position control mode. It is determined whether or not.
In step S130, the mode specifying unit 111 determines whether or not the posture change amount related to a predetermined direction component of the posture change dB1 from the reference posture of the HMD 1 is equal to or larger than the reference amount θth. It may be determined whether to shift the mode to the position control mode. Specifically, the mode designation section 111, in step S130, for example, of the posture change dB1 from the reference posture of the HMD 1, the direction component in the pitch direction _{Q Y,} direction component in the yaw direction _{Q Z} or Pitch Q posture variation of the direction component of the _Y and the yaw direction Q _Z is, by determining whether a reference amount θth above, the control mode may determine whether to transition to the position control mode .
If the result of the determination in step S130 is affirmative, the mode specifying unit 111 advances the process to step S140, and if the result of the determination in step S130 is negative, advances the process to step S132.

As shown in FIG. 11, the mode specifying unit 111 determines whether to shift the control mode to the normal control mode based on the posture information B acquired in step S126 or the posture change dB1 calculated in step S128. Is determined (S132).
In the present embodiment, as an example, when the posture change amount of the HMD 1 in the determination period from the time before the current time by a predetermined time to the current time is equal to or less than a predetermined threshold, the mode specifying unit 111 changes the control mode. It is assumed that the mode is shifted from the attitude control mode to the normal control mode. For this reason, in step S132, the mode specifying unit 111 determines whether or not the amount of change in the attitude of the HMD 1 during the determination period is equal to or less than a predetermined threshold, thereby shifting the control mode to the normal control mode. It is determined whether or not. Further, in step S132, the mode specifying unit 111 determines whether the difference between the attitude of the HMD 1 at the start time of the determination period and the attitude of the HMD 1 at an arbitrary time during the determination period is smaller than a predetermined threshold, for example. May be determined to determine whether to shift the control mode to the normal control mode.
In step S132, the mode specifying unit 111 determines whether or not the amount of posture change related to a specific direction component in the posture change dB1 from the reference posture of the HMD 1 is equal to or greater than a predetermined value, thereby controlling the control mode. May be determined whether to shift to the normal control mode. Specifically, the mode designation section 111, in step S132, for example, whether of the posture change dB1 from the reference posture of the HMD 1, the posture variation of the direction component of the roll direction Q _X is equal to or more than a predetermined value By determining whether the control mode is shifted to the normal control mode, it may be determined.

Next, the virtual camera control unit 112 determines the position and posture of the virtual camera CM in the virtual space SP-V based on the posture change dB1 calculated in step S128 (S134).
Specifically, in step S134, the virtual camera control unit 112 changes the position PC and the imaging direction LC in the virtual space SP-V from the reference position PC1 and the reference imaging direction LC1 to the posture change amount corresponding to the posture change dB1. , The position and orientation of the virtual camera CM in the virtual space SP-V are determined. That is, in step S134, the virtual camera control section 112, the reference camera coordinate system sigma _C1, the camera coordinate system sigma _C, by changing in response to a change in posture dB1, the virtual camera CM in the virtual space SP-V Determine the position and orientation.
More specifically, as an example, the virtual camera control unit 112 sets the reference rotation axis W _SC1 so as to intersect the virtual point K in the virtual space SP-V, as shown in FIG. the sigma _C, to determine the base camera coordinate system sigma _C1 as a coordinate system that has only rotated the rotation angle theta _W around the reference rotation axis W _SC1, to determine the position and orientation of the virtual camera CM in the virtual space SP-V . Here, the reference rotation axis W _SC1 is a straight line in the virtual space SP-V that intersects the reference position PK1 of the virtual point K, and indicates the direction of the reference rotation axis W _SC1 viewed from the reference camera coordinate system Σ _C1. and components of the vector representing the components of the vector representing the direction of the axis of rotation W _S when viewed in the reference coordinate system sigma _S1 is a straight line as the same. That is, as an example, the virtual camera control unit 112 moves the virtual camera CM located at the reference position PC1 in the virtual space SP-V around the reference rotation axis W _SC1 about the virtual point K, as shown in FIG. by rotating by the rotation angle theta _W, to determine the position PC of the virtual camera CM in the virtual space SP-V.

  Next, the display information generation unit 113 generates display information DS indicating a result of imaging the virtual space SP-V with the virtual camera CM, and supplies the display information DS to the display unit 12 so that the display unit 12 On the other hand, the display image GH is displayed (S136).

FIG. 15 is an explanatory diagram illustrating an example of a change in the position and posture of the virtual camera CM in the posture control mode. FIG. 16 is a diagram illustrating an example of the visual recognition image GS displayed on the display unit 12 in the attitude control mode.
In Figure 15, as an example, at time t3, becomes HMD1 reference posture at time t4, is HMD1, the reference posture, the rotation angle theta _W by the rotation position with respect to the yaw direction _{Q Z} around _{Z S} axis Assume the case.
Thus, for example, as shown in FIG. 15, when the virtual camera CM is, at time t3, the reference is an image pickup direction LC1 imaging direction LC (t3) is the posture facing + X _V direction, the virtual camera CM at time t4, the imaging direction LC (t3), is rotated around the Z _C reference rotation axis parallel to the axis W _SC1 of the base camera coordinate system sigma _C1 intersects the virtual point K by the rotation angle theta _W , The posture having the imaging direction LC (t4). In other words, the camera coordinate system sigma _C is at time t4, parallel reference camera coordinate system sigma _C1 is a camera coordinate system sigma _C at time t3, the Z _C axis of the base camera coordinate system sigma _C1 intersects the virtual point K The coordinate system is rotated around the reference rotation axis W _SC1 by the rotation angle θ _W.
As shown in FIG. 15, the position PC (t4) of the virtual camera CM at time t4 is, for example, the position PC (t3) of the virtual camera CM at time t3, that is, At a position rotated by a rotation angle θ _W around the reference rotation axis W _SC1 .
Therefore, at time t3, as shown in FIG. 6, when the character image GV represents the character V facing the front in the center Ymid of the display unit 12, at time t4, as shown in FIG. character image GV is representative of the character V with varying the rotation angle theta _W only direction from the front direction at the center Ymid of the display unit 12.

  Thereafter, the control unit 11 determines whether or not the user U has input a predetermined end operation for terminating the display process from the operation unit 13 (S138). Then, when the result of the determination in step S138 is negative, the control unit 11 advances the process to step S126, and when the result of the determination in step S138 is positive, ends the display process.

[1.3.3. Position control mode]
As shown in FIG. 12, the mode specifying unit 111 sets the control mode to the position control mode (S140).

Next, as shown in FIG. 17, which will be described later, the virtual camera control unit 112 determines the position PC of the virtual camera CM when the mode specifying unit 111 sets the control mode to the position control mode as a “start position PC2”. (S142). In the following, the posture of the HMD 1 when the mode specifying unit 111 sets the control mode to the position control mode is referred to as “starting posture”, and the imaging direction LC when the HMD 1 is the starting posture is referred to as “imaging direction LC2”. , And the camera coordinate system Σ _C when the HMD 1 is in the origin posture is referred to as “origin camera coordinate system Σ _C2 ”.
When the mode specifying unit 111 sets the control mode to the position control mode, the virtual point K exists on a straight line that intersects with the start position PC2 of the virtual camera CM and extends in the imaging direction LC2. Hereinafter, as shown in FIG. 17 described below, the position PK of the virtual point K in the virtual space SP-V when the mode specifying unit 111 sets the control mode to the position control mode is referred to as “starting point position PK2”. . The starting position PK2 is the same position as the reference position PK1.

Next, the posture information acquisition unit 114 acquires posture information B from the posture information generation unit 14 (S144).
Then, based on the posture information B acquired by the posture information acquiring unit 114 in step S126 and the posture information B acquired by the posture information acquiring unit 114 in step S144, the virtual camera control unit 112 The posture change dB2 is calculated (S146).
In the present embodiment, when viewed in the reference coordinate system sigma _S1, rotation HMD1 is, from the reference position, it rotates by the rotation angle theta _W about an axis of rotation W _S, the posture change dB2, in the reference coordinate system sigma _S1 the direction vector showing the axial W _S, and include, a value indicating the rotation angle theta _W.

As shown in FIG. 12, the mode specifying unit 111 shifts the control mode to the attitude control mode based on the attitude information B acquired in steps S126 and S144 or the attitude change dB2 calculated in step S146. It is determined whether or not to make it (S148).
In the present embodiment, as an example, when the posture change amount from the reference posture of the HMD 1 becomes less than the reference amount θth, the mode specifying unit 111 shifts the control mode from the position control mode to the posture control mode. Is assumed. For this reason, in step S148, for example, the mode specifying unit 111 determines whether or not the amount of change in the posture of the HMD 1 from the reference posture is smaller than the reference amount θth, thereby shifting the control mode to the posture control mode. It is determined whether or not.
The mode specifying unit 111 determines in step S148 whether or not the posture change amount related to a predetermined direction component of the posture change dB2 from the reference posture of the HMD 1 is smaller than the reference amount θth. It may be determined whether to shift the mode to the attitude control mode. Specifically, the mode designation section 111, in step S148, for example, of the posture change dB2 from the reference posture of the HMD 1, the direction component in the pitch direction _{Q Y,} direction component in the yaw direction _{Q Z} or Pitch Q posture variation of the direction component of the _Y and the yaw direction Q _Z is, by determining whether or not less than the reference amount [theta] th, the control mode may determine whether or not to shift to the attitude control mode .
If the result of the determination in step S148 is affirmative, the mode specifying unit 111 proceeds to step S120, and if the result of the determination in step S148 is negative, proceeds to step S150.

Next, the virtual camera control unit 112 determines the position PK of the virtual point K in the virtual space SP-V based on the posture change dB2 calculated in step S146 (S150).
Specifically, in step S150, the virtual camera control unit 112 determines, for example, a direction that intersects both the reference rotation axis W _SC1 set in the virtual space SP-V and the imaging direction LC2, and The position PK of the virtual point K is changed in a direction away from the virtual point K. More specifically, the virtual camera control unit 112 sets the position PK of the virtual point K in a direction perpendicular to both the reference rotation axis _WSC1 and the imaging direction LC2 and away from the reference position PC1. Change. In this case, the virtual camera control unit 112 determines the rotation angle θ included in the posture change dB2, such as a change from the starting position PK2, that is, the position PK (t5) to the position PK (t6) shown in FIG. The position PK of the virtual point K is changed by the distance Dis corresponding to the excess angle θov obtained by subtracting the reference amount θth from _W.

Next, the virtual camera control unit 112 determines the position PC of the virtual camera CM in the virtual space SP-V based on the posture change dB2 calculated in step S146 (S152). In the present embodiment, in the position control mode, the imaging direction LC of the virtual camera CM is maintained at the imaging direction LC2.
Specifically, in step S152, the virtual camera control unit 112 determines, for example, a direction that intersects both the reference rotation axis _WSC1 set in the virtual space SP-V and the imaging direction LC2, and The position PC of the virtual camera CM is changed in a direction away from the virtual camera CM. More specifically, for example, the virtual camera control unit 112 sets the position PC of the virtual camera CM in a direction orthogonal to both the reference rotation axis _WSC1 and the imaging direction LC2 and away from the reference position PC1. Change. In this case, the virtual camera control unit 112 determines only the distance Dis corresponding to the excess angle θov, for example, as shown in FIG. , The position PC of the virtual camera CM is changed.
That is, the position change of the virtual point K in step S150 and the position change of the virtual camera CM in step S152 have a direction orthogonal to the reference rotation axis _WSC1 and the imaging direction LC2, as shown in FIG. And the same vector VI having the magnitude Dis. In other words, in the position control mode, the virtual camera control unit 112 determines that the virtual point K is located in the imaging direction LC2 when viewed from the virtual camera CM, and that the distance between the virtual camera CM and the virtual point K is a fixed distance. Is maintained, the position PK of the virtual point K and the position PC of the virtual camera CM are changed. As described above, the virtual camera control unit 112 changes the position PK of the virtual point K in the virtual plane perpendicular to the reference rotation axis _WSC1 in the position control mode.
Note that the virtual camera control unit 112 may execute the processing of step S150 and the processing of step S152 simultaneously, or may execute the processing of step S152 before executing the processing of step S150.

  Next, the display information generation unit 113 generates display information DS indicating a result of imaging the virtual space SP-V with the virtual camera CM, and supplies the display information DS to the display unit 12 so that the display unit 12 On the other hand, the display image GH is displayed (S154).

FIG. 17 is an explanatory diagram for describing an example of a change in the position and orientation of the virtual camera CM in the position control mode. FIG. 18 is a diagram illustrating an example of the visual recognition image GS displayed on the display unit 12 in the position control mode.
In Figure 17, as an example, at time t3, HMD 1 is a reference attitude, at time t5, HMD 1 is the starting point position at time t6, HMD 1 is a reference attitude for the yaw direction _{Q Z} around _{Z S} axis , it is assumed that the only rotational posture large rotation angle theta _W than the reference amount [theta] th.
Thus, for example, as shown in FIG. 17, when the virtual camera CM is, at time t3, the reference is an image pickup direction LC1 imaging direction LC (t3) is the posture facing + X _V direction, the virtual camera CM, at time t5, the imaging direction LC (t3), is rotated by the reference amount θth around parallel reference rotation axis W _SC1 to Z _C axis of the base camera coordinate system sigma _C1 intersects the virtual point K, The posture is such that it has the imaging direction LC (t5) which is the imaging direction LC2, and the virtual camera CM has the posture which has the imaging direction LC (t6) which is the imaging direction LC2 at time t6. In other words, the starting point the camera coordinate system sigma _C2 is a camera coordinate system sigma _C at time t5 is the reference camera coordinate system sigma _C1 is a camera coordinate system sigma _C at time t3, the reference camera coordinate system intersects the virtual point K becomes the coordinate system is rotated by the reference amount θth around parallel reference rotation axis W _SC1 to Z _C axis of sigma _C1. The camera coordinate system sigma _C at time t6, the origin camera coordinate system sigma _C2, it becomes the coordinate system is only translated direction and distance indicated by vector VI.
The position PC (t5) of the virtual camera CM at time t5 is, as shown in FIG. 17, the position PC (t3) of the virtual camera CM at time t3, that is, the reference position PC1, The starting point position PC2 is a position rotated around the rotation axis W _SC1 by the reference amount θth. As shown in FIG. 17, the position PC (t6) of the virtual camera CM at the time t6 is the position PC (t5) of the virtual camera CM at the time t5, that is, the position obtained by moving the starting position PC2 by the vector VI. It becomes. As shown in FIG. 17, the position PK (t6) of the virtual point K at time t6 is the position PK (t5) of the virtual point K at time t5, that is, the position obtained by moving the starting position PK2 by the vector VI. It becomes.
For this reason, at time t3, as shown in FIG. 6, when the character image GV represents the character V facing the front in the central portion Ymid of the display unit 12, the character image GV is displayed at time t5 in FIG. As shown in FIG. 18, a character V whose direction is changed by a reference amount θth from the front direction in the central portion Ymid of the display unit 12 is shown, and the character image GV is displayed at time t6 as shown in FIG. in -Y _D direction position Y (t6) than the central portion Ymid of 12 representing the character V of changing the orientation by reference amount θth from the front.

  Thereafter, the control unit 11 determines whether or not the user U has input a predetermined end operation for terminating the display process from the operation unit 13 (S156). Then, when the result of the determination in step S156 is negative, the control unit 11 advances the process to step S144, and when the result of the determination in step S156 is positive, ends the display process.

The mode specifying unit 111 determines whether or not to shift the control mode to the posture control mode by determining in step S148 whether or not the posture change amount from the reference posture of the HMD 1 is smaller than the reference amount θth. However, the present invention is not limited to such an embodiment.
For example, in step S148, the mode designating unit 111 determines whether or not the amount of posture change related to a specific direction component of the posture change dB2 from the reference posture of the HMD 1 is equal to or greater than a predetermined value, thereby controlling the control mode. May be determined to be shifted to the posture control mode. Specifically, the mode designation section 111, in step S148, for example, whether of the posture change dB2 from the reference posture of the HMD 1, the posture variation of the direction component of the roll direction Q _X is equal to or more than a predetermined value By determining whether or not to shift the control mode to the attitude control mode, it may be determined.
Also, in step S148, the mode specifying unit 111 determines whether or not the amount of change in the attitude of the HMD 1 during the determination period is equal to or less than a predetermined threshold, thereby determining whether to shift the control mode to the attitude control mode. May be determined. Further, in step S148, the mode specifying unit 111 determines whether the difference between the attitude of the HMD 1 at the start time of the determination period and the attitude of the HMD 1 at an arbitrary time in the determination period is smaller than a predetermined threshold, for example. May be determined to determine whether to shift the control mode to the attitude control mode.
In these cases, the virtual camera control unit 112 determines the position PK of the virtual point K and the position of the virtual camera CM when the posture change amount from the reference posture of the HMD 1 is less than the reference amount θth in steps S150 and S152. The position PC may be changed in a direction orthogonal to both the reference rotation axis _WSC1 and the imaging direction LC2, and in a direction approaching the reference position PC1.

[1.4. Conclusion of Embodiment]
As described above, in the present embodiment, the display control unit 110 performs the normal control mode in which the posture of the virtual camera CM is changed based on the posture information B, and the position and posture of the virtual camera CM based on the posture information B. And a position control mode in which the position of the virtual camera CM is changed based on the posture information B can be displayed as the visual recognition image GS. Therefore, according to the present embodiment, the user U can operate the position and the posture of the virtual camera CM in the virtual space SP-V by changing the posture of the HMD 1.

  In the present embodiment, the display control unit 110 changes the position and the posture of the virtual camera CM around the virtual point K set in the setting area corresponding to the area where the character V exists, and performs the visual control in the posture control mode. The display of the image GS is possible. Therefore, according to the present embodiment, the user U wearing the HMD 1 can continuously display the character image GV on the display unit 12.

  In the present embodiment, the attitude control mode is an example of a “first control mode”, and the position control mode is an example of a “second control mode”.

[2. Modification]
Each of the above embodiments can be variously modified. Specific modifications will be described below. Two or more aspects arbitrarily selected from the following examples can be appropriately combined within a mutually consistent range. In addition, in the modified examples illustrated below, elements having the same functions and functions as those of the embodiment will be denoted by the reference numerals used in the above description, and detailed description thereof will be appropriately omitted.

[Modification 1]
In the above-described embodiment, the display control unit 110 can display the visual recognition image GS in three control modes of the normal control mode, the posture control mode, and the position control mode. However, the present invention is not limited to this. The display control unit 110 only needs to be able to display the visible image GS in at least two control modes of the three control modes of the normal control mode, the attitude control mode, and the position control mode. For example, the display control unit 110 may be capable of displaying the visual recognition image GS in two control modes, a normal control mode and a position control mode.

FIGS. 19 and 20 are flowcharts illustrating an example of the operation of the terminal device 10 when the display process according to the present modification is performed. The flowcharts shown in FIGS. 19 and 20 are shown in FIGS. 10 to 12 except that the control unit 11 executes the process of step S160 and does not execute the processes of step S116 and steps S120 to S138. It is the same as the flowchart.
As shown in FIG. 19, the mode specifying unit 111 determines whether to shift the control mode to the position control mode based on the posture information B acquired in step S108 or the posture change dB0 calculated in step S110. Is determined (S160).
Specifically, in step S160, when the amount of posture change from the initial posture of the HMD 1 is equal to or more than the reference amount θth in step S160, the mode specification unit 111 changes the control mode from the normal control mode to the position from the normal control mode. Shift to control mode. That is, in step S160, for example, the mode specifying unit 111 determines whether or not the amount of change in the posture of the HMD 1 from the initial posture is equal to or greater than the reference amount θth, thereby determining whether to shift the control mode to the position control mode. Determine whether or not.
If the result of the determination in step S160 is affirmative, the mode specifying unit 111 proceeds to step S140, and if the result of the determination in step S160 is negative, proceeds to step S112.
As shown in FIG. 20, when the result of the determination in step S148 is affirmative, the virtual camera control unit 112 advances the process to step S104, and when the result of the determination in step S148 is negative, the process proceeds to step S104. Proceeds to step S150.

  Also in this modified example, the display control unit 110 can display the visual recognition image GS in two control modes: the normal control mode and the position control mode. Therefore, the user U can operate the position and the attitude of the virtual camera CM in the virtual space SP-V by changing the attitude of the HMD 1.

  In this modification, the normal control mode is an example of a “first control mode”, and the position control mode is an example of a “second control mode”.

[Modification 2]
In the above-described embodiments and modifications, the imaging direction LC matches the direction of a straight line connecting the virtual camera CM and the virtual point K, but the present invention is not limited to such an embodiment. For example, the angle between the imaging direction LC and a straight line connecting the virtual camera CM and the virtual point K may be a predetermined angle or less.

[Modification 3]
In the above-described embodiment and the modified example, the virtual point K can be moved outside the existence area and the setting area of the character V in the position control mode, but the present invention is not limited to such an aspect. . In the position control mode, the virtual camera control unit 112 may limit a change in the position PC of the virtual camera CM so that the virtual point K is located inside the existing area or the set area.

[Modification 4]
In the above-described embodiments and modifications, the virtual camera control unit 112 determines the distance Dis based on the excess angle θov, but the present invention is not limited to such an aspect. Virtual camera control section 112, for example, the distance Dis is, as a value corresponding to the time length rotation angle theta _W is equal to or greater than a reference amount θth contained in attitude change dB2, position PC of the virtual camera CM and The position PK of the virtual point K may be determined.
For example, the virtual camera control section 112, in the position control mode, when the rotation angle theta _W contained in the posture change dB2 is equal to or greater than the reference amount [theta] th, the position PK position PC and the virtual point K of the virtual camera CM , May be moved at a constant speed in the direction of the vector VI.
Further, the virtual camera control section 112, in the position control mode, when the rotation angle theta _W contained in the posture change dB2 is equal to or greater than the reference amount [theta] th, the position PK position PC and the virtual point K of the virtual camera CM , May be moved in the direction of the vector VI at a speed corresponding to the excess angle θov.

[Modification 5]
In the embodiments and the modifications described above, the posture information B indicates the detection result of the posture change of the terminal device 10, but the present invention is not limited to such an embodiment. The posture information B may be, for example, information indicating the posture of the terminal device 10 viewed from a coordinate system fixed on the ground.
In this case, the attitude information generating unit 14 may include, for example, one or both of an angular velocity sensor and a geomagnetic sensor. In this case, the posture information B may be, for example, image information provided outside the HMD 1 and output from an imaging device that images the HMD 1.

[Modification 6]
In the above embodiments and modifications, the information processing device is provided in the HMD 1, but the information processing device may be provided separately from the HMD 1.

FIG. 21 is a block diagram illustrating an example of a configuration of a display system SYS according to the present modification.
As shown in FIG. 21, the display system SYS includes an information processing device 20 and a head mounted display 1A that can communicate with the information processing device 20. Among them, the information processing device 20 may include, for example, the control unit 11, the operation unit 13, and the storage unit 15. The head mounted display 1A includes, in addition to the display unit 12 and the posture information generating unit 14, an operation unit 31 that receives an operation by the user U wearing the head mounted display 1A, a storage unit 32 that stores various information, May be provided.

[3. Note]
From the above description, the present invention is grasped, for example, as follows. In addition, in order to facilitate understanding of each embodiment, reference numerals in the drawings are appended in parentheses for convenience, but the present invention is not limited to the illustrated embodiment.

[Appendix 1]
A program for an information processing device according to one embodiment of the present invention is a program for an information processing device including a processor, wherein the processor is an image obtained by capturing a virtual space with a virtual camera and uses binocular parallax. A stereoscopic image, a display control unit that causes a display unit provided on a head-mounted display to display, and an acquisition unit that acquires posture information related to the posture of the head-mounted display, functioning as the display control unit, The position of the virtual camera in the virtual space is changed based on the posture information around a virtual point set in the virtual space, and the posture of the virtual camera in the virtual space is changed based on the posture information. Changing the position of the virtual point in the virtual space based on the attitude information, A plurality of control modes including a second control mode for changing the position of the virtual camera according to the posture information based on the posture information, and displaying the image in the first control mode. In this case, the control mode is switched from the first control mode to the second control mode when a change amount of the posture indicated by the posture information becomes equal to or more than a reference amount.

According to this aspect, the posture of the virtual camera in the virtual space can be changed based on the posture information in the first control mode, and the virtual camera in the virtual space can be changed based on the posture information in the second control mode. The position of the camera can be changed. For this reason, according to this aspect, it is possible to perform an operation other than a change in the attitude of the virtual camera in the virtual space by changing the attitude of the head mounted display.
According to this aspect, in the first control mode and the second control mode, the position of the virtual camera in the virtual space can be changed based on the posture information. That is, according to this aspect, the position of the virtual camera in the virtual space can be changed without changing the position of the head mounted display in the real space. For this reason, according to this aspect, compared with the case where the position of the virtual camera in the virtual space is changed by changing the position of the head mounted display in the real space, the user wearing the head mounted display can easily, The position of the virtual camera in the virtual space can be changed.
Further, according to this aspect, in the first control mode, the position of the virtual camera in the virtual space is changed around the virtual point based on the posture information, and in the second control mode, the position of the virtual camera is changed based on the posture information. Is changed, and the position of the virtual camera in the virtual space is changed based on the position of the virtual point. Therefore, according to this aspect, the user wearing the head-mounted display can continue to look near the virtual point in the virtual space. Thus, according to this aspect, for example, the user wearing the head-mounted display can view a predetermined object in the virtual space, such as an opponent in a fighting fighting game or a racing car in a racing game. When it is necessary to continue, the user wearing the head-mounted display controls the attitude of the head-mounted display so that a virtual point is set at a position corresponding to a predetermined object in the virtual space. It is possible to continuously display an area where a predetermined object exists in the virtual space on the display unit of the display.

  In the above aspect, the “virtual camera” is, for example, a first virtual camera that captures an image of a virtual space, and a second virtual camera that captures an image of the virtual space from a different position in the virtual space from the first virtual camera. And a virtual camera. In this case, the “stereoscopic image” refers to, for example, an image for the left eye that is captured by the first virtual camera in the virtual space and that the user can visually recognize with the left eye. And a right-eye image that the user can visually recognize with the right eye.

  In the above aspect, the “head-mounted display” may be, for example, a display device that can be mounted on the head. Specifically, the “head-mounted display” may be a goggle-type or glasses-type display device that can be worn on the head. Further, the “head-mounted display” may be, for example, a device having a wearing device that can be worn on the head, and a portable display device such as a smartphone attached to the wearing device. Good.

  In the above aspect, the “posture of the head-mounted display” may be, for example, the orientation of the head-mounted display, the inclination of the head-mounted display, or the orientation and inclination of the head-mounted display. The concept may include both. Here, the “head-mounted display orientation” may be, for example, a direction in which the head-mounted display is oriented in a horizontal plane in real space, or an angle between a reference direction of the head-mounted display and a magnetic north direction. There may be. Further, the “tilt of the head mounted display” may be, for example, an angle between a reference direction of the head mounted display and a vertical direction.

  In the above aspect, the “posture information” may be, for example, information indicating the posture of the head mounted display, or information indicating a change in the posture of the head mounted display.

  In the above aspect, the “acquisition unit” may acquire the posture information from, for example, a head-mounted display, or may acquire the posture information from an imaging device that images the head-mounted display. When the acquisition unit acquires the posture information from the head-mounted display, the head-mounted display may include a sensor for detecting information indicating a change in the posture of the head-mounted display, or indicates the posture of the head-mounted display. A sensor for detecting information may be provided. Here, the “sensor for detecting information indicating a change in the posture of the head-mounted display” may be, for example, an angular velocity sensor. The “sensor for detecting information indicating the attitude of the head-mounted display” may be, for example, one or both of a geomagnetic sensor and an angular velocity sensor. When the acquisition unit acquires the posture information from the imaging device that images the head-mounted display, the posture information may be, for example, an image indicating a result of imaging the head-mounted display with the imaging device.

[Appendix 2]
The program for an information processing device according to another aspect of the present invention is the program for the information processing device according to supplementary note 1, wherein the display control unit sets the virtual camera and the virtual point in the first control mode. The position and orientation of the virtual camera in the virtual space so that an angle between a connecting line segment and a reference straight line in the virtual space determined based on an image displayed on the display unit is equal to or less than a predetermined angle. Is changed.

  According to this aspect, the angle between the direction in which the virtual camera captures an image in the virtual space and the direction of the virtual point viewed from the virtual camera can be, for example, equal to or smaller than a predetermined angle. For this reason, according to this aspect, for example, when the user wearing the head-mounted display needs to keep watching the predetermined object in the virtual space, the virtual point is set at a position corresponding to the predetermined object in the virtual space. The user wearing the head-mounted display controls the posture of the head-mounted display so that the area where the predetermined object exists in the virtual space is continuously displayed on the display unit of the head-mounted display. It can be displayed.

  In the above aspect, the “reference straight line” may be, for example, a straight line that connects a virtual camera with a specific location in a virtual space displayed at a specific pixel in an image displayed on the display unit. Good. In this aspect, the “reference straight line” may be, for example, a direction in which the virtual camera is facing. More specifically, the “reference straight line” may be, for example, the optical axis direction of the virtual camera.

[Appendix 3]
The program of the information processing apparatus according to another aspect of the present invention is the program of the information processing apparatus according to Supplementary Note 1 or 2, wherein the display control unit is configured to execute the virtual control in the virtual space in the first control mode. The position and orientation of the virtual camera in the virtual space are changed so that the distance between a point and the virtual camera maintains a constant distance.

  According to this aspect, in the virtual space, the distance between the virtual camera and the virtual point can be kept constant. That is, according to this aspect, for example, by setting the virtual point based on the position of the predetermined object in the virtual space, the distance between the virtual camera and the predetermined object in the virtual space is maintained substantially constant. Can be. For this reason, according to this aspect, it is possible to display the results of imaging the predetermined object from various directions while maintaining the size of the predetermined object substantially constant on the display unit of the head mounted display. Note that “maintaining the interval substantially constant” is a concept including a case where the interval is maintained constant while including an error in a predetermined range, in addition to a case where the interval is completely maintained constant.

[Appendix 4]
The program of the information processing apparatus according to another aspect of the present invention is the program of the information processing apparatus according to any one of supplementary notes 1 to 3, wherein the display control unit is configured to execute a predetermined process in the virtual space in the first control mode. The virtual point is set in a setting area corresponding to the object existence area, and the position of the virtual point is changed inside the setting area in the second control mode.

  According to this aspect, it is possible to continuously display an area where the predetermined object exists in the virtual space on the display unit of the head mounted display.

  In the above aspect, the “predetermined object” may be a virtual object existing in the virtual space. For example, the “predetermined object” may be an object having a certain shape, may be an object existing at a certain position in the virtual space, or may be a difference between the shape and the existing position in the virtual space. One or both may be changeable. Specifically, the “predetermined object” may be, for example, a character such as a person, an animal, and a monster that exists in the virtual space, or may be a vehicle, a building, and a vehicle that exist in the virtual space. , Tools, etc., or may be environmental components such as rooms, forests, wilderness, and stars that constitute a virtual space.

[Appendix 5]
The program of the information processing apparatus according to another aspect of the present invention is the program of the information processing apparatus according to any one of supplementary notes 1 to 4, wherein the display control unit is configured to control the virtual camera and the virtual camera in the second control mode. The position of the virtual point in the virtual space so that an angle between a line segment connecting points and a reference straight line in the virtual space determined based on an image displayed on the display unit is equal to or less than a predetermined angle. And changing the position of the virtual camera in the virtual space.

  According to this aspect, the angle between the direction in which the virtual camera captures an image in the virtual space and the direction of the virtual point viewed from the virtual camera can be, for example, equal to or smaller than a predetermined angle. For this reason, according to this aspect, for example, when the user wearing the head-mounted display needs to keep watching the predetermined object in the virtual space, the virtual point is set at a position corresponding to the predetermined object in the virtual space. The user wearing the head-mounted display controls the posture of the head-mounted display so that the area where the predetermined object exists in the virtual space is continuously displayed on the display unit of the head-mounted display. It can be displayed.

[Appendix 6]
The program of the information processing device according to another aspect of the present invention is the program of the information processing device according to supplementary note 5, wherein the display control unit is configured to control the virtual camera in the virtual space in the second control mode. The feature is to keep the posture constant.

  According to this aspect, for example, when the user wearing the head-mounted display needs to keep watching the predetermined object in the virtual space, the virtual point is set at a position corresponding to the predetermined object in the virtual space. As described above, the user wearing the head-mounted display controls the attitude of the head-mounted display so that the display unit of the head-mounted display continuously displays an area in the virtual space where the predetermined object exists. Becomes possible.

[Appendix 7]
The program of the information processing apparatus according to another aspect of the present invention is the program of the information processing apparatus according to any one of supplementary notes 1 to 6, wherein the display control unit is configured to execute the virtual control in the virtual space in the second control mode. The position of a point is changed by a distance corresponding to the amount of change in the posture indicated by the posture information, and the position of the virtual camera in the virtual space is changed by a distance corresponding to the amount of change in the posture indicated by the posture information. It is characterized by the following.

According to this aspect, in the second control mode, the position of the virtual camera in the virtual space can be changed based on the amount of change in the attitude of the head mounted display. For this reason, according to this aspect, it is possible to perform an operation other than a change in the attitude of the virtual camera in the virtual space by changing the attitude of the head mounted display.
According to this aspect, the amount of change in the position of the virtual camera is determined according to the amount of change in the attitude of the head-mounted display. For this reason, according to this aspect, the user wearing the head mounted display can change the position of the virtual camera to a desired position.

[Appendix 8]
The program for an information processing apparatus according to another aspect of the present invention is the program for an information processing apparatus according to any one of supplementary notes 1 to 7, wherein the display control unit is configured to control the head mounted display in the second control mode. When rotating about a rotation axis, the position of the virtual point in the virtual space is changed in a virtual plane perpendicular to a virtual straight line corresponding to the rotation axis, and the position of the virtual camera in the virtual space is It is characterized in that it is changed in a virtual plane.

According to this aspect, in the second control mode, the direction of the change in the position of the virtual camera in the virtual space can be determined based on the direction of the change in the attitude of the head mounted display. For this reason, according to this aspect, it is possible to perform an operation other than a change in the attitude of the virtual camera in the virtual space by changing the attitude of the head mounted display.
According to this aspect, the change direction of the position of the virtual camera is determined according to the change direction of the attitude of the head mounted display. For this reason, according to this aspect, the user wearing the head mounted display can change the position of the virtual camera to a desired position.

  In the above aspect, the “virtual straight line” is, for example, a straight line parallel to the rotation axis by an operator for converting the position and orientation in the real space where the head-mounted display exists into the position and orientation in the virtual space. May be converted to a straight line.

[Appendix 9]
The program for an information processing apparatus according to another aspect of the present invention is the program for an information processing apparatus according to any one of Supplementary Notes 1 to 8, wherein the display control unit is configured to: In the case of rotating about a rotation axis, when the angle of rotation of the head-mounted display about the rotation axis is equal to or greater than a reference angle, the control mode is changed from the first control mode. The mode is switched to the second control mode.

  According to this aspect, the posture of the virtual camera in the virtual space can be changed based on the posture information in the first control mode, and the virtual camera in the virtual space can be changed based on the posture information in the second control mode. The position of the camera can be changed. For this reason, according to this aspect, it is possible to perform an operation other than a change in the attitude of the virtual camera in the virtual space by changing the attitude of the head mounted display.

[Appendix 10]
An information processing device according to one embodiment of the present invention is a display control for displaying a stereoscopic image using a binocular parallax, which is an image obtained by capturing a virtual space with a virtual camera, on a display unit provided in a head-mounted display. Unit, and an acquisition unit for acquiring posture information on the posture of the head-mounted display, wherein the display control unit centers the position of the virtual camera in the virtual space around a virtual point set in the virtual space. A first control mode for changing the posture of the virtual camera in the virtual space based on the posture information, based on the posture information, and a position of the virtual point in the virtual space; And a second control mode that changes the position of the virtual camera in the virtual space based on the posture information. In the case where an image can be displayed in the control mode and the image is displayed in the first control mode, when the amount of change in the posture indicated by the posture information becomes equal to or more than a reference amount, the control mode is changed to the control mode. Switching from the first control mode to the second control mode.

According to this aspect, the posture of the virtual camera in the virtual space can be changed based on the posture information in the first control mode, and the virtual camera in the virtual space can be changed based on the posture information in the second control mode. The position of the camera can be changed. For this reason, according to this aspect, it is possible to perform an operation other than a change in the attitude of the virtual camera in the virtual space by changing the attitude of the head mounted display.
According to this aspect, the position of the virtual camera in the virtual space can be changed without changing the position of the head mounted display in the real space. Thus, according to this aspect, the user wearing the head mounted display can easily change the position of the virtual camera in the virtual space.

[Supplementary Note 11]
A head mounted display according to one embodiment of the present invention is a head mounted display including a display unit and an information processing device, wherein the information processing device is an image obtained by capturing a virtual space with a virtual camera, A display control unit that displays a stereoscopic image using binocular parallax on the display unit, and an acquisition unit that acquires posture information on the posture of the head mounted display, wherein the display control unit is Changing the position of the virtual camera in the center of the virtual point set in the virtual space based on the posture information, and changing the posture of the virtual camera in the virtual space based on the posture information. 1 control mode and the position of the virtual point in the virtual space are changed based on the posture information, and the virtual camera in the virtual space is changed. And a second control mode for changing the position of the image based on the posture information, and an image can be displayed in a plurality of control modes, and when displaying an image in the first control mode, The control mode is switched from the first control mode to the second control mode when a change amount of the posture indicated by the posture information becomes equal to or more than a reference amount.

According to this aspect, the posture of the virtual camera in the virtual space can be changed based on the posture information in the first control mode, and the virtual camera in the virtual space can be changed based on the posture information in the second control mode. The position of the camera can be changed. For this reason, according to this aspect, it is possible to perform an operation other than a change in the attitude of the virtual camera in the virtual space by changing the attitude of the head mounted display.
According to this aspect, the position of the virtual camera in the virtual space can be changed without changing the position of the head mounted display in the real space. Thus, according to this aspect, the user wearing the head mounted display can easily change the position of the virtual camera in the virtual space.

[Supplementary Note 12]
A display system according to one embodiment of the present invention is a display system including a head-mounted display having a display unit and an information processing device, wherein the information processing device uses an image captured in a virtual camera by a virtual camera. There, a stereoscopic image using binocular parallax, a display control unit that displays on the display unit, and an acquisition unit that acquires posture information related to the posture of the head-mounted display, and the display control unit, The position of the virtual camera in the virtual space is changed based on the posture information around a virtual point set in the virtual space, and the posture of the virtual camera in the virtual space is changed based on the posture information. A first control mode to be changed, and a position of the virtual point in the virtual space being changed based on the posture information, and A second control mode for changing the position of the camera based on the posture information; and displaying images in a plurality of control modes, including: displaying images in the first control mode. The control mode is switched from the first control mode to the second control mode when a change amount of the posture indicated by the posture information is equal to or more than a reference amount.

According to this aspect, the posture of the virtual camera in the virtual space can be changed based on the posture information in the first control mode, and the virtual camera in the virtual space can be changed based on the posture information in the second control mode. The position of the camera can be changed. For this reason, according to this aspect, it is possible to perform an operation other than a change in the attitude of the virtual camera in the virtual space by changing the attitude of the head mounted display.
According to this aspect, the position of the virtual camera in the virtual space can be changed without changing the position of the head mounted display in the real space. Thus, according to this aspect, the user wearing the head mounted display can easily change the position of the virtual camera in the virtual space.

[Appendix 13]
A program for an information processing apparatus according to another aspect of the present invention is a program for an information processing apparatus including a processor, wherein the processor is an image obtained by capturing a virtual space with a virtual camera and uses binocular parallax. The displayed stereoscopic image, a display control unit that causes a display unit provided in a head-mounted display to display, and an acquisition unit that acquires posture information on the posture of the head-mounted display, functioning as the display control unit, A first control mode in which the position of the virtual camera in the virtual space is changed based on the posture information without changing the position of the virtual camera in the virtual space, and a position of the virtual camera in the virtual space. And a second control mode in which the image is changed based on the posture information. In the case where an image is displayed in the first control mode, the control mode is changed from the first control mode to the second control mode when a change amount of the posture indicated by the posture information becomes equal to or more than a reference amount. Mode.

According to this aspect, the posture of the virtual camera in the virtual space can be changed based on the posture information in the first control mode, and the virtual camera in the virtual space can be changed based on the posture information in the second control mode. The position of the camera can be changed. For this reason, according to this aspect, it is possible to perform an operation other than a change in the attitude of the virtual camera in the virtual space by changing the attitude of the head mounted display.
According to this aspect, in the second control mode, the position of the virtual camera in the virtual space can be changed without changing the position of the head mounted display in the real space. Thus, according to this aspect, the user wearing the head mounted display can easily change the position of the virtual camera in the virtual space.

[Appendix 14]
A program for an information processing apparatus according to another aspect of the present invention is a program for an information processing apparatus including a processor, wherein the processor is an image obtained by capturing a virtual space with a virtual camera and uses binocular parallax. The displayed stereoscopic image, a display control unit that causes a display unit provided in a head-mounted display to display, and an acquisition unit that acquires posture information on the posture of the head-mounted display, functioning as the display control unit, The position of the virtual camera in the virtual space is changed based on the posture information around a virtual point set in the virtual space, and the posture of the virtual camera in the virtual space is changed based on the posture information. Changing the first control mode to be changed and the position of the virtual point in the virtual space based on the posture information; The position of definitive the virtual camera, and a second control mode for changing on the basis of the attitude information can be displayed in the image by, characterized in that.

According to this aspect, the posture of the virtual camera in the virtual space can be changed based on the posture information in the first control mode, and the virtual camera in the virtual space can be changed based on the posture information in the second control mode. The position of the camera can be changed. For this reason, according to this aspect, it is possible to perform an operation other than a change in the attitude of the virtual camera in the virtual space by changing the attitude of the head mounted display.
According to this aspect, the position of the virtual camera in the virtual space can be changed without changing the position of the head mounted display in the real space. Thus, according to this aspect, the user wearing the head mounted display can easily change the position of the virtual camera in the virtual space.

[Appendix 15]
A program for an information processing apparatus according to another aspect of the present invention is a program for an information processing apparatus including a processor, wherein the processor is an image obtained by capturing a virtual space with a virtual camera and uses binocular parallax. The displayed stereoscopic image, a display control unit that causes a display unit provided in a head-mounted display to display, and an acquisition unit that acquires posture information on the posture of the head-mounted display, functioning as the display control unit, A first control mode in which the position of the virtual camera in the virtual space is changed based on the posture information without changing the position of the virtual camera in the virtual space, and a position of the virtual camera in the virtual space. And a second control mode in which the image is changed based on the posture information.

According to this aspect, the posture of the virtual camera in the virtual space can be changed based on the posture information in the first control mode, and the virtual camera in the virtual space can be changed based on the posture information in the second control mode. The position of the camera can be changed. For this reason, according to this aspect, it is possible to perform an operation other than a change in the attitude of the virtual camera in the virtual space by changing the attitude of the head mounted display.
According to this aspect, in the second control mode, the position of the virtual camera in the virtual space can be changed without changing the position of the head mounted display in the real space. Thus, according to this aspect, the user wearing the head mounted display can easily change the position of the virtual camera in the virtual space.

DESCRIPTION OF SYMBOLS 1 ... Head mounted display, 10 ... Terminal device, 11 ... Control part, 12 ... Display part, 13 ... Operation part, 14 ... Attitude information generation part, 15 ... Storage part, 90 ... Wearing equipment, 110 ... Display control part, 111 ... Mode designation unit, 112 virtual camera control unit, 113 display information generation unit, 114 posture information acquisition unit, 1000 processor, 1002 angular velocity sensor.

Claims (9)

A program executable by an information processing device having a processor,
The processor,
A stereoscopic image using binocular disparity, which is an image obtained by capturing a virtual space with a virtual camera,
A display control unit for displaying on a display unit provided in the head mounted display,
An acquisition unit for acquiring posture information on the posture of the head-mounted display,
Function
The display control unit,
The position of the virtual camera in the virtual space,
Centering on virtual points set in the virtual space,
Change based on the posture information,
The posture of the virtual camera in the virtual space,
A first control mode that changes based on the posture information;
The position of the virtual point in the virtual space,
Change based on the posture information,
The position of the virtual camera in the virtual space,
A second control mode that changes based on the posture information;
Images can be displayed by
A program characterized by that: The display control unit,
In the first control mode,
A line segment connecting the virtual camera and the virtual point;
The angle formed by a reference straight line in the virtual space determined based on the image displayed on the display unit,
So that it is less than the predetermined angle,
Changing the position and orientation of the virtual camera in the virtual space,
The program according to claim 1, wherein: The display control unit,
In the first control mode,
The interval between the virtual point and the virtual camera in the virtual space,
To maintain a certain distance,
Changing the position and orientation of the virtual camera in the virtual space;
The program according to claim 1, wherein: The display control unit,
In the second control mode,
A line segment connecting the virtual camera and the virtual point;
The angle formed by a reference straight line in the virtual space determined based on the image displayed on the display unit,
So that it is less than the predetermined angle,
The position of the virtual point in the virtual space;
Changing the position of the virtual camera in the virtual space;
The program according to any one of claims 1 to 3, characterized in that: The display control unit,
In the second control mode,
Keeping the attitude of the virtual camera in the virtual space constant,
The program according to claim 4, wherein: The display control unit,
In the second control mode,
The position of the virtual point in the virtual space,
Change by a distance according to the amount of change in the posture indicated by the posture information,
The position of the virtual camera in the virtual space,
Changing by a distance corresponding to the amount of change in the posture indicated by the posture information,
The program according to any one of claims 1 to 5, characterized in that: A stereoscopic image using binocular disparity, which is an image obtained by capturing a virtual space with a virtual camera,
A display control unit for displaying on a display unit provided in the head mounted display,
An acquisition unit for acquiring posture information on the posture of the head-mounted display,
With
The display control unit,
The position of the virtual camera in the virtual space,
Centering on virtual points set in the virtual space,
Change based on the posture information,
The posture of the virtual camera in the virtual space,
A first control mode that changes based on the posture information;
The position of the virtual point in the virtual space,
Change based on the posture information,
The position of the virtual camera in the virtual space,
A second control mode that changes based on the posture information;
Images can be displayed by
An information processing apparatus, characterized in that: A display unit, and a head mounted display including an information processing device,
The information processing device,
A stereoscopic image using binocular disparity, which is an image obtained by capturing a virtual space with a virtual camera,
A display control unit to be displayed on the display unit,
An acquisition unit for acquiring posture information on the posture of the head-mounted display,
With
The display control unit,
The position of the virtual camera in the virtual space,
Centering on virtual points set in the virtual space,
Change based on the posture information,
The posture of the virtual camera in the virtual space,
A first control mode that changes based on the posture information;
The position of the virtual point in the virtual space,
Change based on the posture information,
The position of the virtual camera in the virtual space,
A second control mode that changes based on the posture information;
Images can be displayed by
A head-mounted display, characterized in that: A head-mounted display having a display unit, and an information processing device, a display system comprising:
The information processing device,
A stereoscopic image using binocular disparity, which is an image obtained by capturing a virtual space with a virtual camera,
A display control unit to be displayed on the display unit,
An acquisition unit for acquiring posture information on the posture of the head-mounted display,
With
The display control unit,
The position of the virtual camera in the virtual space,
Centering on virtual points set in the virtual space,
Change based on the posture information,
The posture of the virtual camera in the virtual space,
A first control mode that changes based on the posture information;
The position of the virtual point in the virtual space,
Change based on the posture information,
The position of the virtual camera in the virtual space,
A second control mode that changes based on the posture information;
Images can be displayed by
A display system, characterized in that:

Images