WO2018124280A1 - Simulation system, image processing method, and information storage medium - Google Patents

Abstract

This simulation system includes a virtual space setting unit, a moving body processing unit, and a display processing unit. The virtual space setting unit sets a first virtual space and a second virtual space as virtual spaces. Until a switching condition is established, the display processing unit sets positional information about a user's moving body or a virtual camera as positional information in the first virtual space, performs a process for rendering an image of the second virtual space such that the image of the second virtual space is added to an image of the first virtual space, and generates an image in which the image of the second virtual space is displayed in an area corresponding to a singular point. When the switching condition has been established, the display processing unit sets the positional information about the user's moving body or the virtual camera as positional information in the second virtual space, performs a process for rendering an image of the first virtual space such that the image of the first virtual space is added to an image of the second virtual space, and generates an image in which the image of the first virtual space is displayed in an area corresponding to a singular point.

Description

Simulation system, image processing method, and information storage medium

The present invention relates to a simulation system, an image processing method, an information storage medium, and the like.

Conventionally, a simulation system that generates an image that can be seen from a virtual camera in a virtual space is known. For example, as a conventional technique of a simulation system that realizes virtual reality (VR) by displaying an image viewed from a virtual camera on an HMD (head-mounted display device), there is a technique disclosed in Patent Document 1 or the like.

Japanese Patent Laid-Open No. 11-309269

In such a simulation system, only one virtual space is set as a virtual space in which a plurality of objects are arranged and set. And a user will enjoy the world of virtual reality because the user character corresponding to himself moves in the one virtual space. However, conventionally, for example, a simulation system that realizes a virtual reality capable of moving in a plurality of virtual spaces has not been proposed.

According to some aspects of the present invention, it is possible to provide a simulation system, an image processing method, an information storage medium, and the like that can realize a virtual reality that can move in a plurality of virtual spaces.

One aspect of the present invention includes a virtual space setting unit that performs a setting process of a virtual space in which an object is arranged, a moving object processing unit that performs a process of moving a user moving object corresponding to a user in the virtual space, A display processing unit that performs drawing processing of an image viewed from a virtual camera in the virtual space, wherein the virtual space setting unit is specific to the first virtual space and the first virtual space as the virtual space A second virtual space that is connected via a point, and the display processing unit displays the position information of the user moving object or the virtual camera before the given switching condition is established. Corresponding to the singular point by performing a process of drawing the image of the second virtual space in addition to the image of the first virtual space as the first drawing process. Territory Generating the image in which the image of the second virtual space is displayed, and the switching condition is satisfied when the user moving body or the virtual camera passes through the place corresponding to the singular point in the first traveling direction. In this case, the position information of the user moving body or the virtual camera is set as the position information of the second virtual space, and is added to the image of the second virtual space as a second drawing process. The first virtual space image is rendered to generate an image in which the first virtual space image is displayed in a region corresponding to the singular point, and the display processing unit includes the virtual camera The present invention relates to a simulation system that generates an image in which an image of the first virtual space is displayed in a region corresponding to the singular point when the line-of-sight direction is directed in the direction opposite to the first traveling direction. . The present invention also relates to a program that causes a computer to function as each of the above-described units, or a computer-readable information storage medium that stores the program.

According to one aspect of the present invention, an image that can be seen from a virtual camera is generated in a virtual space in which a user moving object moves. A first virtual space and a second virtual space are set as the virtual space. Before the switching condition is satisfied, the position information of the user moving body or the virtual camera is set as the position information of the first virtual space, and the image of the second virtual space is added to the image of the first virtual space. An image is generated in which the image of the second virtual space is displayed in the region corresponding to the singular point. On the other hand, when the switching condition is satisfied, the position information of the user moving body or the virtual camera is set as the position information of the second virtual space, and the image of the first virtual space is drawn in addition to the image of the second virtual space. Thus, an image in which the image of the first virtual space is displayed in the region corresponding to the singular point is generated. In one aspect of the present invention, an image in which an image of the first virtual space is displayed in a region corresponding to a singular point when the line-of-sight direction of the virtual camera faces the opposite direction side of the first traveling direction. Will be generated. In this way, the user moving body or the virtual camera passes through the region corresponding to the singular point, so that the position of the user moving body or the virtual camera is changed from the position of the first virtual space to the position of the second virtual space. It will be switched. When the user moving body or the virtual camera is located in the first virtual space, the image of the second virtual space is drawn in addition to the image of the first virtual space, and the second virtual space is drawn in the region corresponding to the singular point. The image of the virtual space 2 is displayed. On the other hand, when the user moving body or the virtual camera is located in the second virtual space, the image of the first virtual space is drawn in addition to the image of the second virtual space, and the region corresponding to the singular point is drawn. An image of the first virtual space is displayed. This makes it possible to provide a simulation system or the like that can realize a virtual reality that can move in a plurality of virtual spaces.

In the aspect of the invention, the display processing unit may be configured such that when the user moving body or the virtual camera passes through the singular point in a second traveling direction different from the first traveling direction, The position information of the user moving body or the virtual camera is set as the position information of the first virtual space, and as the first drawing process, a process of drawing at least an image of the first virtual space is performed. Also good.

In this way, the user moving body or the virtual camera passes through the region corresponding to the singular point in the second traveling direction different from the first traveling direction, so that the position of the user moving body or the virtual camera is changed. The position of the second virtual space is switched to the position of the first virtual space.

Moreover, in one aspect of the present invention, the display processing unit, when the switching condition is satisfied by the user moving body or the virtual camera passing through a location corresponding to the singular point, the user moving body or the The position information of the virtual camera may be set as the position information of the third virtual space, and a process of drawing at least an image of the third virtual space may be performed as the third drawing process.

This makes it possible to provide a simulation system or the like that can realize a virtual reality that moves in the third virtual space in addition to the first and second virtual spaces.

In the aspect of the invention, the display processing unit may correspond to the singular points, when the plurality of users play, the plurality of user moving bodies corresponding to the plurality of users or the plurality of virtual cameras. The third drawing process may be permitted on condition that the vehicle passes through a place and returns to the first virtual space.

In this way, when a plurality of users play, some users can be prevented from being left in the second virtual space.

In one aspect of the present invention, the display processing unit may determine whether or not the switching condition is satisfied based on the input information of the user or the detection information of the sensor.

In this way, it is possible to realize a process of switching the virtual space based on user input information or sensor detection information.

In one aspect of the present invention, an object corresponding to the singular point is arranged in a play field in the real space in which the user moves, and the display processing unit is configured to allow the user to move the object in the real space. When passing through a place, it may be determined that the user moving body or the virtual camera has passed through a place corresponding to the singular point.

In this way, by actually passing the location of the object corresponding to the singular point in the real space, it is determined that the corresponding user moving body or virtual camera has passed the location of the singular point. Therefore, the virtual reality of the user can be improved.

In one aspect of the present invention, the display processing unit may perform processing for setting or not setting the singular point.

This makes it possible to switch between setting and non-setting of singular points, and to realize more various game processing and game effects.

Moreover, in one aspect of the present invention, it includes a sensation device control unit that controls a sensation device for allowing the user to experience virtual reality (a computer functions as the sensation device control unit), and the sensation device control unit includes the switching The control of the sensation apparatus when the condition is not satisfied may be different from the control of the sensation apparatus when the switching condition is satisfied.

This makes it possible for the user to effectively experience the fact that the virtual space has been switched using the sensation apparatus.

Moreover, in one aspect of the present invention, when a plurality of users play, a notification processing unit that performs a process of outputting notification information of collision between users in real space may be included (a computer is caused to function as the notification processing unit). May be)

In this way, for example, in a situation where a collision between users occurs in the real space even though no collision occurs in the virtual space, the possibility of the occurrence of the collision between the users is effective for the user. Can be informed.

Moreover, in one mode of the present invention, an information acquisition unit that acquires position information of the user in real space is included (a computer is caused to function as the information acquisition unit), and the moving body processing unit includes the acquired position information. The display processing unit generates a display image of a head-mounted display device worn by the user, and the display processing unit satisfies the switching condition. Before, the position information of the user moving body or the virtual camera specified by the position information of the user in the real space is set as the position information of the first virtual space, and the switching condition is If established, the position information of the user moving object or the virtual camera specified by the position information of the user in the real space is used as the position information of the second virtual space. It may be set Te.

In this way, the position information of the user in the real space is acquired, and the user moving body or the like is moved in the virtual space based on the acquired position information. When the switching condition is satisfied, the position of the user moving body or the virtual camera is switched from the position of the first virtual space to the position of the second virtual space, further improving the virtual reality that moves in a plurality of virtual spaces. It becomes possible to do.

One embodiment of the present invention is based on an information acquisition unit that acquires position information of a user in real space, a virtual space setting unit that performs setting processing of a virtual space in which an object is arranged, and the acquired position information. A moving body processing unit that performs a process of moving a user moving body corresponding to the user in the virtual space, and a head-mounted type that performs a drawing process of an image viewed from a virtual camera in the virtual space and is worn by the user A display processing unit configured to generate an image to be displayed on a display device, wherein the virtual space setting unit includes, as the virtual space, a first virtual space and a singular point with respect to the first virtual space. A second virtual space to be associated with each other, and the display processing unit sets the user specified by the position information of the user in the real space before a given switching condition is satisfied. The position information of the moving body or the virtual camera is set as the position information of the first virtual space, and as the first drawing process, at least an image of the first virtual space is drawn, and the user When the moving condition or the virtual camera passes through the place corresponding to the singular point in the first traveling direction and the switching condition is satisfied, it is specified by the position information of the user in the real space. Simulation that sets the position information of the user moving body or the virtual camera as position information of the second virtual space and performs a process of drawing at least an image of the second virtual space as a second drawing process. Related to the system. The present invention also relates to a program that causes a computer to function as each of the above-described units, or a computer-readable information storage medium that stores the program.

According to one aspect of the present invention, user position information in real space is acquired, and a user moving body or the like is moved in the virtual space based on the acquired position information. When the switching condition is satisfied, the position of the user moving body or the virtual camera is switched from the position of the first virtual space to the position of the second virtual space. This makes it possible to provide a simulation system or the like that can realize a virtual reality that can move in a plurality of virtual spaces.

According to another aspect of the present invention, there is provided a virtual space setting process for setting a virtual space in which an object is arranged, a moving body process for moving a user moving body corresponding to a user in the virtual space, and a virtual space in the virtual space. Display processing for rendering an image visible from the camera, and in the virtual space setting processing, the virtual space is connected to the first virtual space and the first virtual space via a singular point The position information of the user moving body or the virtual camera is used as the position information of the first virtual space before a given switching condition is satisfied in the display process. Set and perform a process of drawing the image of the second virtual space in addition to the image of the first virtual space as the first drawing process, and the region corresponding to the singular point When an image in which an image of the virtual space of 2 is displayed is generated and the user moving body or the virtual camera passes through the place corresponding to the singular point in the first traveling direction, the switching condition is satisfied. Sets the position information of the user moving body or the virtual camera as the position information of the second virtual space, and in addition to the image of the second virtual space as the second drawing process, the first information To generate an image in which the image of the first virtual space is displayed in an area corresponding to the singular point. In the display process, the line-of-sight direction of the virtual camera is The present invention relates to an image processing method for generating an image in which an image of the first virtual space is displayed in a region corresponding to the singular point when facing in the direction opposite to the first traveling direction.

Another aspect of the present invention is based on information acquisition processing for acquiring user location information in real space, virtual space setting processing for setting a virtual space in which an object is placed, and the acquired location information. In the virtual space, a moving body process for moving a user moving body corresponding to the user and a drawing process for an image visible from the virtual camera in the virtual space are performed and displayed on the head-mounted display device worn by the user. Display processing for generating an image, and in the virtual space setting processing, as the virtual space, a first virtual space and a second virtual linked to the first virtual space via a singular point In the display process, before the given switching condition is satisfied, the user moving body or the user specified by the position information of the user in the real space is set. The position information of the virtual camera is set as the position information of the first virtual space, and as a first drawing process, a process of drawing at least an image of the first virtual space is performed, and the user moving object or The user movement specified by the position information of the user in the real space when the switching condition is satisfied when the virtual camera passes through a place corresponding to the singular point in a first traveling direction. An image processing method for setting the position information of a body or the virtual camera as position information of the second virtual space and performing at least a process of drawing an image of the second virtual space as a second drawing process Involved.

The block diagram which shows the structural example of the simulation system of this embodiment. FIG. 2A and FIG. 2B are examples of the HMD used in this embodiment. 3A and 3B are other examples of the HMD used in the present embodiment. The perspective view explaining the play field of a simulation system. The top view explaining the play field of a simulation system. FIG. 6A to FIG. 6E are explanatory diagrams of an example of a virtual space switching method. The example of an image at the time of seeing a door from the 1st virtual space side. Explanatory drawing of 2nd virtual space. The example of an image at the time of seeing a door from the 2nd virtual space side. FIG. 10A and FIG. 10B are explanatory diagrams of a control example of the sensation apparatus in the second virtual space. 11A and 11B are explanatory diagrams of images in the third virtual space. Explanatory drawing of the image of 3rd virtual space. FIG. 13A and FIG. 13B are explanatory diagrams of the method of this embodiment. FIG. 14A and FIG. 14B are explanatory diagrams of the method of this embodiment. FIGS. 15A and 15B are explanatory diagrams of a switching method to the third virtual space. Explanatory drawing of the switching method to the 3rd virtual space. FIG. 17A and FIG. 17B are explanatory diagrams of the technique of this embodiment when a plurality of users play. FIG. 18A and FIG. 18B are explanatory diagrams of the technique of this embodiment when a plurality of users play. 19A and 19B are explanatory diagrams of a switching method based on user input information and sensor detection information. FIG. 20A and FIG. 20B are explanatory diagrams of a method for switching the virtual space by arranging an object corresponding to a singular point. FIG. 21A and FIG. 21B are explanatory diagrams of a method for setting or not setting a singular point. 22A and 22B are explanatory diagrams of a control method for the sensation apparatus. FIGS. 23A and 23B are explanatory diagrams of a method for outputting collision notification information. Explanatory drawing of the output method of the alerting | reporting information of a collision. FIG. 25A and FIG. 25B are explanatory diagrams of a special image display example in the present embodiment. FIG. 26A and FIG. 26B are explanatory diagrams of a method for acquiring position information of a user wearing an HMD. The flowchart which shows the detailed process example of this embodiment.

Hereinafter, this embodiment will be described. In addition, this embodiment demonstrated below does not unduly limit the content of this invention described in the claim. In addition, all the configurations described in the present embodiment are not necessarily essential configuration requirements of the present invention.

1. Simulation System FIG. 1 is a block diagram illustrating a configuration example of a simulation system (a simulator, a game system, and an image generation system) according to the present embodiment. The simulation system of this embodiment is a system that simulates virtual reality (VR), for example, a game system that provides game content, a real-time simulation system such as a sports competition simulator and a driving simulator, a system that provides SNS services, and video The present invention can be applied to various systems such as a content providing system that provides content such as an operating system that implements remote work. Note that the simulation system of the present embodiment is not limited to the configuration shown in FIG. 1, and various modifications such as omitting some of the components (each unit) or adding other components are possible.

The operation unit 160 is for a user (player) to input various operation information (input information). The operation unit 160 can be realized by various operation devices such as an operation button, a direction instruction key, a joystick, a handle, a pedal, a lever, or a voice input device.

The storage unit 170 stores various types of information. The storage unit 170 functions as a work area such as the processing unit 100 or the communication unit 196. The game program and game data necessary for executing the game program are held in the storage unit 170. The function of the storage unit 170 can be realized by a semiconductor memory (DRAM, VRAM), HDD (Hard Disk Drive), SSD, optical disk device, or the like. The storage unit 170 includes an object information storage unit 172 and a drawing buffer 178.

The information storage medium 180 (a computer-readable medium) stores programs, data, and the like, and its function can be realized by an optical disk (DVD, BD, CD), HDD, semiconductor memory (ROM), or the like. . The processing unit 100 performs various processes of the present embodiment based on a program (data) stored in the information storage medium 180. That is, in the information storage medium 180, a program for causing a computer (an apparatus including an input device, a processing unit, a storage unit, and an output unit) to function as each unit of the present embodiment (a program for causing the computer to execute processing of each unit). Is memorized.

The HMD 200 (head-mounted display device) is a device that is mounted on the user's head and displays an image in front of the user's eyes. The HMD 200 is preferably a non-transmissive type, but may be a transmissive type. The HMD 200 may be a so-called glasses-type HMD.

The HMD 200 includes a sensor unit 210, a display unit 220, and a processing unit 240. A modification in which a light emitting element is provided in the HMD 200 is also possible. The sensor unit 210 is for realizing tracking processing such as head tracking, for example. For example, the position and direction of the HMD 200 are specified by tracking processing using the sensor unit 210. By specifying the position and direction of the HMD 200, the user's viewpoint position and line-of-sight direction can be specified.

A variety of tracking methods can be used. In the first tracking method, which is an example of the tracking method, a plurality of light receiving elements (photodiodes and the like) are provided as the sensor unit 210, as will be described in detail with reference to FIGS. 2A and 2B described later. Then, by receiving light (laser or the like) from a light emitting element (LED or the like) provided outside by the plurality of light receiving elements, the position of the HMD 200 (user's head) in the real world three-dimensional space, Identify the direction. In the second tracking method, a plurality of light emitting elements (LEDs) are provided in the HMD 200 as will be described in detail with reference to FIGS. 3A and 3B described later. And the position and direction of HMD200 are pinpointed by imaging the light from these light emitting elements with the imaging part provided outside. In the third tracking method, a motion sensor is provided as the sensor unit 210, and the position and direction of the HMD 200 are specified using this motion sensor. The motion sensor can be realized by, for example, an acceleration sensor or a gyro sensor. For example, by using a 6-axis motion sensor using a 3-axis acceleration sensor and a 3-axis gyro sensor, the position and direction of the HMD 200 in a three-dimensional space in the real world can be specified. Note that the position and direction of the HMD 200 may be specified by a combination of the first tracking method and the second tracking method, or a combination of the first tracking method and the third tracking method. Further, instead of specifying the user's viewpoint position and line-of-sight direction by specifying the position and direction of the HMD 200, tracking processing that directly specifies the user's viewpoint position and line-of-sight direction may be employed.

The display unit 220 of the HMD 200 can be realized by, for example, an organic EL display (OEL) or a liquid crystal display (LCD). For example, the display unit 220 of the HMD 200 includes a first display or first display area set in front of the user's left eye and a second display or second display area set in front of the right eye. It is provided and stereoscopic display is possible. When performing stereoscopic display, for example, a left-eye image and a right-eye image with different parallax are generated, a left-eye image is displayed on the first display, and a right-eye image is displayed on the second display. To do. Alternatively, the left-eye image is displayed in the first display area of one display, and the right-eye image is displayed in the second display area. The HMD 200 is provided with two eyepiece lenses (fisheye lenses) for the left eye and the right eye, thereby expressing a VR space that extends over the entire perimeter of the user's field of view. Then, correction processing for correcting distortion generated in an optical system such as an eyepiece is performed on the left-eye image and the right-eye image. This correction process is performed by the display processing unit 120.

The processing unit 240 of the HMD 200 performs various processes necessary for the HMD 200. For example, the processing unit 240 performs control processing of the sensor unit 210, display control processing of the display unit 220, and the like. Further, the processing unit 240 may perform a three-dimensional sound (stereoscopic sound) process to realize reproduction of a three-dimensional sound direction, distance, and spread.

In addition, although the example in case the display part of a simulation system is HMD200 is shown in FIG. 1, the display part of a simulation system may be a display part of types other than HMD. For example, the display unit of the simulation system may be, for example, a display (ordinary 2D monitor or dome screen) in an arcade game device, a television in a home game device, or a display in a personal computer (PC).

The sound output unit 192 outputs the sound generated by the present embodiment, and can be realized by, for example, a speaker or headphones.

The I / F (interface) unit 194 performs interface processing with the portable information storage medium 195, and its function can be realized by an ASIC for I / F processing or the like. The portable information storage medium 195 is for a user to save various types of information, and is a storage device that retains storage of such information even when power is not supplied. The portable information storage medium 195 can be realized by an IC card (memory card), a USB memory, a magnetic card, or the like.

The communication unit 196 communicates with the outside (another apparatus) via a wired or wireless network, and functions thereof are hardware such as a communication ASIC or communication processor, or communication firmware. Can be realized.

A program (data) for causing a computer to function as each unit of this embodiment is distributed from the information storage medium of the server (host device) to the information storage medium 180 (or storage unit 170) via the network and communication unit 196. May be. Use of an information storage medium by such a server (host device) can also be included in the scope of the present invention.

The processing unit 100 (processor) is used for operation information from the operation unit 160, tracking information in the HMD 200 (information on at least one of the position and direction of the HMD, information on at least one of the viewpoint position and the line-of-sight direction), a program, and the like. Based on this, game processing (simulation processing), virtual space setting processing, moving body processing, virtual camera control processing, display processing, sound processing, or the like is performed.

Each process (each function) of this embodiment performed by each unit of the processing unit 100 can be realized by a processor (a processor including hardware). For example, each process of the present embodiment can be realized by a processor that operates based on information such as a program and a memory that stores information such as a program. In the processor, for example, the function of each unit may be realized by individual hardware, or the function of each unit may be realized by integrated hardware. For example, the processor may include hardware, and the hardware may include at least one of a circuit that processes a digital signal and a circuit that processes an analog signal. For example, the processor can be configured by one or a plurality of circuit devices (for example, ICs) mounted on a circuit board or one or a plurality of circuit elements (for example, resistors, capacitors, etc.). The processor may be, for example, a CPU (Central Processing Unit). However, the processor is not limited to the CPU, and various processors such as a GPU (GraphicsＧProcessing Unit) or a DSP (Digital Signal Processor) can be used. The processor may be an ASIC hardware circuit. The processor may include an amplifier circuit, a filter circuit, and the like that process an analog signal. The memory (storage unit 170) may be a semiconductor memory such as SRAM or DRAM, or may be a register. Alternatively, it may be a magnetic storage device such as a hard disk device (HDD) or an optical storage device such as an optical disk device. For example, the memory stores instructions that can be read by a computer, and the processing (function) of each unit of the processing unit 100 is realized by executing the instructions by the processor. The instruction here may be an instruction set constituting a program, or an instruction for instructing an operation to the hardware circuit of the processor.

The processing unit 100 includes an input processing unit 102, an arithmetic processing unit 110, and an output processing unit 140. The arithmetic processing unit 110 includes an information acquisition unit 111, a virtual space setting unit 112, a moving body processing unit 113, a virtual camera control unit 114, a game processing unit 115, a notification processing unit 116, a sensation device control unit 117, a display processing unit 120, A sound processing unit 130 is included. As described above, each process of the present embodiment executed by these units can be realized by a processor (or a processor and a memory). Various modifications such as omitting some of these components (each unit) or adding other components are possible.

The input processing unit 102 performs processing for receiving operation information and tracking information, processing for reading information from the storage unit 170, and processing for receiving information via the communication unit 196 as input processing. For example, the input processing unit 102 stores, in the storage unit 170, processing for acquiring operation information input by the user using the operation unit 160, tracking information detected by the sensor unit 210 of the HMD 200, and the information specified by the read command. A process for reading data from a computer or a process for receiving information from an external device (such as a server) via a network is performed as an input process. Here, the reception process includes a process of instructing the communication unit 196 to receive information, a process of acquiring information received by the communication unit 196, and writing the information in the storage unit 170, and the like.

The arithmetic processing unit 110 performs various arithmetic processes. For example, arithmetic processing such as information acquisition processing, virtual space setting processing, moving body processing, virtual camera control processing, game processing (simulation processing), display processing, or sound processing is performed.

The information acquisition unit 111 (program module for information acquisition processing) performs various information acquisition processing. For example, the information acquisition unit 111 acquires position information of the user wearing the HMD 200 and the like. The information acquisition unit 111 may acquire user direction information and the like.

The virtual space setting unit 112 (program module for virtual space setting processing) performs setting processing for a virtual space (object space) in which objects are arranged. For example, various objects representing display objects such as moving objects (people, robots, cars, trains, airplanes, ships, monsters, animals, etc.), maps (terrain), buildings, auditoriums, courses (roads), trees, walls, water surfaces, etc. A process of placing and setting an object (an object composed of a primitive surface such as a polygon, a free-form surface, or a subdivision surface) in a virtual space is performed. In other words, the position and rotation angle of the object in the world coordinate system (synonymous with direction and direction) are determined, and the rotation angle (rotation angle around the X, Y, and Z axes) is determined at that position (X, Y, Z). Arrange objects. Specifically, in the object information storage unit 172 of the storage unit 170, object information that is information such as the position, rotation angle, moving speed, and moving direction of an object (part object) in the virtual space is associated with the object number. Is memorized. The virtual space setting unit 112 performs a process of updating the object information for each frame, for example.

The moving body processing unit 113 (moving body processing program module) performs various processes on the moving body moving in the virtual space. For example, processing for moving the moving body in virtual space (object space, game space) and processing for moving the moving body are performed. For example, the mobile object processing unit 113 is based on operation information input by the user through the operation unit 160, acquired tracking information, a program (movement / motion algorithm), various data (motion data), and the like. Control processing for moving the model object) in the virtual space or moving the moving object (motion, animation) is performed. Specifically, a simulation for sequentially obtaining movement information (position, rotation angle, speed, or acceleration) and motion information (part object position or rotation angle) of a moving body for each frame (for example, 1/60 second). Process. A frame is a unit of time for performing a moving / movement process (simulation process) and an image generation process of a moving object. The moving body is, for example, a user moving body corresponding to a user (player) in real space. The user moving body is a virtual user (virtual player, avatar) in the virtual space, or a boarding moving body (operation moving body) on which the virtual user is boarded (operated).

The virtual camera control unit 114 (virtual camera control processing program module) controls the virtual camera. For example, a process for controlling the virtual camera is performed based on user operation information, tracking information, and the like input by the operation unit 160.

For example, the virtual camera control unit 114 controls the virtual camera set as the first-person viewpoint or the third-person viewpoint of the user. For example, by setting a virtual camera at a position corresponding to the viewpoint (first-person viewpoint) of a user moving body moving in the virtual space, and setting the viewpoint position and line-of-sight direction of the virtual camera, the position (positional coordinates) of the virtual camera And control the attitude (rotation angle around the rotation axis). Alternatively, the position and orientation of the virtual camera are controlled by setting the virtual camera at the position of the viewpoint (third-person viewpoint) following the user moving body and setting the viewpoint position and line-of-sight direction of the virtual camera.

For example, the virtual camera control unit 114 controls the virtual camera so as to follow the change of the user's viewpoint based on the tracking information of the user's viewpoint information acquired by the viewpoint tracking. For example, in the present embodiment, tracking information (viewpoint tracking information) of viewpoint information that is at least one of the user's viewpoint position and line-of-sight direction is acquired. This tracking information can be acquired by performing tracking processing of the HMD 200, for example. Then, the virtual camera control unit 114 changes the viewpoint position and the line-of-sight direction of the virtual camera based on the acquired tracking information (information on at least one of the user's viewpoint position and the line-of-sight direction). For example, the virtual camera control unit 114 is configured so that the viewpoint position and the line-of-sight direction (position and posture) of the virtual camera change in the virtual space according to changes in the viewpoint position and the line-of-sight direction of the user in the real space. Set up the camera. By doing in this way, a virtual camera can be controlled to follow a user's viewpoint change based on tracking information of a user's viewpoint information.

The game processor 115 (game processing program module) performs various game processes for the user to play the game. In other words, the game processing unit 115 (simulation processing unit) executes various simulation processes for the user to experience virtual reality (virtual reality). The game process is, for example, a process for starting a game when a game start condition is satisfied, a process for advancing the started game, a process for ending a game when a game end condition is satisfied, or calculating a game result. Processing.

The notification processing unit 116 (program module for notification processing) performs various types of notification processing. For example, a warning notification process for the user is performed. The notification process may be a notification process using an image or sound, for example, or may be a notification process using a sensation device such as a vibration device, sound, or an air cannon. The sensation device control unit 117 (program module for sensation device control processing) performs various control processes of the sensation device. For example, the sensation device is controlled to allow the user to experience virtual reality.

The display processing unit 120 (display processing program module) performs display processing of a game image (simulation image). For example, a drawing process is performed based on the results of various processes (game process, simulation process) performed by the processing unit 100, thereby generating an image and displaying it on the display unit 220. Specifically, geometric processing such as coordinate transformation (world coordinate transformation, camera coordinate transformation), clipping processing, perspective transformation, or light source processing is performed. Based on the processing result, drawing data (the position of the vertex of the primitive surface) Coordinates, texture coordinates, color data, normal vector, α value, etc.) are created. Based on the drawing data (primitive surface data), the object (one or a plurality of primitive surfaces) after perspective transformation (after geometry processing) is converted into image information in units of pixels such as a drawing buffer 178 (frame buffer, work buffer, etc.). Draw in a buffer that can be stored. As a result, an image that can be seen from the virtual camera (given viewpoints, the first and second viewpoints for the left eye and the right eye) in the virtual space is generated. Note that the drawing processing performed by the display processing unit 120 can be realized by vertex shader processing, pixel shader processing, or the like.

The sound processing unit 130 (sound processing program module) performs sound processing based on the results of various processes performed by the processing unit 100. Specifically, game sounds such as music (music, BGM), sound effects, or sounds are generated, and the game sounds are output to the sound output unit 192. Note that part of the sound processing of the sound processing unit 130 (for example, three-dimensional sound processing) may be realized by the processing unit 240 of the HMD 200.

The output processing unit 140 performs various types of information output processing. For example, the output processing unit 140 performs processing for writing information in the storage unit 170 and processing for transmitting information via the communication unit 196 as output processing. For example, the output processing unit 140 performs a process of writing information specified by a write command in the storage unit 170 or a process of transmitting information to an external apparatus (server or the like) via a network. The transmission process is a process of instructing the communication unit 196 to transmit information, or instructing the communication unit 196 to transmit information.

And the simulation system of this embodiment contains the virtual space setting part 112, the mobile body process part 113, and the display process part 120, as shown in FIG.

The virtual space setting unit 112 performs processing for setting a virtual space in which objects are arranged. For example, a process is performed in which an object of a user moving object corresponding to the user, an object of an opponent moving object such as an enemy, and an object constituting a map or background are set in the virtual space. The user moving body corresponding to the user is, for example, a moving body that the user operates with the operation unit 160 or a moving body that moves in the virtual space following the movement of the user in the real space. This user moving body is called, for example, a character or an avatar. The user mobile body may be a boarding mobile body such as a robot on which the user is boarding. Further, the user moving body may be a display object on which the image is displayed, or may be a virtual object on which the image is not displayed.

The moving body processing unit 113 performs processing for moving a user moving body (virtual camera) corresponding to the user in the virtual space. For example, the user moving body is moved in the virtual space based on the operation information input by the user through the operation unit 160. Or when the information acquisition part 111 acquires the positional information on the user in real space, the mobile body process part 113 is a user mobile body in virtual space based on the acquired positional information (viewpoint tracking information). Process to move. For example, the user moving body is moved in the virtual space so as to move following the movement of the user in the real space. For example, based on the moving speed and moving acceleration of the user moving body, a process of updating the position of the user moving body for each frame is performed to move the user moving body in the virtual space (virtual field).

The display processing unit 120 (drawing processing unit) performs drawing processing of an image (object) in the virtual space. For example, a drawing process of an image viewed from a virtual camera (a given viewpoint) in the virtual space is performed. For example, a drawing process of an image seen from a virtual camera set as a viewpoint (first person viewpoint) of a user moving body such as a character (avatar) is performed. Alternatively, a drawing process of an image seen from a virtual camera set to a viewpoint (third person viewpoint) that follows the user moving body is performed. The generated image is desirably a stereoscopic image such as a left-eye image or a right-eye image.

In this embodiment, the virtual space setting unit 112 sets a plurality of first to Mth virtual spaces (M is an integer of 2 or more) as the virtual space. Specifically, the virtual space setting unit 112 sets a first virtual space and a second virtual space as virtual spaces. For example, an arrangement setting process for objects constituting the first virtual space and an arrangement setting process for objects constituting the second virtual space are performed. When the first virtual space is a room space as described later, an object placement setting process corresponding to an object placed in the room is performed. When the second virtual space is an ice country space as will be described later, an object placement setting process corresponding to a glacier or sea of the ice country is performed. Furthermore, the virtual space setting unit 112 sets, for example, a third virtual space. When the third virtual space is a space above a train, which will be described later, an object placement setting process corresponding to a train, tunnel, background, or the like is performed. For example, the second virtual space is a virtual space that is linked to the first virtual space via a singular point (in other words, a passing point; hereinafter the same). For example, the third virtual space may be a virtual space that is linked to the first virtual space via a singular point, or may be a virtual space that is linked to the second virtual space via a singular point. There may be.

Then, before the given switching condition (single point passage condition) is satisfied (when the switching condition is not satisfied), the display processing unit 120 detects the position information (position coordinates) of the user moving object or the virtual camera. , Direction, etc.) is set as position information (position coordinates, direction, etc.) of the first virtual space. For example, the position information of the user moving body or the virtual camera is associated as the position information of the first virtual space. Then, the display processing unit 120 performs a process of drawing at least an image of the first virtual space as the first drawing process. For example, as the first drawing process, the display processing unit 120 performs a process of drawing an image of the second virtual space in addition to the image of the first virtual space, and includes an area corresponding to the singular point (including the singular point). An image in which the image of the second virtual space is displayed in a region to be generated) is generated. The drawing process of the image in the first virtual space is realized, for example, by drawing an object configuring the first virtual space and drawing an image that can be seen from the virtual camera in the first virtual space. In the process of drawing the image of the second virtual space in addition to the image of the first virtual space, for example, for an area (display area) other than the area corresponding to the singular point, the object constituting the first virtual space is changed. A region (display region) corresponding to a singular point is rendered by rendering an object constituting the second virtual space and rendering an image that can be viewed from the virtual camera in the first virtual space. .

On the other hand, when the switching condition is satisfied, the display processing unit 120 sets the position information of the user moving body or the virtual camera as the position information of the second virtual space. For example, when the switching condition is satisfied when the user moving body or the virtual camera passes through the place corresponding to the singular point in the first traveling direction, the position information of the user moving body or the virtual camera is stored in the second virtual space. Set as location information. For example, the position information of the user moving body or the virtual camera is associated as the position information of the second virtual space instead of the first virtual space. And the display process part 120 performs the process which draws the image of a 2nd virtual space at least as a 2nd drawing process. For example, as the second drawing process, the display processing unit 120 performs a process of drawing an image of the first virtual space in addition to the image of the second virtual space, and the first virtual space is displayed in the region corresponding to the singular point. An image in which an image of the space is displayed is generated. The drawing process of the image in the second virtual space is realized, for example, by drawing an object constituting the second virtual space and drawing an image that can be seen from the virtual camera in the second virtual space. In the process of drawing the image of the first virtual space in addition to the image of the second virtual space, for example, for an area (display area) other than the area corresponding to the singular point, the object constituting the second virtual space is changed. The region (display region) corresponding to the singular point is drawn and is realized by drawing an object constituting the first virtual space and drawing an image seen from the virtual camera in the second virtual space. .

For example, it is assumed that an area (object or area) corresponding to a singular point is an area of a door (gate) described later. In this case, in the first drawing process for drawing the image of the second virtual space in addition to the image of the first virtual space, the second virtual space on the other side of the door with respect to the door region. Drawing processing is performed so that an image is displayed. Similarly, in the second drawing process for drawing the image of the first virtual space in addition to the image of the second virtual space, the image of the first virtual space on the other side of the door with respect to the door area. The drawing process is performed so that is displayed.

Then, the display processing unit 120 generates an image in which an image of the first virtual space is displayed in a region corresponding to the singular point when the line-of-sight direction of the virtual camera faces the opposite direction side of the first traveling direction. To do. For example, after the user moving body or virtual camera passes through a place corresponding to a singular point, when the visual line direction of the virtual camera turns to the opposite direction side of the traveling direction, as an image that can be seen in the visual line direction of the virtual camera, An image in which an image of the first virtual space is displayed in a region corresponding to the singular point is generated. For example, by performing the process of drawing the image of the first virtual space in addition to the image of the second virtual space, the second virtual space is changed for the region (main region) other than the region corresponding to the singular point. For the area corresponding to the singular point, an image that draws the object constituting the first virtual space is generated. On the other hand, when the direction of the line of sight of the virtual camera is turned to the back side of the place corresponding to the singular point and the direction corresponding to the singular point is directed to the place corresponding to the singular point, the second drawing process A process of drawing an image is performed, and a process of drawing an image of the first virtual space is not performed. Specifically, the image of the second virtual space is drawn also in the region corresponding to the singular point. The direction opposite to the first direction of travel does not have to be the direction opposite to the first direction of travel, and corresponds to, for example, a negative direction when the first direction of travel is a positive direction. .

Here, a singular point is a point at which the standard cannot be applied under a certain standard. For example, when a user moving object or a virtual camera is moving in the first virtual space, the rule that is a criterion for moving only in the first virtual space is applied to the user moving object or the virtual camera. Is done. That is, the user moving body or the virtual camera moves under the law of moving in the first virtual space. The singular point of the present embodiment is a point at which such a rule, which is the reference, is not applied and the rule is not followed. For example, in this embodiment, when the switching condition is satisfied by passing a singular point, the law (reference) of moving in the first virtual space is not applied to the user moving body or the virtual camera. The virtual camera moves in a second virtual space different from the first virtual space. For example, the singular point can be said to be a switching point for associating the position information of the user moving body or the virtual camera with the position information of the first virtual space or the position information of the second virtual space. . The first virtual space and the second virtual space are linked via a singular point so that the association with the position information of the user moving body or the virtual camera is switched by the establishment of the switching condition. For example, information for connecting the first virtual space and the second virtual space via a singular point is stored in the storage unit 170. The switching condition of the present embodiment is a condition for switching the correspondence between the position information of such a user moving body or virtual camera and the position information of the first and second virtual spaces by a singular point. The same is true for the singularity connection between the first and second virtual spaces and the third virtual space. The location corresponding to the singular point need not be a point, for example, and may be a surface or a region. For example, it may be a surface or region including a singular point.

In addition, when the user moving body or the virtual camera passes the singular point in the second traveling direction different from the first traveling direction, the display processing unit 120 displays the position information of the user moving body or the virtual camera as the first information. It is set as position information of one virtual space. Then, the display processing unit 120 performs a process of drawing at least an image of the first virtual space as the first drawing process. For example, as the first drawing process, a process of drawing an image of the first virtual space or drawing an image of the second virtual space in addition to the image of the first virtual space is performed. For example, when a user moving body or virtual camera that has moved from the first virtual space to the second virtual space via a singular point returns to the first virtual space, the position information of the user moving body or virtual camera is obtained. The first drawing process in the first virtual space is performed in association with the position information of the first virtual space. By doing in this way, a user moving body etc. can come and go between the 1st virtual space and the 2nd virtual space via a singular point. In addition, the user moving object or the virtual camera to which the rule (standard) of moving only in the second virtual space is applied passes the place corresponding to the singular point in the second advancing direction, so that the rule Can no longer be applied and can be moved in the first virtual space.

Here, the second traveling direction is different from the first traveling direction. For example, when the first traveling direction is a positive direction based on the singular point (location of the singular point), the second traveling direction is a negative direction based on the singular point. As an example, the second traveling direction is opposite to the first traveling direction.

In addition, the display processing unit 120 displays the user moving body when the switching condition (second switching condition) is satisfied when the user moving body or the virtual camera passes through a place corresponding to the singular point (second singular point). Alternatively, the position information of the virtual camera is set as the position information of the third virtual space. For example, the position information of the user moving body is associated as the position information of the third virtual space. Here, the movement to the third virtual space may be a movement from the first virtual space to the third virtual space via a singular point that connects the first virtual space and the third virtual space. The movement from the second virtual space to the third virtual space may be performed via a singular point that connects the second virtual space and the third virtual space. And the display process part 120 performs the process which draws the image of a 3rd virtual space at least as a 3rd drawing process. For example, when the third virtual space is connected to the first virtual space via a singular point, for example, an image of the third virtual space is drawn as the third drawing process, In addition to the virtual space image, a process of drawing the first virtual space image is performed. Further, when the third virtual space is linked to the second virtual space via a singular point, for example, an image of the third virtual space is drawn as the third drawing process, In addition to the virtual space image, a process of drawing the second virtual space image is performed.

Further, when a plurality of users play, the display processing unit 120 returns to the first virtual space through a plurality of user moving bodies corresponding to the plurality of users or a plurality of virtual cameras passing through a place corresponding to the singular point. The third drawing process is permitted on the condition. For example, the first user moving body or the first virtual camera corresponding to the first user has returned from the second virtual space to the first virtual space, but the second user movement corresponding to the second user. It is assumed that the body or the second virtual camera has not returned from the second virtual space to the first virtual space. In this case, even when the switching condition (second switching condition) is satisfied, the movement of the first user moving body or the first virtual camera to the third virtual space via the singular point is permitted. The third drawing process is not permitted. On the other hand, when both the first and second user moving bodies or both the first and second virtual cameras return from the second virtual space to the first virtual space and then the switching condition is satisfied. In this case, the movement of the first and second user moving bodies or the first and second virtual cameras via the singular point to the third virtual space is permitted, and the third drawing process is permitted.

Further, the display processing unit 120 determines whether the switching condition is satisfied based on whether the user moving body or the virtual camera has passed the singular point. For example, when the user moving body or virtual camera does not pass the singular point, it is determined that the switching condition is not satisfied, and when the user moving body or virtual camera passes the singular point, the switching condition is satisfied. Judge that

Further, the display processing unit 120 may determine whether or not the switching condition is satisfied based on user input information or sensor detection information. For example, the display processing unit 120 determines whether the switching condition is satisfied based on user operation information, voice input information, and the like input via the operation unit 160. For example, the determination is made based on input information of a user instructing establishment of the switching condition. Alternatively, the display processing unit 120 determines whether the switching condition is satisfied based on the detection information of the sensor. For example, a sensor is provided on an object corresponding to a singular point, and it is determined whether a switching condition is satisfied based on detection information of the sensor. When the object is a door (gate), it is determined whether the switching condition is satisfied by detecting the open / closed state of the door based on the detection information of the sensor.

In this embodiment, an object corresponding to a singular point is arranged in a play field (play space) in a real space where the user moves. In the case of a real space in a room described later, for example, a door object corresponding to a singular point is arranged. Then, the display processing unit 120 determines that the user moving object or the virtual camera has passed the singular point when the user passes the location of the object in the real space. For example, the passage condition of the singular point is determined by whether or not the user has passed the location of the object in the real space. Then, when the user passes the location of the object, it is determined that the switching condition is satisfied, the position information of the user moving body or the virtual camera is set as the position information of the second virtual space, and the second The drawing process is performed.

Further, the display processing unit 120 may perform processing for setting or not setting a singular point. For example, a singular point that has not been set is set to a set state, or a singular point that has been set is set to a non-set state. The singularity setting process is, for example, a process of displaying an object corresponding to a singularity in a virtual space such as the first to third virtual spaces or permitting movement between virtual spaces via singularities. . For example, the singularity non-setting process hides an object corresponding to a singularity in a virtual space such as the first to third virtual spaces, or disallows movement between virtual spaces via singularities. It is processing to do.

Also, the simulation system of the present embodiment includes a sensation device control unit 117. The sensation device control unit 117 controls the sensation device for allowing the user to experience virtual reality. The bodily sensation device is a device for causing a user to experience virtual reality by working on a sensory organ other than the visual organ of the user, for example. The sensation apparatus is, for example, a blower or a vibration device described later. The blower can be realized by, for example, a sirocco fan or a propeller fan. The blower may blow hot air or cold air. The vibration device can be realized by, for example, a transducer or a vibration motor. The body sensation device may be a halogen heater or the like. For example, it may be a sensation device that allows the user to feel heat or hot air by radiant heat from a halogen lamp. The body sensation device may be realized by a mechanical mechanism such as an air spring or an electric cylinder. For example, it may be a bodily sensation device that makes the user feel shaking or tilting by a mechanical mechanism such as an air spring or an electric cylinder.

Then, the sensation device control unit 117 makes the control of the sensation device when the switching condition is not satisfied and the control of the sensation device when the switching condition is satisfied. For example, the sensation device control unit 117 does not operate the sensation device when the switching condition is not satisfied (before the switching condition is satisfied), and when the switching condition is satisfied (after the switching condition is satisfied), May be operated. Alternatively, the control mode of the sensation apparatus and the type of sensation apparatus to be controlled may be different depending on whether the switching condition is not satisfied or when the switching condition is satisfied. For example, when the switching condition is not satisfied, the sensation apparatus is controlled in the first control mode, and when the switching condition is satisfied, the sensation apparatus is controlled in the second control mode different from the first control mode. Control. The first control mode and the second control mode differ in the degree of sensation experienced by the user. Taking a blower as an example, the first control mode and the second control mode have different blower strengths or different wind temperatures. Taking a vibrating device as an example, the first control mode and the second control mode differ in vibration intensity and vibration time. Alternatively, when the switching condition is not satisfied, the first type of sensation apparatus may be controlled, and when the switching condition is satisfied, the second type of sensation apparatus may be controlled. That is, depending on whether or not the switching condition is satisfied, the type of the sensation apparatus to be controlled is varied.

The simulation system also includes a notification processing unit 116. When a plurality of users play, the notification processing unit 116 performs an output process of notification information on collision between users in real space. For example, based on the user's position information acquired by the information acquisition unit 111, a warning notification process for a collision between users is performed. For example, a prediction process is performed as to whether or not the user is in a collision positional relationship (approaching relationship). If such a positional relationship is reached, a notification process for warning that there is a possibility of a collision is performed. The prediction process can be realized by determining whether or not there is a possibility that the users have a positional relationship of collision based on the position, speed, acceleration, or the like of each user moving body corresponding to each user.

Note that the warning notification processing is an image displayed on the HMD 200, sound output from a headphone or a speaker installed in a play field, or a vibration device provided in equipment such as a user's weapon, clothing, or decoration. It can be realized by vibrations caused by the above, or various types of sensation devices (sensation devices using wind, vibration, light, air cannon, sound, etc.) provided in a real space field.

As shown in FIG. 1, the simulation system of this embodiment includes an information acquisition unit 111 that acquires position information of the user in real space. For example, the information acquisition unit 111 acquires user position information through user viewpoint tracking or the like. The moving body processing unit 113 performs processing for moving the user moving body based on the acquired position information, and the display processing unit 120 generates a display image of the HMD 200 worn by the user. For example, the user moving body in the virtual space is moved so as to follow the movement of the user in the real space. Then, an image that can be seen from the virtual camera corresponding to the user moving object is generated as a display image of the HMD 200. Then, before the switching condition is satisfied (when the switching condition is not satisfied), the display processing unit 120 displays the position information of the user moving body or the virtual camera specified by the user position information in the real space. , And set as position information of the first virtual space. For example, the first drawing process is performed by associating the position information of the user moving body or the virtual camera as the position information of the first virtual space. For example, as the first drawing process, at least a process of drawing an image in the first virtual space is performed. On the other hand, when the switching condition is satisfied, the position information of the user moving body or the virtual camera specified by the position information of the user in the real space is set as the position information of the second virtual space. For example, the second drawing process is performed by associating the position information of the user moving body or the virtual camera as the position information of the second virtual space. For example, as the second drawing process, a process of drawing at least an image of the second virtual space is performed.

For example, the information acquisition unit 111 acquires position information of a user who wears the HMD 200 so as to cover the field of view. For example, the information acquisition unit 111 acquires the position information of the user in real space based on the tracking information of the HMD 200 and the like. For example, the position information of the HMD 200 is acquired as the position information of the user wearing the HMD 200. Specifically, when the user is located in a play field (simulation field, play area) in real space (real world), position information in the play field is acquired. Note that the position information of the user may be acquired by a method of directly tracking a part such as the user or the user's head instead of the tracking process of the HMD 200.

Further, the virtual camera control unit 114 controls the virtual camera so as to follow the change of the user's viewpoint based on the tracking information of the user's viewpoint information.

For example, the input processing unit 102 (input reception unit) acquires tracking information of viewpoint information of a user wearing the HMD 200. For example, tracking information (viewpoint tracking information) of viewpoint information that is at least one of the user's viewpoint position and line-of-sight direction is acquired. This tracking information can be acquired by performing tracking processing of the HMD 200, for example. Note that the user's viewpoint position and line-of-sight direction may be directly acquired by tracking processing. As an example, the tracking information includes change information of the viewpoint position from the initial viewpoint position of the user (change value of the coordinate of the viewpoint position), and change information of the gaze direction from the user's initial gaze direction (rotation axis in the gaze direction). At least one of the rotation angle change values around the rotation angle). Based on the change information of the viewpoint information included in such tracking information, the user's viewpoint position and line-of-sight direction (information on the user's head position and posture) can be specified.

In this embodiment, a virtual reality simulation process is performed as the game process of the game played by the user. The virtual reality simulation process is a simulation process for simulating an event in the real space in the virtual space, and is a process for causing the user to experience the event virtually. For example, a virtual user corresponding to a user in real space or a moving body such as a boarding moving body is moved in the virtual space, or processing for causing the user to experience changes in the environment and surroundings associated with the movement is performed.

Note that the processing of the simulation system of this embodiment in FIG. 1 can be realized by a processing device such as a PC installed in a facility, a processing device worn by a user, or distributed processing of these processing devices. Or you may implement | achieve the process of the simulation system of this embodiment with a server system and a terminal device. For example, it may be realized by distributed processing of a server system and a terminal device.

2. Tracking Processing Next, an example of tracking processing will be described. FIG. 2A shows an example of the HMD 200 used in the simulation system of this embodiment. As shown in FIG. 2A, the HMD 200 is provided with a plurality of light receiving elements 201, 202, and 203 (photodiodes). The light receiving elements 201 and 202 are provided on the front side of the HMD 200, and the light receiving element 203 is provided on the right side of the HMD 200. In addition, a light receiving element (not shown) is also provided on the left side, upper surface, and the like of the HMD.

It should be noted that the movement of the user's US hand or finger can be detected by a so-called leap motion process. For example, a controller (not shown) is attached to the HMD 200 or the like, and based on this controller, a motion detection process for hands and fingers is realized. This controller has, for example, a light emitting unit such as an LED that emits infrared rays, and a plurality of infrared cameras that photograph a hand or a finger illuminated by infrared rays. Based on the image analysis result of the image captured by the infrared camera, the movement of the hand or finger is detected. By providing such a controller, it becomes possible to detect the movement of the user's hand or finger when the door is opened.

In addition, the HMD 200 is provided with a headband 260 and the like so that the user US can stably wear the HMD 200 on the head with a better wearing feeling. In addition, the HMD 200 is provided with a headphone terminal (not shown). By connecting a headphone 270 (sound output unit 192) to the headphone terminal, for example, processing of three-dimensional sound (three-dimensional audio) is performed. The user US can listen to the game sound. Note that the operation information of the user US may be input by detecting the head movement or the swinging movement of the user US by the sensor unit 210 of the HMD 200 or the like.

Also, the user US wears a processing device (backpack PC) (not shown) on his back, for example. For example, the user US wears a jacket, and a processing device is attached to the back side of the jacket. The processing device is realized by an information processing device such as a notebook PC. And this processing apparatus and HMD200 are connected by the cable not shown. For example, the processing device performs processing for generating an image (game image or the like) displayed on the HMD 200, and the generated image data is sent to the HMD 200 via a cable and displayed on the HMD 200. In addition to such image generation processing, this processing apparatus is also capable of performing each processing (information acquisition processing, virtual space setting processing, moving body processing, virtual camera control processing, game processing, notification processing, and sensation device control of this embodiment. Processing, display processing, sound processing, or the like). Note that each processing of the present embodiment may be realized by a processing device (not shown) such as a PC installed in a facility, or may be realized by distributed processing of the processing device and a processing device worn by the user US. .

As shown in FIG. 2B, base stations 280 and 284 are installed around the simulation system. The base station 280 is provided with light emitting elements 281 and 282, and the base station 284 is provided with light emitting elements 285 and 286. The light emitting elements 281, 282, 285, and 286 are realized by LEDs that emit laser (infrared laser or the like), for example. The base stations 280 and 284 use these light emitting elements 281, 282, 285, and 286 to emit, for example, a laser beam radially. The light receiving elements 201 to 203 and the like provided in the HMD 200 in FIG. 2A receive the laser beams from the base stations 280 and 284, thereby realizing the tracking of the HMD 200 and the position and direction of the head of the user US. (Viewpoint position, line-of-sight direction) can be detected.

FIG. 3A shows another example of the HMD 200. In FIG. 3A, a plurality of light emitting elements 231 to 236 are provided for the HMD 200. These light emitting elements 231 to 236 are realized by LEDs, for example. The light emitting elements 231 to 234 are provided on the front side of the HMD 200, and the light emitting element 235 and the light emitting element 236 (not shown) are provided on the back side. These light emitting elements 231 to 236 emit (emit) light in a visible light band, for example. Specifically, the light emitting elements 231 to 236 emit light of different colors.

The imaging unit 150 shown in FIG. 3B is installed in at least one place around the user US (for example, the front side, the front side, the rear side, or the like). Image up to 236 lights. That is, spot images of these light emitting elements 231 to 236 are reflected in the captured image of the imaging unit 150. And the tracking of the user's US head (HMD) is implement | achieved by performing the image process of this captured image. That is, the three-dimensional position of the head of the user US and the facing direction (viewpoint position, line of sight direction) are detected.

For example, as illustrated in FIG. 3B, the imaging unit 150 includes first and second cameras 151 and 152, and the first and second cameras 151 and 152 of the first and second cameras 151 and 152 are provided. By using the captured image, the position of the head of the user US in the depth direction can be detected. Further, based on the motion detection information of the motion sensor provided in the HMD 200, the rotation angle (line of sight) of the head of the user US can also be detected. Therefore, by using such an HMD 200, when the user US faces in any direction of all 360 degrees around the image, the image (the user's virtual space in the virtual space (virtual three-dimensional space)) Image viewed from a virtual camera corresponding to the viewpoint) can be displayed on the display unit 220 of the HMD 200.

Note that as the light emitting elements 231 to 236, infrared LEDs instead of visible light may be used. Further, the position or movement of the user's head may be detected by another method such as using a depth camera.

Also, the tracking processing method for detecting the user's viewpoint position and line-of-sight direction (user position and direction) is not limited to the method described with reference to FIGS. For example, the tracking process may be realized by a single unit of the HMD 200 using a motion sensor or the like provided in the HMD 200. That is, tracking processing is realized without providing external devices such as the base stations 280 and 284 in FIG. 2B and the imaging unit 150 in FIG. Or you may detect viewpoint information, such as a user's viewpoint position and a gaze direction, by various viewpoint tracking methods, such as well-known eye tracking, face tracking, or head tracking.

3. Next, the method of this embodiment will be described in detail. In the following description, a case where an image generated by the simulation system of the present embodiment is displayed on the HMD will be mainly described as an example. However, the display unit on which the image generated by the simulation system is displayed is not limited to the HMD, and may be a normal display used in a home game device, a business game device, or a PC. Further, in the following, the case where the determination target of the passage of the singular point, the setting target of the position information of the virtual space, etc. is mainly a user moving body or a user moving body of the virtual camera will be described as an example. The determination target of the passage of the object, the setting object of the position information of the virtual space, and the like may be a virtual camera. In the following description, the user moving object corresponding to the user is described as a user character. In addition, the method of the present embodiment includes various games (virtual experience game, battle game, RPG, action game, competition game, sports game, horror experience game, simulation game of vehicles such as trains and airplanes, puzzle games, communication games, Alternatively, it can be applied to music games and the like, and can be applied to other than games.

3.1 Game Description First, a VR (virtual reality) game realized by the present embodiment will be described. This game is a virtual reality experience game that can move in a plurality of virtual spaces (virtual worlds).

4 and 5 are explanatory diagrams of the play field FL in the room used in the simulation system of this embodiment. FIG. 4 is a perspective view illustrating the play field FL, and FIG. 5 is a top view.

In the play field FL (play area, play space) simulating a room, a door DR, a desk DK, a bookshelf BS, etc. are arranged, and windows WD1, WD2 are provided on the wall. The user enters the play field FL simulating this room and enjoys a VR game. In FIG. 4, a plurality of users US1 and US2 enter the room, and these two users US1 and US2 can enjoy a VR game.

Each user US1, US2 wears a processing device (backpack PC) on his / her back, for example, and an image generated by this processing device is displayed on HMD1, HMD2 (head-mounted display device). Further, a management processing device (not shown) is arranged in the play field FL, and the management processing device performs data synchronization processing (communication processing) between the processing devices worn by the users US1 and US2. Done. For example, a synchronization process for displaying a user character corresponding to the user US2 (user moving body in a broad sense) on the HMD1 of the user US1 and displaying a user character corresponding to the user US1 on the HMD2 of the user US2 is performed. In addition, control processing of the sensation apparatus can be performed. In addition, an operator is waiting in the room, and performs operations of management processing devices, helping the users US1 and US2 to install the HMD1, HMD2 and jackets, operation work and guidance work for game progress.

In addition, the base stations 280 and 284 described with reference to FIG. 2B are installed in the room of the play field FL, and the location information of the users US1 and US2 can be acquired using these base stations 280 and 284. It has become. Further, as shown in FIG. 5, the play field FL is provided with a blower BL and a vibration device VB, which are sensation devices for allowing the user to experience virtual reality. The vibration device VB is realized by, for example, a transducer installed under the floor of a room.

According to the game of this embodiment, when the real-world door DR is opened, another world (a world different from the room landscape) spreads beyond the door DR. The user can experience a virtual reality that can pass through the door DR and go to another world.

For example, in FIG. 4, the images of the first virtual space corresponding to the room are displayed on the HMD1 and HMD2 of the users US1 and US2. Specifically, an object corresponding to an object placed / installed in a room is placed in the first virtual space (first object space). For example, objects corresponding to the door DR, the desk DK, the bookshelf BS, and the windows WD1 and WD2 are arranged. And in this 1st virtual space, the image seen from the virtual camera (1st, 2nd virtual camera) corresponding to the viewpoint (1st, 2nd viewpoint) of user US1, US2 is produced | generated, HMD1, Display on HMD2 (first and second display units). In this way, the users US1 and US2 who move while wearing the HMD1 and HMD2 can experience virtual reality as if they were walking around a real room.

As shown in FIG. 6A, when the user (US1, US2) opens the door DR for the first time, the other side of the door DR remains in the room, and the area of the door DR (in a broad sense) In the region corresponding to the singular point, a room image is displayed. Then, after the user closes the door DR as shown in FIG. 6B, when the door DR is opened again as shown in FIG. 6C, the other side of the door DR changes to an ice country. That is, as shown in FIG. 7, an image of the ice country that is an image of the second virtual space VS2 (second object space) is displayed in the region of the door DR (door opening region). At this time, as shown in FIG. 7, an image of a room such as a bookshelf BS and windows WD1 and WD2 is displayed around the door DR. That is, an image of the ice country which is an image of the second virtual space VS2 is displayed in the region of the door DR (region corresponding to the singular point), while the first region is displayed in the region other than the door DR. A room image which is an image of the virtual space VS1 is displayed.

Then, for example, when the user US1 passes through the door DR (passes through the place corresponding to the singular point) and moves beyond the door DR, as shown in FIG. 8, the user character UC1 (in a broad sense) corresponding to the user US1 The user moving body) moves from the room that is the first virtual space VS1 to the ice country that is the second virtual space VS2. Here, the user character UC1 is a character (display object) that moves in the virtual space as the user US1 moves in the real space, and is also called an avatar.

Note that the present embodiment mainly deals with the case where the position information of the user US1 in the real space is acquired and the user character UC1 is moved in the virtual space (first and second virtual spaces) based on the acquired position information. However, the present embodiment is not limited to this. For example, the user character UC1 may be moved in the virtual space (first and second virtual spaces) based on operation information from the operation unit 160 (game controller or the like) in FIG. Further, the movement of the hand or finger of the user US1 (US2) is detected by, for example, a leap motion process. And based on this detection result, the motion process which moves the site | part (part object) of the hand and finger | toe of user character UC1 corresponding to user US1 is performed. Thereby, for example, when the user US1 opens the door DR, the user US1 can visually recognize the movement of his or her hand or finger by looking at the movement of the hand or finger part of the user character UC1.

In FIG. 8, since a vast VR space spreads over the entire perimeter of the field of view of the user US1 (UC1) wearing the HMD1, the virtual reality of the user US1 can be significantly improved. That is, the user US1 can feel a virtual reality as if he were in a real ice country. The user character UC1 corresponding to the user US1 can freely walk around the ice country that is the second virtual space.

FIG. 9 is an example of an image displayed when the user character UC1 that has moved to the ice country as the second virtual space VS2 looks back to the door DR side as shown in FIG. As illustrated in FIG. 9, an image of a room that is an image of the first virtual space VS <b> 1 is displayed in the region of the door DR. At this time, as shown in FIG. 9, an image of the ice country that is an image of the second virtual space VS2 is displayed around the door DR. That is, an image of a room that is an image of the first virtual space VS1 is displayed in the area of the door DR, while an area of the ice that is an image of the second virtual space VS2 is displayed in an area other than the door DR. Is displayed. When the user character UC1 moves toward the door DR and passes through the door DR again, the user character UC1 can return to the room that is the first virtual space VS1. That is, by passing the door DR in the first advancing direction in FIG. 7, it is possible to move (warp) from the first virtual space VS1 (room) to the second virtual space VS2 (ice country). On the other hand, in FIG. 9, by passing through the door DR in the second traveling direction different from the first traveling direction, the second virtual space VS2 (land of ice) changes to the first virtual space VS1 (room). Can move. That is, the user character UC1 can freely go back and forth between the first virtual space VS1 and the second virtual space VS2 through the door DR (a place corresponding to a singular point).

FIG. 10A and FIG. 10B show a situation when the users US1 and US2 pass through the door DR. At this time, the user characters UC1 and UC2 corresponding to the users US1 and US2 are located in the ice country that is the second virtual space. That is, the position information of the user characters UC1 and UC2 is set as the position information of the second virtual space.

In the vicinity of the users US1 and US2, a blower BL and a vibration device VB, which are sensation devices, are installed. The blower BL is installed on the front side of the users US1 and US2, and the vibration device VB is installed under the floor around the users US1 and US2. When the users US1 and US2 pass through the door DR and move to the other side of the door DR, the blower BL starts to blow air, and the users US1 and US2 are exposed to wind (cold wind). Also, a sound that makes the snowstorm “hue” is output from the speaker of the headphones worn by the users US1 and US2. Thereby, the users US1 and US2 can feel a virtual reality as if they came to a real ice country.

Further, when the users US1 and US2 move close to the vibrating device VB, as shown in A1 of FIG. 10A and A2 of FIG. 10B, a game effect is performed in which the glacier in the second virtual space collapses. . That is, the glacier that existed at A1 in FIG. 10A collapses and disappears at A2 in FIG. 10B. Specifically, an image representing how the glacier collapses is displayed on the HMD1 and HMD2 of the users US1 and US2, and the sound of the glacier collapse is output from the headphones speaker worn by the users US1 and US2. As a result, the users US1 and US2 can experience a thrill that the glacier collapses and feels dangerous.

As shown in A3 in FIG. 10A and A4 in FIG. 10B, the range in which the users US1 and US2 can move is the same as the room area, and moves beyond the room wall in FIG. I can't do it. For example, when the users US1 and US2 move close to the wall of the room, for example, notification information for warning the HMD1 and HMD2 of a collision with the wall or the like is displayed so that the collision with the wall or the like can be avoided. .

As described above, according to the simulation system of the present embodiment, as shown in FIG. 7, the scenery of the ice country spreads at the tip of the user opening the door, the sun and ice whiteness, You can see a completely different landscape. In addition, the sound of wind blowing with dazzlingness improves virtual reality.

And the user can step into the end of the door. In addition to the scenery, sound, and white breath of the icy country, you can feel the cold with visual, auditory, and bodily sensations by actually feeling the wind from the blower. If you move beyond the door, you can experience the mysterious sensation of going from a small room to a wide world at once. In FIG. 8, the user can look around and see the sea, iceberg, clear sky sun and diamond dust, and enjoy the scenery of the ice country. Also, as shown in FIGS. 10A and 10B, the sea extends beyond the cliff at one end of the door, and the user cools the liver to that height. When the user approaches the cliff or a predetermined time elapses, the user can enjoy a horror experience because the foot is vibrated by the vibration device and the cliff in front of the user collapses. The user frequently goes back and forth between two virtual spaces (virtual worlds), and one person goes to the front of the door, and the other turns around behind the door and confirms that the other party cannot be seen. Standing sideways in the middle of the door, you can experience the difference in field of view and sound between the right and left halves.

Further, after the ice country is displayed in the area of the door DR as shown in FIG. 6C, the door DR is closed as shown in FIG. 6D, and again as shown in FIG. 6E. When DR is opened, the other side of the door DR changes to the space above the train. That is, as shown in FIG. 11A, an image when the user is on the train TR, which is an image of the third virtual space VS3, is displayed in the area of the door DR. At this time, as shown in FIG. 11A, images of rooms such as the bookshelf BS, the windows WD1, and WD2 are displayed in an area other than the door DR. When the user US1 passes through the door DR and moves beyond the door DR, the user character UC1 gets on the train TR, and a thrilling image in which the tunnel TN approaches is displayed in front of the user.

Note that the virtual space switching process may not be performed when the door is opened slightly and then closed immediately. For example, depending on the user, when an image as shown in FIG. 11A is displayed, the user may be surprised and immediately close the door. In such a case, it is not desirable that the image of the train scene as shown in FIG. 11A is not displayed when the door is opened next time.

When the user character UC1 moving on the train TR looks back toward the door DR, an image as shown in FIG. 12 is displayed. As illustrated in FIG. 12, an image of a room that is an image of the first virtual space VS <b> 1 is displayed in the region of the door DR. At this time, as shown in FIG. 12, an image on a train (an image of a tunnel, a train, etc.) that is an image of the third virtual space VS3 is displayed around the door DR. That is, an image of a room that is an image of the first virtual space VS1 is displayed in the area of the door DR, while an area above the train that is an image of the third virtual space VS3 is displayed in an area other than the door DR. The image at is displayed. In addition, for example, an effect image is displayed in which sparks are scattered when the upper end of the door DR hits the roof of the tunnel TN. When the user character UC1 moves toward the door DR and passes through the door DR again, the user character UC1 can return to the room that is the first virtual space VS1. 6A to 6E, every time the door DR is opened and closed, the virtual space on the other side of the door DR is switched, such as a room, an icy country, or a train. Yes.

As described above, according to the simulation system of the present embodiment, the user can enjoy a thrilling experience that is suddenly thrown into a fast and dangerous place. The train repeats entering and exiting the tunnel, and the top edge of the door hits the tunnel roof, sparks are scattered and the thrill feeling is further improved. The vibration of the floor can give you the feeling of being really on the train, and you can give a feeling of speed with the blower.

That is, the user is confused as “Where is this?” At the moment when the user opens the door. In addition, you can have a strange experience of feeling confused because the end of the door is moving even though you are stopped. When you step into the door, you can feel the sensation of being really on the train. In addition, you can experience the thrill of a tunnel approaching at a tremendous speed in front of you. While passing through the tunnel, the tunnel ceiling approaches, and the upper edge of the door touches the ceiling and sparks rise, doubling your fear. Even if you leave the tunnel, the tunnel will approach again, so you can enjoy the thrills over and over again.

3.2 Virtual Space Switching Processing Next, the method of this embodiment will be described in detail. In the present embodiment, the first virtual space and the second virtual space that is linked to the first virtual space via a singular point are set as the virtual space. As described with reference to FIGS. 4 to 10B, the first virtual space is, for example, a virtual space corresponding to a room, and the second virtual space is a virtual space corresponding to an ice country. These first and second virtual spaces are connected via a singular point corresponding to the door DR. For example, it is possible to move between the first and second virtual spaces via the door DR. As described above, the singularity is a point at which the law cannot be applied under the law that is the reference. For example, when a user character (or a virtual camera, hereinafter the same) is moving in a first virtual space (room), the rule that the user character moves only in the first virtual space is Applied. The singular point of the present embodiment is a point where such a law (standard) is not applied and the law is not followed. For example, in this embodiment, when the switching condition is established by passing a singular point, the law of moving in the first virtual space is not applied to the user character, and the user character is defined as the first virtual space. It moves in a different second virtual space (Iceland).

Specifically, in the present embodiment, before the switching condition for the virtual space is established, the position information of the user character (or virtual camera) is set as the position information of the first virtual space. For example, in FIG. 13A, information on the position P1 of the user character UC1 is set as position information on the first virtual space VS1 (room). And as a 1st drawing process, the process which draws the image of the 1st virtual space VS1 (room) at least is performed. That is, in the first virtual space VS1, an image that can be seen from the virtual camera (user's viewpoint) is generated.

In the present embodiment, as described with reference to FIG. 7, in the first drawing process, in addition to the image of the first virtual space VS1 (room), the image of the second virtual space VS2 (ice country) Is generated to generate an image in which the image of the second virtual space VS2 is displayed in the region of the door DR, which is a region corresponding to the singular point. That is, as shown in FIG. 7, an image is generated in which an image of the ice country is displayed in the area of the door DR and a room image is displayed in the area other than the door DR.

On the other hand, as shown in FIG. 13A, the user character UC1 (virtual camera) is switched by passing the location of the door DR corresponding to the singular point (SG) in the first traveling direction D1. Suppose the condition is met. That is, in FIG. 13A, the switching condition is established when the user character UC1 moves from the position P1 through the door DR to the position P2. In this case, the position information of the user character UC1 (virtual camera) is set as the position information of the second virtual space VS2 (ice country). For example, in FIG. 13A, information on the positions P2 and P3 of the user character UC1 is set as position information on the second virtual space VS2 (ice country). And as a 2nd drawing process, the process which draws the image of the 2nd virtual space VS2 at least is performed. That is, an image that can be seen from the virtual camera (user viewpoint) is generated in the second virtual space VS2.

In the present embodiment, as described with reference to FIG. 9, in the second drawing process, in addition to the image of the second virtual space VS <b> 2 (ice country), the image of the first virtual space VS <b> 1 (room). Is generated to generate an image in which the image of the first virtual space VS1 is displayed in the region of the door DR, which is a region corresponding to the singular point. That is, as shown in FIG. 9, an image is generated in which an image of a room is displayed in the area of the door DR and an image of the ice country is displayed in an area other than the door DR.

More specifically, as shown in FIG. 13A, the user character UC1 (virtual camera) passes through the location of the door DR (location corresponding to the singular point SG) in the first traveling direction D1, and the virtual camera It is assumed that the line-of-sight direction SL faces the direction opposite to the first traveling direction D1. That is, in FIG. 13A, after the user character UC1 passes through the door DR in the first traveling direction D1, the user DR looks back toward the door DR, and the visual line direction SL of the virtual camera is directed toward the door DR. . The line-of-sight direction SL is, for example, a direction opposite to the first traveling direction D1. In such a case, in the present embodiment, as shown in FIG. 9, an image in which an image of the first virtual space VS1 (room) is displayed in the region of the door DR (region corresponding to the singular point SG) is generated. .

On the other hand, as shown in FIG. 13A, it is assumed that the user character UC1 moves from the position P2 to the position P3 in the second virtual space VS2, and the visual line direction SL of the virtual camera is directed toward the door DR. In other words, it is assumed that the position P2 moves from the position P2 to the position P3 on the back side of the door DR and the line-of-sight direction SL is directed toward the door DR. In this case, unlike FIG. 9, the room image is not displayed in the area of the door DR. Specifically, when the line-of-sight direction SL of the virtual camera is directed toward the door DR at the position P2 in FIG. 13A, the room on the other side of the door DR has an opening area as shown in FIG. Is displayed. On the other hand, when the viewing direction SL of the virtual camera is directed toward the door DR at the position P3 in FIG. 13A, an image of the ice country is displayed in the opening area of the door DR, and the room Images are not displayed. That is, an image in which only the frame of the door DR stands on the glacier is displayed. In other words, an image is displayed as long as the open door DR is placed on the glacier.

The reason why such an image is displayed is that in the present embodiment, the first virtual space and the second virtual space are connected discontinuously via the singular point SG. Therefore, as shown in FIG. 13A, when the room position P1, which is the movement source position, is viewed from the position P2, the room image can be viewed through the opening area of the door DR. However, at the position P3 on the back side of the door DR, an image is displayed in which only the frame of the door DR (open door) stands on the glacier. In this way, it is possible to experience a virtual reality experience such as warping from the first virtual space to the second virtual space, which is a different dimension from the first virtual space. Realization of virtual reality becomes possible.

7 and 9 can be generated by the following method, for example. For example, in FIG. 7 and FIG. 9, when viewed from the virtual camera, a pixel in an area other than the door DR (an area other than the area corresponding to the singular point) and a pixel in the door DR area (an area corresponding to the singular point). Is set for each pixel. For example, in the area other than the door DR, the flag is set to, for example, FG = 1 (first flag state), and in the area of the door DR, for example, the flag is set to FG = 0 (second flag state). When the image of the first virtual space (room) seen from the virtual camera is the first image, and the image of the second virtual space (ice country) seen from the virtual camera is the second image, FIG. , For pixels set to FG = 1 (other than the door), the color of the first image (room) is drawn, and for pixels set to FG = 0 (door), the second image ( Draw the color of the iceland). In this way, an image as shown in FIG. 7 can be generated. On the other hand, in FIG. 9, for pixels set to FG = 1 (other than the door), the color of the second image (ice country) is drawn, and for pixels set to FG = 0 (door) The color of the first image (room) is drawn. By doing so, an image as shown in FIG. 9 can be generated.

FIG. 13B shows an example in which the user character UC1 does not pass through the location of the door DR (singular point SG) and the switching condition is not satisfied. Thus, even if the user character UC1 moves from the position P1 to the position P2 without passing through the door DR, the switching condition is not satisfied, so the virtual space is not switched, and the information of the position P2 is the first virtual space VS1. Set as (room) location information. Accordingly, even if the visual line direction SL of the virtual camera is directed toward the door DR at the position P2, a room image is displayed in the opening of the door DR. That is, an image in which only the frame of the door DR stands on the floor of the room is displayed. In FIG. 13B, even if the user character UC1 moves from the position P2 to the position P3 and the viewing direction SL of the virtual camera is directed toward the door DR, only the frame of the door DR is on the floor of the room. A standing image is displayed.

As described above, in this embodiment, when the switching condition is satisfied by passing through the singular point SG as shown in FIG. 13A, the positions P2 and P3 after passing are set as the positions of the second virtual space VS2. . On the other hand, in FIG. 13B, the singular point SG is not passed and the switching condition is not satisfied. For this reason, the same positions P2 and P3 as FIG. 13A remain in the position of the first virtual space VS1 in FIG. 13B.

In FIG. 14A, after the user character UC1 (virtual camera) passes through the door DR (singular point SG) in the first traveling direction D1, the second traveling direction is different from the first traveling direction D1. Passing through the door DR at D2. For example, after passing through the door DR in the first traveling direction D1 from the position P1 in the first virtual space VS1, and moving to the position P2 in the second virtual space VS2, the first traveling direction D1 (forward direction). Is passing through the door DR in the second traveling direction D2 (negative direction) in the opposite direction (reverse polarity direction). In other words, the vehicle has moved from the position P2 to the position P4 through the door DR. In this case, information on the position P4 of the user character UC1 (virtual camera) is set as position information on the first virtual space VS1 (room). And as a 1st drawing process, the process which draws the image of the 1st virtual space VS1 at least is performed. That is, a process of drawing an image of a room that is the first virtual space VS1 is performed. Alternatively, as shown in FIG. 7, in addition to the image of the first virtual space VS1 (room), a process of drawing an image of the second virtual space VS2 (ice country) is performed, and the door DR (singular point SG ), An image in which the image of the second virtual space VS2 is displayed is generated. For example, as shown in FIG. 14A, the line-of-sight direction SL of the virtual camera of the user character UC1 at the position P4 is facing the direction opposite to the second traveling direction D2 and facing the door DR. In such a case, an image in which an image of the second virtual space VS2 (ice country) is displayed in the area of the door DR is generated. By doing so, it is possible to realize a virtual reality that can be moved between the first virtual space VS1 and the second virtual space VS2 via a singular point, for example.

In FIG. 14B, the second virtual space VS2 has moved from the position P2 to the position P4 without passing through the door DR. In this case, since the virtual space switching condition is not satisfied, the position P4 remains at the position of the second virtual space VS2. That is, in FIG. 13A, the position P4 is switched to the position of the first virtual space VS1, but in FIG. 13B, the same position P4 remains at the position of the second virtual space VS2.

Further, in the present embodiment, as described with reference to FIGS. 11A to 12, when the switching condition is satisfied when the user character (virtual camera) passes through a place corresponding to the singular point, the user character (virtual Camera) position information is set as position information of the third virtual space VS3 (on the train), and at least an image of the third virtual space VS3 is drawn as the third drawing process.

For example, in FIG. 15A, the user character UC1 passes through the door DR (singular point SG) in the first traveling direction D1 (positive direction) from the position P1 of the first virtual space VS1 to the position P2. Has moved. Thereby, since the switching condition by passage of the door DR is established, the position P2 is set as the position of the second virtual space VS2 (ice country). Then, the user character UC1 passes through the door DR in the second traveling direction D2 (negative direction) from the position P2 of the second virtual space VS2 and returns to the position P1. Thereby, since the switching condition by passage of the door DR is established, the position P1 is set as the position of the first virtual space VS1 (room).

Thus, after the user character UC1 returns to the position P1 of the first virtual space VS1 (room), the door DR is opened and closed in FIG. 15B. As a result, as described with reference to FIGS. 6C to 6E, the world beyond the door DR changes from the second virtual space VS2 (ice land) to the third virtual space VS3 (on the train). ). That is, an image as shown in FIG. 11A is displayed. Then, as shown in FIG. 16, the user character UC1 has moved from the position P1 of the first virtual space VS1 to the position P2 through the door DR. Thereby, since the switching condition by passage of the door DR is established, the position P2 is set as the position of the third virtual space VS3 (on the train). Then, as the third drawing process, at least an image of the third virtual space VS3 is drawn, thereby generating an image as shown in FIG. 11B, for example. When the user character UC1 looks back at the direction of the door DR, an image as shown in FIG. 12 is generated. That is, as the third drawing process, a process of drawing the image of the first virtual space VS1 (room) in addition to the image of the third virtual space VS3 (on the train) is performed, and the region of the door DR An image in which an image of one virtual space VS1 is displayed is generated. In this way, not only the switching process between the first virtual space and the second virtual space, but also a switching process between the first virtual space and the third virtual space, for example, can be realized. Alternatively, switching processing between the second virtual space and the third virtual space may be performed.

In this embodiment, when a plurality of users play, a plurality of user characters (a plurality of virtual cameras) corresponding to the plurality of users pass through a place corresponding to a singular point and return to the first virtual space. On this condition, a technique for permitting the third drawing process is adopted.

For example, in FIG. 17A, a plurality of users corresponding to the user characters UC1 and UC2 are playing. Then, the user character UC1 passes through the door DR from the first virtual space VS1 and moves to the second virtual space VS2, and then passes again through the door DR and returns to the first virtual space VS1. Yes. On the other hand, after the user character UC2 passes through the door DR and moves to the second virtual space VS2, the user character UC2 remains in the second virtual space VS2.

In such a situation, it is assumed that the door DR is opened and closed as shown in FIG. At this time, as shown in FIGS. 6C to 6E, when the second virtual space VS2 (the land of ice) is switched to the third virtual space VS3 (on the train), FIG. In (B), a situation occurs in which the user character UC2 is left in the second virtual space VS2.

Therefore, in the present embodiment, in order to prevent the occurrence of such a situation, the third drawing in the third virtual space is performed on the condition that both of the user characters UC1 and UC2 have returned to the first virtual space VS1. Allow processing.

That is, in FIG. 18A, not only the user character UC1 but also the user character UC2 passes through the door DR from the position of the second virtual space VS2 and returns to the first virtual space VS1. Then, after the user characters UC1 and UC2 return to the first virtual space VS1, the door DR is opened and closed. At this time, as shown in FIG. 18B, when the user characters UC1 and UC2 pass the door DR and the switching condition is satisfied, the positions of the user characters UC1 and UC2 are in the third virtual space VS3 (train of the train). Set as the top position. Then, the third drawing process in the third virtual space VS3 is performed, and images as shown in FIGS. 11B and 12 are generated. In this way, it becomes possible to prevent a situation in which some of the plurality of user characters corresponding to the plurality of users are left in the second virtual space and the game progresses, etc. Appropriate and smooth game progress can be realized.

In the present embodiment, it may be determined whether the switching condition is satisfied based on user input information or sensor detection information.

For example, in FIG. 19A, voice information “I want to go to the iceland” is input as input information of the user US1 using a microphone or the like. Based on such input information of the user US1, it may be determined whether or not a switching condition is satisfied, and for example, a virtual space switching process may be performed. In this way, the virtual space switching process can be realized with a simple effort of only inputting input information.

Note that the user input information used for determining the switching condition may be, for example, operation information input by a game controller (operation unit in a broad sense). Alternatively, when the movement of the user's hand or finger can be detected by the leap motion process, the switching condition is determined using the input information based on the movement of the user's hand or finger as the user's input information. Good. Alternatively, the movement of the user's head may be detected based on an HMD sensor unit or the like and used as user input information.

In the present embodiment, it may be determined whether the switching condition is satisfied based on the detection information of the sensor. For example, in FIG. 19B, a sensor SE is provided for the door DR. In this case, the opening / closing state of the door DR may be determined based on the detection information of the sensor SE to determine whether the switching condition is satisfied. As the sensor SE, for example, a light receiving element as described with reference to FIG. In this way, the open / closed state of the door DR can be determined by detecting the light from the base stations 280 and 284 provided in the room as shown in FIG. 4 by the light receiving element as the sensor SE. Therefore, it is possible to determine the switching condition with a simple process. Alternatively, a motion sensor composed of an acceleration sensor, a gyro sensor, or the like may be used as the sensor SE. By using such a motion sensor, the open / close state of the door DR may be determined to determine whether or not the virtual space switching condition is satisfied. As described above, various types of sensors can be employed as the sensor SE.

In this embodiment, as shown in FIGS. 4, 20 (A), and 20 (B), an object corresponding to a singular point is arranged in the play field FL in the real space where the users (US 1, US 2) move. Has been. For example, a door DR is arranged as an object corresponding to a singular point. In the present embodiment, when the user passes through the location of the door DR, which is an object, in real space, it is determined that the user character (virtual camera) has passed the location corresponding to the singular point.

In this way, since the user actually passes the location of the door, which is an object in the real space, it is determined that the corresponding user character has passed the location of the door. Can be improved. In this case, by arranging the door object simulating the door of the real space in the virtual space, the door of the real space and the object of the virtual space door can be properly associated with each other, and the virtual reality of the user Can be further improved. Further, for example, as shown in FIG. 19B, if a sensor is provided on a door in the real space and the opening / closing state of the object in the virtual space is controlled based on the detection information of the sensor, the door in the real space can be opened and closed. In conjunction with this, the door object in the virtual space is also opened and closed, and the virtual reality of the user can be greatly improved.

In FIG. 20A, as shown by B1, only the head and upper body part of the user character UC1 pass through the door DR and move to the second virtual space VS2 (ice country). . On the other hand, the lower body part of the user character UC1 remains in the first virtual space VS1 (room). In this case, from the user character UC2 (user US2) located in the first virtual space VS1, the head and upper body of the user character UC1 appear to disappear, and it is strange that the other side of the door DR is a different world. Experience virtual reality. Further, when the user character UC2 moves to the other side of the door DR as shown in B2 without passing through the door DR, the appearance is further different. Further, as shown in FIG. 20B, even if the user character UC1 (user US1) passes through the door DR and looks back, the user character UC1 (user US1) can see only the ice country that is the second virtual space, and thus the first virtual space. I cannot see the room. Therefore, it is possible to give a mysterious feeling that the two virtual spaces are connected via the door DR, which is a singular point, and to experience a mysterious virtual reality that has never existed.

In order to appropriately generate the images as shown in FIGS. 20A and 20B, for example, in addition to the detection of the position information of the head of the user character, the position information of the lower body part such as the foot It is desirable to detect. Also, as shown in FIGS. 20A and 20B, the region corresponding to the singular point only needs to pass at least the virtual camera corresponding to the user's viewpoint, and the entire user character passes. There is no need to be.

3.3 Various Processing Examples Next, various processing examples of this embodiment will be described. In the present embodiment, a process for setting or not setting a singular point may be performed.

For example, in FIG. 21A, the user character UC1 is located in the second virtual space VS2 (ice country), and unlike FIG. 8, the door DR corresponding to the singular point SG is not displayed. In FIG. 21A, the user US1 corresponding to the user character UC1 inputs, for example, a voice “Appearance door”. Thereby, the process of setting the singular point SG is performed, and the door DR corresponding to the singular point SG appears in the second virtual space VS2 and is displayed as shown in FIG. Alternatively, in FIG. 21 (B), the user US1 inputs a voice of “disappearing door”, for example, to perform the process of unsetting the singular point SG, for example, as shown in FIG. 21 (A), The door DR may be hidden.

In this way, if the setting or non-setting of singular points can be arbitrarily switched based on user input information or the like, for example, an object corresponding to a singular point can be displayed or non- It becomes possible to display. As a result, for example, it is possible to hide singular points and the like, and more various game processes and game effects can be realized. Note that the setting and non-setting of singular points may be switched according to, for example, the result of game processing, the game level of the user, etc., in addition to the user input information, for example.

Further, in the present embodiment, processing for controlling the sensation device for allowing the user to experience virtual reality is performed, and control of the sensation device when the switching condition is not satisfied and control of the sensation device when the switching condition is satisfied May be different.

For example, in FIG. 22 (A), the user character UC1 (US1) moves beyond the door DR without passing through the door DR, and the virtual space switching condition is not satisfied. In this case, sensation devices such as the blower BL and the vibration device VB are not operated. On the other hand, in FIG. 22B, the user character UC1 passes through the door DR and moves to the other side of the door DR, and the virtual space switching condition is satisfied. In this case, sensation devices such as the blower BL and the vibration device VB are operated. For example, control such as blowing cool air by the blower BL or vibrating the floor by the vibration device VB is performed. By doing so, as described in FIG. 10A and FIG. 10B, the virtual space is switched from the first virtual space (room) to the second virtual space (ice country). It is possible to let the user experience using a sensation apparatus such as the blower BL and the vibration device VB.

Note that the control mode of the sensation apparatus and the type of sensation apparatus to be controlled may be different depending on whether the switching condition is not satisfied or when the switching condition is satisfied. For example, the power of the blower BL may be varied, or the vibration level of the vibration device VB may be varied. Alternatively, the first sensation device for the first virtual space and the second sensation device for the second virtual space are prepared, and the first sensation device is operated when the switching condition is not satisfied. When the switching condition is satisfied, the second sensation apparatus may be operated.

Also, in the present embodiment, when a plurality of users play, notification information output processing for collision between users in real space is performed.

For example, in FIG. 23A, a plurality of users US1, US2 corresponding to the user characters UC1, UC2 are playing a game. The user character UC1 moves through the door DR to move to the second virtual space VS2, but the user character UC2 does not pass through the door DR and enters the first virtual space VS1. Stays. In FIG. 23B, the user character UC1 moves in the second virtual space VS2 and approaches the user character UC2.

In this case, since the user character UC1 remains in the first virtual space VS1, an image of the first virtual space VS1 (room) is displayed on the HMD1 of the user US1. On the other hand, since the user character UC2 has moved to the second virtual space VS2, an image of the second virtual space VS2 (ice country) is displayed on the HMD2 of the user US2. Therefore, the user US1 whose field of view is covered by the HMD1 cannot visually recognize the presence of the user character UC2 corresponding to the user US2. Similarly, the user US2 whose field of view is covered by the HMD2 cannot visually recognize the presence of the user character UC1 corresponding to the user US1. Therefore, there is a possibility that a situation occurs in which the users US1 and US2 collide in the real world.

Therefore, in the present embodiment, in order to prevent the occurrence of such a situation, when a plurality of users play, an output process of notification information of collision between users in real space is performed. For example, FIG. 24 is an example of a display image of the HMD1 of the user US1. In this display image, a hand, a finger, and the like of the user US1 are displayed.

In the case of the situation as shown in FIG. 23B, the user character UC2 is not normally displayed on the HMD1 of the user US1. On the other hand, in FIG. 24, the user character UC2 is displayed as thin as, for example, a ghost character. For example, the user character UC2 that is translucently synthesized with the background or the like with a given translucency is displayed. By doing so, the user US1 can visually recognize that the user US2 corresponding to the user character UC2 is nearby, and can avoid a collision between users in the real world. In this case, the HMD2 of the user US2 also displays the user character UC1 corresponding to the user US1 as thin as a ghost character by, for example, semi-transparent composition with the background or the like. By doing so, the user US2 can visually recognize that the user US1 corresponding to the user character UC1 is nearby, and can avoid a collision between users in the real world.

Note that the display mode of the user character UC2 in FIG. 24 may be changed according to the risk of collision. For example, as the distance between the user characters UC1 and UC2 approaches, or as the approach speed of the user characters UC1 and UC2 increases, the display of the user character UC2 is gradually darkened to increase the degree of visual recognition. May be.

Further, as shown at C1 in FIG. 24, information for notifying a collision warning may be superimposed on the display image of the HMD. Or you may alert | report a warning of a collision with an audio | voice or a vibration. As described above, various types of output processing can be assumed as the notification information output processing.

In FIG. 25A, after the user characters UC1 and UC2 have moved to the second virtual space VS2, the user character UC2 has moved to a position behind the door DR. As shown in FIG. 25B, the user character UC2 moves from the position on the back side of the door DR toward the user character UC1 and passes through the door DR.

In this case, the visual line direction SL of the virtual camera of the user character UC1 faces the direction of the door DR. For this reason, as shown in FIG. 9, an image in which the region of the door DR becomes an image of the room is displayed. In this state, as shown in FIG. 25B, when the user character UC2 in the second virtual space VS2 passes through the door DR, the user character UC2 suddenly pops out from the room image in FIG. Correct images will be displayed.

Further, in the present embodiment, it is desirable to acquire the position information of the user in the real space and perform a process of moving the user character based on the acquired position information. For example, in FIG. 26A, information on the position PR of the user US1 in the real space is acquired. The information on the position PR in the real space can be acquired by, for example, the tracking process of the HMD 1 described with reference to FIGS. 2 (A) to 3 (B). Then, based on the acquired information of the position PR in the real space, a process of moving the user character UC1 in the virtual space shown in FIG. That is, the position PR of the user US1 in the real space shown in FIG. 26A and the position PV of the user character UC1 in the virtual space shown in FIG. 26B are associated with each other so as to be linked to the movement of the position PR. The position PV is changed to move the user character UC1. And the display image of HMD1 which user US1 wears is generated by the method of this embodiment.

Specifically, before the switching condition is satisfied, the information on the position PV of the user character UC1 (virtual camera) specified by the information on the position PR of the user US1 in the real space is used as the position information on the first virtual space. Set as. On the other hand, when the switching condition is satisfied, the information on the position PV of the user character UC1 (virtual camera) specified by the information on the position PR of the user US1 in the real space is set as the position information on the second virtual space. To do.

In this manner, when the user US1 moves the play field FL in the real space, the user character UC1 also moves to correspond to the movement. Then, whether or not the switching condition is satisfied is determined based on whether or not the user US1 has passed through the location of the object of the door DR in the real space, and the virtual as shown in FIGS. 13 (A) and 13 (B). Space switching processing and drawing processing are executed.

In this case, as shown in FIG. 13 (A), when passing through the door DR and moving to the positions P2, P3, and as shown in FIG. 13 (B), without passing through the door DR, the positions P2, P3. The image displayed on the HMD 1 is different depending on the movement. That is, even in the real space at the same positions P2 and P3, the image in the second virtual space VS2 (Iceland) is displayed on the HMD1 in FIG. 13A, but FIG. Then, an image in the first virtual space VS1 (room) is displayed on the HMD1. Therefore, it becomes possible to provide the user with a mysterious VR experience that could not be realized with conventional simulation systems.

4). Detailed Processing Next, a detailed processing example of this embodiment will be described with reference to the flowchart of FIG. First, it is determined whether or not the switching condition is satisfied (step S1). For example, when the user character does not pass through the place corresponding to the singular point and the switching condition is not satisfied, the position information of the user character or the virtual camera is set as the position information of the first virtual space. (Step S2). For example, position information is set as shown in FIG. Then, in addition to the image of the first virtual space, a process of drawing the image of the second virtual space is performed to generate an image in which the image of the second virtual space is displayed in the region corresponding to the singular point (step S3). For example, as shown in FIG. 7, an image is generated in which an image of the ice country that is the second virtual space VS2 is displayed in the region of the door DR that is a region corresponding to the singular point.

On the other hand, when the user character or the moving object passes through the place corresponding to the singular point and the switching condition is satisfied, the position information of the user character or the virtual camera is set as the position information of the second virtual space (step S4). . For example, position information is set as shown in FIG. Then, in addition to the image of the second virtual space, a process of drawing the image of the first virtual space is performed to generate an image in which the image of the first virtual space is displayed in the region corresponding to the singular point (step S5). For example, as shown in FIG. 9, an image in which an image of a room that is the first virtual space VS1 is displayed in the region of the door DR that is a region corresponding to the singular point is generated.

Although the present embodiment has been described in detail as described above, it will be readily understood by those skilled in the art that many modifications can be made without departing from the novel matters and effects of the present invention. Accordingly, all such modifications are intended to be included in the scope of the present invention. For example, a term (user character, door, etc.) written together with a different term (user moving object, singular point, etc.) in a broader sense or the same meaning at least once in the specification or drawing is used anywhere in the specification or drawing. Can be replaced by its different terms. In addition, position information acquisition processing, virtual space setting processing, moving body movement processing, display processing, game processing, notification processing, sensory device control processing, virtual space switching processing, and the like are also described in this embodiment. The present invention is not limited, and techniques, processes, and configurations equivalent to these are also included in the scope of the present invention. The present invention can be applied to various games. Further, the present invention can be applied to various simulation systems such as a business game device, a home game device, or a large attraction system in which a large number of users participate.

US1, US2, US users,
UC1, UC2 user character (user moving body),
VS1 first virtual space, VS2 second virtual space, DR door,
SG Singularity, FL Playfield, BL Blower,
VB vibration device, DK desk, BS bookshelf, WD1, WD2 window,
TR train, TN tunnel, SL line-of-sight direction,
100 processing units, 102 input processing units, 110 arithmetic processing units,
111 Information acquisition unit, 112 Virtual space setting unit, 113 Mobile object processing unit,
114 virtual camera control unit, 115 game processing unit, 116 notification processing unit,
117 sensation device control unit, 120 display processing unit, 130 sound processing unit,
140 output processing unit, 150 imaging unit, 151, 152 camera,
160 operation unit, 170 storage unit, 172 object information storage unit,
178 Drawing buffer, 180 information storage medium, 192 sound output unit,
194 I / F unit, 195 portable information storage medium, 196 communication unit,
200 HMD (head-mounted display device), 201 to 203 light receiving element,
210 sensor unit, 220 display unit, 231 to 236 light emitting element,
240 processing units, 250 processing devices, 260 headbands,
270 headphones, 280, 284 base station,
281, 282, 285, 286 Light emitting element

Claims (15)

1. A virtual space setting unit that performs setting processing of a virtual space in which the object is arranged;
   In the virtual space, a moving body processing unit that performs a process of moving a user moving body corresponding to the user;
   A display processing unit that performs drawing processing of an image seen from a virtual camera in the virtual space;
   Including
   The virtual space setting unit
   As the virtual space, a first virtual space and a second virtual space connected to the first virtual space via a singular point are set.
   The display processing unit
   Before a given switching condition is met,
   The position information of the user moving body or the virtual camera is set as the position information of the first virtual space, and as the first drawing processing, the second virtual space is added to the image of the first virtual space. To generate an image in which the image of the second virtual space is displayed in a region corresponding to the singular point,
   When the user moving body or the virtual camera passes through the place corresponding to the singular point in the first traveling direction, the switching condition is satisfied,
   The position information of the user moving body or the virtual camera is set as position information of the second virtual space, and as the second drawing process, the first virtual space is added to the image of the second virtual space. Performing a process of drawing an image of the space to generate an image in which the image of the first virtual space is displayed in an area corresponding to the singular point;
   The display processing unit
   Generating an image in which an image of the first virtual space is displayed in a region corresponding to the singular point when a line-of-sight direction of the virtual camera is directed in a direction opposite to the first traveling direction. A featured simulation system.
2. In claim 1,
   The display processing unit
   When the user moving body or the virtual camera passes through the singular point in a second traveling direction different from the first traveling direction, the position information of the user moving body or the virtual camera is A simulation system which is set as position information of a first virtual space, and performs a process of drawing at least an image of the first virtual space as the first drawing process.
3. In claim 1 or 2,
   The display processing unit
   When the switching condition is satisfied when the user moving body or the virtual camera passes through a location corresponding to the singular point, the position information of the user moving body or the virtual camera is stored in the third virtual space. A simulation system which is set as position information and performs a process of drawing at least an image of the third virtual space as a third drawing process.
4. In claim 3,
   The display processing unit
   When a plurality of users play, the plurality of user moving bodies corresponding to the plurality of users or the plurality of virtual cameras return to the first virtual space through a place corresponding to the singular point. The simulation system is characterized in that the third drawing process is permitted on the condition.
5. In any one of Claims 1 thru | or 4,
   The display processing unit
   A simulation system that determines whether or not the switching condition is satisfied based on input information of the user or detection information of a sensor.
6. In any one of Claims 1 thru | or 5,
   An object corresponding to the singular point is arranged in the play field of the real space where the user moves,
   The display processing unit
   When the user passes the location of the object in the real space, it is determined that the user moving body or the virtual camera has passed a location corresponding to the singular point.
7. In any one of Claims 1 thru | or 6.
   The display processing unit
   The simulation system characterized by performing the process which sets or does not set the said singular point.
8. In any one of Claims 1 thru | or 7,
   Including a sensation device control unit for controlling a sensation device for allowing the user to experience virtual reality,
   The sensation device controller is
   A simulation system characterized in that the control of the sensation apparatus when the switching condition is not satisfied differs from the control of the sensation apparatus when the switching condition is satisfied.
9. In any one of Claims 1 thru | or 8.
   The simulation system characterized by including the alerting | reporting process part which performs the output process of the alerting | reporting information of the collision between users in real space, when the said several user plays.
10. In any one of Claims 1 thru | or 9,
    Including an information acquisition unit for acquiring position information of the user in real space;
    The mobile processing unit is
    Based on the acquired position information, a process of moving the user moving body is performed,
    The display processing unit
    Generating a display image of a head-mounted display device worn by the user;
    The display processing unit
    Before the switching condition is satisfied,
    Setting the position information of the user moving body or the virtual camera specified by the position information of the user in the real space as the position information of the first virtual space;
    When the switching condition is satisfied,
    The simulation system, wherein the position information of the user moving object or the virtual camera specified by the position information of the user in the real space is set as position information of the second virtual space.
11. An information acquisition unit for acquiring user location information in real space;
    A virtual space setting unit that performs setting processing of a virtual space in which the object is arranged;
    Based on the acquired position information, in the virtual space, a moving body processing unit that performs a process of moving a user moving body corresponding to the user,
    A display processing unit that performs drawing processing of an image seen from a virtual camera in the virtual space, and generates an image to be displayed on a head-mounted display device worn by the user;
    Including
    The virtual space setting unit
    As the virtual space, a first virtual space and a second virtual space connected to the first virtual space via a singular point are set.
    The display processing unit
    Before a given switching condition is met,
    The position information of the user moving object or the virtual camera specified by the position information of the user in the real space is set as the position information of the first virtual space, and at least as the first drawing process, A process of drawing an image of the first virtual space;
    When the user moving body or the virtual camera passes through the place corresponding to the singular point in the first traveling direction, the switching condition is satisfied,
    The position information of the user moving body or the virtual camera specified by the position information of the user in the real space is set as position information of the second virtual space, and at least as a second drawing process, A simulation system for performing a process of drawing an image of the second virtual space.
12. A virtual space setting process for setting a virtual space in which an object is placed;
    In the virtual space, a moving object process for moving a user moving object corresponding to the user,
    Display processing for performing drawing processing of an image seen from a virtual camera in the virtual space;
    And
    In the virtual space setting process,
    As the virtual space, a first virtual space and a second virtual space connected to the first virtual space via a singular point are set.
    In the display process,
    Before a given switching condition is met,
    The position information of the user moving body or the virtual camera is set as the position information of the first virtual space, and as the first drawing processing, the second virtual space is added to the image of the first virtual space. To generate an image in which the image of the second virtual space is displayed in a region corresponding to the singular point,
    When the user moving body or the virtual camera passes through the place corresponding to the singular point in the first traveling direction, the switching condition is satisfied,
    The position information of the user moving body or the virtual camera is set as position information of the second virtual space, and as the second drawing process, the first virtual space is added to the image of the second virtual space. Performing a process of drawing an image of the space to generate an image in which the image of the first virtual space is displayed in an area corresponding to the singular point;
    In the display process,
    Generating an image in which an image of the first virtual space is displayed in a region corresponding to the singular point when a line-of-sight direction of the virtual camera is directed in a direction opposite to the first traveling direction. A featured image processing method.
13. An information acquisition process for acquiring user location information in real space;
    A virtual space setting process for setting a virtual space in which an object is placed;
    Based on the acquired position information, a moving body process for moving a user moving body corresponding to the user in the virtual space;
    A display process for rendering an image visible from a virtual camera in the virtual space, and generating an image to be displayed on a head-mounted display device worn by the user;
    And
    In the virtual space setting process,
    As the virtual space, a first virtual space and a second virtual space connected to the first virtual space via a singular point are set.
    In the display process,
    Before a given switching condition is met,
    The position information of the user moving object or the virtual camera specified by the position information of the user in the real space is set as the position information of the first virtual space, and at least as the first drawing process, A process of drawing an image of the first virtual space;
    When the user moving body or the virtual camera passes through the place corresponding to the singular point in the first traveling direction, the switching condition is satisfied,
    The position information of the user moving body or the virtual camera specified by the position information of the user in the real space is set as position information of the second virtual space, and at least as a second drawing process, An image processing method comprising performing a process of drawing an image of the second virtual space.
14. A virtual space setting unit that performs setting processing of a virtual space in which the object is arranged;
    In the virtual space, a moving body processing unit that performs a process of moving a user moving body corresponding to the user;
    As a display processing unit that performs drawing processing of an image seen from a virtual camera in the virtual space,
    Memorize the program that makes the computer work,
    The virtual space setting unit
    As the virtual space, a first virtual space and a second virtual space connected to the first virtual space via a singular point are set.
    The display processing unit
    Before a given switching condition is met,
    The position information of the user moving body or the virtual camera is set as the position information of the first virtual space, and as the first drawing processing, the second virtual space is added to the image of the first virtual space. To generate an image in which the image of the second virtual space is displayed in a region corresponding to the singular point,
    When the user moving body or the virtual camera passes through the place corresponding to the singular point in the first traveling direction, the switching condition is satisfied,
    The position information of the user moving body or the virtual camera is set as position information of the second virtual space, and as the second drawing process, the first virtual space is added to the image of the second virtual space. Performing a process of drawing an image of the space to generate an image in which the image of the first virtual space is displayed in an area corresponding to the singular point;
    The display processing unit
    Generating an image in which an image of the first virtual space is displayed in a region corresponding to the singular point when a line-of-sight direction of the virtual camera is directed in a direction opposite to the first traveling direction. A computer-readable information storage medium.
15. An information acquisition unit for acquiring user location information in real space;
    A virtual space setting unit that performs setting processing of a virtual space in which the object is arranged;
    Based on the acquired position information, in the virtual space, a moving body processing unit that performs a process of moving a user moving body corresponding to the user,
    As a display processing unit that performs drawing processing of an image seen from a virtual camera in the virtual space and generates an image to be displayed on a head-mounted display device worn by the user,
    Memorize the program that makes the computer work,
    The virtual space setting unit
    As the virtual space, a first virtual space and a second virtual space connected to the first virtual space via a singular point are set.
    The display processing unit
    Before a given switching condition is met,
    The position information of the user moving object or the virtual camera specified by the position information of the user in the real space is set as the position information of the first virtual space, and at least as the first drawing process, When a process of drawing an image of the first virtual space is performed, and the switching condition is satisfied when the user moving body or the virtual camera passes through a place corresponding to the singular point in a first traveling direction. Is
    The position information of the user moving body or the virtual camera specified by the position information of the user in the real space is set as position information of the second virtual space, and at least as a second drawing process, A computer-readable information storage medium that performs a process of drawing an image of the second virtual space.

Images