WO2024111123A1

WO2024111123A1 - Virtual space experience system and virtual space experience method

Info

Publication number: WO2024111123A1
Application number: PCT/JP2022/043614
Authority: WO
Inventors: 良哉尾小山
Original assignee: 株式会社Abal
Priority date: 2022-11-25
Filing date: 2022-11-25
Publication date: 2024-05-30

Abstract

A VR system S generates, in a virtual space VS1, a first virtual region V1a corresponding to a first real region Ra of a real space RS, and a second virtual region V1b corresponding to a second real region Rb, of the real space RS, adjacent to the first real region Ra. The positional relationship between the first virtual region V1a and the second virtual region V1b is different from the positional relationship between the first real region Ra and the second real region Rb.

Description

Virtual space experience system and virtual space experience method

The present invention relates to a virtual space experience system and a virtual space experience method that allow a user to experience a virtual space via an environment output device that allows the user to recognize the environment of the virtual space.

Conventionally, there are virtual space experience systems that generate a virtual space on a server or the like, and allow a user to view an image of that virtual space via a head-mounted display (hereinafter sometimes referred to as an "HMD"), making the user perceive that they are present in that virtual space.

This type of virtual space experience system uses a motion capture device or the like to recognize the user's position and movement in real space (i.e., coordinate movement and posture change, etc.), and then moves and operates an avatar corresponding to the user in the virtual space according to the recognized position and movement (see, for example, Patent Document 1).

JP 2010-257461 A

In a so-called immersive virtual space experience system such as that described in Patent Document 1, in order to give the user a strong sense of awareness that he or she is present in the virtual space (i.e., to enhance the sense of immersion), it is preferable to maintain a constant correspondence between the amount of movement and action of the user in real space and the amount of movement and action of the avatar corresponding to that user in the virtual space, so that the user does not feel uncomfortable between his or her own movement and action and the movement and action of the avatar.

However, if one were to try to maintain a constant correspondence, one would naturally have to make the shape and size of the virtual space correspond to the shape and size of the real space, and the shape and size of the virtual space would end up being restricted by the shape and size of the real space. As a result, for example, when attempting to express a spatial aspect in a virtual space that is impossible in real space, there was a problem in that the expression would be restricted by the shape and size of the real space that corresponds to that virtual space.

The present invention has been made in consideration of the above points, and aims to provide a system and method for experiencing a virtual space in which the shape and size of the virtual space are not likely to be restricted by the shape and size of the real space, making it easy to maintain a sense of immersion.

The virtual space experience system of the present invention comprises:
a virtual space generation unit that generates a virtual space corresponding to a real space in which a user exists;
an avatar generation unit that generates an avatar corresponding to the user in the virtual space;
A user state recognition unit that recognizes the position and action of the user;
an avatar state control unit that controls a position and a movement of the avatar based on a position and a movement of the user;
an environment determination unit that determines an environment in the virtual space to be recognized by the user based on a position and a movement of the avatar;
A virtual space experiencing system that allows a user to experience a virtual space via an environment output device that outputs an environment of the virtual space,
the virtual space generation unit generates, in the virtual space, a first virtual area corresponding to a first real area in the real space and a second virtual area corresponding to a second real area in the real space adjacent to the first real area;
A positional relationship between the first virtual area and the second virtual area is different from a positional relationship between the first real area and the second real area.

In this way, in the virtual space experience system of the present invention, the virtual space includes a first virtual area corresponding to a first real area in real space, and a second virtual area corresponding to a second real area in real space adjacent to the first real area. In other words, in this system, one specific area in real space is divided, and an independent virtual area is assigned to each of the divided areas. Furthermore, in this system, the positional relationship between the first virtual area and the second virtual area is made different from the positional relationship between the first real area and the second real area.

As a result, this system makes it possible to make the size and shape of the entire virtual space different from the size and shape of the real space depending on the position of the virtual area (i.e., how it is arranged). For example, if two virtual areas are positioned offset in the vertical direction, the height of the entire virtual space can be made higher than the height of the corresponding entire real space. Ultimately, this system makes it possible for the user to experience a wide variety of virtual spaces that would not be possible in real space.

Furthermore, when the shape and size of the virtual space are made different from the shape and size of the corresponding real space by changing the positional relationship of the virtual regions in this way, the correspondence between the amount of movement and action of the user and the amount of movement and action of the avatar can be maintained constant, unlike when the shape and size of the virtual space are made different from the shape and size of the corresponding real space by transforming the shape and size of the virtual space.

As a result, this system makes it possible for the user to feel less uncomfortable between their own movements and actions and those of their avatar, allowing them to maintain the awareness that they are present in a virtual space (i.e., a sense of immersion).

In addition, in the virtual space experience system of the present invention,
The first virtual area and the second virtual area are spaced apart from each other,
It is preferable that a third virtual area is disposed between the first virtual area and the second virtual area, the third virtual area corresponding to a third real area that does not correspond to the real space or is independent of the first real area and the second real area.

In this way, by arranging two virtual areas that correspond to two adjacent real areas at a distance from each other and placing a third virtual area between them that is independent of them, it is possible to make the overall size of the virtual space larger than the size of the corresponding real space.

In addition, in the virtual space experience system of the present invention,
Preferably, an edge of the first virtual area corresponds to an edge of the second real area.

For example, if the first virtual area and the second virtual area are positioned apart from each other and a third virtual area is positioned between them, when the user moves from the first real area to the second real area, the avatar will move from the first virtual area to the second virtual area, jumping over the third virtual area.

However, if the boundary portion where the avatar makes such a sudden movement across the third virtual area is not indicated, the sudden movement of the avatar may give the user a sense of discomfort and hinder the sense of immersion.

In this way, it is advisable to make the edge of the first virtual area correspond to the edge of the second real area. With this configuration, when the user moves to the edge of the second real area, the avatar will be present both on the edge of the first virtual area (the side in front of the boundary) and on the edge of the second virtual area (the side beyond the boundary).

When avatars are displayed overlapping each other in a specific area in this way, the user can intuitively understand that this area is a boundary, and that the avatar will move suddenly if it crosses this boundary. As a result, even when the avatar moves suddenly, it is less likely to give the user a sense of discomfort, and less likely to disrupt the sense of immersion.

In addition, in the virtual space experience system of the present invention, when the edge of the first virtual area corresponds to the edge of the second real area,
It is preferable that the color tone of the edge of the first virtual area is different from the color tone of the other part of the first virtual area.

This configuration allows the user to easily recognize the boundary portion (i.e., the boundary portion of the first area) before the avatar enters the edge. This makes the user aware that some kind of change will occur at the boundary portion. This makes it less likely that the user will feel uncomfortable even when the avatar enters the boundary portion and causes a sudden movement of the avatar, making it less likely that the sense of immersion will be hindered.

In addition, in the virtual space experience system of the present invention, when the edge of the first virtual area corresponds to the edge of the second real area,
It is preferable that when the avatar enters the edge of the first virtual area, the portion of the avatar located at the edge of the first virtual area has a form different from other portions of the avatar.

When configured in this manner, when part of the avatar enters the edge (i.e., the boundary portion of the first area), the user can easily recognize the boundary portion. In turn, the user can be made aware that some kind of change will occur at the boundary portion. This makes it less likely that the user will feel uncomfortable even when the avatar enters the boundary portion and causes a sudden movement of the avatar, making it less likely that the sense of immersion will be hindered.

In addition, in the virtual space experience system of the present invention,
A correspondence relationship between the coordinate axes of the first real area and the coordinate axes of the first virtual area may be different from a correspondence relationship between the coordinate axes of the second real area and the coordinate axes of the second virtual area.

In this way, by making the correspondence between the coordinate axes in the real and virtual realms different for each realm, it is possible to configure the virtual space as a space that does not exist in real space. For example, if the coordinate axes of the first virtual realm are made to coincide with those of the first real realm and the coordinate axes of the second virtual realm are made to be upside down compared to those of the second real realm, then it is possible to realize a virtual space in which the top and bottom are reversed by moving from the first virtual realm to the second virtual realm.

The virtual space experiencing method of the present invention comprises:
A step in which a virtual space generation unit generates a virtual space corresponding to a real space in which a user exists;
an avatar generation unit generating an avatar corresponding to the user in the virtual space;
A user state recognition unit recognizes a position and a movement of the user;
an avatar state control unit controlling a position and a movement of the avatar based on a position and a movement of the user;
an environment determination unit determining an environment in a virtual space to be recognized by the user based on a position and a movement of the avatar;
a step of outputting an environment of the virtual space to the user by an environment output device,
the virtual space generation unit generates, in the virtual space, a first virtual area corresponding to a first real area in the real space and a second virtual area corresponding to a second real area in the real space adjacent to the first real area;
A positional relationship between the first virtual area and the second virtual area is different from a positional relationship between the first real area and the second real area.

FIG. 1 is a schematic diagram showing a general configuration of a VR system according to a first embodiment. FIG. 2 is a block diagram showing the configuration of the VR system shown in FIG. 1 . FIG. 2 is a perspective view showing the state of real space and virtual space when the VR system of FIG. 1 is used. 4 is a flowchart showing a process executed by the VR system of FIG. 1 . 13 is a perspective view showing the state of real space and virtual space when using the VR system of the second embodiment. FIG. FIG. 13 is a perspective view showing the state of real space and virtual space when using the VR system of the third embodiment.

[First embodiment]
Hereinafter, a VR system S (virtual space experiencing system) according to a first embodiment and a process (virtual space experiencing method) executed by the VR system S will be described with reference to FIGS.

The VR system S allows a user U present in a real space RS (e.g., a room) to recognize the environment (e.g., images, sounds, etc.) of a virtual space VS1 that corresponds to the real space RS, and also makes the user U recognize that he or she exists in the virtual space VS1 by moving or moving an avatar A corresponding to the user U in the virtual space VS1 to correspond to the user U (see Figure 3, etc.).

In this embodiment, for ease of understanding, there is one user. However, the virtual space experience system of the present invention is not limited to such a configuration, and the number of users may be two or more.

[System Overview]
First, the schematic configuration of the VR system S will be described with reference to FIG.

As shown in FIG. 1, the VR system S includes a number of signs 1 that are attached to a user U in a real space RS, a camera 2 that photographs the user U (or, more precisely, the signs 1 attached to the user U), a server 3 that determines images and sounds in a virtual space VS1 (see FIG. 3), and a head-mounted display (hereinafter referred to as "HMD 4") that allows the user to recognize the determined images and sounds.

In the VR system S, the camera 2, server 3, and HMD 4 can wirelessly transmit and receive information between each other via the Internet network, public lines, short-distance wireless communication, etc. However, any of them may also be configured to transmit and receive information between each other via wires.

The multiple signs 1 are attached to the user U's head, both hands, and both feet via the HMD 4, gloves, and shoes worn by the user U. The multiple signs 1 are used to recognize the amount of movement and action of the user U in the real space RS, as described below. Therefore, the positions at which the signs 1 are attached, the number of signs 1 attached, etc. may be changed as appropriate depending on the other devices that make up the VR system S.

Camera 2 is installed so that it can capture the user U's range of motion (i.e., the range within which user U can move and act) in the real space RS in which user U exists from multiple directions.

The server 3 recognizes the sign 1 from the image captured by the camera 2, and recognizes the coordinates and posture (and thus the amount of movement and action) of the user U based on the position of the recognized sign 1 in the real space RS. The server 3 also determines the environment of the virtual space VS1 (e.g., images, sounds, etc.) that the user U will recognize based on the coordinates and posture.

The HMD4 is an environment output device that outputs the environment of the virtual space VS1 to the user so that the user can recognize it. The HMD4 is worn on the head of the user U. The HMD4 has a monitor 40 that allows the user U to recognize an image of the virtual space VS1 determined by the server 3, and a speaker 41 that allows the user U to recognize the sound of the virtual space VS1 determined by the server 3 (see Figure 2).

When experiencing the virtual space VS1 using the VR system S, the user U is made to perceive only the images and sounds of the virtual space VS1 via the HMD 4, and is made to perceive that he or she is present in the virtual space VS1. In other words, the VR system S is configured as a so-called immersive system.

The virtual space experience system of the present invention is not limited to such a configuration. For example, when using a motion capture device, in addition to the above configuration, a configuration in which the number and arrangement of signs and cameras are different from the above configuration (for example, one of each) may be used. Also, without using signs, feature points may be recognized from the image of the user itself to recognize the user's posture and coordinates.

Furthermore, for example, instead of a motion capture device, another device may be used to recognize the user's state. Specifically, for example, a sensor such as a GPS may be mounted on the HMD, and the user's coordinates, posture, etc. may be recognized based on the output from the sensor. Furthermore, such a sensor may be used in combination with the motion capture device described above.

[Configuration of Processing Unit]
Next, the configuration of the processing unit of the server 3 will be described in detail with reference to FIG.

The server 3 is composed of one or more electronic circuit units including a CPU, RAM, ROM, interface circuits, etc. As shown in FIG. 2, the server 3 has a virtual environment generation unit 30, a user state recognition unit 31, an avatar state control unit 32, and an environment determination unit 33 as functions (processing units) realized by the implemented hardware configuration or programs.

The virtual environment generation unit 30 has a virtual space generation unit 30a and an avatar generation unit 30b.

The virtual space generation unit 30a generates a virtual space VS1 that corresponds to the real space RS in which the user U exists. Specifically, the virtual space generation unit 30a generates images that represent the background of the virtual space VS and objects that exist in the virtual space VS, as well as sounds associated with these images.

Note that, although the VR system S of this embodiment does not have such a feature, if the virtual space experience system has a feature for realizing a specific sensation (such as a cushion with variable hardness) or a feature for generating a specific smell, the virtual space generation unit may generate the virtual space using the sensation and smell in addition to the images and sounds.

The avatar generation unit 30b generates an avatar A corresponding to the user U in the virtual space VS1 (see Figure 3). The state of the avatar A in the virtual space VS1 changes in response to changes in the state of the corresponding user U in the real space RS. Note that multiple avatars A, either in part or in whole, may be generated for each user U.

The user state recognition unit 31 recognizes image data of the user U, including the sign 1 captured by the camera 2, and recognizes the state of the user U in the real space RS (position and movement, i.e., movement of coordinates, change of posture, etc.) based on the image data. The user state recognition unit 31 has a user posture recognition unit 31a and a user coordinate recognition unit 31b.

The user posture recognition unit 31a extracts a sign 1 from the recognized image data of the user U, and recognizes the posture of the user U, including the orientation of each part of the body, based on the extraction result.

The user coordinate recognition unit 31b extracts sign 1 from the image data of the recognized user U, and recognizes the coordinates of user U based on the extraction results.

The avatar state control unit 32 controls the state (e.g., movement of coordinates, change of posture, etc.) of the avatar A corresponding to the user U in the virtual space VS1 based on the posture of the user U in the real space RS recognized by the user posture recognition unit 31a and the coordinates of the user U in the real space RS recognized by the user coordinate recognition unit 31b.

The environment determination unit 33 determines the environment of avatar A in the virtual space VS1 based on the state of avatar A (e.g., coordinates, posture, etc. at that time).

Here, "avatar environment" refers to things that affect the avatar in the virtual space. For example, the "avatar environment" refers to the state of objects in the virtual space relative to the state of the avatar (e.g., position, posture, etc.).

In addition, based on the determined environment of avatar A, the environment determination unit 33 determines the environment (images and sounds) of the virtual space VS1 that the user U corresponding to that avatar A will recognize through the monitor 40 and speaker 41 of the HMD 4.

Here, "the environment that the user is made to perceive" refers to the environment in the virtual space that the user is made to perceive through the five senses. For example, "the environment that the user is made to perceive" refers to the images and sounds of the virtual space around the avatar that corresponds to the user.

In addition, "virtual space images" here include images of the background of the virtual space, as well as images of other avatars, images of objects that exist only in the virtual space, and images of objects that exist in the virtual space that correspond to the real world.

Note that each processing unit constituting the virtual space experience system of the present invention is not limited to the configuration described above.

For example, part of the processing unit provided in the server 3 in this embodiment may be provided in the HMD 4. Also, it may be configured using multiple servers, or the server may be omitted and the CPU mounted on the HMD may work in cooperation. Also, speakers other than those mounted on the HMD may be provided. In addition to devices that affect the senses of sight and hearing, devices that affect the senses of smell and touch, such as producing smells, wind, etc. that correspond to the virtual space, may also be included.

[Generated virtual space]
Here, with reference to FIG. 3, the virtual space VS1 generated by the virtual space generating unit 30a of the VR system S of this embodiment will be described.

As shown in Figure 3, the virtual space VS1 is configured as a rectangular parallelepiped space overall.

Specifically, the virtual space VS1 is composed of a first virtual area V1a (area bounded by a dashed line) which is a rectangular parallelepiped area located at one end of the entire space, a second virtual area V1b (area bounded by a dashed line) which is a rectangular parallelepiped area located at the other end of the entire space and at a position separated from the first virtual area V1a, and a third virtual area V1c (area bounded by a dashed line) which is a rectangular parallelepiped area located between the first virtual area VS1a and the second virtual area V1b.

The first virtual area V1a is generated as an area corresponding to the entire first real area Ra of the real space RS and the area of the edge of the second real area Rb on the first real area Ra side (upper left side in Figure 3). Therefore, the shape of the part of the first virtual space V1a excluding the edge (first overlapping area V1d) and the shape of the first real area Ra are the same or similar.

The second virtual area V1b is generated as an area corresponding to the entire second real area Rb of the real space RS and the area of the edge of the first real area Ra on the second real area Rb side (the lower right side in Figure 3). Therefore, the shape of the part of the second virtual space V1b excluding the edge (second overlap area V1e) and the shape of the second real area Rb are the same or similar.

The third virtual area V1c is generated as an area that does not correspond to any area in the real space RS. Because the virtual space VS1 includes the third virtual space V1c, the overall size of the virtual space VS1 is larger than the size of the corresponding real space RS. Note that the third virtual area V1c may also be generated as an area that corresponds to an area in a real space that is independent of the real space RS (a third real area).

Of these virtual areas, in the first virtual area V1a and the second virtual area V1b corresponding to the first real area Ra and the second real area Rb of the real space RS, the state of the avatar A corresponding to the user U also changes in response to a change in the state of the user U in the real space RS.

In this way, if the first virtual area V1a and the second virtual area V1b are positioned at a distance from each other and the third virtual area V1c is positioned between these areas, when the user U moves from the first real area Ra to the second real area Rb, the avatar A will move from the first virtual area V1a to the second virtual area V1b, jumping over the third virtual area V1c.

Therefore, for example, when a user U experiences the virtual space VS1 through avatar A and observes a virtual object O located in the third virtual area V1c, when avatar A is located in the first virtual area V1a (i.e., when user U is located in the first real area Ra), user U can observe object O from one side (the back side of the drawing, which is the upper left side in Figure 3).

If the user U wishes to observe the object O from the other side (the lower right side in Figure 3, that is, the front side of the drawing), the user U can move from the first real area Ra to the second real area Rb, jumping over the third virtual area V1c in which the object O exists, and move to the second virtual area V1b, and then by simply looking back after that movement, the user U can observe the object O from the other side.

In this way, in the VR system S, one specific area in the real space RS is divided into two adjacent areas (a first real area Ra and a second real area Rb), and an independent virtual area (a first virtual area V1a and a second virtual area V1b) is assigned to each of the divided areas.

In addition, in this VR system S, the positional relationship between the first virtual area V1a and the second virtual area V1b (i.e., the shape and size of the virtual space VS1) is made different from the positional relationship between the first real area Ra and the second real area Rb (i.e., the shape and size of the real space RS).

As a result, this VR system S allows the user U to experience a variety of virtual spaces that would not be possible in the real world.

Furthermore, by changing the positional relationship of the virtual regions in this manner, when the shape and size of the virtual space VS1 is made different from the shape and size of the corresponding real space RS, the correspondence between the amount of movement and action of the user U and the amount of movement and action of the avatar A can be maintained constant, unlike when the shape and size of the virtual space is made different from the shape and size of the corresponding real space by deforming the shape and size of the virtual space.

As a result, this VR system S makes it possible to reduce the sense of incongruity felt by the user U between his or her own movements and actions and those of avatar A, allowing the user U to maintain the awareness that he or she is present in a virtual space (i.e., a sense of immersion).

However, if Avatar A were to suddenly move beyond the third virtual area V1c, the sudden movement could give the user U a strange feeling and hinder the sense of immersion.

As described above, in the VR system S, the first virtual area V1a is configured as an area that corresponds not only to the first real area Ra but also to the edge of the second real area Rb on the first real area Ra side. Specifically, the area on the second virtual area V1b side of the first virtual area V1a (the area where the floor surface is hatched with diagonal lines in Figure 3; hereinafter referred to as the "first overlapping area V1d") corresponds to the edge of the second real area Rb on the first real area Ra side.

The second virtual area V1b is configured as an area that corresponds not only to the second real area Rb but also to the edge of the first real area Ra on the second real area Rb side. Specifically, the area on the first virtual area V1a side of the second virtual area V1b (the area where the floor surface is hatched with diagonal lines in FIG. 3; hereinafter referred to as the "second overlapping area V1e") corresponds to the edge of the first real area Ra on the second real area Rb side.

Therefore, as shown in FIG. 3, when user U enters the edge of the second real world Rb from the first real world Ra, the part of avatar A that corresponds to the part of user U's body that has entered the edge of the second real world Rb (in FIG. 3, the front half of avatar A) will be present in both the first overlapping area V1d and the second virtual area V1b.

At the same time, the part of avatar A that corresponds to the part of user U's body that remains in the first real area Ra (in Figure 3, the rear half of avatar A) will be present in both the second overlap area V1e and the first virtual area V1a.

In this way, when avatar A is displayed overlapping in a specific area, user U can intuitively understand that this area is a boundary area, and that if avatar A moves beyond this boundary area, he or she will move across the third virtual area V1c. As a result, even if avatar A moves suddenly, it is possible to make it less likely that the user U will feel uncomfortable, and to make it less likely that the sense of immersion will be hindered.

Note that the virtual space experience system of the present invention is not limited to this configuration, and it is not necessary to provide such an overlapping area in the virtual space. Therefore, for example, only one of the first overlapping area V1d and the second overlapping area V1e in this embodiment may be generated, or neither overlapping area may be generated.

Furthermore, in the VR system S, the color tone of the floor surface in the first overlapping area V1d of the first virtual area V1a is made different from the color tone of the floor surface in other parts of the first virtual area V1a. Similarly, the color tone of the floor surface in the second overlapping area V1e of the second virtual area V1b is made different from the color tone of the floor surface in other parts of the second virtual area V1b.

This is to allow user U to easily recognize the overlapping area before avatar A enters that area. In turn, this is to make the user aware that some kind of change will occur at the boundary.

Note that the virtual space experience system of the present invention is not limited to this configuration, and the color tone of the floor surface in the overlapping area does not necessarily have to be different from the color tone of the floor surface in the other area. Therefore, the color tone of only one of the overlapping areas may be different from the color tone of the other area. Furthermore, the color tone of not only the floor surface but also the entire overlapping area may be different from the color tone of the entire other area. Furthermore, the color tone of the overlapping area does not have to be different from the color tone of the other area.

Furthermore, the VR system S is configured so that avatar A is semi-transparent in the first overlapping area V1d and the second overlapping area V1e.

This is to allow the user U to easily recognize the overlapping area when part of avatar A enters the overlapping area by changing the form of avatar A in the overlapping area. Ultimately, this is to make the user aware that some kind of change will occur at the boundary area.

Note that the virtual space experience system of the present invention is not limited to this configuration, and the avatars do not necessarily have to be semi-transparent in the overlapping area. Therefore, the color, shape, etc. of the avatars may be made different. Furthermore, the form of the avatars may be made different only in one of the overlapping areas. Furthermore, the form of the avatars does not have to be made different in the overlapping areas.

[Processing to be performed]
Next, with reference to Figures 2 to 4, a process (i.e., a virtual space experiencing method) executed by the VR system S when allowing the user U to experience the virtual space VS1 using the VR system S will be described.

In this process, first, the virtual environment generation unit 30 of the server 3 generates a virtual space VS1 and an avatar A (FIG. 4/STEP 100).

Specifically, as shown in FIG. 3, the virtual space generation unit 30a of the virtual environment generation unit 30 generates an image that serves as the background of the virtual space VS1 and an object O that exists in the virtual space VS1. In addition, the avatar generation unit 30b of the virtual environment generation unit 30 generates an avatar A that corresponds to the user U.

Next, the avatar state control unit 32 of the server 3 determines the state of avatar A based on the state of user U (Figure 4/STEP 101).

The state of user U in the processing from STEP 101 onwards is the state recognised by the user state recognition unit 31 of the server 3 based on the image data captured by the camera 2.

Next, the environment determination unit 33 of the server 3 determines the environment of avatar A based on the state of avatar A (FIG. 4/STEP 102).

Next, the environment determination unit 33 determines the environment that the user U will recognize based on the environment of avatar A (Figure 4/STEP 103).

Specifically, the environment determination unit 33 determines the images and sounds of the virtual space VS1 that represents the environment of avatar A as the environment that the user U is to recognize.

Next, the HMD 4 worn by the user U outputs the determined environment (Figure 4/STEP 104).

Specifically, the HMD 4 displays the determined image on a monitor 40 mounted on the HMD 4, and generates the determined sound from a speaker 41 mounted on the HMD 4.

Next, the user state recognition unit 31 of the server 3 determines whether the user U has performed any action (FIG. 4/STEP 105).

If user U performs some action (YES in STEP 105), the process returns to STEP 101 and the processing from STEP 101 onwards is executed again.

On the other hand, if the user U has not performed any action (NO in STEP 105), the server 3 determines whether or not it has recognized a signal instructing the end of processing (FIG. 4/STEP 106).

If the VR system S1 does not recognize the signal instructing termination (NO in STEP 106), it returns to STEP 105 and executes the processing from STEP 105 onwards again.

On the other hand, if a signal instructing termination is recognized (YES in STEP 106), the VR system S1 ends this processing.

[Second embodiment]
The VR system according to the second embodiment will be described below with reference to FIG.

The VR system of this embodiment has a similar configuration to the VR system S1 of the first embodiment, except that the shape of the virtual space VS2 generated by the virtual space generation unit is different from the shape of the virtual space VS1 generated by the virtual space generation unit 30a of the VR system S of the first embodiment.

For this reason, in the following explanation, only the generated virtual space VS2 will be described. Furthermore, the same reference numerals will be used for the same components as or corresponding components to the VR system S1 of the first embodiment, and detailed explanations will be omitted.

As shown in FIG. 5, the virtual space VS2 is composed of two rectangular parallelepiped regions spaced apart from each other.

Specifically, the virtual space VS2 is composed of a first virtual area V2a (area bounded by a dashed line) which is a rectangular parallelepiped area, and a second virtual area V2b (space bounded by a dashed line) which is a rectangular parallelepiped area located to the side of the first virtual area V2a, rearward and upwardly.

The first virtual area V2a is generated as an area corresponding to the entire first real area Ra of the real space RS and the area of the edge of the second real area Rb on the first real area Ra side (upper left side in Figure 5). Therefore, the shape of the part of the first virtual space V2a excluding the edge (first overlapping area V2d) and the shape of the first real area Ra are the same or similar.

The second virtual area V2b is generated as an area corresponding to the entire second real area Rb of the real space RS and the area of the edge of the first real area Ra on the second real area Rb side (the lower right side in Figure 5). Therefore, the shape of the part of the second virtual space V2b excluding the edge (second overlapping area V2e) and the shape of the second real area Rb are the same or similar.

When user U enters the edge of the second real world Rb from the first real world Ra, the part of avatar A that corresponds to the part of user U's body that has entered the edge of the second real world Rb (in Figure 5, the front half of avatar A) will be present in both the first overlapping area V2d and the second virtual area V2b.

At the same time, the part of avatar A that corresponds to the part of user U's body that remains in the first real area Ra (in Figure 5, the rear half of avatar A) will be present in both the second overlap area V2e and the first virtual area V2a.

In these virtual areas, the state of the avatar A corresponding to the user U changes in response to changes in the state of the user U in the real space RS. Therefore, when the user U moves from the first real area Ra to the second real area Rb, the avatar A moves from the first virtual area V2a to the second virtual area V2b, regardless of the positional relationship between the first virtual area V2a and the second virtual area V2b.

Here, the second virtual area V2b is located to the side of the first virtual area V2a (to the left as viewed from avatar A in the state shown in FIG. 3), shifted rearward and upward.

As a result, while moving, user U can see the back of avatar A, which corresponds to him or her, to the right, in front and below.

The VR system of the second embodiment that generates such a virtual space VS2 and the method of experiencing a virtual space using it can allow the user U to experience a variety of virtual spaces that would not be possible in real space, just like the VR system S of the first embodiment and the method of experiencing a virtual space using it. In addition, it is possible to make it less likely for the user U to feel uncomfortable between his or her own movements and actions and those of the avatar A, so that the user U can maintain the awareness that he or she is present in a virtual space (i.e., a sense of immersion).

[Third embodiment]
Hereinafter, the VR system according to the third embodiment will be described with reference to FIG.

The VR system of this embodiment has a similar configuration to the VR system S1 of the first embodiment, except that the shape of the virtual space VS3 generated by the virtual space generation unit is different from the shape of the virtual space VS1 generated by the virtual space generation unit 30a of the VR system S of the first embodiment.

For this reason, in the following explanation, only the generated virtual space VS3 will be described. Furthermore, the same reference numerals will be used for the same configuration as or corresponding configuration to the VR system S1 of the first embodiment, and detailed explanations will be omitted.

As shown in Figure 6, the virtual space VS3 is a rectangular parallelepiped space overall, and is composed of two rectangular parallelepiped regions that are arranged so that some of them overlap.

Specifically, the virtual space VS3 is composed of a first virtual area V3a (area separated by a dashed line) which is a rectangular parallelepiped area, and a second virtual area V3b (space separated by a dashed line) which is a rectangular parallelepiped area whose edge (second overlapping area V3e) on one side (the upper left side in FIG. 6, the back side of the drawing) overlaps with the edge (first overlapping area V3d) on the other side (the lower right side in FIG. 6, the front side of the drawing) of the first virtual area V3a.

The first virtual area V3a is generated as an area corresponding to the entire first real area Ra of the real space RS and the area of the edge of the second real area Rb on the first real area Ra side (upper left side in Figure 6). Therefore, the shape of the part of the first virtual space V3a excluding the edge (first overlapping area V3d) and the shape of the first real area Ra are the same or similar.

The second virtual area V3b is generated as an area corresponding to the entire second real area Rb of the real space RS and the area of the edge of the first real area Ra on the second real area Rb side (the lower right side in Figure 6). Therefore, the shape of the part of the second virtual space V3b excluding the edge (second overlap area V3e) and the shape of the second real area Rb are the same or similar.

When user U enters the edge of the second real world Rb from the first real world Ra, the part of avatar A that corresponds to the part of user U's body that has entered the edge of the second real world Rb (in Figure 6, the front half of avatar A) will be present in both the first overlapping area V3d and the second virtual area V3b.

At the same time, the part of avatar A that corresponds to the part of user U's body that remains in the first real area Ra (in Figure 6, the rear half of avatar A) will be present in both the second overlap area V3e and the first virtual area V3a.

In these virtual areas, the state of the avatar A corresponding to the user U changes in response to a change in the state of the user U in the real space RS. Therefore, when the user U moves from the first real area Ra to the second real area Rb, the avatar A moves from the first virtual area V3a to the second virtual area V3b.

Here, the correspondence between the coordinate axes of the first real area Ra and the coordinate axes of the first virtual area V3a is different from the correspondence between the coordinate axes of the second real area Rb and the coordinate axes of the second virtual area V3b. Specifically, the virtual axes of the first virtual space V3a are oriented in the same direction as the coordinate axes of the corresponding real space RS, whereas the coordinate axes of the second virtual space V3b are oriented in the vertical direction opposite to the coordinate axes of the corresponding real space RS, resulting in an upside-down relationship.

Furthermore, the first overlapping region V3d, which is the edge of the first virtual region V3a, and the second overlapping region V3e, which is the edge of the second virtual region V3b, are positioned so as to overlap.

As a result, while moving, user U can see the top side of avatar A corresponding to him/her (i.e., his/her own avatar A upside down) above or below him/her.

In this embodiment, a case has been described in which the coordinate axes of a specified virtual area are inverted in the vertical direction relative to the coordinate axes of real space. However, changes in the correspondence relationship of the coordinate axes in this invention are not limited to such inversion in the vertical direction. Therefore, for example, the coordinate axes of the virtual area may be turned sideways relative to the coordinate axes of real space, or may be rotated in a specified direction.

[Other embodiments]
Although the illustrated embodiment has been described above, the present invention is not limited to this embodiment.

For example, in the above first and second embodiments, a case has been described in which two virtual areas are separated from each other, but the coordinate axes of those virtual areas are the same as the coordinate axes of real space. However, in the first and second embodiments, the coordinate axes of one of the virtual areas may be made different from the coordinate axes of real space, as in the third embodiment.

In addition, in any of the above embodiments, the shape of the first virtual space excluding the edge (first overlapping area) and the shape of the first real area are the same or similar, and the shape of the second virtual space excluding the edge (second overlapping area) and the shape of the second real area are the same or similar.

However, the virtual space experience system and method of the present invention are not limited to such a configuration, and either the first virtual area or the second virtual area does not have to be the same shape or a similar shape to the corresponding real area. However, if configured in this way, it is preferable to make the degree of deformation of the virtual area relative to the real area the same for the two virtual areas, as this is less likely to impede the sense of immersion.

1...sign, 2...camera, 3...server, 4...HMD (environment output device), 30...virtual environment generation unit, 30a...virtual space generation unit, 30b...avatar generation unit, 31...user state recognition unit, 31a...user posture recognition unit, 31b...user coordinate recognition unit, 32...avatar state control unit, 33...environment determination unit, 40...monitor, 41...speaker, A...avatar, O...object, RS...real space, Ra...first real area, Rb...second real area, S...VR system (virtual space experience system), U...user, VS1, VS2, VS3...virtual space, V1a, V2a...first virtual area, V1b, V2b...second virtual area, V1c...third virtual area, V1d, V2d...first overlapping area, V1e, V2e...second overlapping area.

Claims

a virtual space generation unit that generates a virtual space corresponding to a real space in which a user exists;
an avatar generation unit that generates an avatar corresponding to the user in the virtual space;
A user state recognition unit that recognizes the position and action of the user;
an avatar state control unit that controls a position and a movement of the avatar based on a position and a movement of the user;
an environment determination unit that determines an environment in the virtual space to be recognized by the user based on a position and a movement of the avatar;
A virtual space experiencing system that allows a user to experience a virtual space via an environment output device that outputs an environment of the virtual space,
the virtual space generation unit generates, in the virtual space, a first virtual area corresponding to a first real area in the real space and a second virtual area corresponding to a second real area in the real space adjacent to the first real area;
A virtual space experiencing system, characterized in that a positional relationship between the first virtual area and the second virtual area is different from a positional relationship between the first real area and the second real area.
2. The virtual space experience system according to claim 1,
The first virtual area and the second virtual area are spaced apart from each other,
A virtual space experience system characterized in that a third virtual area is located between the first virtual area and the second virtual area, the third virtual area corresponding to a third real area that does not correspond to the real space or is independent of the first real area and the second real area.
2. The virtual space experience system according to claim 1,
A virtual space experiencing system, characterized in that an edge of the first virtual area corresponds to an edge of the second real area.
4. The virtual space experience system according to claim 3,
A virtual space experiencing system, characterized in that the color tone of the edge of the first virtual area is different from the color tone of other parts of the first virtual area.
4. The virtual space experience system according to claim 3,
A virtual space experience system characterized in that when the avatar enters the edge of the first virtual area, the part of the avatar located at the edge of the first virtual area takes on a form different from other parts of the avatar.
2. The virtual space experience system according to claim 1,
A virtual space experiencing system, characterized in that the correspondence between the coordinate axes of the first real area and the coordinate axes of the first virtual area is different from the correspondence between the coordinate axes of the second real area and the coordinate axes of the second virtual area.
A step in which a virtual space generation unit generates a virtual space corresponding to a real space in which a user exists;
an avatar generation unit generating an avatar corresponding to the user in the virtual space;
A user state recognition unit recognizes a position and a movement of the user;
an avatar state control unit controlling a position and a movement of the avatar based on a position and a movement of the user;
an environment determination unit determining an environment in a virtual space to be recognized by the user based on a position and a movement of the avatar;
a step of outputting an environment of the virtual space to the user by an environment output device,
the virtual space generation unit generates, in the virtual space, a first virtual area corresponding to a first real area in the real space and a second virtual area corresponding to a second real area in the real space adjacent to the first real area;
A method for experiencing a virtual space, characterized in that the positional relationship between the first virtual area and the second virtual area is different from the positional relationship between the first real area and the second real area.