KR20220109920A - Experience system of online multi-players - Google Patents

Abstract

The present invention relates to an online multi-player VR experience system which allows a plurality of participants to experience the same virtual reality independently in individual places. According to the present invention, provided is an online multi-player VR experience system. The online multi-player VR experience system comprises: a head mounted display (HMD, 10, 10a, 10b, 10c to 10n) which includes a 6-degree-of-freedom sensor unit (12) for detecting 6 degrees of freedom related to the posture of each experiencer and displays a 3D image; a DB server (20) which constructs a web server or storage, has a program necessary for realizing a 3D virtual space, and provides 3D image content in the form of a uniform resource locator (URL) response; a content server (30) which is configured as a server for asset bundles and provides content and a specific virtual space meeting a request by comparing and analyzing URLs and bundle versions requested online; a simulator unit (40) which provides motion with respect to a space where each wearer of the HMD (10, 10a, 10b, 10c to 10n) is located to match the virtual space; an effective access determination unit (60) which determines an effective access space range for each user's occupied effective space in the virtual space provided by the content server (30); and a control unit (70) which controls to generate an alarm for collision for each user according to an interaction generated by an interaction data generation unit (50) and provide alarm data to the user of the corresponding HMD (10, 10a, 10b, 10c to 10n) according to the result of the effective access space range for each user determined by the effective access determination unit (60).

Description

Online multiplayer VR experience system {Experience system of online multi-players}

The present invention relates to an online multiplayer VR experience system, and more particularly, two or more users can experience together in a virtual space using a head mounted display (HMD), and It relates to an online multiplayer VR experience system that can prevent errors or accidents that may occur due to overlapping collisions between users in a virtual experience space.

As the population enjoying leisure life increases, leisure activities or leisure activities that are actually experienced, such as horse riding, driving a car, and driving an airplane, are increasing.

However, for such leisure activities or leisure life, there is the inconvenience of obtaining a license or receiving long-term education, and there is a lot of burden on the user in terms of time and cost.

Recently, a virtual experience simulation device has been introduced to solve this inconvenience.

In this regard, a large display is installed in the front of the 'simulation experience hall' in Patent Publication No. 10-2011-0123302, and a plurality of user seats are installed in the rear so that the screen displayed on these displays can be viewed. Such a seat discloses a technology that is installed so as to move forward, backward, left and right by a motion device composed of a piston or the like.

At this time, the user watches the simulation screen displayed from the front in a state in which the user is seated on the seat, and as the motion device programmed to interlock with the simulation screen is driven, the user can tilt forward or tilt to the left and right so that the user can experience it virtually. .

However, in the conventional virtual experience simulation device configured in this way, a large display is provided in the front, and the experiencer on the seat has no choice but to see the simulation screen only when he looks forward. There is a problem that the reality of the virtual experience decreases.

In addition, in order to solve the problem of this lack of reality, the display can be configured as a large screen. There is a problem that further lowers the reality of

Due to these problems, a technology related to a stereoscopic image kiosk has been proposed in Utility Model Registration No. 20-447950.

However, even with this technology, the existing VR experience is a simple experience type using individual vision and hearing wearing an HMD, so there is a problem in that the sense of reality and liveliness is lowered. There is a problem that cannot be done.

Moreover, in the process of multiple participants experiencing the same experience space independently in individual places as virtual reality, depending on each participant's motion or movement path, overlapping collisions may cause system errors or limit the realm of a specific virtual space. There is a problem that an access error occurs.

Therefore, the development of a technology capable of solving these problems is required.

Accordingly, it is an object of the present invention to provide an online multiplayer VR experience system in which a plurality of participants can simultaneously experience the same experience space online in the same virtual reality at an individual location.

In addition, another object of the present invention is a system that occurs due to overlapping collision phenomenon depending on the motion or movement path of each participant in the process of simultaneously experiencing the same experience space online with the same virtual reality in an individual place independently. It is to provide an online multiplayer VR experience system that enables efficient VR experience by preventing errors in the virtual space or access errors in the realm of a specific virtual space.

According to the present invention, an HMD (head mounted display; 10: 10a, 10b, 10c,.. .10n); A DB server 20 for constructing a web server or storage, having a program necessary for realizing a three-dimensional virtual space, and providing a URL (uniform resource locator) response form to the content of a 3D image; a content server 30 comprising a server for an asset bundle and providing content and a specific virtual space suitable for the request by comparing and analyzing the URL and the bundle version requested through online; a simulator unit 40 for providing motion in a space in which each wearer of the HMD 10; 10: 10a, 10b, 10c, ... 10n is located so as to match the virtual space; an effective access determining unit 60 for determining an effective access space range for each user's occupied effective space on the virtual space provided by the content server 30; and the result of the effective access space range for each user determined by the effective access determining unit 60 and generating an alert for collisions for each user according to the interaction generated by the interaction data generating unit 50 An online multiplayer VR experience system is provided that includes a control unit 70 for controlling to provide alert data to users of corresponding HMDs 10; 10: 10a, 10b, 10c, ... 10n.

Here, for each user of each HMD (10; 10: 10a, 10b, 10c, ... 10n), an identification ID is given to each user according to the online access ID, and each HMD (10; 10: 10a, 10b, 10c, ... 10n), it is preferable to further include an interaction data generating unit 50 for generating data on the interaction between each user.

In addition, the HMD (10; 10: 10a, 10b, 10c, ... 10n) is worn on the head by each user who is an experiencer so that he or she can individually view the simulation image. It is preferable to include a 6-degree-of-freedom sensor unit 12 and a display unit 14 on which a 3D image is displayed.

In addition, the display unit 14 has two display screens to be shown to the user's eyes when worn, and receives the content URL from the DB server 20 in JSON format when the initial program is driven and compares it with the list stored in the local memory. It is preferable to access the minor version or the content server 30 to download and update the necessary content.

In addition, when each HMD (10; 10: 10a, 10b, 10c, ... 10n) of each user is connected to the Internet network through a wireless function, it is preferable that an identification ID is generated as an Internet connection ID to be connected.

In addition, the simulator unit 40 provides motion to match the virtual space with respect to the real space in which each user of the HMD 10; 10: 10a, 10b, 10c, ... 10n is located, and the interaction data generating unit At 50, the interaction data generating unit 50 assigns an identification ID to each user according to the online access ID to each user of each HMD 10; 10: 10a, 10b, 10c, ... 10n. And it is preferable to give each user of each HMD (10; 10: 10a, 10b, 10c, ... 10n) each virtual space coordinates initialized in a specific same virtual space.

In addition, the effective access determining unit 60 provides the effective access space range for the effective space occupied according to the movement or operation of each user on the same virtual space provided by the content server 30, and whether the boundary range is exceeded It is desirable to determine

In addition, the effective access space range provided by the effective access determining unit 60 is the user of the HMD 10; 10: 10a, 10b, 10c, ... 10n in a specific virtual space where the space provided to the user is experienced. With respect to the space that cannot be occupied or the first space that is within the range outside the boundary of the dangerous space, it is preferable that the second space is made up of a space available to the user that is narrower from the first space.

In addition, a third space formed of a buffer space between the first space and the second space is provided, and the control unit 70 controls the first space corresponding to the area of the dangerous space from the second space consisting of the available space in the user's virtual space. When entering in the direction of the area, data for providing an alert to the user of the HMD (10; 10: 10a, 10b, 10c, ... 10n) located in the area of the second space that is the buffer space is transmitted to the corresponding HMD (10; 10: 10a, 10b, 10c, ... 10n).

In addition, a user that can be generated according to the motion result of each user of each HMD 10; 10: 10a, 10b, 10c, ... 10n related to the interaction generated by the interaction data generating unit 50 It is desirable to raise an alarm about a collision between them.

In addition, it is preferable that the boundary between the first area corresponding to the area of the danger space and the second area corresponding to the buffer space is formed of an obstacle such as a cliff or wall in the virtual space.

Therefore, according to the present invention, a plurality of participants can experience the same virtual reality at the same time in the same virtual reality independently in an individual place online, but also a plurality of participants can independently use the same experience space online in an individual place at the same time. In the process of experiencing the same virtual reality, it is possible to effectively experience VR by preventing system errors caused by overlapping collisions depending on the motions or movement paths of each participant or access errors to the realm of a specific virtual space.

1 is a schematic block diagram of an online multiplayer VR experience system according to a preferred embodiment of the present invention.
2 is a block diagram showing the configuration of an HMD in an online multiplayer VR experience system according to a preferred embodiment of the present invention.
3 is a flowchart of an online multiplayer VR experience system according to a preferred embodiment of the present invention.
4 is an exemplary diagram illustrating the generation of an alert for deviation from an effective occupied space in an online multiplayer VR experience system according to a preferred embodiment of the present invention.
5 is a flow chart of a service between the HMD experiencer, the experiencer, the system, and the manager in the online multiplayer VR experience system according to another preferred embodiment of the present invention.

Hereinafter, an online multiplayer VR experience system according to a preferred embodiment of the present invention will be described in detail with reference to the accompanying drawings.

1 is a schematic block diagram of an online multiplayer VR experience system according to a preferred embodiment of the present invention, and FIG. 2 is a configuration showing the configuration of an HMD in the online multiplayer VR experience system according to a preferred embodiment of the present invention. 3 is a flowchart of an online multiplayer VR experience system according to a preferred embodiment of the present invention, and FIG. 4 is an online multiplayer VR experience system according to a preferred embodiment of the present invention. It is an exemplary diagram illustrating the generation of an alarm, and FIG. 5 is a service flow diagram between the HMD experiencer, the experiencer, the system, and the manager in the online multiplayer VR experience system according to another preferred embodiment of the present invention.

1 to 5 , according to the online multiplayer VR experience system according to the preferred embodiment of the present invention, the 6 degree of freedom sensor unit 12 for detecting 6 degrees of freedom related to the posture of each user is provided. HMD (Head Mounted Display; 10: 10a, 10b, 10c, ... 10n), web server or storage that displays 3D images, and programs necessary for realizing 3D virtual space are built-in, and the contents of 3D images It consists of a DB server 20 for providing URL (uniform resource locator) response in the form of a response and a server for asset bundle. It compares and analyzes the URL and bundle version requested online to provide content and a specific virtual space suitable for the request. The content server 30 for this purpose, the simulator unit 40 for providing motion for the space in which each wearer of the HMD 10; 10: 10a, 10b, 10c, ... 10n is located so as to match the virtual space, each For each user of the HMD (10; 10: 10a, 10b, 10c, ... 10n), an identification ID is given to each user according to the online access ID, and each HMD (10; 10: 10a, 10b, 10c,. Effectiveness of the effective space occupied by each user on the virtual space provided by the interaction data generating unit 50 for generating data on the interaction between each user of ..10n) and the content server 30 The effective access determination unit 60 for determining the access space range, and the effective access determination unit 60 to generate an alert for collisions for each user according to the interaction generated by the interaction data generation unit 50 ) according to the result of the effective access space range for each user determined by the control unit ( 70), an online multiplayer VR experience system is provided.

Here, the HMD (10; 10: 10a, 10b, 10c, ... 10n) is worn on the head by each user who is an experiencer so that he or she can individually view the simulation image, and detects 6 degrees of freedom related to the user's posture It includes a 6-DOF sensor unit 12 and a display unit 14 on which a 3D image is displayed.

The display unit 14 has two display screens to be shown to the user's eyes when worn, and receives the content URL in JSON form from the DB server 20 when the initial program is driven and compares it with the list stored in the local memory, followed by a minor version Alternatively, it accesses the content server 30 to download and update the necessary content.

Each HMD (10; 10: 10a, 10b, 10c, ... 10n) of each user is connected to the Internet network through a wireless function.

The 6-DOF sensor unit 12 calculates the Euler angle using the raw data outputted in real time from the MCU chip, that is, the rotation angle of the sensor in space using the real-time acceleration and angular velocity data with the data of the accelerometer and the gyro sensor. It is output by a compensation filter method that converges the data of

On the other hand, when each HMD (10; 10: 10a, 10b, 10c, ... 10n) of each user is connected to the Internet network through a wireless function, it is connected to the present system with the connected Internet access ID.

The DB server 20 builds a web server or storage, contains a program necessary for realizing a three-dimensional virtual space, and provides the content of a 3D image in the form of a URL response.

The DB server 20 provides a URL (Uniform Resource Locator) address to the HMD 10 . The HMD 10 transmits a URL address, and the HMD 10 accesses the content server 30 through the URL input from the DB server 20 to obtain a data version of the content stored in the content server 30 and the HMD 10 ) and compare the data versions of the contents stored in

At this time, when the data version of the content stored in the HMD 10 and the data version of the content stored in the content server 30 are the same, the HMD 10 reads the content stored in itself, and the data of the content stored in the HMD 10 is the same. If the version is lower than the data version of the content stored in the content server 30 (minor), the HMD 10 updates the data related to the content stored in the content server 30, and, if necessary, to the DB server 20 Make sure to change the new URL address.

The HMD 10 displays a virtual object of a 3D virtual image allocated in advance for each real object.

The content server 30 is configured as a server for the asset bundle, and provides content matching the request by comparing and analyzing the URL requested through the online and the bundle version.

Here, the Asset Bundle makes a bundle of assets (scripts, prefabs, sounds, textures, materials, etc.) related to resources existing in Unity and loads them into external storage for use. , After installing the virtual experience data, the remaining asset bundles are downloaded by divided capacity.

The simulator unit 40 provides motion to match the virtual space with respect to the real space in which each user of the HMD 10; 10: 10a, 10b, 10c, ... 10n is located.

The interaction data generating unit 50 determines the effective access space range for the effective space occupied by each user on the virtual space provided by the content server 30 .

At this time, the interaction data generating unit 50 gives an identification ID to each user according to the online access ID to each user of each HMD 10; 10: 10a, 10b, 10c, ... 10n, and Each user of each HMD 10; 10: 10a, 10b, 10c, ... 10n is given respective virtual space coordinates initialized in the same specific virtual space.

Thereafter, the interaction data generating unit 50 performs an interaction between each user of each HMD 10; 10: 10a, 10b, 10c, ... 10n, for example, in mutual access between users. It generates data about the interaction.

The effective access determining unit 60 provides the effective access space range for the effective space occupied according to the movement or operation of each user on the same virtual space provided by the content server 30, and determines whether the boundary range is exceeded. do.

At this time, the space provided to the user is a space that cannot be occupied by the user of the HMD 10; 10: 10a, 10b, 10c,... It consists of a second space consisting of a user usable space consisting of a range of space and a narrower space from the first space, and a third space consisting of a buffer space between the first space and the second space.

The effective access space range provided by the effective access determining unit 60 includes a third space formed of a buffer space between the first space and the second space.

The control unit 70 responds to the interaction generated by the interaction data generating unit 50, for example, the motion result of each user of each HMD 10; 10: 10a, 10b, 10c, ... 10n. Generates an alert for conflicts between users that may be generated accordingly. In addition, the control unit 70 transmits the alarm data to the corresponding HMD (10; 10: 10a, 10b, 10c, ... 10n) for users. At this time, for example, the control unit 70 is located in the area of the second space that is the buffer space when the user enters from the second space consisting of the available space in the direction of the first area corresponding to the area of the dangerous space in the user's virtual space. Data for providing an alert to the user of the HMD (10; 10: 10a, 10b, 10c, ... 10n) is provided to the corresponding HMD (10; 10: 10a, 10b, 10c, ... 10n).

Here, the boundary between the first area corresponding to the area of the danger space and the second area corresponding to the buffer space may be formed of, for example, an obstacle such as a cliff or a wall in the virtual space.

On the other hand, the control unit 70 grasps the current position and motion information of the user holding the HMD 10 , and the posture of at least one virtual object selected in the HMD 10 can be changed in synchronization with the 3D posture information. do.

At this time, the coordinates of at least one or more virtual objects selected in the HMD 10 are changed from the spatial coordinate system for real image information to the mobile coordinate system of the HMD 10 , and the coordinates of the deselected virtual objects are the mobile coordinate system of the HMD 10 . is changed to the spatial coordinate system for actual image information. When the user moves the HMD 10 in three dimensions, the posture of the selected virtual object is automatically changed in synchronization with the three-dimensional movement. The 6-DOF sensor unit 12 may detect a three-dimensional movement of the HMD 10 as well as a user's gaze direction, movement direction, tilt, and the like.

When a virtual object is selected for the HMD 10 , the selected virtual object is transmitted to the display unit 14 of the HMD 10 . At this time, the reference coordinate system of the virtual object is changed from the spatial coordinate system to the coordinate system of the HMD 10 . When the HMD 10 is moved/rotated while the virtual object is input, the movement/rotation information of the virtual object connected to the HMD 10 is three-dimensionally changed in synchronization with the three-dimensional movement of the HMD 10 . If the virtual object is not input, the virtual object is separated from the HMD 10 . Accordingly, the reference coordinate system of the virtual object is changed from the coordinate system of the HMD 10 to the spatial coordinate system. In this way, the control unit 70 receives the URL from the DB server 20 according to the driving signal of the HMD 10 and controls the HMD 10 and the simulator unit 40 .

According to the online multiplayer VR experience system according to another embodiment of the present invention, in order to prevent safety accidents that occur while users wearing the HMD 10A for the experience and the HMD 10B for the guide, respectively, move in a virtual space, The HMD 10 worn by each experiencer and the guide further includes an identification mark generating unit 16 for generating each identification mark data for each HMD 10 . The identification mark generating unit 16 generates data including the wearer's position according to the movement of each HMD 10 , and inputs it to the control unit 70 .

On the other hand, the control unit 70 arranges data on real space coordinates for users wearing each HMD 10 as two-dimensional position coordinates, and data on positions generated by each identification mark generating unit 16 . generates relative distance information between users wearing the HMD 10 according to the It is transmitted to the HMD (10).

Therefore, it is possible to prevent in advance a safety accident that occurs between wearers of the HMD 10 who move while wearing the HMD 10 .

10, 10a, 10b, 10c,...10n: HMD
12: 6 degree of freedom sensor unit
14: display unit
16: identification mark generation unit
20: DB server
30: content server
40: simulator unit
50: interaction data generation unit
60: effective access determination unit
70: control unit

Claims (11)

an HMD (head mounted display; 10: 10a, 10b, 10c, ... 10n) having a 6 degree of freedom sensor unit 12 for detecting 6 degrees of freedom related to each participant's posture and displaying a 3D image;
A DB server 20 for constructing a web server or storage, having a program necessary for realizing a three-dimensional virtual space, and providing a URL (uniform resource locator) response form to the content of a 3D image;
a content server 30 comprising a server for an asset bundle and providing content and a specific virtual space suitable for the request by comparing and analyzing the URL and the bundle version requested through online;
a simulator unit 40 for providing motion in a space in which each wearer of the HMD 10; 10: 10a, 10b, 10c, ... 10n is located so as to match the virtual space;
an effective access determining unit 60 for determining an effective access space range for each user's occupied effective space on the virtual space provided by the content server 30; and
Generates an alert for collision for each user according to the interaction generated by the interaction data generating unit 50, and the result of the effective access space range for each user determined by the effective access determining unit 60 Online multiplayer VR experience system comprising: a controller (70) for controlling to provide alert data according to the corresponding HMD (10; 10: 10a, 10b, 10c, ... 10n) to the user. The method of claim 1, wherein an identification ID is given to each user of each HMD (10; 10: 10a, 10b, 10c, ... 10n) according to an online access ID, and each HMD (10; 10: 10a, 10b, 10c, ... 10n) Online multiplayer VR experience system, characterized in that it further comprises an interaction data generating unit (50) for generating data on the interaction between each user. The method of claim 1 or 2, wherein the HMD (10; 10: 10a, 10b, 10c, ... 10n) is worn on the head by each user who is an experiencer to individually view the simulation image. An online multiplayer VR experience system comprising a 6-DOF sensor unit (12) for detecting 6 degrees of freedom related to posture and a display unit (14) on which a 3D image is displayed. The method according to claim 3, wherein the display unit 14 has two display screens to be displayed to the user's eyes when worn, and receives the content URL from the DB server 20 in JSON format when the initial program is driven and stored in the local memory. Online multiplayer VR experience system, characterized in that after comparing the list with the minor version or the content server (30) to download and update the necessary content. 4. The method of claim 3, wherein when each HMD (10; 10: 10a, 10b, 10c, ... 10n) of each user is connected to the Internet network through a wireless function, an identification ID is generated as an Internet access ID to be accessed. Online multiplayer VR experience system, characterized in that. The method of claim 3, wherein the simulator unit 40 provides motion to match the virtual space with respect to the real space in which each user of the HMD (10; 10: 10a, 10b, 10c, ... 10n) is located,
The interaction data generation unit 50 generates the interaction data generation unit 50 according to the online access ID for each user of each HMD 10; 10: 10a, 10b, 10c, ... 10n. An identification ID is assigned to each HMD (10; 10: 10: 10a, 10b, 10c, ... 10n), and each virtual space coordinate initialized in a specific same virtual space is given to each user. Online multiplayer VR experience system. According to claim 6, wherein the effective access determination unit (60) provides an effective access space range for the effective space occupied according to the movement or operation of each user on the same virtual space provided by the content server (30), the boundary Online multiplayer VR experience system, characterized in that it is determined whether the range is exceeded. The method according to claim 7, wherein the effective access space range provided by the effective access determining unit 60 is the space provided to the user in the specific virtual space experienced by the HMD (10; 10: 10a, 10b, 10c, ... 10n) of a space that cannot be occupied by a user or a first space that is within a range outside the boundary of a dangerous space, characterized in that it consists of a second space consisting of a user's usable space consisting of a narrower space from the first space Player VR experience system. The method according to claim 8, wherein a third space consisting of a buffer space between the first space and the second space is provided,
When the controller 70 enters in the direction of the first area corresponding to the area of the dangerous space from the second space consisting of the available space in the user's virtual space, the HMD (10; 10) located in the area of the second space as the buffer space: 10a, 10b, 10c,... VR experience system. 10. The method of claim 9, wherein the interaction generated by the interaction data generating unit (50) is generated according to the motion result of each user of each HMD (10; 10: 10a, 10b, 10c, ... 10n) related to the interaction generated by the interaction data generation unit (50). An online multiplayer VR experience system, characterized in that it raises an alert for possible conflicts between users. The online multiplayer VR experience system according to claim 9, wherein a boundary between the first area corresponding to the danger space area and the second area corresponding to the buffer space is formed by an obstacle such as a cliff or wall in the virtual space.

Images