JP7256398B2 - computer system - Google Patents

Description

The present invention relates to computer systems.

Conventionally, systems have been proposed that enhance a user's virtual experience in a virtual space. For example, there is a technique in which an avatar in a virtual space performs a performance according to the user's actions in the real space, thereby increasing the interest of the user's virtual experience (see, for example, Patent Document 1).

Japanese Patent No. 6514397

In computer systems, there is a need for users to obtain the interest of virtual experiences.

SUMMARY OF THE INVENTION Accordingly, it is an object of the present invention to provide a computer system that allows a user to enjoy a virtual experience.

A first invention is a computer system comprising one or more computers,
said computer,
a first output unit configured to output, to a first user who causes a proxy object formed in a virtual space to perform an action, object action information for deriving the action of the proxy object;
a first acquisition unit that acquires first user action information indicating an action of the first user corresponding to the object action information;
a second output unit that outputs the first user action information to a second user;
functioning as a second acquisition unit for acquiring second user motion information indicating the motion of the second user;
The first output unit outputs the object action information corresponding to the second user action information to the first user,
The computer system is characterized in that the second output unit does not output the object action information to the second user.

A second invention is a computer system comprising one or more computers,
said computer,
a first output unit configured to output, to a first user who causes a proxy object formed in a virtual space to perform an action, object action information for deriving the action of the proxy object;
a first acquisition unit that acquires first user action information indicating an action of the first user corresponding to the object action information;
a second output unit that outputs the first user action information to a second user;
functioning as a second acquisition unit for acquiring second user motion information indicating the motion of the second user;
When the second user action information acquired by the second acquisition section after the second output section outputs the first user action information to the second user satisfies a predetermined condition, the first output section satisfies a predetermined condition. is a computer system characterized by outputting the object action information according to the second user action information to the first user.

Also, in the first invention or the second invention, the object action information may be determined according to the action of the first user.

Further, in the first invention or the second invention, the computer executes a game,
The first output unit can output the object action information according to the game scenario to the first user.

Further, in the first invention or the second invention, the computer
an operation input unit that receives an operation input from the first user or the second user;
further functioning as a scenario determination unit that determines a scenario of the game based on the operation input;
The first output unit can output the object action information according to the scenario determined by the scenario determination unit to the first user.

In addition, in the first invention or the second invention, the scenario determination section can determine at least one scenario out of a plurality of scenarios in the game by lottery based on the operation input.

Further, in the first invention or the second invention, the first output section can output information regarding the scenario determined by the scenario determination section to the first user.

Further, in the first invention or the second invention, the computer
Further functions as a first user selection unit that selects the first user who plays the same scenario as the second user from among the plurality of first users, based on an operation input from the second user. let, can

Further, in the first invention or the second invention, the computer
Further functions as a second user selection unit that selects the second user who plays the same scenario as the first user from among the plurality of second users based on an operation input from the first user. let, can

Further, in the first invention or the second invention, the computer
a scenario determination unit that determines a scenario of the game based on an operation input from the first user or the second user;
a first user selection unit that selects the first user who plays the same scenario as the second user from among the plurality of first users based on the scenario determined by the scenario determination unit; let, can

According to the present invention, it is possible to provide a computer system that allows a user to enjoy a virtual experience.

1 is a block diagram showing the hardware configuration and functional configuration of a game system in this embodiment; FIG. The schematic diagram of the game system in this embodiment. The figure which shows a series of flows of the game system in this embodiment.

[Embodiment]
A game system 1 according to an embodiment of the present invention will be described with reference to the drawings. FIG. 1 shows a block diagram of a game system in this embodiment. FIG. 2 shows a schematic diagram of the game system in this embodiment.

<Description of the game>
In the game system 1 of the embodiment shown in FIG. 1, a server device 2, a plurality of first game devices 3, and a plurality of second game devices 5 are connected via a communication network 6 so as to be able to communicate with each other. A game program and game data are installed in the server device 2 , each first game device 3 and each second game device 5 . The first user U1 of the first game device 3 and the second user U2 of the second game device 5 each make the player character act in the virtual space and make the player character fight against the enemy character.

In the game described in this embodiment, the player character performs actions in the virtual space in accordance with actions of the first user U1 of the first game device 3 (eg, body movements, voice, etc. of the first user U1). . In the game, the first user U1 of the first game device 3 becomes an actor who plays the player character (character C1), and the game progresses.

Also, in this game, each second user U2 is wearing an HMD (Head Mounted Display) 61 . The second game device 5 displays a game image generated from the three-dimensional virtual space on the display unit (not shown) of the HMD 61 worn by the second user U2. This game allows the second user U2 to experience virtual reality (VR).

Also, in this game, the game progresses according to a predetermined scenario. For example, the game scenario includes a wide range of game contents, such as a mission to subdue a predetermined enemy character, a story in which a character progresses in a virtual space, and the like.

The above game is executed on the side of the second user U2 on a home-use game machine such as PlayStation (registered trademark), a portable game machine such as PlayStation Vita (registered trademark), a personal computer, a tablet, or the like.

<Overview of Game System 1>
A game system 1 includes a server device 2 , a first game device 3 and a second game device 5 .

The server device 2 provides game programs and manages game data.

The server device 2 also executes matching processing between the first game device 3 and the second game device 5 . Specifically, in response to a matching request from the second game device 5, the server device 2 determines (matches) the first user U1 who plays the same scenario as the second user U2. The server device 2 connects the first game device 3 operated by the first user U1 and the second game device 5 operated by the second user U2 who is matched with the first user U1 so as to be able to communicate with each other.

The first game device 3 tracks the body movement and voice of the first user U1, and generates motion tracking information and voice tracking information indicating the results. The first game device 3 transmits the generated action tracking information and voice tracking information to the second game device 5 operated by the second user U2 who is a matching partner.

The second game device 5 transmits to the first game device 3 as input information the operational input performed by the second user U2 on the controller 63 .

The first game device 3 and the second game device 5 move the character C1 in the virtual space according to the motion tracking information and the voice tracking information, and move the character C2 in the virtual space according to the input information. That is, the character C1 is a character operated by the first user U1, and the character C2 is a character operated by the second user U2.

The first game device 3 and the second game device 5 generate game images from the virtual space and display them on the display units of the HMDs 41 and 61 . The game progresses while the first game device 3 and the second game device 5 are synchronized.

<Hardware configuration>
Each hardware configuration of the server device 2, the first game device 3, and the second game device 5 will be described below.

<Configuration of Server Apparatus 2>
As shown in FIG. 1 , the server device 2 has a network interface 21 , a storage section 22 and a control section 23 . Network interface 21 and storage unit 22 are electrically connected to control unit 23 via bus 29 .

The network interface 21 is communicably connected to each first game device 3 and each second game device 5 via a communication network 6 such as the Internet and LAN.

The storage unit 22 is composed of an HDD, SSD, RAM, ROM, and the like. Specifically, the storage unit 22 stores various programs including account information of users who use the game system, login histories, game programs, and game data. The storage unit 22 also stores a matching list used when executing the matching process.

The control unit 23 is composed of a microcomputer including a CPU and a semiconductor memory, and controls the operation of the self-device 2 .

<Functional Configuration of Control Unit 23 in Server Device 2>
By executing various programs, the control unit 23 functions as an information processing means 231 and a matching processing means 232 as shown in FIG.

The information processing means 231 mainly transmits and receives data necessary for game execution to and from each first game device 3 and each second game device 5 .

The data that the information processing means 231 receives from each of the first game devices 3 includes download request information of the game program and account information of the first user U1. The data that the information processing means 231 transmits to each first game device 3 includes information indicating the matched second user U2, scenario information indicating the scenario determined in the second game device 5, and the like.

The data that the information processing means 231 receives from each of the second game devices 5 includes game program download request information, account information of the second user U2, matching request information, and the like. The data that the information processing means 231 transmits to each second game device 5 includes information indicating the matched first user U1.

The matching processing means 232 executes matching processing based on the matching list stored in the storage unit 22 when the information processing means 231 receives the matching request information. When the matching process is executed, the information processing means 231 selects the first game device 3 operated by the first user U1 and the second game device 5 operated by the second user U2 who is matched with the first user U1. Connect so that they can communicate with each other.

<Structure of first game device 3>
The HMD 41 , the speaker 42 , the motion sensor 43 and the microphone 44 are externally connected or built into the first game device 3 . The first game device 3 also has a network interface 31 , a graphics processing unit 32 , an audio processing unit 33 , a tracking processing unit 34 , a storage unit 35 and a control unit 36 . The network interface 31 , graphics processing section 32 , audio processing section 33 , tracking processing section 34 and storage section 35 are electrically connected to a control section 36 via a bus 39 .

The network interface 31 is communicatively connected to the communication network 6 in order to transmit and receive various data between the first game device 3 and the server device 2 and each of the second game devices 5 .

The graphics processing unit 32 draws game images including various objects related to the game space in a moving image format according to game image data output from the control unit 36 during game play. The graphics processing unit 32 is communicably connected to, for example, the HMD 41 worn by the first user U1, and a game image rendered in a moving image format is displayed on the display unit of the HMD 41 as a game screen.

Further, the graphics processing unit 32 causes the display unit of the HMD 41 to display character motion information, which will be described later, on the display unit of the HMD 41 according to instructions from the control unit 36 .

The audio processing unit 33 is communicably connected to the speaker 42 , and reproduces and synthesizes game sound according to instructions from the control unit 36 during game play, and outputs this from the speaker 42 . Also, the audio processing unit 33 causes the speaker 42 to output a converted voice, which will be described later.

The tracking processing unit 34 is communicably connected to the motion sensor 43 worn by the first user U1. The motion sensor 43 includes, for example, an acceleration sensor attached to the first user U1, and detects body movements of the first user U1 (arms, legs, body movements, etc. of the first user U1). The tracking processing unit 34 outputs motion tracking information indicating the body movement of the first user U1 to the control unit 36 according to the output from the motion sensor 43 .

Further, the tracking processing unit 34 is communicably connected to a microphone 44 that detects the voice uttered by the first user U1, and indicates the voice uttered by the first user U1 according to the output from the microphone 44. Audio tracking information is output to the control unit 36 .

The storage unit 35 is composed of HDD, SSD, RAM, ROM, and the like. The storage unit 35 stores various programs including game data and game programs downloaded from the server device 2 . The storage unit 35 also stores account information and character action information of the first user U1 who uses the first game device 3 .

The character action information includes information on actions of the character C1. For example, the character motion information includes information for instructing the first user U1 to perform the motion of the character C1 when a predetermined operation input is performed on the controller 63 . That is, the storage unit 35 stores character motion information corresponding to the input information received from the second game device 5 .

The control unit 36 is composed of a microcomputer including a CPU and a semiconductor memory, and controls the operation of the device 3 itself.

<Functional Configuration of Control Unit 36 in First Game Device 3>
The control unit 36 functions as communication means 361, game progression means 362, character action information processing means 363, and voice conversion means 364 by executing various programs.

The communication means 361 has a function of communicating with the server device 2 and the second game device 5 via the network interface 31 .

Specifically, the communication means 361 transmits account information, download request information including a download request for game data, and the like to the server device 2 . The communication means 361 receives scenario information, information about the matched second user U2, and the like from the server device 2 .

Further, the communication means 361 transmits to the second game device 5 action tracking information, converted voice information generated based on the voice tracking information, scenario start information for notifying the start of a game scenario, and the like. The communication means 361 receives from the second game device 5 input information indicating an operation input by the second user U2.

When the communication means 361 receives the scenario information, the game progress means 362 executes the game program according to the scenario information. Specifically, the game progress means 362 reads out data such as game space objects and textures included in the game data from the storage unit 35, or uses data received from the server device 2 to generate three-dimensional game image information. to generate As the game image information is processed by the graphics processing unit 32 , the processed game images are sequentially displayed on the display unit of the HMD 41 .

Then, the game advancing means 362 arranges the characters C1 and C2 on the game image. The game progression means 362 causes the character C1 to act according to the action tracking information output from the tracking processing section 34 and causes the character C2 to act according to the input information received from the second game device 5 .

The character action information processing means 363 displays the character action information stored in the storage section 35 on the display section of the HMD 41 according to the game scenario. For example, the character action information processing means 363 causes the display section of the HMD 41 to display the character action instruction information cm1 and the character voice instruction information cm2 along with the game image in accordance with the input information received from the second game device 5 .

Specifically, the character action instruction information cm1 is information that instructs the first user U1 to perform the action of the character C1. The character voice instruction information cm2 is information for instructing the first user U1 to make a voice uttered by the character C1. Character action instruction information cm1 and character voice instruction information cm2 are displayed on the display section of HMD 41 when a predetermined operation input is performed on controller 63 .

The voice converter 364 converts the voice indicated in the voice tracking information into another voice. For example, the audio converter 364 generates converted audio by correcting the frequency of the audio included in the audio tracking information. The audio processor 33 outputs the converted voice generated by the voice converter 364 to the speaker 42 . Also, the communication means 361 transmits converted voice information indicating the converted voice generated by the voice conversion means 364 to the second game device 5 .

<Configuration of Second Game Device 5>
The second game device 5 has an HMD 61 , a speaker 62 and a controller 63 externally connected or built therein. The second game device 5 also has a network interface 51 , a graphics processing section 52 , an audio processing section 53 , an operation section 54 , a storage section 55 and a control section 56 . Network interface 51 , graphics processing unit 52 , audio processing unit 53 , operation unit 54 and storage unit 55 are electrically connected to control unit 56 via bus 59 .

The network interface 51 is communicably connected to the communication network 6 in order to transmit and receive various data between the server device 2 and each first game device 3 .

The graphics processing unit 52 draws game images including various objects related to the game space in a moving image format according to game image data output from the control unit 56 during game play. The graphics processing unit 52 is communicably connected to, for example, the HMD 61 worn by the second user U2, and a game image rendered in a moving image format is displayed on the display unit of the HMD 61 as a game screen.

The audio processing unit 53 is communicably connected to the speaker 62 , reproduces and synthesizes game sounds according to instructions from the control unit 56 during game play, and outputs the sound from the speaker 62 . Also, the audio processing unit 53 causes the speaker 62 to output the converted sound indicated in the converted sound information received from the first game device 3 .

The operation unit 54 is communicably connected to the controller 63 and transmits/receives input information indicating an operation input from the second user U2 to/from the controller 63 . For example, the second user U2 inputs input information to the second game device 5 by pressing various buttons of the controller 63 .

The storage unit 55 is configured with an HDD, SSD, RAM, ROM, and the like. The storage unit 55 stores various programs including game data and game programs downloaded from the server device 2 . The storage unit 55 also stores account information of the second user U2 who uses the second game device 5 .

The control unit 56 is composed of a microcomputer including a CPU and a semiconductor memory, and controls the operation of the device 5 itself.

<Functional Configuration of Control Unit 56 in Second Game Device 5>
The control unit 56 functions as communication means 561, scenario determination means 562, matching request means 563, and game progression means 564 by executing various programs.

The communication means 561 has a function of communicating with the server device 2 and the first game device 3 via the network interface 31 .

Specifically, the communication means 561 transmits account information, download request information, matching request information, and the like to the server device 2 . The communication unit 561 receives information about the first game device 3 operated by the matched first user U1 from the server device 2 .

In addition, the communication means 561 transmits input information indicating an operation input performed on the controller 63 to the first game device 3 . The communication means 561 receives, from the first game device 3, action tracking information, converted voice information, scenario start information for notifying a game scenario, and the like.

The scenario determining means 562 determines the scenario of the game to be executed on the second game device 5 according to the operation input of the second user U2. For example, when the second user U2 performs an operation input for determining a scenario, the scenario determining means 562 executes scenario lottery processing and determines one scenario to be played from among a plurality of scenarios. Scenario determination means 562 selects one scenario from a plurality of scenarios using, for example, random numbers.

When the scenario determination means 562 determines the scenario, the matching request means 563 generates matching request information including the determined scenario as scenario information. Communication means 561 transmits the generated matching request information to server device 2 .

When the scenario determination means 562 determines the scenario, the game progress means 564 executes the game program according to the determined scenario. Specifically, the game progress means 564 reads out data such as game space objects and textures included in the game data from the storage unit 65, or uses data received from the server device 2 to read out data according to the determined scenario. to generate three-dimensional game image information. As the game image information is processed by the graphics processing unit 52 , the processed game images are sequentially displayed on the display unit of the HMD 61 .

Then, the game advancing means 564 arranges the characters C1 and C2 on the game image. The game progression means 564 moves the character C1 according to the motion tracking information received from the first game device 3 and moves the character C2 according to the input information to the controller 63 .

<Regarding Matching Processing Executed in Matching Processing Means 232>
When the information processing means 231 receives the matching request information from the second game device 5, the matching processing means 232 refers to the matching list stored in the storage section 22 and executes matching processing. Specifically, the matching list associates the account information of the first user U1 with the scenario information.

When the matching request information is received from the second game device 5, the matching processing means 232 searches the matching list for the first user U1 corresponding to the scenario information included in the matching request information. The matching processing means 232 matches the logged-in first user U1 among the first users U1 corresponding to the scenario information with the second user U2.

Here, the matching processing unit 232 selects one first user U1 from among the plurality of first users U1 when there are a plurality of first users U1 that can be matched with the second user U2. The matching first user U1 may be selected randomly, or may be selected by the second user U2 (for example, selected by operating the controller 63).

Then, the information processing means 231 connects the first game device 3 operated by the first user U1 and the second game device 5 operated by the second user U2 who is matched with the first user U1 so as to be able to communicate with each other. do.

<About character movement information>
When matching processing is executed by the matching processing means 232 , the information processing means 231 transmits scenario information included in the matching request information received from the second game device 5 to the first game device 3 . That is, when the server device 2 executes the matching process, the scenario information indicating the scenario determined by the scenario determining means 562 of the second game device 5 is operated by the first user U1 matched with the second user U2. It is transmitted to the first game device 3 .

The game progress means 362 of the first game device 3 and the game progress means 564 of the second game device 5 progress the game according to the scenario determined by the scenario determination means 562 .

After the game scenario is started, the motion sensor 43 of the first game device 3 detects the motion of the first user U1. The first game device 3 transmits motion tracking motion information indicating the detected motion of the first user U1 to the second game device 5 operated by the second user U2 matched with the first user U1.

Also, the first game device 3 detects the voice of the user U1 with the microphone 44 . The first game device 3 generates voice tracking information indicating the detected voice of the user U1. Furthermore, the first game device 3 generates a converted voice in which the frequency of the voice of the first user U1 in the voice tracking information is corrected. The first game device 3 transmits converted voice information indicating the converted voice to the second game device 5 operated by the second user U2 who is matched with the first user U1.

On the other hand, the second game device 5 detects an operational input to the controller 63 . The second game device 5 transmits input information indicating an operation input to the controller 63 to the first game device 3 operated by the first user U1 matched with the second user U2.

Then, the game progression means 362 and 564 move the character C1 of the first user U1 according to the motion tracking information and the converted voice information, respectively. In addition, the game progression means 362 and 564 respectively move the character C2 of the second user U2 according to the input information.

That is, the first game device 3 and the second game device 5, which have become communicable with each other through the matching process, execute the same scenario, and the characters C1 and C2 perform the same actions.

Here, in the first game device 3, the display unit of the HMD 41 displays character action information for deriving the action of the character C1 for the first user U1. The character action information includes character action instruction information cm1 and character voice instruction information cm2.

Specifically, the display screen SC1 in FIG. 2 is an example of a display screen displayed on the display unit of the HMD 41 in the first game device 3, and the display screen SC2 is displayed on the display unit of the HMD 61 in the second game device 5. It is an example of a display screen.

Character action instruction information cm1 and character voice instruction information cm2 are displayed on the display screen SC1. The character action instruction information cm1 is information for instructing the user U1 to perform the action of the character C1. The character voice command information cm2 is information for commanding the voice of the character C1 to the user U1.

In FIG. 2, the first user U1 is operating a character C1, which is an enemy character in the game scenario. A second user U2 is operating a character C2, which is a player character in the game scenario. For example, when the second user U2 operates the character C2 and the character C1 encounters the character C2, the character action instruction information cm1 displays "Action 'Raise both hands up'", and the character voice instruction information cm2 displays “The line “Try to beat me”” is displayed.

That is, when a predetermined condition is satisfied in the game scenario by the operation input of the second user U2, the character action information is displayed on the display section of the HMD 41 . In the character action instruction information cm1 and the character voice instruction information cm2, information for instructing the movement of the character C1 and information for instructing the voice of the character C1 (dialogue of the character C1) according to the game scenario are respectively displayed. be.

When the character action information is displayed, the first user U1 moves his/her body according to the character action instruction information cm1. Also, the first user U1 speaks according to the character voice instruction information cm2. For example, in FIG. 2, the first user U1 raises both arms according to the character action instruction information cm1. The first user U2 reads out the lines according to the character voice instruction information cm2. Therefore, the body motion and speech performed by the first user U1 are reflected in the motion of the character C1 as if they were performed by the character C1.

Since the first user U1 performs actions according to the character action instruction information cm1 and the character voice instruction information cm2, the scenario of the game can be livened up, and the interest of the user's virtual experience can be enhanced.

<Operation flow of the game system>
The operation flow of the game system will be described with reference to FIGS. 1 to 3. FIG.

In the second game device 5, the controller 63 detects an operation input from the second user U2. The operation unit 54 outputs input information indicating an operation input from the second user U2, which is detected by the controller 63, to the control unit 56 (step S101). When the input information is to execute a scenario lottery process, the scenario determining means 562 in the control unit 56 executes a scenario lottery process to determine the scenario of the game to be played (step S102). The matching request means 563 generates matching request information including the determined scenario as scenario information, and transmits it to the server device 2 (step S103).

In the server device 2, the information processing means 231 receives the matching request information (step S201). The matching processing means 232 executes matching processing based on the scenario information included in the matching request information and the matching list stored in the storage unit 22 (step S202). Specifically, the matching processing means 232 searches the matching list for the first user U1 corresponding to the received scenario information, and determines the first user U1 who plays the same scenario as the second user U2. Then, the matching processing means 232 connects the first game device 3 operated by the first user U1 and the second game device 5 operated by the second user U2 who is matched with the first user U1 so as to be able to communicate with each other. do.

Then, the information processing means 231 transmits the scenario information received from the second game device 5 to the first game device 3 that has become communicable (step S203).

In the first game device 3, the communication means 361 receives the scenario information (step S301). For example, when the motion sensor 43 detects a predetermined action of the first user U1, the communication means 361 transmits scenario start information for notifying the start of the scenario to the second game device 5 (step S302).

The game progression means 362 progresses the game according to the scenario information received by the communication means 361 (step S303). For example, the game progress means 362 causes the display section of the HMD 41 to display information indicating the actions (body movements) and lines (spoken voice) of the first user U1 set in the game scenario. The first user U1 moves his or her body or utters a line according to the information displayed on the display section of the HMD 41 .

On the other hand, the second game device 5 waits until the communication means 561 receives the scenario start information. Then, when the communication means 561 receives the scenario start information (step S104), the game progress means 564 progresses the game according to the scenario determined by the scenario determination means 562 (step S105).

After step S303, in the first game device 3, the motion sensor 43 and the microphone 44 respectively detect the motion of the first user U1 and the voice of the first user U1. The tracking processing unit 34 then generates motion tracking information and voice tracking information (step S304). Specifically, the tracking processing unit 34 generates motion tracking information indicating the motion of the first user U1 according to the output of the motion sensor 43 . Also, the tracking processing unit 34 generates voice tracking information indicating the voice of the first user U1 in accordance with the output of the microphone 44 .

Also, the voice converting means 364 generates converted voice information (step S305). Specifically, the voice converter 364 generates converted voice information by correcting the frequency of the voice of the first user U1 included in the voice tracking information. Then, the communication means 361 transmits the generated action tracking information and converted voice information to the second game device 5 (step S306).

After step S105, the second game device 5 stops the progress of the game scenario (for example, does not develop the story of the game) until the communication means 561 receives the action tracking information and the converted voice information. Then, when the communication means 561 receives the action tracking information and the converted voice information (step S106), the communication means 561 receives the input information (information indicating the operation input from the second user U2 detected by the controller 63). It is transmitted to the first game device 3 (step S107).

After step S306, in the first game device 3, the communication means 361 receives the input information (step S307). The game progress means 362 moves the character C1 according to the generated motion tracking information, and moves the character C2 according to the received input information (step S308).

On the other hand, after step S107, in the second game device 5, the game progression means 564 causes the character C1 to act according to the received action tracking information, and causes the character C2 to act according to the generated input information (step S108). .

After step S308, in the first game device 3, the character action information processing means 363 executes character action information processing so that the character action information is displayed on the display section of the HMD 41 (step S309). Specifically, the character action information processing means 363 controls the display section of the HMD 41 to display character action information according to the game scenario in accordance with the input information received from the second game device 5 ( step S309).

For example, as shown in FIG. 2, the character action information processing means 363 causes the display section of the HMD 41 to display a display screen SC1 in which the character action information is superimposed on the game screen (step S310). The character action information includes character action instruction information cm1 and character voice instruction information cm2. The character action instruction information cm1 is information for instructing the action of the character C1, and the character voice instruction information cm2 is information for instructing the sound produced by the character C1. Then, the audio processing unit 33 reproduces the converted voice from the speaker 42 according to the generated converted voice information (step S311).

On the other hand, after step S108, in the second game device 5, the graphics processing unit 52 causes the display unit of the HMD 61 to display the display screen SC2 according to the output from the control unit 56 (step S109). Also, the audio processing unit 53 causes the speaker 62 to reproduce the converted sound (step S110).

After step S311, the first game device 3 returns to step S303 and repeats steps S303 to S311. On the other hand, after step S110, the second game device 5 returns to step S105 and repeats steps S105 to S110.

To summarize the above, the game system of the present embodiment allows the controller 36 (computer) of the first game device 3 and the controller 56 (computer) of the second game device 5 to be the character C1 (proxy object) appearing in the game. ), a display unit (first output unit) of the HMD 41 that displays character action information (object action information) for deriving the action of the character C1, and a first output unit corresponding to the character action information. Motion sensor 43 (first acquisition unit) for detecting (obtaining) motion tracking information (first user motion information) indicating motion of user U1, and voice tracking information (first user motion information) indicating voice of first user U1 ), and the display unit of the HMD 61 (second output unit), a speaker 62 (second output unit) that reproduces the converted voice generated based on the voice tracking information, and input information (second user action information) indicating the operation input performed by the second user U2. , and the display unit of the HMD 41 displays (outputs) character action information corresponding to the input information to the first user U1.

<Effect of invention>
As described above, in the present embodiment, the motion sensor 43 and the microphone 44 respectively detect (acquire) motion tracking information and voice tracking information indicating motions of the first user U1 who cause the character C1 to perform motions. Also, the display unit of the HMD 61 and the speaker 62 respectively display and reproduce (output) the motion tracking information and the voice tracking information (converted voice information) for the second user U2. The controller 63 detects (acquires) input information indicating an operation input by the second user U2. The display unit of the HMD 41 displays character motion information that guides the motion of the first user U1 according to the input information to the first user U1.

That is, motion tracking information and voice tracking information indicating the motion of the first user U1 are output to the second user U2. In addition, character action information for deriving the action of the character C1 is output to the first user U1 who causes the character C1 to perform the action in accordance with the operation input of the second user U2. In the character motion information, motions that are likely to interest the user can be set. Then, the first user U1 can move the character C1 so as to liven up the game play. Therefore, it is possible for the user to obtain interest in the virtual experience.

Further, the scenario determination means 562 (scenario determination unit) determines the scenario played by the second user U2 according to the operation input of the second user U2. The game progression means 362 of the first game device 3 progresses the game according to the scenario determined by the scenario determination means 562 . The character action information processing means 363 causes the display section of the HMD 41 to display (output) character action information corresponding to the determined scenario. In the character motion information, motions that the first user U1 and the second user U2 are likely to be interested in can be set according to the scenario. Then, the first user U1 can make the character C1 act in accordance with the scenario so as to liven up the game play. Therefore, it is possible for the user to obtain interest in the virtual experience.

In addition, the scenario determining means 562 of the second game device 5 determines, by lottery, one scenario to be played by the second user U2 from a plurality of scenarios according to the operation input of the second user U2. Thereby, user's interest can be enhanced.

Further, the matching processing means 232 (first user selection unit) of the server device 2 determines a scenario when a request for matching is received from the second game device 5 (when matching request information is received from the second game device 5). Based on the scenario determined by means 562, the first user U1 who plays the same scenario as the second user U2 who requested matching is selected from among the plurality of first users U1. This makes it possible to enhance the interest of the user's virtual experience.

[Other embodiments]
Note that, when the scenario determination means 562 determines the scenario, the first game device 3 and the second game device 5 may display information about the determined scenario on the display units of the HMDs 41 and 61 . For example, in the case of an action game, the display units of the HMDs 41 and 61 may display information such as enemy characters to be defeated and stages to be played.

The character C1 operated by the first user U1 and the character C2 operated by the second user U2 may be substitute objects other than characters, such as humans, animals, and monsters.

Also, other users may be able to watch while the first user U1 and the second user U2 are playing the same scenario.

Further, when receiving a matching request from the second game device 5, the matching processing means 232 may match a plurality of first users U1 with one second user U2, or may A plurality of users U2 may be matched, or a plurality of first users U1 and a plurality of second users U2 may be matched.

Also, the first game device 3 may transmit matching request information to the server device 2 . In this case, the matching processing means 232 may execute matching processing according to matching request information received from the first game device 3 .

Also, the matching list used when the matching processing means 232 performs matching may be created based on the time zone, the day of the week, the first user U1's favorite scenario information, and the like.

Also, the second game device 5 (second user U2) may be able to make a matching request to the server device 2 so as to play the same scenario with a specific first user U1. At this time, the display section of the HMD 61 of the first game device 3 may display that there is a request to play the scenario.

Also, when the second game device 5 (second user U2) requests the specific first user U1 to play the same scenario, the first user U1 is playing the game with another user. In this case, the second user U2 may be allowed to wait in line to play the game. At this time, the second user U2 may be allowed to watch the game being played by the first user U1.

Also, the first user U1 and the second user U2 may be allowed to obtain a reward (for example, in-game currency) when the game scenario is cleared. Also, the first user U1 and the second user U2 may be able to obtain a reward (for example, in-game currency) when all the scenarios in the game are cleared (when the scenarios are completed).

Further, when the matching processing means 232 executes the matching processing, if there are a plurality of first users U1 that can be matched with the second user U2, the second user U2 is matched from among the plurality of first users U1. One user U1 may be selected.

Further, when the matching processing means 232 executes the matching process, if there are a plurality of first users U1 that can be matched with the second user U2, the matching processing means 232 selects the second user U1 from among the plurality of first users U1. A first user U1 that matches user U2 may be randomly selected. In this case, the second user U2 wants to play the game with all the first users U1 included in the matching list (want to complete the first user U1), so he plays the same scenario many times. Thereby, user's interest can be enhanced.

Also, if the second user U2 plays the game (completes the first user U1) with all the first users U1 included in the matching list, the second user U2 can obtain a reward (for example, in-game currency). good.

Further, when receiving a matching request from the second game device 5, the matching processing section 232 may perform matching processing without referring to the matching list. For example, the matching processing unit 232 may randomly select a partner to be matched with the second user U2 who operates the second game device 5 from among the logged-in first users U1.

Further, instead of using the server device 2 and the network 6, the first game device 3 and the second game device 5 may be configured so as to be able to directly communicate with each other by wire or wirelessly via a communication cable or the like. In this case, at least one of the first game device 3 and the second game device 5 is provided with a matching processing section. The matching processing unit may match the first user U1 and the second user U2 operating the first game device 3 and the second game device 5, which are communicable via a communication cable or the like.

In addition, when the second user U2 performs an inappropriate act (interfering with other users, falsifying game data, etc.) during the game play, the second user U1 who has performed the inappropriate act User U2's game play may be interrupted. In this case, the character C2 operated by the second user U2 may be moved according to a predetermined program, or may be replaced with another object.

Also, the second user U2 may be able to play a scenario in which another second user U2 is determined by lottery. For example, the storage unit 22 of the server device 2 stores a scenario determination history that associates the scenario information received from the second game device 5 with the second user U2 operating the second game device 5 that transmitted the scenario information. Keep Then, the second game device 5 may refer to the scenario determination history stored in the server device 2 so that the second user can play the scenario information associated with the other second user U2.

In addition, the scenario determining means 562 may change the scenario to be drawn according to the length of waiting time until game play. For example, the scenario determining means 562 may win a scenario with a higher rarity (a rarity called "rarity") as the waiting time until game play is longer.

For example, a game participation ticket may be distributed to the second user U2 in order to measure the length of waiting time until game play. Specifically, the second game device 5 includes an issuing device that issues a game participation ticket and a reading device that reads a code given to the participation ticket, either externally or internally. The second user U2 causes the issuing device to issue a game participation ticket before starting the game play. At this time, the issuing device issues a game participation ticket with a code indicating the time of issue. Then, when it is the turn of the second user U2 to play the game, the second user U2 causes the reading device to recognize the game participation ticket (for example, holds it over the reading device to read it). The second game device 5 determines the difference between the time indicated on the game participation ticket and the time when the game participation ticket is read as the waiting time until game play. Note that the participation ticket may be a paper medium or may be electronic data.

Further, the scenario determination means 562 may determine the scenario to be played by a lottery method called "gacha" as a scenario lottery method. Also, the second user U2 may be able to exchange scenarios determined by Gacha with other users.

In addition, a rarity level is set for each scenario. In a scenario with a low rarity level, the character C1 operates according to a program, and in a scenario with a high rarity level, the character C1 operates based on the operation input of the first user U1. You may make it Thereby, user's interest can be enhanced.

Also, the scenario determining means 562 may be provided in the control section 36 of the first game device 3 . In this case, the scenario determining means 562 executes a scenario lottery in response to an operation input by the first user U1 (for example, an operation by the motion sensor 43 or the like), and selects a scenario for the first user U1 to play from among a plurality of scenarios. may be determined.

Further, the matching processing means 232 may select the second user U2 who plays the same scenario as the first user U1 based on a matching request from the first game device 3 (first user U1). In this case, the matching list associates the second user U2 with the scenario information.

Also, the HMDs 41 and 61 may be other display devices. For example, each of the HMDs 41 and 61 may be a display device such as a display or a wearable device, or may be a light-emitting display device such as a Versalighter.

Also, the controller 63 may be another input device. For example, the controller 63 may be an input device such as a mouse, keyboard, or touch panel. Further, the operation unit 54 of the second game device 5 may generate input information according to the output of a motion sensor that detects the motion of the second user U2.

Also, the tracking processing unit 34 may generate motion tracking information based on output from another device instead of the motion sensor 43 . For example, the first user U1 may be photographed with a camera or the like, image data output from the camera may be analyzed, and motion tracking information may be output.

Further, the tracking processing unit 34 may generate motion tracking information indicating the movement of the facial expression of the first user U1 from the output of the motion sensor 43 attached to the face of the first user U1. In this case, the tracking processing unit 34 may photograph the face of the first user U1 with a camera or the like, analyze the image data output from the camera, and output action tracking information.

Also, the first game device 3 does not have to include either one of the motion sensor 43 and the microphone 44 .

Also, the character action information processing means 363 does not have to display either the character action instruction information cm1 or the character voice instruction information cm2 on the display section of the HMD 41 . Further, the character action information processing means 363 may output the character action instruction information cm1 and the character voice instruction information cm2 from the speaker 42 as sounds.

Further, the character action information processing means 363 may display the character action instruction information cm1 and the character voice instruction information cm2 on the display section of the HMD 41 based on the action tracking information and the voice tracking information. That is, the contents displayed in the character action instruction information cm1 and the character voice instruction information cm2 may be determined according to the action of the first user U1.

In addition, the voice conversion means 364 analyzes the voice indicated in the voice tracking information, and converts the voice of the first user U1 into another person's voice (for example, artificial voice or the voice of an actor playing a character). , or may be converted to other voices.

Also, the first game device 3 may not be equipped with the voice conversion means 364 . In this case, the first game device 3 transmits the audio tracking information to the second game device 5, and the second game device reproduces the audio according to the audio tracking information.

In addition, the game system receives the audio tracking information from the first game device 3, generates converted audio information by converting the audio included in the audio tracking information into a predetermined frequency, and converts the audio information into a predetermined frequency. A game device or server device transmitting to the device 5 may further be provided.

Also, the character motion information processing means 363 may not be provided in the first game device 3 . In this case, in step S109, the display screen SC1 is displayed on the display section of the HMD 41 instead of the display screen SC2.

Further, the second game device 5 may be provided with a motion sensor that detects the body movement of the second user U2 and a microphone that detects the voice uttered by the second user U2. In this case, the communication means 561 of the second game device 5 transmits information detected by the motion sensor and microphone of the second game device 5 to the first game device 3 . Then, the game progress means 362 of the first game device 3 and the game progress means 564 of the second game device 5 move the character C2 according to the information detected by the motion sensor and microphone of the second game device 5 .

Further, the second game device 5 may detect only the body movement, the uttered voice, or the facial expression of the first user U1, or may detect a combination of two or more of these.

In addition, the game may proceed according to one scenario. In this case, the scenario determination means 562 becomes unnecessary.

Also, the present game system can be applied to other than the game system. For example, it can be applied to a communication system or the like in which an avatar or the like in a virtual space moves according to the motion of the first user U1.

In addition, each of the server device 2, the first game device 3, and the second game device 5 may be a plurality of devices, or may be a single device. Further, the server device 2, the first game device 3 and the second game device 5 may cooperate to perform similar processing.

1 game system 2 server device 23 control unit (computer)
232 matching processing means (first user selection unit)
3 first game device 36 control unit (computer)
363 character motion information processing means 364 voice conversion means 41 HMD (first output unit)
43 motion sensor (first acquisition unit)
44 microphone (first acquisition unit)
5 second game device 56 control unit (computer)
562 Scenario Determination Means (Scenario Determination Unit)
61 HMD (second output unit)
62 speaker (second output unit)
63 controller (second acquisition unit)

Claims (10)

A computer system comprising one or more computers,
said computer,
a first output unit configured to output, to a first user who causes a proxy object formed in a virtual space to perform an action, object action information for deriving the action of the proxy object;
a first acquisition unit that acquires first user action information indicating an action of the first user corresponding to the object action information;
a second output unit that outputs the first user action information to a second user;
functioning as a second acquisition unit for acquiring second user motion information indicating the motion of the second user;
The first output unit outputs the object action information corresponding to the second user action information to the first user,
The computer system, wherein the second output unit does not output the object action information to the second user. A computer system comprising one or more computers,
said computer,
a first output unit configured to output, to a first user who causes a proxy object formed in a virtual space to perform an action, object action information for deriving the action of the proxy object;
a first acquisition unit that acquires first user action information indicating an action of the first user corresponding to the object action information;
a second output unit that outputs the first user action information to a second user;
functioning as a second acquisition unit for acquiring second user motion information indicating the motion of the second user;
When the second user action information acquired by the second acquisition section after the second output section outputs the first user action information to the second user satisfies a predetermined condition, the first output section satisfies a predetermined condition. A computer system, wherein the object action information corresponding to the second user action information is output to the first user. In claim 1 or 2 ,
The computer system, wherein the object action information is determined according to the content of the action of the first user. In any one of claims 1 to 3 ,
The computer executes a game,
The computer system, wherein the first output unit outputs the object action information according to the scenario of the game to the first user. In claim 4 ,
said computer,
an operation input unit that receives an operation input from the first user or the second user;
further functioning as a scenario determination unit that determines a scenario of the game based on the operation input;
The computer system, wherein the first output unit outputs the object action information corresponding to the scenario determined by the scenario determination unit to the first user. In claim 5 ,
The computer system, wherein the scenario determination unit determines at least one scenario out of a plurality of scenarios in the game by lottery based on the operation input. In claim 5 or 6 ,
The computer system, wherein the first output unit outputs information regarding the scenario determined by the scenario determination unit to the first user. In any one of claims 5 to 7 ,
said computer,
Further functions as a first user selection unit that selects the first user who plays the same scenario as the second user from among the plurality of first users, based on an operation input from the second user. A computer system characterized by allowing In any one of claims 5 to 7 ,
said computer,
Further functions as a second user selection unit that selects the second user who plays the same scenario as the first user from among the plurality of second users based on an operation input from the first user. A computer system characterized by allowing In any one of claims 5 to 9 ,
said computer,
a scenario determination unit that determines a scenario of the game based on an operation input from the first user or the second user;
a first user selection unit that selects the first user who plays the same scenario as the second user from among the plurality of first users based on the scenario determined by the scenario determination unit; A computer system characterized by allowing

Images