JP2022034112A - Online interaction system - Google Patents

Abstract

To provide an online interaction system configured to efficiently and smoothly operate a meeting regardless of the number of participants in the meeting.SOLUTION: When detecting an inter-group transfer request signal, which is a signal generated in a client device 6, to request transfer to another group, including a specification of another group other than a group to which a self belongs and belonging to a dialogue room, an inter-group transfer control unit 33 of a client-side interaction control unit 30 in a client device 6 adds the client device 6 as a constituent component of the other group and separates the client device 6 from the previous group. Accordingly, a user of the client device 6 can freely move to another group during the meeting.SELECTED DRAWING: Figure 3

Description

The present invention relates to an online dialogue system, and is a technique for mutually presenting, exchanging, and sharing information such as characters, voice, and images (including moving images such as still images and videos; the same shall apply hereinafter), particularly via information communication means. Regarding.

By mutually presenting, exchanging, and sharing perceptual information such as characters, voices, and images via information and communication means (hereinafter, such an act may be referred to as "dialogue"), they are physically separated. Includes systems called online dialogue systems (video conference systems, video conference systems, web conference systems, etc.) that allow you to participate in meetings, meetings, lessons, etc. (hereinafter referred to simply as "meetings") even from a location. )It has been known.

By using the online dialogue system, it is possible to hold and participate in meetings even in remote areas, so efficient meeting operations can be expected from the perspective of reducing travel time and travel costs. ..

As such a system, for example, the video conference system disclosed in Cited Document 1 has been proposed. In this system, the speaker is identified based on the audio data obtained from the terminals of the conference participants, and among the video of the conference participants displayed on each terminal, the speaker and the non-speaker The video is configured to be visually distinguished and output. (See paragraphs [0037], [0045] to [0055], FIG. 7, FIG. 9, FIG. 11, FIG. 12, FIG. 13, FIG. 15, FIG. 17, FIG. 19, FIG. 21 of Patent Document 1).

By constructing in this way, the speaker can inform other participants that the current speaker is himself / herself without being aware of it, and participants other than the speaker can also speak. Since it is possible to know who is in real time, it is possible to concentrate all the participants in the meeting.

However, such a system is overly tense and restrained compared to the actual meeting, such as focusing on concentrating all the participants in the meeting and not expecting to speak privately. It will be given to the participants. As a result, the participants may feel tired and their concentration may be interrupted, which may hinder the efficiency of the meeting.

Furthermore, in recent years, if there is an environment that can connect to an information communication network such as the Internet, it is possible to easily participate in a video conference using a personal computer or smartphone, so many people can participate in one conference. As the number of participants in the conference increases, the number of participants who are not so interested in what the speaker says will increase in proportion to this, and it is also an efficient conference. It is a factor that hinders operation.

In particular, when such a system is used for purposes other than meetings (for example, meetings for the purpose of interacting with participants such as online drinking parties), the conventional feeling of excessive tension and restraint is imposed on the participants. With a video conference system, it is difficult to operate a smooth meeting.

Japanese Unexamined Patent Application Publication No. 2003-299051

An object of the present invention is to provide an online dialogue system and the like that can solve such conventional problems and realize efficient and smooth operation of a meeting regardless of the number of participants in the meeting. do.

The online dialogue system according to the present invention is an online dialogue system including a group of information processing devices including a plurality of client devices capable of communicating information via information communication means, and each client device is in the same group. All groups are configured to belong to one virtual dialogue room, the information processing device is configured to belong to one of the virtual groups configured to be able to interact with other client devices to which it belongs. An inter-group movement request signal that is a signal generated by the client device and that requests movement to the other group including the designation of another group that belongs to the dialogue room and is not the group to which the user belongs. When detected, a dialogue with an intergroup movement control unit configured to add the client device as a component of the other group and control the client device to leave the group to which it belonged immediately before. It is characterized by having a control unit.

The features of the present invention can be broadly shown as described above, but the structure and contents thereof, together with the purpose and features, will be further clarified by the following disclosure in consideration of the drawings.

In each invention according to the present application, "the client device is in a state where it can interact with another client device" means that "a user who is currently using the client device is currently using another client device". It means that you can interact with the user through each client device. " Therefore, in order to avoid complicating the explanation, "the client device is in a state where it can interact with another client device" may be appropriately referred to as "a user of the client device (simply," user "". The same shall apply hereinafter.) Will be able to interact with other users. "

Further, in each invention according to the present application, "each client device belongs to any virtual group" means "a user who is currently using each client device belongs to any group". Therefore, in order to avoid complicated explanation, "each client device belongs to any virtual group" may be appropriately referred to as "a user of each client device (simply," user "hereinafter." Similarly.) Belongs to one of the groups. "

The online dialogue system according to the first invention of the present application is an online dialogue system including a group of information processing devices including a plurality of client devices capable of communicating information via information communication means, and each client device is the same. It is configured to belong to one of the virtual groups configured to be able to interact with other client devices belonging to the group, and all groups are configured to belong to one virtual dialogue room for information processing. The device is a signal generated in the client device, and is a group-to-group movement to request movement to the other group including the designation of another group other than the group to which the dialogue room belongs. When the request signal is detected, the client device is added as a component of the other group, and the inter-group movement control unit configured to control the client device to leave the group to which the client device immediately belongs is added. It is characterized by having a dialogue control unit.

In this way, one virtual dialogue room is divided into a plurality of virtual groups, and the users of the client device are configured to be able to interact only within the same group, so that each user can interact with other groups. It is possible to concentrate on dialogue within each group without worrying about.

Then, by configuring the users to move freely to other groups, each user is free to join any group that is interacting with a topic of more interest, even during a meeting. It becomes possible to do.

Therefore, if this system is applied to meetings such as subcommittee-style meetings and so-called online drinking parties, it is possible to realize efficient and smooth meeting operation as a whole regardless of the number of participants in the meeting. It will be possible.

The online dialogue system according to the second invention of the present application is the online dialogue system according to the first invention of the present application, in which the dialogue control unit is a signal generated in the client device, is a group belonging to the dialogue room, and belongs to itself. When a other group dialogue content display request signal for requesting the display of dialogue content in the other group including the designation of another group other than the group is detected, the client device is not separated from the group currently belonging to the group. It is characterized by having another group dialogue content display control unit that controls the display of the dialogue content of another group on the client device.

With this configuration, the user knows the content of the dialogue in the other group, for example, perceptual information such as images, sounds, and texts showing the state of the dialogue in the other group without moving to another group. be able to.

Therefore, if a user is most interested in the dialogue content of his or her group, but is also interested in the dialogue content of another group to some extent, he / she remains in his / her own group and has the right to speak in another group, for example. It is possible to participate in dialogues of other groups in the form of an observer without.

Further, by configuring in this way, the user can know in advance the dialogue contents of the other group of concern before moving to the other group. As a result, it is possible to accurately execute the movement between groups by the user, and it is possible to suppress unnecessary movement between groups.

The online dialogue system according to the third invention of the present application is a signal generated by a dialogue control unit in a client device in the online dialogue system according to any one of the first and second inventions of the present application, and belongs to the dialogue room. When a group generation request signal for requesting the generation of a new group is detected, a new group including the client device as a component is generated, and the client device constituting the new group belongs to the immediately preceding group. It is characterized by being provided with a new group generation control unit configured to control the withdrawal from.

By configuring in this way, the user does not want to leave the dialogue room or cannot leave the dialogue room, for example, although he / she is not very interested in the dialogue contents of any group including the group to which he / she belongs. In this case, by creating a new group in the dialogue room and belonging to that group, it is possible to make effective use of the meeting (especially the time spent in the meeting; the same applies hereinafter).

The online dialogue system according to the fourth invention of the present application generates a new group in the online dialogue system according to the third invention of the present application, in which the group generation request signal includes the designation of another client device generated in one client device. A group generation proposal signal to the effect of making a proposal and a group generation acceptance signal to accept the proposal to generate a new group generated in the specified other client device in response to the group generation proposal signal. It is characterized by being configured to include.

With this configuration, the user proposes to other users to create a new group, and if the other user accepts this proposal, a new user having these users as a component. It becomes possible to set up a group.

As a result, users will be able to set up groups that target new themes that are not bound by the content of dialogues in existing groups, or groups that are formed by like-minded users, and can make effective use of meetings. can.

In the online dialogue system according to the third invention of the present application, the online dialogue system according to the fifth invention of the present application requests the generation of a new group in which the group generation request signal is generated only in the client device and is a component of the online dialogue system according to the third invention of the present application. It is characterized in that it is a single element group generation request signal to that effect.

By configuring in this way, the user can launch a new group having only himself as a component.

As a result, users can take advantage of meetings by creating a new group of themselves who do not want to leave the dialogue room or who do not need to interact with anyone even if they cannot. It becomes possible to do.

The online dialogue system according to the sixth invention of the present application is a signal generated by the dialogue control unit in the client device in the online dialogue system according to any one of the first to fifth inventions of the present application, and belongs to the dialogue room. When a specific client-to-client dialogue request signal indicating that a dialogue between specific multiple client devices including the designation of another client device is requested is detected, the specific multiple client devices are separated from the group to which they currently belong. It is characterized by including a specific client-to-client dialogue control unit configured to control dialogue between the specific plurality of client devices without any problem.

With this configuration, users can interact privately only between specific users without moving to other groups.

Therefore, the user may have a private dialogue (so-called private language) between specific users, for example, about a topic that is more in-depth about the main dialogue content in his / her group, or a topic that is unrelated to the main dialogue content in the group. Is possible.

As a result, it is possible to realize efficient and smooth meeting operation as a whole without forcing the participating users to feel excessive tension and restraint.

The information processing apparatus according to the seventh invention of the present application is characterized by being used in the online dialogue system according to any one of the first to sixth inventions of the present application.

Therefore, by using these information processing devices in the online dialogue system, the same effect as that of the first to sixth inventions can be obtained.

The program according to the eighth invention of the present application is a program for making a computer function as a dialogue control unit of the information processing apparatus according to the seventh invention of the present application.

Therefore, by causing the computer to execute the program, the same effect as that of the seventh invention can be obtained.

The recording medium according to the ninth invention of the present application is a recording medium that stores the program according to the eighth invention of the present application.

Therefore, by causing the computer to execute the program stored in the recording medium, the same effect as that of the eighth invention can be obtained.

Further, the online dialogue method according to the tenth invention of the present application is an online dialogue method performed by using a group of information processing devices including a plurality of client devices capable of communicating information via information communication means, and each client device. Is configured to belong to any virtual group configured to be able to interact with other client devices belonging to the same group, and all groups are configured to belong to one virtual dialogue room. , The information processing device requests the movement to the other group including the designation of the signal generated in the client device and the group belonging to the dialogue room and other than the group to which the information processing device belongs. When an inter-group movement request signal is detected, the client device is added as a component of the other group, and the client device is controlled to be separated from the group to which the client device belongs immediately before. It is characterized by having a dialogue control step, which is provided with a step.

Therefore, by using the method using a group of information processing devices including a plurality of client devices capable of communicating information via information communication means, the same effect as that of the first invention can be obtained.

FIG. 1 is a block diagram showing a configuration of an online dialogue system 2 according to an embodiment of the present invention. FIG. 2 is a block diagram illustrating the configuration of the server device 4. FIG. 3 is a block diagram illustrating the configuration of each client device 6. FIG. 4 is a block diagram showing an example of the hardware configuration of the server device 4 shown in FIG. 2 and the client device 6 shown in FIG. 3, when one computer is used as the server device 4 and the client device 6 respectively. Is an example of. FIG. 5 is a drawing schematically illustrating the configuration of a virtual dialogue room realized in the online dialogue system 2. FIG. 6 is a flowchart showing an example of the processing flow in the server device 4 constituting the online dialogue system 2, and is a drawing mainly for explaining the processing related to the transfer of various control data. FIG. 7 is a flowchart showing an example of the processing flow in each client device 6 constituting the online dialogue system 2. FIG. 8 is a flowchart showing an example of a processing flow in each client device 6 constituting the online dialogue system 2. FIG. 9 is a drawing showing an example of the user management table 21. FIG. 10 is a drawing showing an example of the server-side dialogue management table 22. FIG. 11 is a drawing showing an example of the client-side dialogue management table 41, and is a drawing for explaining a situation in which the dialogue situation of each user changes. FIG. 12 is a drawing showing an example of the client-side dialogue management table 41, and is a drawing for explaining a situation in which the dialogue situation of each user changes. 13A and 13B are drawings showing an example of the client-side dialogue management table 41, and are drawings for explaining a situation in which the dialogue situation of each user changes. 14A and 14B are drawings showing an example of the client-side dialogue management table 41, and are drawings for explaining a situation in which the dialogue situation of each user changes. 15A and 15B are drawings showing an example of the client-side dialogue management table 41, and are drawings for explaining a situation in which the dialogue situation of each user changes. 16A and 16B are drawings showing an example of a display screen 80 displayed on the LCD 70 of the client device 6 during processing in the online dialogue system 2. 17A and 17B are drawings showing an example of a display screen 80 displayed on the LCD 70 of the client device 6 during processing in the online dialogue system 2. 18A and 18B are drawings showing an example of a display screen 80 displayed on the LCD 70 of the client device 6 during processing in the online dialogue system 2. 19A and 19B are drawings showing an example of a display screen 80 displayed on the LCD 70 of the client device 6 during processing in the online dialogue system 2. 20A and 20B are drawings showing an example of a display screen 80 displayed on the LCD 70 of the client device 6 during processing in the online dialogue system 2.

(1. Configuration of this system)
FIG. 1 is a block diagram showing a configuration of an online dialogue system 2 according to an embodiment of the present invention.

The online dialogue system 2 includes a server device 4 and a plurality of client devices 6, 6, ... As an information processing device, and is between the server device 4 and each client device 6, and the client device 6, ... ... Information such as characters, voices, images, and control signals can be communicated between each other via the information communication means 8 as appropriate.

Hereinafter, the perceptual information (characters, voices, images, etc.) to be displayed on the client device 6 may be referred to as “content data” in particular. In addition, information (excluding content data) such as control signals used to execute each process in the system 2 may be referred to as "control data". "Content data" and "control data" may be collectively referred to as "content data, etc."

FIG. 2 is a block diagram illustrating the configuration of the server device 4.

As shown in FIG. 2, the server device 4 includes a server-side dialogue control unit 10 and a server-side storage unit 20.

The server-side dialogue control unit 10 is a dialogue control unit provided in the server device 4 as an information processing device, and includes a communication control unit 11 and a room management unit 12.

The communication control unit 11 controls the client devices 6 so that communication of content data and the like between the client devices 6 and the like can be smoothly executed. In addition, depending on the communication mode, content data and the like may be relayed.

The room management unit 12 manages the user configurations of the virtual dialogue room, the virtual group belonging to the dialogue room, and the client device 6 belonging to the group.

The server-side storage unit 20 includes a user management table 21 and a server-side dialogue management table 22. The server-side storage unit 20 further stores a program (server-side program) executed on the server device 4 side in the system 2.

The user management table 21 is a table that stores user attributes and the like. FIG. 9 is a drawing showing an example of the user management table 21. In this example, as the attributes of each user who uses the system 2, the user's identification marker "user ID", the user's "name", "affiliation", and the "password" for logging in to the system 2 are stored. Has been done.

The attributes of the user stored in the user management table 21 are not limited to this, and may be configured to include, for example, the gender, age, address, and the like of the user.

The server-side dialogue management table 22 is a table provided on the server device 4 side for managing (understanding) the dialogue status of the user. FIG. 10 is a drawing showing an example of the server-side dialogue management table 22. In this example, as information indicating the current dialogue status of each user, "user ID", "destination information" indicating a destination for transmitting (uploading) content data, etc. to the user, and the group to which the user belongs. The "group ID" which is an identification mark and the "room ID" which is an identification mark of the dialogue room to which the user belongs are stored.

Of these, the "user ID" has the same content as the information indicated by the item having the same name stored in the user management table 21.

FIG. 3 is a block diagram illustrating the configuration of each client device 6.

As shown in FIG. 3, the client device 6 includes a client-side dialogue control unit 30 and a client-side storage unit 40.

The client-side dialogue control unit 30 is a dialogue control unit provided in the client device 6 as an information processing device, and is a transmission / reception control unit 31, a display control unit 32, an intergroup movement control unit 33, and other group dialogue content display control. A unit 34, a new group generation control unit 35, and a specific client-to-client dialogue control unit 36 are provided.

The transmission / reception control unit 31 controls to transmit content data or the like to another client device 6 or server device 4, or to receive content data or the like transmitted from another client device 6 or server device 4.

The display control unit 32 controls to display the received content data according to a predetermined specification. Of the content data, the image is displayed, for example, in a manner of drawing on the LCD 70 (see FIG. 16A) of the client device 6. The voice is displayed, for example, in a mode of being output as voice information from the speaker 71 of the client device 6 (see FIG. 16A, including earphones, headphones, and the like; the same applies hereinafter). The characters are displayed, for example, in a manner of drawing on the LCD 70 of the client device 6 or outputting as voice information from the speaker 71 of the client device 6.

In the above display process, the display control unit 32 integrates and edits each content data received from each client device 6 (directly or indirectly via the server device 4), and then integrates and edits each content data, and then owns the client device. It is controlled to display the content data on the server device 4 or to display the content data already integrated / edited on the server device 4 on the client device 6 as it is or partially processed.

The inter-group movement control unit 33 is a signal generated by the client device 6 and includes the designation of another group (a group belonging to the dialogue room to which the self belongs and a group other than the group to which the self belongs). When an inter-group movement request signal requesting movement to a group is detected, the user of the client device 6 is added as a component of the other group, and the user of the client device 6 is added to the group to which the client device 6 belongs immediately before. It is configured to control the withdrawal from.

In this embodiment, the inter-group movement request signal is generated in one client device 6, and the processing in the inter-group movement control unit 33 is also configured to be executed in the client device 6.

The other group dialogue content display control unit 34 is a signal generated by the client device 6 and includes the designation of another group (a group belonging to the dialogue room to which the other group belongs and a group other than the group to which the self belongs). When the other group dialogue content display request signal for requesting the display of the dialogue content in another group is detected, the dialogue content of the other group is displayed without leaving the user of the client device 6 from the group to which the client device 6 currently belongs. It is configured to control the display on the client device 6.

In this embodiment, the other group dialogue content display request signal is generated in one client device 6, and the processing in the other group dialogue content display control unit 34 is also configured to be executed in the client device 6.

When the new group generation control unit 35 detects a group generation request signal that is a signal generated by the client device 6 and requests the generation of a new group belonging to the dialogue room to which the client device 6 belongs, the user of the client device 6 Is configured to generate a new group including the above, and to control the user of the client device 6 constituting the new group to leave the group to which the client device 6 belonged immediately before.

In this embodiment, the group generation request signal is generated in one or more client devices 6, and the processing in the new group generation control unit 35 is also configured to be executed in these client devices 6.

For example, the group generation request signal includes a group generation proposal signal for proposing the generation of a new group including the user's designation of another client device 6 generated in one client device 6, and the group generation proposal signal. It can be configured to include a group generation acceptance signal to the effect that it responds and accepts the proposal to generate a new group generated in the other designated client device 6.

Further, the group generation request signal is configured to be a single element group generation request signal for requesting the generation of a new group having only the user of the client device 6 generated in one client device 6 as a component. You can also do it.

The specific client-to-client dialogue control unit 36 is a signal generated in the client device 6 and includes a designation of another client device 6 belonging to the dialogue room to which the specific client device 6 belongs, among users of a plurality of specific client devices 6. When the dialogue request signal between specific clients to request the dialogue is detected, the users of the specific plurality of client devices 6 do not leave the group to which the specific client device 6 currently belongs, and the users of the specific plurality of client devices 6 mutually. It is configured to control to allow dialogue between them.

In this embodiment, the specific client-to-client dialogue request signal is generated in at least one client device 6 out of the specific plurality of client devices 6, and the processing in the specific client-to-client dialogue control unit 36 is performed by these specific plurality. It is configured to be executed in the client device 6.

The client-side storage unit 40 includes a client-side dialogue management table 41. The client-side storage unit 40 further stores a program (client-side program) executed on the client device 6 side in the system 2.

The client-side dialogue management table 41 is a table provided on the client device 6 side for managing (understanding) the dialogue status of the user. 11 to 15B are drawings showing an example of the client-side dialogue management table 41, and are drawings for explaining a situation in which the dialogue situation of each user changes.

In this example, as information indicating the current dialogue status of each user, "user ID", "destination information", "group ID", and "speaking" indicating the current speaker (indicated by flag '1') Person flag ”,“ Other group dialogue content display ”representing the group ID of another group currently specified in the other group dialogue content display request signal, and the user ID of the user currently specified in the specific client-to-client dialogue request signal. The "specific client-to-client dialogue designation destination" and the "specific client-to-client dialogue designation source" representing the user ID of the user who is actually issuing the specific client-to-client dialogue request signal are stored. In the same table,'-' indicates that the information does not exist.

Of the information shown in the client-side dialogue management table 41, the "user ID", "destination information", and "group ID" have the same contents as the information indicated by the item of the same name stored in the server-side dialogue management table 22. be.

FIG. 4 is a block diagram showing an example of the hardware configuration of the server device 4 shown in FIG. 2 and the client device 6 shown in FIG. 3, when one computer is used as the server device 4 and the client device 6 respectively. Is an example of.

The server device 4 is not particularly limited, but in this example, it has the same configuration as a general server computer.

The server device 4 is a recording medium that stores a program on the server device 4 side of the online dialogue system 2, and is an auxiliary storage device 55 such as an HDD (hard disk drive) having a hard disk that is also a server side storage unit 20 and an auxiliary storage device. The main storage device 54 into which the program stored in the 55 is loaded, the CPU 51 corresponding to the server-side dialogue control unit 10 that executes the program loaded in the main storage device 54, the display device 52 such as an LCD (liquid disk display device), It includes an input device 53 such as a keyboard, a mouse, and a track pad, and a communication interface 56 for communicating with the client device 6 via the information communication means 8.

The client device 6 is not particularly limited, and may be, for example, a personal computer, a tablet computer, a mobile information terminal device, or a so-called smartphone. It may be a mobile phone.

The client device 6 is a recording medium that stores a program on the client device 6 side of the online dialogue system 2, and is an auxiliary storage device 65 such as an SSD (solid state drive) equipped with a flash memory that is also a client side storage unit 40. The main storage device 64 into which the program stored in the storage device 65 is loaded, the CPU 61 corresponding to the client-side dialogue control unit 30 that executes the program loaded in the main storage device 64, the LCD (liquid crystal display device), the speaker, and the like. A server device 4 and other client devices 6 via a display device 62, an input key, a touch panel, a microphone (hereinafter, may be abbreviated as “mic”), an input device 63 such as a camera, and an information communication means 8. It is provided with a communication interface 66 for communicating with.

The information communication means 8 is a communication means for transmitting information converted into an electric signal, an optical signal, or the like, and may be wired or wireless. As the information communication means 8, computer networks such as WAN (Wide Area Network) and LAN (Local Area Network) represented by the Internet, telephone lines (including mobile phone lines), communication lines such as dedicated lines, communication cables, and the like An example is a direct connection by infrared rays or the like, or a combination of these.

FIG. 5 is a drawing schematically illustrating the configuration of a virtual dialogue room realized in the online dialogue system 2. This drawing shows the situation of the dialogue room R01 (room ID: R01) represented by the server-side dialogue management table 22 shown in FIG. 10 and the client-side dialogue management table 41 shown in FIG.

In this example, the dialogue room R01 is currently composed of four groups: group GA, group GB, group GC, and group GD. Users constituting one group, for example, user U01, user U02, user U03, and user U04 constituting the group GA can each interact with other users belonging to the same group (that is, the group GA) in principle. However, it is configured so that it cannot interact with users belonging to other groups (that is, group GB, group GC, group GD). The group GD is a single element group having only the user U10 as a component. Hatching is attached to the current speakers of each group in the dialogue room R01.

(2. Processing in this system)
FIG. 6 is a flowchart showing an example of the processing flow in the server device 4 constituting the online dialogue system 2, and is a drawing mainly for explaining the processing related to the transfer of various control data. 7 and 8 are flowcharts showing an example of the processing flow in each client device 6 constituting the online dialogue system 2.

16A to 20B are drawings showing an example of a display screen 80 displayed on the LCD 70 of the client device 6 (smartphone in this example) during processing in the online dialogue system 2.

As shown in FIG. 16A and the like, the client device 6 includes an LCD 70 and a speaker 71 as a display device 62, and a microphone 72, a camera 73, and a touch panel 74 as an input device 63.

An example of the processing procedure in the online dialogue system 2 will be described with reference to FIGS. 6 to 20B. The overall processing in the online dialogue system 2 is called online dialogue processing.

(2-1. Login-related processing)
As shown in FIG. 7, the client device 6 monitors the login input input from the input device 63 of the client device 6 (step S11).

When the user wishes to open a new dialogue room, the content of the login input is not particularly limited, but for example, the user ID and password of the user and the request to open the dialogue room are requested. Can be configured to be included.

On the other hand, when the user wishes to enter the existing dialogue room, the content of the login input is not particularly limited, but for example, the user ID and password of the user, and the room ID and password of the dialogue room. Can be configured to include.

When the login input is detected, the client device 6 executes the login request process (step S12).

In the login request processing, the client device 6 transmits to the server device 4 a login request signal including the fact that the login input has been made and the content of the login input.

As shown in FIG. 6, the server device 4 monitors a login request signal from each client device 6 (step S1), and when it receives a login request signal from any of the client devices 6, it executes a login process. (Step S2).

In the login process, first, the user authentication process is executed. In the user authentication process, the server device 4 refers to the user management table 21 (see FIG. 9), and if the combination of the user ID and the password included in the login request signal is registered in the user management table 21, the user is registered. It is determined that it is a registered member of this system, and the user authentication process is terminated. However, the user authentication method is not limited to this, and for example, an authentication method using a public key or a private key can be used.

The user authentication process does not necessarily have to be strictly executed. For example, even a user who is not registered in the user management table 21 performs a predetermined process (for example, a process such as temporary registration). It can also be configured to be considered successful in the user authentication process.

When the user authentication process is successful (including the case where it is considered to be successful), and then the login request signal includes a request to open a dialogue room, the dialogue room setting process is executed. In the dialogue room setting process, the server device 4 opens a new virtual dialogue room hosted by the user, sets the room ID (for example, R1) of the dialogue room, and the password of the dialogue room, and sets these. It is associated and stored in the server-side storage unit 20 (not shown), and the user is notified of these information.

The user who is the organizer may notify other users of the room ID and password of the dialogue room by some means (for example, e-mail) and encourage them to participate in the dialogue room.

On the other hand, when the login request signal includes the room ID and password of the existing dialogue room, the dialogue room entry permission process is executed. In the dialogue room entry permission process, the server device 4 determines whether or not the room ID and password included in the login request signal match the information stored in the server-side storage unit 20, and if it determines that they match. , Allow the user to log in (enter) the dialogue room.

For the user who is the organizer, even if he / she does not execute the login input including the request to enter the existing dialogue room again, he / she automatically goes to the dialogue room after the above dialogue room setting process is executed. It can also be configured to allow entry into the room.

For a user who is permitted to enter the dialogue room, the user ID and the room ID of the dialogue room are associated with each other and stored in the server-side dialogue management table 22 (see FIG. 10).

In the login process (step S2), next, a group allocation process and a communication form determination process are executed.

In the group allocation process, the server device 4 determines the group to which the user who is permitted to log in first belongs in the dialogue room.

The method of allocating groups is not particularly limited, but for example, the number of users who have set up one group (for example, group GA) in the dialogue room and are allowed to log in is a predetermined capacity (for example, four people). Will be assigned to the same group until the number reaches, and after the group reaches the expected capacity, another group (for example, group GB) will be opened, and users who are permitted to log in thereafter will be assigned to the other group. It can be configured to repeat the same process thereafter.

Alternatively, multiple groups are set in advance in the dialogue room, and the groups to which the user who is permitted to log in should belong are assigned based on the attributes of the user (for example, affiliation, gender, age, address, etc.). It can also be configured to be assigned according to each user's wishes, or to be randomly assigned.

The group allocation method can be configured to be set in the server device 4 in advance, or can be configured so that the user, particularly the user who is the organizer, can appropriately specify the group to the server device 4.

For the user to which the group is assigned, the user ID and the group ID of the group are associated with each other and stored in the server-side dialogue management table 22 (see FIG. 10).

Next, the communication form determination process will be described. In the communication form determination process, the server device 4 transfers the content data or the like generated (or input, the same applies hereinafter) in each client device 6 to the other client device 6 or the server device 4. Performs processing to determine whether to communicate in the communication mode (communication path, communication standard, etc.).

The communication mode in the system 2 is not particularly limited, but in this embodiment, WebRTC (Web Real-Time Communication), which is a technology that enables real-time communication of content data and the like via a Web browser, is used. The case of using and communicating is illustrated.

In this example, as a communication mode when using WebRTC, P2P (Peer) communicates directly (or in a state considered to be direct) when transmitting and receiving content data and the like between client devices 6. A communication mode called to Peer) type and a communication mode called SFU (Selective Forwarding Unit) type that indirectly communicates via the server device 4 are assumed, and which communication mode should be used is the server. Determined in device 4.

In the P2P type communication mode, the content data and the like generated by the client device 6 of 1 are individually transmitted to all the other client devices 6, and the content data and the like generated by the other client devices 6 are transmitted to the other client devices 6. It will be received individually from the client device 6 of. Therefore, assuming that the number of other client devices 6 is n, both upload and download have n routes. As a result, if the number n of the client devices 6 to be communication partners increases, the communication load of the client devices 6 may become excessive.

On the other hand, in the SFU type communication mode, receiving the content data and the like generated in the other client device 6 individually from the other client device 6 is the same as the P2P type communication mode, but the client device 1 The content data or the like generated in 6 may be transmitted only to the server device 4. Therefore, although the download has n routes, the upload has 1 route. As a result, even if the number of client devices 6 to be communication partners increases, the communication load of the client devices 6 does not increase as much as in the case of the P2P type communication mode.

In order to execute a P2P type communication mode using WebRTC, in this embodiment, the server device 4 functions as a Web server, a function as a signaling server, and a STUN (Session Travelals for NAT) server. And the function as a TURN (Traversal Using Relay around NAT) server.

The Web server is used to provide the Web browser of the client device 6 with a Web page or the like for using the system 2.

The signaling server is used to exchange destination information (for example, IP address and port number) with a communication partner in order to perform P2P type communication.

The STUN server and TURN server are used for so-called NAT traversal and firewall crossing in order to perform P2P type communication when the client device 6 is protected by NAT (Network Address Translation) or a firewall. ..

Further, in order to execute the SFU type communication mode using WebRTC, in this embodiment, the server device 4 further has a function as an SFU server.

The SFU server is used to relay the content data or the like received from each client device 6 and transfer it to each client device 6 as it is.

The method for determining the communication form is not particularly limited, but for example, if the number of participating members in one dialogue room is a predetermined number (for example, 5 people) or less, the P2P type is used, and if the number exceeds this, the SFU type is used. Can be configured to: Further, it is also possible to detect the communication load of the client device 6 and the processing load of the server device 4, and to switch between the P2P type and the SFU type based on the detection result. Further, if there is a predetermined request from the client device 6 (for example, a request to record the dialogue content or leave a recording in the server device 4), it can be configured to forcibly switch to the SFU type.

When the communication mode is determined in the communication mode determination process, the server device 4 writes the destination information of each user corresponding to the determined communication mode in the server-side dialogue management table 22 (see FIG. 10).

When the determined communication mode is a P2P type communication mode, the upload destination of the content data or the like seen from the client device 6 is another client device 6, so that the destination information of each user is, for example, those clients. The IP address and port number of the device are written.

On the other hand, when the determined communication mode is the SFU type communication mode, the upload destination of the content data as seen from the client device 6 is the SFU server equivalent part of the server device 4, so that the destination information of each user is used. For example, an IP address or the like indicating the SFU server equivalent portion is written.

Finally, the server device 4 stores the "user ID", "destination information", and "group ID" of all the users constituting the dialogue room stored in the server-side dialogue management table 22 (hereinafter, these data are stored in the server device 4). The "server-side dialogue information", which means the information stored in the server device 4 for dialogue processing, may be referred to as "server-side dialogue information"), which is a client device of all users constituting the dialogue room (for example, dialogue room R01). It is transmitted to No. 6 to end the login process (FIG. 6, step S2).

(2-2. Dialogue information setting / update processing)
Next, as shown in FIG. 7, the client device 6 executes the dialogue information setting / update process (step S13).

In the dialogue information setting / updating process, the client device 6 sets or updates the dialogue information on the client device 6 side based on the server-side dialogue information received from the server device 4.

The dialogue information on the client device 6 side (hereinafter, may be referred to as "client-side dialogue information" meaning information stored in the client device 6 for dialogue processing) is the client side shown in FIG. 11. Among the data listed in the dialogue management table 41, it is the data indicated by the items of "user ID", "destination information", and "group ID".

That is, in the dialogue information setting / updating process, the "client-side dialogue information" in the client-side dialogue management table 41 is synchronized with the "server-side dialogue information" in the server-side dialogue management table 22.

(2-3. Dialogue processing)
Subsequently, the client device 6 executes the dialogue processing (step S14). A detailed example of the dialogue processing is shown in FIG.

(2-3-1. Data transmission / reception / display processing)
In the dialogue processing, the client device 6 executes data transmission / reception / display processing (that is, data transmission / reception processing and display processing (step S21).

In the data transmission / reception processing, the client device 6 is input from the input device 63 (mic 72, camera 73, touch panel 74, etc.) of the client device 6, or is stored in the client-side storage unit 40 of the client device 6. The content data and the like are transmitted to another client device 6 according to the current communication mode.

The destination (upload destination) when transmitting content data or the like to each client device 6 is stored as "destination information" in the client-side dialogue management table 41, and this "destination information" is the current communication mode (this). In the embodiment, the information corresponds to P2P type or SFU type). Therefore, if the content data or the like is transmitted according to the "destination information", the data can be transmitted to the other client device 6 regardless of the communication mode.

In the data transmission / reception process, the client device 6 receives the content data or the like transmitted from the other client device 6 via a predetermined communication path corresponding to the current communication mode. In this embodiment, the content data or the like uploaded by each client device 6 is not processed by integration, editing, or the like, regardless of which communication path is used for reception, and is directly received by another client. Received by the device 6.

In the display process, the client device 6 processes the content data generated by its own client device 6 and the received content data of the other client device 6 such as integration and editing, and then generates the display screen 80. Then, it is displayed on the LCD 70 (the form of such display processing is hereinafter referred to as "display processing by the screen"), or the sound is output via the speaker 71 (the form of such display processing). Is hereinafter referred to as "display processing by voice").

First, among the display processes, the display process on the screen will be described.

16A, 16B, 17A, 17B, 18A, 18B, 19A, 19B, 20A and 20B are drawings showing an example of the appearance of the client device 6 and are shown in the system 2. It is a drawing for demonstrating the transition of the display screen 80 of a client apparatus 6. Hereinafter, when it is necessary to specify and explain the user in particular, for example, the client device 6 used by the user U01 is expressed as the client device 6a, and the client device 6 used by the user U03 is expressed as the client device 6b. Sometimes.

As shown in FIG. 16A, the LCD 70 of the client device 6 displays the display screen 80 generated by the display process on the screen of the client device 6. The configuration of the display screen 80 is not particularly limited, but in this example, the display screen 80 is configured to include a self-group display unit 81 and another group display unit 86.

The self-group display unit 81 displays the dialogue status of the group to which the self belongs (hereinafter, may be referred to as “self-group”. In this example, the group GA). The configuration of the self-group display unit 81 is not particularly limited, but in this example, the number of users constituting the group is the user-specific display unit 82 that individually displays the images of the users constituting the group. Only, it is configured to be arranged side by side. In addition, a display representing the group ID of the group (“Group GA” in this example) is displayed on a part of the self-group display unit 81.

Further, the display unit 82 for each user is configured to display the user ID (or the name of the user) of the user together with the image of the user.

The speaker mark 83 indicating the current speaker in the self-group is displayed at or near a part of the user-specific display unit 82 corresponding to the user who is the speaker. In this example, the outer frame of the user-specific display unit 82 changed to a specific color (for example, blue) corresponds to the speaker mark 83.

The current speaker in each group is indicated by the "speaker flag" in the client-side dialogue management table 41 (see FIG. 11). The user whose flag indicated by the "speaker flag" is "1" is the current speaker. The speaker mark 83 is displayed based on this “speaker flag”.

In this embodiment, the user-specific display unit 82 on which the image of the self (user U01 in this example) is displayed is configured to be displayed in a state that can be distinguished from other users belonging to the self-group. The "distinguishable state" is not particularly limited, but includes, for example, arranging the display screen 80 at a specific position. In this example, the user-specific display unit 82 on which the self-image is displayed is always arranged in the upper left corner of the self-group display unit 81. In addition, as a "distinguishable state", the size of the user-specific display unit 82 on which the self-image is displayed can be made different from that of other users.

Next, the configuration of the other group display unit 86 will be described. The other group display unit 86 displays the dialogue status of groups other than the self-group (in this example, group GB, group GC, and group GD; hereinafter, these may be collectively referred to as “other groups”).

In this embodiment, the other group display unit 86 is configured to display an "unmanned group" in addition to the dialogue status of the "other group". The "unmanned group" will be described later.

The configuration of the other group display unit 86 is not particularly limited, but in this example, the images of other groups belonging to the dialogue room to which the self belongs (dialogue room R01 in this example) are individually displayed for each group. It is configured to arrange one display unit 87.

The display method of the group-based display unit 87 is not particularly limited, but for example, the group displayed on the group-based display unit 87 can be configured to be appropriately changed. The method of changing the group displayed on the group display unit 87 is not limited, but for example, the group GB, the group GC, the group GD, and the unmanned group are displayed in this order at regular intervals, and thereafter. , It can also be configured to repeat this.

Further, when the feed button 88 is displayed at a predetermined position (right side and left side in this example) near the group display unit 87 and the feed button 88 is tapped, the group displayed on the group display unit 87 is changed. It can also be configured. It is also possible to change the group displayed on the group display unit 87 by swiping the group display unit 87.

The method of changing the group displayed on the group-specific display unit 87 is not limited to the above method. For example, by performing a predetermined operation on the client device 6 such as executing a predetermined operation on the display screen 80 or operating a predetermined input key (not shown) of the client device 6, the display for each group is performed. It can be configured to change the group displayed in the unit 87. Further, it can be configured to use the above-mentioned method for changing the group together.

The content of the image of the other group displayed on the display unit 87 for each group is not particularly limited, but the image of the other group may be configured to use, for example, the image of a user representing the other group. can.

The user representing the other group is not particularly limited, but in this example, if there is a speaker currently in the other group, the speaker is configured to be a user representing the other group. is doing.

In this case, as described above, the current speaker in each group including other groups is indicated by the "speaker flag" in the client-side dialogue management table 41 (see FIG. 11). Based on the content of this "speaker flag", the image to be displayed on the group-specific display unit 87 is determined.

Further, a display representing the group ID of another group currently displayed on the group-specific display unit 87 on a part of the other group display unit 86 (near the lower end of the group-specific display unit 87 in this example) (in this example). "Group GB") is displayed.

Further, the group-specific display unit 87 is configured to display the user ID (or the name of the user) of the user together with the image of the user representing the other group currently displayed.

As a configuration of the other group display unit 86, for example, a plurality of group-specific display units 87 may be arranged in the other group display unit 86. In this case, by arranging a number of group-specific display units 87 corresponding to the total number (4 in this example) of all other groups (group GB, group GC, group GD) and unmanned groups, in these groups. It can also be configured to display the status at the same time.

By the way, in this embodiment, among the self-group display unit 81 and the other group display unit 86 constituting the display screen 80, the self-group display unit 81 displays the dialogue status of the self-group in detail, while the other group. The dialogue status of the other group is simply displayed on the display unit 86 as compared with the dialogue status of the self-group.

Further, as shown in FIG. 16A, on the display screen 80, the self-group display unit 81 is arranged above the other group display unit 86, and in addition, the area occupied by the self-group display unit 81 is that of the other group display unit 86. It is configured to be larger than the area it occupies.

In other words, in this embodiment, in the display process on the screen, the dialogue status of the self-group is mainly displayed, and the dialogue status of another group is additionally displayed. Of course, the configuration of the display process on the screen is not limited to this.

Next, among the display processes, the display process by voice will be described.

The display method in the display process by voice is not particularly limited, but as in the case of the display process by the above screen, the voice of the dialogue in the self-group (self-group dialogue voice) is mainly output and additional. It is preferable to output the voice of dialogue in another group (dialogue voice of another group).

When the other group dialogue voice is output from the speaker 71, it is preferable to select and output any one of the other groups. For example, when one group-specific display unit 87 is arranged in the other group display unit 86 (see FIG. 16A), the other group (group GB in this example) currently displayed in the group-specific display unit 87 is used. Only the dialogue voice can be configured to be output as another group dialogue voice.

In principle, the dialogue voice of one group, whether it is a self-group dialogue voice or another group dialogue voice, is in principle unless a specific process (for example, a dialogue process between specific clients described later) is being executed. It is configured to be obtained by simply mixing the voices of all the members belonging to the group by a known method.

As a specific example of the display processing by voice, for example, it is possible to configure the speaker 71 to output only the self-group dialogue voice, or to output the other group dialogue voice from the speaker 71 at the same time as the self-group dialogue voice. You can also do it.

Further, it is possible to switch between the other group dialogue voice and the self-group dialogue voice so that the self-group dialogue voice can be selectively output from the speaker 71, and the self-group dialogue voice is constantly output from the speaker 71 while the other group dialogue voice is output. It can also be configured so that it can be selected whether or not to output from the speaker 71.

When the self-group dialogue voice and the other group dialogue voice are configured to be output from the speaker 71 at the same time or switched, the volume of the other group dialogue voice may be configured to be lower than the volume of the self-group dialogue voice. preferable.

It can also be configured so that the ratio between the volume of the dialogue voice of another group and the volume of the dialogue voice of the self-group can be changed. In this case, for example, the volume of the other group dialogue voice can be changed from about 4/5 times to about 0 times the volume of the self-group dialogue voice. More preferably, the volume of the other group dialogue voice can be changed from about 1/2 times to about 0 times the volume of the self-group dialogue voice.

Instead of outputting the other group dialogue voice from the speaker 71, or while outputting the other group dialogue voice from the speaker 71, the other group dialogue voice (textified other group dialogue voice) converted into text is displayed on the display screen 80. It can also be configured to be displayed at an appropriate position, for example, in the other group display unit 86. Textification The other-group dialogue voice may be a text converted from the other-group dialogue voice as it is, or may be a text after summarizing the other-group dialogue voice.

In this way, the data transmission / reception / display process is executed (FIG. 8, step S21), but when various interrupts (steps S22 to S27) are detected during the execution of the data transmission / reception / display process, the client device 6 Executes processing (step S32 to step S37) corresponding to these interrupts.

(2-3-2. Speaker change process)
The client device 6 monitors the change of the speaker in the self-group and the other group, and when the change of the speaker is detected (step S22), the “speaker flag” of the client-side dialogue management table 41 shown in FIG. 11 is displayed. The information is updated, and the display related to the speaker displayed on the display screen 80 of the client device 6 is changed (step S32). This is called the speaker change process.

The method of detecting the change of the speaker in the self-group or another group is not particularly limited, but for example, the following method can be considered.

That is, each client device monitors the voice level input from the microphone 72 of its own client device 6, and when the voice level exceeds a predetermined value, and the latest speaker in the group ( When the voice level of the user other than the self) is equal to or lower than the predetermined value, the client device 6 detects that the speaker of the group has changed to the user of the client device 6.

Then, the client device 6 transmits a new speaker notification signal for notifying that the user of the client device 6 has become a new speaker in the group to another client device 6 as control data. The other client device 6 detects the change of the speaker in the self-group or another group by receiving the new speaker notification signal.

The information of the "speaker flag" in the client-side dialogue management table 41 is updated in both the client device 6 that has transmitted the new speaker notification signal and the client device 6 that has received the new speaker notification signal. The display content of the display screen 80 of each client device 6 is updated based on the "person flag".

For example, when the speaker in the group GA changes from the user U02 to the user U01 and the speaker in the group GB changes from the user U06 to the user U07, the client-side dialogue management table 41 is updated by executing step S32. , The description content of the "speaker flag" changes from FIG. 11 to FIG.

Then, for example, the display screen 80 of the client device 6 of the user U01 changes from FIG. 16A to FIG. 16B. It can be seen that the display position of the speaker mark 83 in the self-group display unit 81 has been changed from the user-specific display unit 82 representing the user U02 to the user-specific display unit 82 representing the user U01.

Further, the image showing the speaker of the group GB displayed on the group-specific display unit 87 of the other group display unit 86 in the client device 6 is changed from the image showing the user U06 to the image showing the user U07. I understand.

(2-3-3. Other group dialogue content display processing)
The client device 6 includes the designation of another group dialogue content display request signal (that is, a group belonging to the dialogue room to which the client device 6 belongs and other than the group to which the client device 6 belongs) generated by the client device 6. (Signal requesting display of dialogue content in the group of The dialogue content of the group is displayed on the client device 6. (Step S33). This is called other group dialogue content display processing.

The method of generating the dialogue content display request signal of another group is not particularly limited, but for example, the following method can be considered. As an example, a case where the user U01 of the group GA, which is the user of the client device 6, requests the display of the dialogue contents in the group GB, which is another group, will be described.

Then, as shown in FIG. 16A, it is assumed that the image of the group GB is currently displayed on the group-specific display unit 87 of the other group display unit 86 constituting the display screen 80 displayed on the client device 6.

According to this method, when the user U01 selects by tapping the group-specific display unit 87 on which the image of the group GB of the client device 6 shown in FIG. 16A is displayed, the other group dialogue content in which the group GB is specified is selected. A display request signal is generated.

When the client device 6 detects the other group dialogue content display request signal generated by its own client device 6, as shown in FIG. 13A, the client device 6 itself (user) of the "other group dialogue content display" of the client-side dialogue management table 41. As the information related to U01), the group ID (GB) of the other group specified in the dialogue content display request signal of the other group is stored.

Based on the information in the "other group dialogue content display" of the client-side dialogue management table 41, the client device 6 displays the dialogue content of the group GB, which is another group, without leaving the user U01 from the group GA to which the user U01 currently belongs. It is displayed on its own client device 6.

The method of displaying the dialogue contents of the other group on the own client device 6 is not particularly limited, but for example, the dialogue voice of the other group specified in the dialogue content display request signal of the other group (other group dialogue voice). Can be configured to be output from the speaker 71 at a predetermined volume.

In this case, it is preferable that the volume of the other group dialogue voice output in the process (step S33) is higher than the volume of the other group dialogue voice output in the normal display process (step S21).

When the other group dialogue voice is output from the speaker 71, only the other group dialogue voice may be configured to be output from the speaker 71, or both the other group dialogue voice and the self-group dialogue voice are output from the speaker 71. It may be configured to do so.

When both the other group dialogue voice and the self-group dialogue voice are configured to be output from the speaker 71, the ratio of the volume of both voices is not particularly limited, but the volume of the self-group dialogue voice is the volume of the other group dialogue voice. It can be configured to be equal to or lower than the volume of the voice of another group dialogue voice.

Further, it can be configured so that the ratio of the volume of the self-group dialogue voice to the volume of the other group dialogue voice can be adjusted.

Further, as a method of displaying the dialogue contents of the other group on the own client device 6, instead of outputting the dialogue voice of the other group from the speaker 71, or outputting the dialogue voice of the other group from the speaker 71 according to the above-mentioned various methods. At the same time, it is also possible to configure the other group dialogue voice converted into text (text conversion other group dialogue voice) to be displayed on the other group display unit 86 of the display screen 80. Textification The other-group dialogue voice may be a text converted from the other-group dialogue voice as it is, or may be a text after summarizing the other-group dialogue voice.

Further, in this embodiment, the dialogue contents of the other group are displayed on the own client device 6 in this way, and the other group designation mark 89 is displayed on the display screen 80 by group as shown in FIG. 17A. It is configured to be displayed in a part of 87 or its vicinity. The other group designation mark 89 is a mark indicating that the other group is designated in order to display the dialogue content of the other group on its own client device 6. In this example, the outer frame of the group-specific display unit 87 changed to a specific color (for example, red) corresponds to the other group designation mark 89.

At the same time, the cancel button 90 and the move button 91 are displayed in the vicinity of the other group designation mark 89.

In the normal display process (step S21 described above), the target group (in this case, group GB, group GC, group GD, and unmanned group) to be displayed on the group-specific display unit 87 of the client device 6 is Even if it is configured to switch automatically at regular intervals, such an automatic switching operation is not performed while the other group dialogue content display process is being executed, and the target of the other group dialogue content display process. Only the dialogue content of the group (in this case, the group GB) is displayed on the client device 6.

By operating the cancel button 90 or the like, the dialogue content display process of another group can be terminated. The move button 91 will be described later.

The method of terminating the other group dialogue content display process is not limited to the above method. For example, a predetermined operation can be performed on the display screen 80 such as swiping the group-specific display unit 87 shown in FIG. 17A or tapping the feed button 88, or a predetermined input key of the client device 6 (FIG. 17A). It can be configured to end the other group dialogue content display process by performing a predetermined operation on the client device 6 such as operating (not shown).

Further, separately from the above-mentioned end method or in combination with the above-mentioned end method, for example, it is configured to automatically end the process after a certain period of time has elapsed from the start of the other group dialogue content display process. You can also do it.

In this way, when the other group dialogue content display request signal is detected (step S23), the client-side dialogue management table 41 is updated by executing step S33, and the description content of the "other group dialogue content display" is shown in FIG. 13A, and the other group dialogue content display process is started in the client device 6. When the other group dialogue content display process is completed, the description content of the “other group dialogue content display” returns to the content shown in FIG.

Then, the display screen 80 of the client device 6 is updated by the execution of step S33, and changes from FIG. 16A to FIG. 17A. When the other group dialogue content display process is completed, the display screen 80 of the client device 6 returns to the state shown in FIG. 16A.

(2-3-4. Movement process between groups)
The client device 6 includes the designation of an intergroup movement request signal (that is, a group belonging to the dialogue room to which the client device 6 belongs and other groups other than the group to which the client device 6 belongs) generated by the client device 6. The signal requesting movement to the group) is monitored (step S24), and when the signal is detected, the user of the client device 6 is added as a component of the other group, and the user is immediately preceding. It is controlled to leave the group belonging to (step S34). This is called inter-group movement processing.

The method for generating the movement request signal between groups is not particularly limited, but for example, the following method can be considered. As an example, a case where the user U01 of the group GA who is the user of the client device 6 requests to move to the group GB which is another group will be described.

Then, as shown in FIG. 17A, it is assumed that the above-mentioned other group dialogue content display process (step S33) is executed in the client device 6.

According to this method, when the user U01 operates by tapping the move button 91 displayed in the vicinity of the group-specific display unit 87 of the client device 6 that is executing the other group dialogue content display process, the group GB is operated. An intergroup move request signal is generated.

When the client device 6 detects the intergroup movement request signal generated by its own client device 6, as shown in FIG. 13B, the information related to the self (user U01) of the "group ID" of the client-side dialogue management table 41. Instead of the group ID (GA) of the group to which it belonged immediately before, the group ID (GB) of another group specified in the inter-group movement request signal is stored.

As a result, the user U01 is added as a component of the group GB and is separated from the group GA to which the user U01 belonged immediately before.

When the inter-group movement request signal is detected in this way (step S24), the client-side dialogue management table 41 is updated by executing step S34, and the description of the "group ID" is described in FIGS. 11 to 13A. It changes to FIG. 13B.

Then, the display screen 80 of the client device 6 is updated by the execution of step S34, and changes from FIG. 16A through FIG. 17A to FIG. 17B. As shown in FIG. 17B, the self-group display unit 81 of the display screen 80 includes each user (including the user U01 who is a new component of the group) constituting the group GB to which the user U01 is moved. Four user-specific display units 82 that display images are displayed.

On the other hand, in FIG. 17A, it can be seen that the other group designation mark 89, the cancel button 90, and the move button 91 displayed on the other group display unit 86 of the display screen 80 have been erased. Further, in the group-specific display unit 87 of the other group display unit 86, an image of a group (group GA in this example) other than the group (group GB) to which the user U01 newly belongs is displayed.

The client device 6 transmits a group change notification indicating that the user (user U01) has moved to another group (group GB) as control data to the server device 4 by the intergroup movement process, and directly or to the server. It is transmitted to another client device 6 via the device 4.

The processing in the other client device 6 and the server device 4 that received the control data will be described later.

As described above, in this embodiment, the inter-group movement process (step S34) is executed after the other group dialogue content display process (step S33). This configuration is convenient because the user can know the contents of the dialogue in the destination group before moving between the groups.

However, it can also be configured to execute the inter-group movement process without going through the other group dialogue content display process. For example, when the content of dialogue in another group (discussion theme of the subcommittee) is known in advance, such as an online meeting in the form of a subcommittee, it is less necessary to go through the process of displaying the dialogue content of other groups. ..

In addition, when executing the inter-group movement process, it can be configured so that it can be selected whether or not to pass the other group dialogue content display process.

(2-3-5. Dialogue processing between specific clients)
The client device 6 is a specific client-to-client dialogue request signal generated by its own client device 6 (that is, between users of a specific plurality of client devices including a user designation of another client device belonging to the dialogue room). A signal requesting dialogue) is monitored (step S25), and when the signal is detected, the user of the specific plurality of client devices is not separated from the group to which the specific client device currently belongs, and the specific plurality of the user devices are monitored. Controls to allow interaction between users of the client device. (Step S35). This is called dialogue processing between specific clients.

The method of generating the dialogue request signal between specific clients is not particularly limited, but for example, the following method can be considered. As an example, a case where a user U01 of a group GA who is a user of the client device 6 requests a dialogue with a user U03 who is a user in the same group will be described.

Then, as shown in FIG. 16A, the self-group display unit 81 constituting the display screen 80 displayed on the client device 6 has four user-specific display units 82 displaying images of each user constituting the group GA. It is arranged. It is assumed that the speaker mark 83 indicating the current speaker in the group GA is displayed on the user-specific display unit 82 representing the user U02.

According to this method, the user U01, who is a user who is not the current speaker (hereinafter, may be referred to as a “non-speaker user”), displays the self-group display unit 81 of his / her client device 6 shown in FIG. 16A on the self-group display unit 81. When the user-specific display unit 82 indicating the user U03 displayed as a non-speaking user is selected by tapping or the like, a dialogue request signal between specific clients specifying the user U03 is generated.

When the client device 6 detects the specific client-to-client dialogue request signal generated by its own client device 6, as shown in FIG. 14A, the client device 6 is the self (user) of the "specific client-to-client dialogue designation destination" in the client-side dialogue management table 41. As the information related to U01), the user ID (U03) of the user specified in the specific client dialogue request signal is stored, and as the information related to the user U03 of the "specific client dialogue designation source", the specific client dialogue request is made. The user ID (U01) of the user who generated the signal is stored.

The fact that the specific client-to-client dialogue request signal is generated in the client device 6 of 1 and the content of the signal are shared with other client devices.

In this way, the fact that the signal is generated in one information processing device (for example, the client device 6) and the content of the signal are shared with another information processing device (for example, another client device 6). That is sometimes simply "sharing a signal".

The method of sharing the signal is not particularly limited, but for example, the information processing device that generated the signal transmits the content of the signal as (a part of) the control data to another information processing device. Can be configured to. The information processing apparatus that has received the signal interprets the content of the signal and executes necessary processing such as rewriting its own table.

Further, each information processing device stores a table or the like having the same contents (or a part of the same contents), and a part or the whole of the table of each information processing device is appropriately stored in the information communication means 8. It can also be configured to synchronize via.

By the way, the client device 6a of the user U01 is self (user U01) as shown in FIG. 18A based on the information related to the self (user U01) of the “specific client-to-client dialogue designated destination” in the client-side dialogue management table 41 shown in FIG. 14A. A dialogue designation destination mark 84 indicating a user designated by the specific client-to-client dialogue request signal (hereinafter, may be referred to as a “dialogue designation destination user”) is displayed on an appropriate portion of the display screen 80 of the client device 6a. .. In this example, the outer frame of the user-specific display unit 82 related to the designated user (U03) is changed to a specific color (for example, red) so that the dialogue designated destination mark 84 is used.

On the other hand, in the client device 6b of the user U03 who is the user specified in the specific client-to-client dialogue request signal, the specific client-to-client dialogue request signal is shared, and the client-side dialogue management table 41 of the user U03 shares the specific client-to-client dialogue request signal. It is assumed that the contents are the same as those shown in FIG. 14A.

As shown in FIG. 18B, the client device 6b of the user U03 is based on the information related to the self (user U03) of the “specific client-to-client dialogue designation source” in the client-side dialogue management table 41 (see FIG. 14A). A dialogue designation source mark 85 indicating a user who has generated the specific client-to-client dialogue request signal (hereinafter, may be referred to as a “dialogue designation source user”) is displayed on an appropriate portion of the display screen 80 of the own client device 6b. .. In this example, the outer frame of the user-specific display unit 82 related to the designated user (U01) is changed to a specific color (for example, red) so that the dialogue designated source mark 85 is used.

The client device 6a and the client device 6b actually belong to the user U01 and the user U03 based on the information of the "specific client-to-client dialogue designation destination" and the "specific client-to-client dialogue designation source" in the client-side dialogue management table 41, respectively. It is controlled to allow dialogue between the users without leaving the group GA.

The method of dialogue between users of the specific plurality of client devices in the dialogue processing between specific clients (hereinafter, this may be referred to as “dialogue between specific clients”) is not particularly limited. In this embodiment, the voice of the dialogue between specific clients (dialogue between specific clients) is output only to the speaker 71 of the specific plurality of client devices 6, and is not output from the speaker 71 of the other client device 6. It is composed. That is, the self-group dialogue voice in the above-mentioned voice display process (step S21) is configured not to include the dialogue voice between specific clients.

By configuring in this way, it is possible to prevent the dialogue between specific clients from hindering the normal dialogue (dialogue by a user other than the user of the specific plurality of client devices) in the group to which the specific client device 6 belongs. Can be done.

Further, in the dialogue between specific clients, the voice input from the specific plurality of client devices 6 is configured not to be the target of the speaker change process (FIG. 8, step S22 and step S32). With such a configuration, it is possible to prevent the "current speaker" in the group to which the specific client device 6 belongs from being changed by the dialogue between specific clients.

Further, in the dialogue process between specific clients, how to configure the dialogue voice output from the speakers 71 of the specific plurality of client devices 6 is not particularly limited, but for example, in the process, the said subject. The dialogue voice output from the speakers 71 of the specific plurality of client devices 6 can be configured to include the self-group dialogue voice.

In this case, both the specific client-to-client dialogue voice and the self-group dialogue voice may be output from the speaker 71, and both the specific client-to-client dialogue voice and the self-group dialogue voice may be output from the speaker 71. It may be configured so that it can be selected whether to output only the dialogue voice between clients from the speaker 71.

When both the dialogue voice between specific clients and the self-group dialogue voice are output from the speaker 71, the ratio of the volume of both voices is not particularly limited, and for example, the ratio can be changed.

Further, in the client device 6a of the dialogue designation source user (user U01 in this case), for example, the volume of the self-group dialogue voice is equal to the volume of the dialogue voice between specific clients, or the dialogue voice between specific clients. It can be configured to be lower than the volume of.

On the other hand, in the client device 6b of the dialogue designated user (user U03 in this case), for example, the volume of the self-group dialogue voice becomes equal to the volume of the specific client dialogue voice, or the specific client dialogue voice is used. It can be configured to be louder than the volume of.

Further, in the dialogue processing between specific clients, as a method of displaying the self-group dialogue voice or the dialogue voice between specific clients on the client device 6 of the dialogue designation source user and / or the dialogue designation destination user, these voices are displayed on the client device 6. Instead of outputting from the speaker 71 of the above, or by outputting these voices from the speaker 71 according to the various methods described above, the voices converted into text are displayed on the display screen 80. You can also do it. These voices converted into text may be self-group dialogue voices or dialogue voices between specific clients directly converted into text, or these voices may be summarized and then converted into text. good.

For example, in the dialogue processing between specific clients, as a method of displaying the self-group dialogue voice on the client device 6a of the dialogue designation source user, instead of outputting the voice from the speaker 71 of the client device 6a, or displaying the voice. According to the various methods described above, the voice can be output from the speaker 71 and the voice converted into text can be displayed on the display screen 80.

Further, in the dialogue processing between specific clients, as a method of displaying the dialogue voice between specific clients on the client device 6b of the user to be designated for dialogue, instead of outputting the voice from the speaker 71 of the client device 6b, or by outputting the voice. According to the various methods described above, the voice can be output from the speaker 71 and the voice converted into text can be displayed on the display screen 80.

As shown in FIG. 18A, the cancel button 92 is displayed on the display screen 80 of the client device 6a of the dialogue designation source user together with the dialogue designation destination mark 84 displayed on the self-group display unit 81.

On the other hand, as shown in FIG. 18B, the cancel button 93 and the move button 94 are displayed on the display screen 80 of the client device 6b of the dialogue designation destination user together with the dialogue designation source mark 85 displayed on the self-group display unit 81. To.

By operating the cancel button 92 or the cancel button 93 by tapping or the like, it can be configured to end the dialogue processing between specific clients. The move button 94 will be described later.

The method of terminating the dialogue processing between specific clients is not limited to the above method. For example, a client may perform a predetermined operation on the display screen 80 of the client device 6a or the client device 6b, or operate a predetermined input key (not shown) of the client device 6a or the client device 6b. By performing a predetermined operation on the device 6a or the client device 6b, it can be configured to end the dialogue processing between specific clients.

In addition, separately from the above termination method or in combination with the above termination method, for example, it is configured to automatically terminate the processing after a certain period of time has elapsed from the start of the dialogue processing between specific clients. In the dialogue process between specific clients, the process may be automatically terminated when the dialogue voice between specific clients is below a predetermined level (for example, in a silent state) for a predetermined time.

As described above, on condition that the specific client-to-client dialogue request signal (step S25) is detected, the client-side dialogue management table 41 is updated by executing step S35, and the "specific client-to-client dialogue designation destination" and "specific client-to-client dialogue designation destination" are updated. The description of "Specific client-to-client dialogue designation source" changes from FIG. 11 to FIG. 14A, and specific client-to-client dialogue processing is started between a plurality of specific client devices. When the dialogue processing between specific clients is completed, the description contents of the "specific client dialogue designation destination" and the "specific client dialogue designation source" return to the contents shown in FIG.

Then, the display screen 80 of the client device 6a is updated by executing step S35, changes from the state shown in FIG. 16A to the state shown in FIG. 18A, and when the dialogue processing between specific clients is completed, the display screen of the client device 6a is completed. 80 returns to the state shown in FIG. 16A. The display screen 80 of the client device 6b is updated by the execution of step S35, changes from the state similar to FIG. 16A (not shown) to the state shown in FIG. 18B, and when the dialogue processing between specific clients is completed, the client device 6b The display screen 80 returns to a state similar to that shown in FIG. 16A.

In this example, the non-speaking user who is the dialogue designation source user designates another non-speaking user who is the dialogue designation destination user in the same group, and the dialogue between the specific clients is performed between the two users. Although the case where is performed is described, the dialogue processing between specific clients is not limited to this.

For example, a non-speaking user who is a dialogue designation source user can specify two or more non-speaking users who are dialogue designation destination users in the same group, and a dialogue between specific clients can be performed between the three or more users. It can also be configured to be.

Further, it can be configured so that the dialogue designation source user and / or the dialogue designation destination user can start the dialogue processing between specific clients even if they are speakers in the group. However, it is only after these users turn into non-speaking users that the dialogue between specific clients is actually possible in these dialogue designation source users and / or dialogue designation destination users.

Further, if the dialogue designation source user and the dialogue designation destination user belong to the same dialogue room, even if they belong to different groups, the dialogue processing between specific clients can be executed between these users. It can also be configured.

(2-3-6. New group generation process)
The client device 6 monitors a group generation request signal (that is, a signal requesting the generation of a new group belonging to the dialogue room to which the client device 6 belongs) generated by one or more client devices 6 including its own client device 6. (Step S26), when the signal is detected, a new group including the one or more client devices 6 as a component is generated, and the client devices constituting the new group belong to the immediately preceding group. It is controlled to be separated from (step S36). This is called a new group generation process.

The new group generation process is divided into a multi-element group generation process that generates a new group having a plurality of users as a component and a single element group generation process that generates a new group having one user as a component. I will explain.

(2-3-6-1. Multiple element group generation process)
The mode of the group generation request signal in the multi-element group generation process is not particularly limited, but for example, the group generation request signal includes a designation of another client device 6 generated in one client device 6. Group generation proposal signal to propose the generation of a new group and a group to accept the proposal to generate a new group generated in the other designated client device 6 in response to the group generation proposal signal. It can be configured to include a generation acceptance signal.

The method for generating the group generation proposal signal and the group generation acceptance signal is not particularly limited, but for example, the following method can be considered. As an example, a user U01 of a group GA who is a user of the client device 6a specifies a user U03 who is a user of the client device 6b and belongs to the same group, and requests the generation of a new group having both users as components. The case will be described.

Then, as shown in FIGS. 18A and 18B, it is assumed that the above-mentioned specific client-to-client dialogue process (step S35) is executed between the client device 6a and the client device 6b.

According to this method, the specific client-to-client dialogue request signal generated in the above-mentioned specific client-to-client dialogue process (step S35) also serves as the group generation proposal signal specifying the user U03. Therefore, the group generation proposal signal is generated in the client device 6a and shared with the client device 6b.

Then, when the user U03 operates by tapping the move button 94 (see FIG. 18B) displayed on the display screen 80 of the client device 6b that is executing the dialogue processing between specific clients, a group generation acceptance signal is generated. Will be done. The group generation acceptance signal is shared with the client device 6a by any of the above methods.

When the client device 6a detects the group generation proposal signal generated by its own client device 6a and the group generation acceptance signal generated by the client device 6b, as shown in FIG. 14B, the client device 6a "group" in the client-side dialogue management table 41. As information related to the self (user U01) and user U03 of "ID", the group ID (GE) of the group newly generated in the multi-element group generation process is replaced with the group ID (GA) of the group to which the user U03 belonged immediately before. Remember. In the client device 6b, the same processing as in the above-mentioned processing in the client device 6a is performed.

As a result, the group GE, which is a new group having the user U01 and the user U03 as components, is generated, and the user U01 and the user U03 are separated from the group GA to which the user U01 and the user U03 belonged immediately before.

As described above, when the client device 6a detects the group generation request signal including the group generation proposal signal and the group generation acceptance signal (step S26), the client-side dialogue management table 41 is updated by the execution of step S36, and the client device 6a is updated by the execution of step S36. The description content of the "group ID" changes from FIG. 11 to FIG. 14B via FIG. 14A. The same applies to the client device 6b.

Further, the display screen 80 of the client device 6a is updated by executing step S36, and changes from the state shown in FIG. 16A to FIG. 19A via FIG. 18A.

On the other hand, the display screen 80 of the client device 6b is updated by the execution of step S36, and changes from the state similar to FIG. 16A to FIG. 19B via FIG. 18B.

The client device 6a and / or the client device 6b sends a group change notification indicating that a new group (group GE) including itself (user U01) and the user U03 is generated by the multi-element group generation process. As control data, it is transmitted to the server device 4, and is also transmitted to another client device 6 directly or via the server device 4.

The processing in the other client device 6 and the server device 4 that received the control data will be described later.

As described above, in this embodiment, the multi-element group generation process (step S36) as the new group generation process is executed after the dialogue process between specific clients (step S35). By configuring in this way, before creating a new group, the user can preliminarily discuss the purpose of creating a new group with other users who may be a component of the new group. It is convenient because you can have a dialogue.

However, it can also be configured to execute the multi-element group generation process without going through the dialogue process between specific clients. For example, when a plurality of users who may be components of a new group are familiar with each other's way of thinking, it is less necessary to go through a specific client-to-client dialogue process.

In addition, when executing the multi-element group generation process, it can be configured so that it can be selected whether or not the dialogue process between specific clients is performed.

In this example, a case where a non-speaking user designates another non-speaking user in the same group to generate a new group having the two users as components has been described. The element group generation process is not limited to this.

For example, a non-speaking user may be configured to specify two or more other non-speaking users in the same group to generate a new group having the three or more users as components.

Also, if all of the multiple users that should be components of the newly generated group belong to the same dialogue room, then some or all of the plurality of users belong to different groups. Can also be configured to allow these users to generate new multi-element groups.

In addition, it is configured so that the multi-element group generation process can be started even if any one of the plurality of users who should be the components of the newly generated group or all of them are speakers in the group to which the group currently belongs. You can also do it. However, the speaker user does not actually become a component of the new multi-element group after these users have turned into non-speaker users.

(2-3-6-2. Single element group generation process)
The method for generating a single element group is not particularly limited, but for example, the following method can be considered. As an example, a case where the user U01 of the group GA, which is the user of the client device 6a, requests the generation of a new group having only the self as a component will be described.

This method is a method of generating a single element group by the same procedure as the intergroup movement process (step S34).

As shown in FIG. 16A, it is assumed that the above display process (step S21) is executed in the client device 6a.

In the display process (step S21), it is assumed that an image indicating an "unmanned group" is currently displayed on the group-specific display unit 87 of the other group display unit 86 constituting the display screen 80 of the client device 6a (FIG. FIG. Not shown).

The "unmanned group" is a group in which the number of users as constituent elements is 0, and is a dummy group used when executing the single element group generation process. However, the display process (step S21) and the dialogue contents of other groups are used. In the display process (step S33) and the inter-group movement process (step S34), it is configured to be treated in the same manner as the “other group”.

In this state, when the user U01 selects by tapping the group-specific display unit 87 on which the image of the unmanned group is displayed, the other group dialogue content display request signal that specifies the unmanned group (hereinafter, "unmanned group designation" is specified. Sometimes referred to as a "signal") is generated.

When the client device 6a detects the unmanned group designation signal generated by its own client device 6, as shown in FIG. 15A, the client device 6a displays itself (user U01) of the "other group dialogue content display" in the client-side dialogue management table 41. As the relevant information, the group ID (Null) of the unmanned group specified in the unmanned group designation signal is stored.

As shown in FIG. 20A, the client device 6a displays the other group designation mark 89 as one of the group-specific display units 87 of the display screen 80 based on the information of the “other group dialogue content display” of the client-side dialogue management table 41. It is configured to be displayed in or near the part. The other group designation mark 89 displayed based on the unmanned group designation signal may be particularly referred to as an unmanned group designation mark 89.

The unmanned group designation mark 89 is a mark indicating that an unmanned group is designated by an unmanned group designation signal. In this example, the outer frame of the group-specific display unit 87 changed to a specific color (for example, red) corresponds to the unmanned group designation mark 89.

At the same time, the cancel button 90 and the move button 91 are displayed in the vicinity of the unmanned group designation mark 89.

It can be configured to end the single element group generation process by performing an operation such as tapping the cancel button 90.

Then, the user U01 operates by tapping the move button 91 shown in FIG. 20A to generate an intergroup move request signal for which an unmanned group is designated. When the user U01 moves to the unmanned group, a new single element group will be generated. Therefore, in this method, the inter-group movement request signal that specifies the unmanned group corresponds to the single element group generation request signal.

When the client device 6a detects the single element group generation request signal generated by its own client device 6a, as shown in FIG. 15B, the client device 6a becomes the self (user U01) of the "group ID" of the client-side dialogue management table 41. As such information, the group ID (GF) of the group newly generated by the single element group generation request signal is stored in place of the group ID (GA) of the group to which the previous member belonged.

As a result, the group GF, which is a new single element group having only the user U01 as a component, is generated, and the user U01 is separated from the group GA to which the user U01 belonged immediately before.

As described above, when the client device 6a detects the single element group generation request signal as the group generation request signal (step S26), the client-side dialogue management table 41 is updated by the execution of step S36, and the "group ID" thereof is updated. The description content changes from FIG. 11 to FIG. 15B via FIG. 15A.

Further, the display screen 80 of the client device 6a is updated by executing step S36, and changes from a state similar to FIG. 16A to FIG. 20B via FIG. 20A.

The client device 6a uses as control data a group change notification indicating that a new single element group (group GF) having only itself (user U01) as a component has been generated by the single element group generation process. It is transmitted to the server device 4 and is transmitted to another client device 6 directly or via the server device 4.

The processing in the other client device 6 and the server device 4 that received the control data will be described later.

As described above, in this embodiment, a single element group is generated by the same procedure as the intergroup movement process (step S34). With such a configuration, it is possible to simplify the processing configuration of the entire system.

However, a procedure different from this, for example, a button for generating a single element group may be displayed on the display screen 80 of the client device 6, and the button may be operated to generate the single element group. can.

By the way, the client device 6 of the user constituting the single element group can be configured to output a predetermined voice, image and / or character. In this case, it can be configured to output, for example, music as audio. It can be configured so that the user can select whether or not to output the sound or the content of the sound to be output.

The same applies when outputting an image and / or characters. When outputting an image and / or characters, the display screen 80 of the client device 6 can be configured to be changed from the state shown in FIG. 20B. For example, images and / or characters can be configured to be displayed on the self-group display unit 81. In this case, the user-specific display unit 82 already displayed on the self-group display unit 81 may be configured to be temporarily hidden or hidden until the single element group is eliminated.

In the client device 6 of the user who constitutes the single element group, the same processing in the client device 6 of the user who constitutes the plurality of element groups under the same conditions as the client device 6 of the user who constitutes the plurality of element groups. (For example, other group dialogue content display processing, inter-group movement processing, etc.) can be executed.

(2-3-7. Logout processing)
The client device 6 monitors the logout input input from the input device 63 of its own client device 6 (step S27).

Upon detecting the logout input, the client device 6 transmits a logout notification indicating that the client device 6 is logging out from the dialogue room to the server device 4 as control data, and directly or via the server device 4. It is transmitted to another client device 6, and then the online dialogue process in the client device 6 is terminated (step S37). As a result, the user of the client device 6 leaves the dialogue room to which the client device 6 belongs.

The processing in the other client device 6 and the server device 4 that has received the control data will be described later.

(2-4. Other processing)
Returning to FIG. 6, the server device 4 monitors the communication mode in the system 2 and various notifications sent from each client device 9 in the form of control data and the like, and based on these monitoring results, the server device 4 monitors. A predetermined process is executed (step S1 to step S8). The processes shown in steps S1 and S2 are as described above.

On the other hand, as shown in FIG. 7, each client device 6 monitors various notifications sent from the server device 4 or another client device 6 in the form of control data or the like (steps S15 to S17). Based on these monitoring results, processing such as updating the dialogue information is executed (step S13).

That is, as shown in FIG. 6, the server device 4 monitors the change of the communication mode (P2P type or SFU type in this embodiment) in the system 2 determined by the server device 4 (step). S3) When the change in the communication mode is detected, the communication mode change process (step S4) is executed.

In the communication mode change process, the server device 4 changes the information stored in the "destination information" of the server-side dialogue management table 22 to the information corresponding to the changed communication mode, and the communication mode is changed. A communication mode change notification including the information stored in the changed "destination information" is generated and transmitted to each client device 6.

On the other hand, as shown in FIG. 7, the client device 6 monitors whether or not the communication mode change notification has been received (step S15), and when the notification is received, the necessary dialogue information is updated. The process is executed (step S13).

In this case, in the process of updating the dialogue information, the client device 6 uses the information stored in the "destination information" of the client-side dialogue management table 41 as information indicating the "destination information" described in the communication mode change notification. Change to.

Further, as shown in FIG. 6, the server device 4 monitors the group change notification transmitted from the client device 6 (step S5), and when it detects the reception of the notification, it performs the group change process (step S6). Execute.

The group change notification to be monitored includes the group change notification transmitted from the corresponding user in the intergroup movement process (FIG. 8, step S34) or the new group generation process (FIG. 8, step S36).

In the group change process, the server device 4 rewrites the information related to the user in the "group ID" of the server-side dialogue management table 22 to that after the change, and if necessary, sends the received group change notification to another. Transfer to the client device 6.

On the other hand, as shown in FIG. 7, the client device 6 monitors whether or not a group change notification has been received from the server device 4 or another client device 6 (step S16), and when the notification is received. Is an update process of necessary dialogue information (step S13).

In this case, in the process of updating the dialogue information, the client device 6 rewrites the information related to the user in the "group ID" of the client-side dialogue management table 41 to that after the change.

Further, as shown in FIG. 6, the server device 4 monitors the logout notification transmitted from the client device 6 (step S7), and when it detects the reception of the notification, executes the logout process (step S8). ..

In the logout process, the server device 4 deletes the column (row) related to the corresponding user in the server-side dialogue management table 22, and transfers the received logout notification to another client device 6 as necessary.

On the other hand, as shown in FIG. 7, the client device 6 monitors whether or not a logout notification has been received from the server device 4 or another client device 6 (step S17), and when the notification is received. Executes the necessary dialogue information update process (step S13).

In this case, in the process of updating the dialogue information, the client device 6 deletes the column (row) related to the corresponding user in the client-side dialogue management table 41.

Note that steps S1 to S8 shown in FIG. 6 correspond to the room management unit 12 of the server-side dialogue control unit 10 of the server device 4 of FIG.

Steps S11 to S17 shown in FIG. 7 (including steps S21 to S27 and steps S32 to S37 shown in FIG. 8 constituting step S14) are the client-side dialogue control unit 30 of the client device 6 of FIG. Corresponds to.

Of these, step S21 shown in FIG. 8 corresponds to the transmission / reception control unit 31 and the display control unit 32 of the client-side dialogue control unit 30.

Steps S23 and S33 shown in FIG. 8 correspond to the other group dialogue content display control unit 34 of the client-side dialogue control unit 30. Step S24 and step S34 correspond to the intergroup movement control unit 33. Step S25 and step S35 correspond to the specific client-to-client dialogue control unit 36. Step S26 and step S36 correspond to the new group generation control unit 35.

(3. Other embodiments)
In the above-described embodiment, the case where the client device is in charge of all the functions of the display control unit 32 (see FIG. 3) in this system is described as an example, but as the display control unit in this system. It is also possible to configure the server device to take charge of some of the functions of.

In this case, for example, the server device may be configured to be in charge of the function of integrating / editing each content data received from each client device. In order to realize such a configuration, for example, the server device can be configured to have a function as an MCU (Multipoint Control Unit) server.

Further, in the above-described embodiment, the functions as the inter-group movement control unit 33, the other group dialogue content display control unit 34, the new group generation control unit 35, and the specific client-to-client dialogue control unit 36 (see FIG. 3) in this system. Although the case where the client device as the information processing device is in charge of all of the above is described as an example, the inter-group movement control unit, the other group dialogue content display control unit, the new group generation control unit, and the specific client in this system are described. It is also possible to configure the server device as the information processing device to be in charge of all or part of the function as the dialogue control unit.

Further, in the above-described embodiment, the system serves as an inter-group movement control unit 33, another group dialogue content display control unit 34, a new group generation control unit 35, and a specific client-to-client dialogue control unit 36 (see FIG. 3). Although the case of executing all the functions is described as an example, this system functions as an inter-group movement control unit, another group dialogue content display control unit, a new group generation control unit, and a specific client-to-client dialogue control unit. It can be configured to perform only some of these functions.

For example, if the system is configured to execute only the function as a specific client-to-client dialogue control unit among the above functions, and the virtual dialogue room is configured by only one virtual group, that is, In the case where the virtual dialogue room and the virtual group are equated, the online dialogue system that executes only the function can be grasped as the invention A shown below.

[Invention A]
An online dialogue system equipped with a group of information processing devices including a plurality of client devices capable of communicating information via information communication means.
Each of the client devices is configured to belong to one virtual dialogue room configured to be in a state of being able to interact with other client devices belonging to the dialogue room.
The information processing device is
When a specific client-to-client dialogue request signal that is a signal generated in the client device and requests a dialogue between a specific plurality of specific client devices including a designation of another client device belonging to the dialogue room is detected, A specific client-to-client dialogue control unit configured to control a plurality of specific client devices to allow dialogue between the specific plurality of client devices without leaving the dialogue room to which the specific client device currently belongs. Dialogue control unit, equipped with
Being equipped with
An online dialogue system featuring.

Further, in each of the above-described embodiments, the case where the server device and the client device are each configured by using one computer has been described as an example, but the present invention is not limited thereto. The server device can also be configured by two or more computers. In this case, the two or more computers can be connected via the information communication means 8.

Further, the client device can be configured by two or more computers. Also in this case, the two or more computers can be connected via the information communication means 8.

Further, in this embodiment, a hard disk mounted on the HDD is exemplified as a recording medium for storing the program on the server device 4 side of the online dialogue system 2, and the SSD is used as the recording medium for storing the program on the client device 6 side. Although the attached flash memory is illustrated, the recording medium for storing the program is not limited to these, and examples of the recording medium for storing the program include an external memory card, a CD-ROM, and a DVD-ROM. Flexible disks and magnetic tapes can also be used. Further, the main storage device can also be used as a recording medium for storing the program.

Further, the distribution mode of the program is not particularly limited, and the program may be distributed in a state of being stored in a recording medium, or the program may be distributed via a wired or wireless information communication means.

Further, the recording mode of the program is not particularly limited. In addition to being stored and distributed on a recording medium in a form that can be directly executed, for example, it can be stored and distributed on a recording medium in a compressed form for decompression and use.

In each of the above-described embodiments, the case where the functions of FIGS. 2 and 3 are realized by using a computer has been described as an example, but some or all of these functions are configured by using hardware logic. You may try to do it.

Further, the above-mentioned block diagram, hardware configuration, flowchart, table (database) configuration, display screen configuration, etc. are given as examples, and the present invention is not limited thereto.

Further, a part or all of the data constituting the table (database) can be individually stored as a variable.

In the above, the present invention has been described as a preferred embodiment, but each term is not used for limitation but for explanation and deviates from the scope and spirit of the present invention. However, it can be changed within the scope of the attached claim. Also, although only some typical embodiments of the present invention have been described in detail above, those skilled in the art will appreciate the above typical embodiments without departing from the novel teachings and advantages of the present invention. It will be easy to recognize that many changes are possible in morphology. Therefore, all such changes are within the scope of the invention.

6: Client device 30: Client-side dialogue control unit 33: Inter-group movement control unit

Claims (10)

An online dialogue system equipped with a group of information processing devices including a plurality of client devices capable of communicating information via information communication means.
Each of the client devices is configured to belong to one of the virtual groups configured to be able to interact with other client devices belonging to the same group, and all the groups are in one virtual dialogue room. Configured to belong,
The information processing device is
An inter-group movement request signal that is a signal generated by the client device and that requests movement to the other group including the designation of another group that belongs to the dialogue room and is not the group to which the user belongs. When the client device is detected, the client device is added as a component of the other group, and an intergroup movement control unit configured to control the client device to leave the group to which the client device immediately belonged is provided. Dialogue control unit,
Being equipped with
An online dialogue system featuring. In the online dialogue system of claim 1,
The dialogue control unit
Another group dialogue that requests the display of the dialogue content in the other group including the designation of another group that is a signal generated in the client device and belongs to the dialogue room and is not the group to which the user belongs. When the content display request signal is detected, the other group dialogue content display control unit that controls the dialogue content of the other group to be displayed on the client device without leaving the client device from the group to which the client device currently belongs.
Being equipped with
An online dialogue system featuring. In the online dialogue system of any one of claims 1 or 2.
The dialogue control unit
When a group generation request signal for requesting the generation of a new group belonging to the dialogue room is detected, which is a signal generated in the client device, a new group including the client device as a component is generated and a new group is generated. A new group generation control unit configured to control the client devices constituting the new group to be separated from the group to which the new group belonged immediately before.
Being equipped with
An online dialogue system featuring. In the online dialogue system of claim 3,
The group generation request signal is a group generation proposal signal to propose the generation of a new group including the designation of another client device generated in one client device, and the designation in response to the group generation proposal signal. It was configured to include a group generation acceptance signal to accept the proposal to generate a new group generated in another client device.
An online dialogue system featuring. In the online dialogue system of claim 3,
The group generation request signal is a single element group generation request signal for requesting the generation of a new group having only the client device generated in the client device as a component.
An online dialogue system featuring. In the online dialogue system according to any one of claims 1 to 5.
The dialogue control unit
When a specific client-to-client dialogue request signal that is a signal generated in the client device and requests a dialogue between a specific plurality of client devices including a designation of another client device belonging to the dialogue room is detected, A specific client-to-client dialogue control unit configured to control dialogue between the specific client devices without leaving the group to which the specific client device currently belongs.
Being equipped with
An online dialogue system featuring. The information processing apparatus used in the online dialogue system according to any one of claims 1 to 6. A program for causing a computer to function as a dialogue control unit of the information processing apparatus according to claim 7. A recording medium in which the program of claim 8 is stored. An online dialogue method using a group of information processing devices including a plurality of client devices capable of communicating information via information communication means.
Each of the client devices is configured to belong to one of the virtual groups configured to be able to interact with other client devices belonging to the same group, and all the groups are in one virtual dialogue room. Configured to belong,
The information processing device is a signal generated by the client device, and requests to move to the other group including the designation of a group belonging to the dialogue room and other than the group to which the information processing device belongs. When the inter-group movement request signal is detected, the client device is added as a component of the other group, and the client device is controlled to be separated from the group to which the client device belonged immediately before. Dialogue control step, with control step,
Being equipped with
An online dialogue method that features.

Images