JP2006254328A - Audio/video communications system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an audio/video communications system, capable of being used as new communication means in social life by adding a function to be easily used by only a personal user. <P>SOLUTION: The audio/video communications system 12 relays a communication to be performed by an audio and video between a plurality of user terminals 11 via a communications network 10. The system comprises acquiring means 610 for acquiring operation information, including terminal identification information of each of the user terminals 11, and transmitting means 810 for transmitting the operation information acquired by the acquiring means 610 to any one among the plurality of the user terminals 11. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to an audio / video communication system that relays audio and video communications between a plurality of user terminals via a communication network such as the Internet.

  Conventionally, as an example of an audio / video communication system that relays audio and video communication between a plurality of user terminals via a communication network, for example, a multipoint video conference system described in Patent Document 1 below is used. Service.

  When hosting a service using this type of multi-point video conference system, the names of participants in the video conference, the telephone numbers and addresses of the participants, the conference name, the conference start and end times, the conference time, etc. are reserved and registered. A method in which the meeting organizer calls each meeting participant sequentially when the predetermined date and time of reservation registration is reached, or a method in which the management system that accepts reservation registration sequentially calls each meeting member when the predetermined date and time arrives The conference organizer starts the conference when all the members who have been called are prepared.

  When the conference progresses and the pre-registered end time is reached or the predetermined conference time elapses, the conference organizer declares the end of the conference or reports the conference end from the management system. Ends.

  Upon receiving the notification of the end of the conference, the members who participate in the conference process the conference end on their own conference terminals, or are released from the conference connection all at the same time by the conference organizer's end command, or processing from the management system Thus, processing is performed such that all the conference participants including the conference organizer are simultaneously released from the conference connection.

In addition, when there is a request to join (add) or leave a new member while the conference is in progress, the conference organizer calls a new member to perform additional processing in the conference. The conference organizer designates a process of leaving the member or the member voluntarily leaves the conference connection (leaves).
http://www.meetingplaza.com/index-j.html

  However, such a multipoint video conference system has the following problems.

  In other words, in a multipoint video conference system, in advance, a conference participant name, conference opening and closing time, conference opening time, conference name, etc., pre-registration to the conference participants, advance notification by conference participants There is a complication of having to perform various processes and operations such as terminal operations. Therefore, when hosting and participating in a multipoint video conference, it is necessary to adjust the schedule for the conference, and it is also required to be familiar with the functions and operations of the system. Most of them are used for business purposes, and there is almost no use for general purposes.

  However, there is no doubt that an audio-video communication system such as a multi-point video conference system is an excellent communication means capable of communicating abundant information including audio and video in real time and simultaneously at a plurality of points. . Therefore, it is not limited to business use, and it is possible to provide various conveniences to individual users if they can be easily used even by individual users such as telephones and electronic mail. is expected.

  For example, in recent years, the social environment has been undergoing major changes, such as the increasing number of nuclear families and the declining birthrate and aging population, and the expansion of depopulation due to urban population concentration. Along with this, the number of elderly people living alone and single residents are increasing, and in the future, it will be necessary to develop technologies that take account of these situations.

  In consideration of such a situation, it is conceivable to use an audio-video communication system as an effective means for connecting parents and children who live remotely. As a result, parents and children living away from each other can communicate in real time with voice and video, so that they can talk to each other and check their current appearance without having to meet together. In particular, it is expected that the convenience and security felt by users will be exceptional, such as the release from the loneliness experienced by elderly people living alone. The application range is expected to be extremely wide, such as communication between relatives such as parents and children, brothers, etc., and communication between groups with good friends and people with the same hobby.

  As described above, the audio-video communication system is used for business purposes despite being an excellent communication means capable of communicating abundant information including audio and video in real time and simultaneously with a plurality of points. However, it is rarely used as a personal user base, and there is a problem that its utility is not fully utilized.

  The present invention has been made in view of such circumstances, and can be used as a new communication means in social life by adding a function that can be easily used even by an individual user. An object is to provide an audio-video communication system.

  In order to achieve the above object, the present invention takes the following measures.

  That is, the invention of claim 1 is an audio / video communication system that relays audio and video communication between a plurality of user terminals via a communication network, and includes an acquisition unit and a transmission unit. This acquisition means acquires operation information including terminal identification information of each user terminal. The transmission unit transmits the operation information acquired by the acquisition unit to any one of the plurality of user terminals.

  According to a second aspect of the present invention, in the audio / video communication system according to the first aspect of the invention, the transmission means preliminarily designates the operation information acquired by the acquisition means by a user terminal corresponding to the terminal identification information included in the operation information. To the user terminal.

  According to a third aspect of the present invention, in the audio / video communication system according to the first or second aspect of the present invention, the operation information includes power on / off information of the user terminal, audio information transmitted from the user terminal, and user terminal It further includes operation state information indicating the state of the operation performed.

  According to a fourth aspect of the present invention, in the audio / video communication system according to any one of the first to third aspects, the operation information includes communication state information indicating whether or not the user terminal is communicating, and the user terminal. Is further included in the terminal identification information of the user terminal of the communication partner.

  A fifth aspect of the present invention is the audio / video communication system according to any one of the first to fourth aspects of the present invention, wherein the participation is transmitted from a user terminal that wishes to participate in communication between a plurality of user terminals. A participation request receiving means for receiving the request information is further provided. Then, when the participation request information is received by the participation request receiving means, the transmission means performs communication in which the participation request is made to the terminal identification information of the user terminal that is the transmission source of the participation request information and the participation request information. The operation information of the plurality of user terminals is transmitted to the user terminal of the transmission source.

  A sixth aspect of the present invention is the audio / video communication system according to the fifth aspect of the present invention, further comprising first participation permission information receiving means and first communication participation permission means. The first participation consent information receiving means, in response to the participation request information transmitted by the transmission means, when participation consent information is transmitted from each user terminal performing communication desired to participate. Receive participation consent information. In addition, the first communication participation permission unit, when the first participation permission information receiving unit receives the participation permission information, participates in the communication performed between the user terminals that transmitted the participation permission information. Permit the participation of the user terminal that sent the request information.

  A seventh aspect of the present invention is the audio / video communication system according to any one of the first to sixth aspects of the present invention, wherein a user terminal that wants to participate in communication from any of the user terminals participating in the communication When the terminal identification number is transmitted, the transmission means transmits the operation information of the user terminal corresponding to the terminal identification number to each user terminal participating in the communication. The audio / video communication system further includes second participation consent information receiving means and second communication participation permission means. The second participation permission information receiving means receives the participation permission information when the participation permission information is transmitted from each user terminal participating in the communication with respect to the operation information transmitted by the transmitting means. To do. In addition, the second communication participation permission unit wants to participate in the communication performed between the user terminals that transmitted the participation permission information when the participation permission information is received by the second permission information receiving unit. Let the user terminal participate.

  The invention of claim 8 is the audio-video communication system of the invention of claim 6 or claim 7, wherein the communication participation permission means is sent from all user terminals participating in the corresponding communication by the participation permission information receiving means. Only when the participation consent information is received, the participation of a new user terminal in this communication is permitted.

  ADVANTAGE OF THE INVENTION According to this invention, the audio video communication system which can be utilized as a new communication means in social life is realizable by adding the function which even an individual user can utilize easily. .

  The best mode for carrying out the present invention will be described below with reference to the drawings.

  FIG. 1 is a functional block diagram showing a configuration example of an audio / video communication system according to an embodiment of the present invention.

  That is, the audio / video communication system according to the embodiment of the present invention includes a user information storage management terminal 12, an audio / video distribution management terminal 13, and a plurality of user terminals 11 ( # 1, # 2,... #N). The user information storage management terminal 12 and the video / audio distribution management terminal 13 communicate with each other by the audio and video between the plurality of user terminals 11 (# 1, # 2,... #N) via the Internet 10. Relay. In FIG. 1, the user information storage management terminal 12 and the video / audio distribution management terminal 13 are displayed as separate hardware, but the functions of the user information storage management terminal 12 and the video / audio distribution management terminal 13 are combined. Alternatively, it may be realized by a single server. Further, instead of the Internet 10, a network constructed by a LAN, a WAN, or an intranet, or a network obtained by appropriately combining a LAN, a WAN, or an intranet with the Internet may be used.

  FIG. 2 is a functional block diagram illustrating a detailed configuration example of the user terminal 11 and the user information accumulation management terminal 12.

  The user terminal 11 may be a terminal that is installed in each user's house or the like and has a function equivalent to that of a personal computer or a video display screen 414. The user terminal 11 is connected with a microphone 111 for user voice input, a speaker 411 for voice reproduction, and a video input camera 114. The user terminal 11 may be connected to various input devices such as an information input keyboard and mouse. When the keyboard and mouse are not connected, the video display screen 414 has a touch panel input function. Also good. As a result, even a user who is not familiar with keyboard and mouse operations can easily perform operations.

  Furthermore, the user terminal 11 includes a communication processing unit 510 for transmitting and receiving audio information, video information, operation information, conversation information, and partner user registration information via the Internet 10. Furthermore, a video input unit 115 that processes video information from the video input camera 114, a video encoding unit 116 that encodes the video information processed by the video input unit 115 and outputs the encoded video information to the communication processing unit 510, and a microphone 111 The voice information input unit 112 that processes voice information from the voice information input unit 112 and the voice encoding unit 113 that encodes the voice information processed by the voice information input unit 112 and outputs the encoded voice information to the communication processing unit 510. Further, after being transmitted from the communication processing unit 510, the video decoding unit 416 that decodes the encoded video information distributed by the video / audio distribution management terminal 13 and the video information decoded by the video decoding unit 416 are displayed. A video information output unit 415 that performs output processing on the video display screen 414; an audio decoding unit 413 that decodes encoded audio information transmitted from the communication processing unit 510 and distributed by the video / audio distribution management terminal 13; The audio information output unit 412 outputs the audio information decoded by the audio decoding unit 413 to the speaker 411. Furthermore, a user information request unit 310 that performs a user information acquisition request process of another user terminal 11 and a user information generation unit 210 that performs an input process of user information are provided. The user information includes the user name of the user who operates the user terminal 11 and the identification number of the user terminal 11 operated by this user.

  Further, the user information generation unit 210 stores the conversation information acquisition unit 211 that acquires the conversation information from the audio information input unit 112 and the video information input unit 115, the conversation information acquired by the conversation information acquisition unit 211, and communication processing. When there is a request from the unit 510, the conversation information storage unit 212 that outputs the stored conversation information to the communication processing unit 510, the operation information acquisition unit 213 that acquires the operation information of the user terminal 11, and the operation The operation information storage unit 214 that stores the operation information acquired by the information acquisition unit 213 and outputs the stored operation information to the communication processing unit 510 when requested by the communication processing unit 510; Registered in the partner user registration unit 215 for registering user information, which is information of the user terminal 11 as a communication partner, and the partner user registration unit 215 Stores the user information, when a from the communication processing unit 510 is requested, and a mating user storage unit 216 for outputting user information stored in the communication processing unit 510.

  Here, the operation information is the identification information (user name, IP address, identification number, etc.) of the user terminal 11, power on / off information of the user terminal 11, voice information transmitted from the user terminal 11, and the user terminal 11. Operation state information indicating the state of the operation that has been performed (indirect information relating to conversation such as change in sound pressure level, presence or absence of mouse or keyboard operation, speed of video change, user terminal 11, conversation state, etc.), user terminal Communication status information indicating whether or not the user 11 is communicating, and when the user terminal 11 is communicating, identification information (user name, IP address, identification number, etc.) of the partner user terminal, the presence of the user / Contains absence information.

  The user information storage management terminal 12 includes a user information database 712 that stores user information that is information about a user who operates the user terminal 11. In addition, a communication processing unit 810 for transmitting / receiving information to / from the user terminal 11 via the Internet 10 is provided. In addition, the communication processing unit 810 includes a user information registration unit 610 for processing the conversation information received from the user terminal 11 via the Internet 10, the operation information, and the user information of the other user. The user information registration unit 610 further includes a conversation information storage unit 611 that stores the conversation information from the communication processing unit 810, and a conversation that performs registration processing of the conversation information stored in the conversation information storage unit 611 in the user information database 712. An information registration unit 612, an operation information storage unit 613 that stores operation information from the communication processing unit 810, and an operation information registration unit that performs registration processing of the operation information stored in the operation information storage unit 613 in the user information database 712 614, a partner user storage unit 615 that stores user information of the partner user from the communication processing unit 810, and a partner that performs registration processing of the user information of the partner user stored in the partner user storage unit 615 in the user information database 712. A user registration unit 616.

  FIG. 3A is a data configuration diagram illustrating an example of an operation information table 713 for the user information database 712 to store operation information. The operation information table 713 includes a terminal identification number 713a, a user name 713b, user presence / absence information 713c, power on / off information 713d of the user terminal 11, and operation information 713e such as a mouse of the user terminal 11. And the keyboard operation presence / absence information 713f of the user terminal 11. Among these, the terminal identification number 713a, the user name 713b, the user presence / absence information 713c, and the power on / off information 713d of the user terminal 11 are information that is constantly sent to the user terminal 11. Further, the operation information 713e such as the mouse of the user terminal 11 and the keyboard operation information 713f of the user terminal 11 are information sent to the user terminal 11 only when there is a request.

  FIG. 3B is a data configuration diagram illustrating an example of a conversation information table 714 for the user information database 712 to store conversation information. The conversation information table 714 includes a terminal identification number 714a, a user name 714b, user's busy / empty (not busy) information 714c, a terminal identification number 714d of the connected partner user, and conversation level information. 714e and information 714f such as the degree of movement of the other user. Among these, the terminal identification number 714d of the connected partner user, the conversation level information 714e, and the partner user movement degree information 714f are information sent to the user terminal 11 only when requested. .

  FIG. 3C is a data configuration diagram illustrating an example of a user information table 715 for the user information database 712 to store user information. The user information table 715 includes a terminal identification number 715a, a user name 715b, an IP address 715c of the user terminal 11, and a terminal identification number 715d of the other user.

  The user information storage management terminal 12 further includes a user information search unit 710 for searching the user information database 712 for user information that matches the information received by the communication processing unit 810, and a search result made by the user information search unit 710. In addition to storing, when there is a request from the communication processing unit 810, the stored search results are temporarily stored for distribution from the communication processing unit 810 to the user terminal 11 via the Internet 10. And a result storage unit 711.

  The video / audio distribution management terminal 13 has a function of distributing the video and audio transmitted from the user terminal 11 that is the transmission source to a plurality of designated user terminals 11.

(User terminal operating status monitoring function)
By adopting the configuration as described above, the audio-video communication system according to the embodiment of the present invention connects multi-point video conference terminals according to a predetermined schedule as in the conventional multi-point video conference service. Unlike the method in which the multipoint video conference is held after the conference is completed and the multipoint connection is released, the user information storage management terminal 12 determines the operation information from each user terminal 11 in advance. By automatically collecting at periodic intervals, a function of grasping the operating state of each user terminal 11 is provided.

  This is performed by causing the user information storage management terminal 12 to transmit operation information to each user terminal 11 at a predetermined cycle. In this way, the operation information transmitted from each user terminal 11 is received by the communication processing unit 810, the operation information storage unit 613 stores the information, and the operation information stored in the operation information storage unit 613 is operated. The registration unit 614 performs registration in the user information database 712 in association with the terminal identification information.

  In this way, the user information storage management terminal 12 stores operation information for each user terminal 11 in the user information database 712. Then, from the operation information accumulated in the user information database 712 in this way, the user information search unit 710 searches the operation information of the user terminal (partner user terminal) designated from the user terminal 11 and searches for the operation information thus searched. By transmitting the information to the requesting user terminal 11, the requesting user terminal 11 grasps the operating state of the counterpart user terminal. As a result, the user terminal 11 can request a conversation after confirming the operating state of the partner user terminal in advance, so that the user terminal 11 encounters a scene where an acquaintance person has a well-end conversation while walking on the street. The situation of participating in the conversation is realized by communication through a network such as the Internet 10.

(Interrupt function)
In addition, the audio / video communication system according to the embodiment of the present invention is configured as described above, so that a user who has not participated in a conversation (communication via a network) at a certain point in time can newly join this conversation. When you want to join, you can check which other users are already talking, whether the conversation is taking place, and the state of the ongoing conversation, operation status information (change in sound pressure level, mouse (Indirect information on the presence or absence of keyboard operation, the speed of video change, indirect information on the user terminal 11, conversation state, etc.) It is displayed on the terminal 11. This is equivalent to showing whether or not someone is having a well-end conversation while walking on the street, and then indicating the intention to participate in the well-end conversation. In other words, if there is a user who is talking to someone on the network, he / she is allowed to participate in the well-end conversation on the network so that he / she can join the conversation after newly indicating his / her intention to participate.

(User terminal call function)
Furthermore, since the audio / video communication system according to the embodiment of the present invention can accumulate the operation information of each user terminal 11 as described above, a user who is already in conversation invites another user to the conversation. If you want to join, you can check the status of the user you want to call, confirm that the user is at home, has the user terminal 11 turned on, and is not talking to another user For the first time, the user is called up and the call-in function of joining the ongoing conversation is realized. This is the realization on the network that a person who has already had a well-end conversation goes to a neighbor to call him and join a new well-end conversation.

  The operation of the audio / video communication system according to the embodiment of the present invention when each function of the user terminal 11 is realized will be described below.

  FIG. 4 is a diagram showing the relationship between the functions of the audio / video communication system as described above. In FIG. 4, communication by exchanging audio and video between a plurality of user terminals 11 via the Internet 10 using the audio / video communication system according to the embodiment of the present invention is referred to as “conversation”.

  That is, in the audio / video communication system according to the embodiment of the present invention, a two-way conversation between two user terminals 11 is started by selecting a communication partner from an initial state (S1) where no conversation is performed. (S2). When the conversation is started in this way, the video and audio distribution management terminal 13 distributes video and audio between the two user terminals 11.

  Furthermore, in the audio / video communication system according to the embodiment of the present invention, in addition to the basic call made between two parties as in step S2, the interrupt function (S3 to S8) as described above, the call function ( S9 to S13) can be performed.

  If there is a request for an interrupted conversation from another user terminal 11 to each user terminal 11 in a two-party conversation (S3), an interruption occurs if the two parties currently in a conversation agree (S4: Yes) Is accepted (S5), and a conversation between the three parties is established (S6).

  On the other hand, if at least one of the two users currently in conversation does not agree in step S4 (S4: No), this interruption is rejected (S7), and the conversation between the two is continued (S8). ).

  When each user in a two-party conversation wants to call another user into this conversation (S9), the user terminal 11 state of the user who wants to call is acquired via the user information storage management terminal 12. Then, when it is confirmed that the user terminal 11 is not in conversation with any other user terminal 11 and is in a callable state (S10), the user terminal 11 participates in the conversation with the user terminal 11. (S11). On the other hand, when the requested user terminal 11 agrees to participate in the conversation (S12), a three-party conversation is established (S13).

  If the user wants to leave the conversation, the user can leave the conversation at an arbitrary timing by turning off the power of the user terminal 11 or performing a connection release operation from the user terminal 11.

  The operation of the audio / video communication system when realizing such an operation state grasping function of the user terminal 11 will be described with reference to the flowchart of FIG.

  FIG. 5 shows a case where four users constitute a conversation group, but the number of users constituting the same conversation group is not limited to four as long as the system determines the number. . Here, a case where four users A, B, C, and D are assumed and the user A and the user B start a conversation will be described as an example.

  Information relating to each user terminal 11 is generated by the user information generation unit 210, then transmitted from the communication processing unit 510, periodically transmitted to the user information accumulation management terminal 12 via the Internet 10, and the user information registration unit 610. Is stored in the user information database 712 (S11).

  In this way, among the information from each user terminal 11 accumulated in the user information database 712, information related to the users A, B, C, and D is searched by the user information search unit 710, and the user information search result storage unit 711. Further, the stored information is transmitted by the communication processing unit 810, so that information on the user terminals 11 other than the user terminal 11 is periodically distributed to each user terminal 11 via the Internet 10 (S12).

  In this way, even in a state where video and audio are not communicated, information on users other than himself / herself is included in the information regarding the user terminals 11 of the users A, B, C, and D constituting the same conversation group. Then, it is sent to each user terminal 11 and displayed (S13). For example, information regarding the users B, C, and D is sent to the user terminal 11 of the user A. Thereby, each user can grasp the state of users other than himself / herself who constitute the same conversation group.

  In this state (state 1 during non-conversation), for example, when user A wants to start a conversation with user B using the audio-video communication system according to the embodiment of the present invention, user A The user B is selected by operating (S14).

  Further, it is determined whether or not the other party (that is, the user C and the user D) constituting the same conversation group can be disclosed to the user B who requests the conversation. When it is determined that “the user B” is the user B who is requesting the conversation can be disclosed (S15: Yes), a call is made to the user terminal 11 of the user B. (S16).

  User B responds to this call (S17: Yes), and user B is also the user C who is another user in the same conversation group that his (user B) conversation partner is user A and When it is determined whether or not it can be disclosed to the user D, and it is determined that it may be disclosed (S18: Yes), the conversation between the user A and the user B is started for the first time by video and audio. (S19).

  When the conversation is started (state 2 in which two-party conversation is in progress), the video and audio distribution management terminal 13 exchanges video and audio between the two user terminals 11. Further, as in step S11, information on the user A and the user B is updated by the user information storage management terminal 12 from the user terminals 11 of the user A and the user B (S20), and the updated information is updated. Then, it is sent to the user terminal 11 of the user C and the user D who are the other members (S21), and from there, it is displayed that “the user A conversation is in progress and the user B conversation is in progress” (S22).

  By seeing this, the user C and the user D can grasp that the user A and the user B are in conversation. However, although the user C and the user D can confirm that the user A and the user B are both in conversation, they cannot confirm to whom they are talking. In order to know each conversation partner, when the user C or the user D requests information browsing of the user A or the user B, both the user A and the user B may “disclose” the conversation partner. In this case, it can be confirmed that “User A and User B are in conversation”.

  In the above description, when the conversation between the user A and the user B is started, it is assumed that the conversation partner may be “open to the public”. Even if the conversation partner is “not disclosed”, the conversation between the user A and the user B may be started. As described above, the audio / video communication system according to the embodiment of the present invention registers other members constituting the same conversation group in advance, so that other members constituting the same conversation group It is possible to grasp information such as operation information, conversation information, and user information related to the current state of the member.

  Next, the operation of the audio / video communication system when the interrupt function of the user terminal 11 is realized will be described with reference to the flowchart of FIG.

  FIG. 6 shows the flow of processing when user C interrupts the state 2 shown in FIG. 5, that is, the conversation between user A and user B.

  That is, the user C grasps that the user A and the user B are in conversation with somebody by looking at the display that is “conversation of the user A and the conversation of the user B” in step S22.

  On the other hand, the user C requests user detailed information from the user information storage management terminal 12 in order to know who the user A and the user B are talking with (S23). In response to this request, the user information storage management terminal 12 displays on the user terminals 11 of the user A and the user B that “user C is browsing detailed information of the user A and the user B” (S24). .

  Further, in the user terminals 11 of the user A and the user B, it is determined whether or not the user C is registered as a member constituting the same conversation group, that is, a conversation partner (S25). And when it determines with having registered in any user terminal 11 of the user A and the user B (S25: Yes), the user A and the user from the user information database 712 by the user information accumulation management terminal 12 The latest information updated about B (user A and user B are in conversation) is acquired. Then, the acquired information is sent to the user terminal 11 of the user C and displayed therefrom, whereby the user C can know that the user A and the user B are in conversation (S26). ).

  On the other hand, when the user C wants to participate in the conversation between the user A and the user B, the user terminal of the user A and the user B is operated by operating the user terminal 11 of the user C. 11 is selected (S27). Then, the user C himself also sets “may be disclosed” in the selection of whether or not to disclose the conversation partner (S28). Thereafter, the user C operates the user terminal 11 to call the user terminals 11 of the user A and the user B (S29).

  In response to the call from the user C made in step S29, both the user A and the user B respond (S30: Yes), and it is further determined whether or not the conversation partner can be disclosed again (S31). ). If it is determined that “it may be disclosed” (S31: Yes), the user C can participate in the conversation between the user A and the user B, and a state in which the conversation between the three parties is possible (interrupt) State 3) where the conversation is established is established (S32).

  In the above description, when the user C interrupts the conversation between the user A and the user B, all the users who want to talk (in this case, the user A, the user B, and the user C) have the conversation partner disclosed to the public. However, this is just an example, and even if all users who are trying to converse do not disclose their conversation partners, the conversation between user A and user B User C may be able to interrupt. When the conversation is started in this way, video and audio are exchanged between the three user terminals 11 by the video / audio distribution management terminal 13.

  As described above, in the audio / video communication system according to the embodiment of the present invention, when a conversation with a plurality of members is already performed and a member who wants to participate in the conversation newly appears, the conversation is already in progress. Members can be added after asking whether or not they can participate in interrupts.

  If there is a member who is already in conversation but does not agree to the participation, the member who wants to participate cannot participate in the conversation. FIG. 7 is a flowchart showing an example of the processing flow in this case.

  The flowchart of FIG. 7 shows a case where, in step S30, the user A responds (agrees to participate) but the user B does not respond (disagrees to participate). In this case, the interruption of the user C is not established, and the conversation between the user A and the user B is still continued (S33). That is, the interrupt conversation is not established 31 and the user terminal 11 of the user C displays “user A and user B are in conversation” as in step S26 (S34).

  As described above, in the audio / video communication system according to the embodiment of the present invention, when a conversation with a plurality of members is already performed and a member who wants to participate in the conversation newly appears, the conversation is already in progress. If all members of do not agree to participate in the interruption, the interruption request can be rejected.

  Next, the operation of the audio / video communication system when realizing the calling function of the user terminal 11 will be described with reference to the flowchart of FIG. FIG. 8 shows the flow of processing when calling user C into the state 2 shown in FIG. 5, that is, the conversation between user A and user B.

  That is, the user C grasps that the user A and the user B are in a conversation by looking at the display that is “conversation of the user A and the conversation of the user B” in step S22.

  In this state, it is assumed that user B wants to call user C into this conversation. In this case, the user B requests the user information storage management terminal 12 for detailed information of the user C (S41). On the other hand, the user information storage management terminal 12 displays that the user B is browsing the detailed information of the user C from the user terminals 11 of the user A and the user C (S42). In addition, the user information storage management terminal 12 displays information from the user terminal 11 of the user B such that the user A and the user B are in conversation and the user C is in the room (S43).

  As a result, the user B can confirm that the user C is in the room. Then, the user B selects the user C as a user who calls into the conversation (S44), and further sets the user B's own conversation partner as "can be disclosed" (S45). Then, the user A who is the current conversation partner asks for the approval of the call of the user C (S46), and when the approval is obtained from the user A (S47), the user C calls the user terminal 11 of the user C for the first time there. Is made (S48).

  When the user C participates in response to the call, the user C answers “Respond” (S49). Further, both the user A and the user C reply that the conversation partner in the future is “can be disclosed” (S50), thereby further inviting the user C from the state 2 during the two-party conversation between the user A and the user B. The transition to state 4 of the three-party conversation is made (S51).

  In the above, when the user B calls the user C in the conversation between the user A and the user B, all the users who want to talk (in this case, the user A, the user B, and the user C) Although it is assumed that the conversation partner may be disclosed, this is merely an example, and even if all users who want to have a conversation do not disclose the conversation partner, the user A User C may be called in during a conversation with the user B.

  When the conversation is started in this way, video and audio are exchanged between the three user terminals 11 by the video / audio distribution management terminal 13.

  As described above, in the audio / video communication system according to the embodiment of the present invention, a member who constitutes the same conversation group is newly assigned to this conversation from a state in which a conversation by a plurality of members has already been performed. It is possible to call in.

  In this way, the user C who newly joins the conversation, from the conversation information as shown in FIG. 3B, the terminal identification number 714a, the user name 714b, the user's busy / empty (not busy) information 714c. In addition to knowing the other party's terminal identification number 714d, the conversation partner can be identified from the conversation level etc. information 714e, and the atmosphere such as whether the conversation is excited from the other party's movement degree information 714f. You can grasp the excitement of each conversation. Therefore, the user C can easily perceive the atmosphere of the “place” of the conversation that has been made by the user A and the user B so far, and can quickly merge.

  As described above, in the audio / video communication system according to the embodiment of the present invention, multi-point video and audio communication by members registered in advance can be performed in advance by participating members and conversation dates and times. If it is within the range of members registered in advance, it is not necessary to prepare for reservation registration, etc., and information such as the home and absence of each member and the power on / off status of the user terminal 11 is displayed. The members can be periodically accumulated in the user information accumulation management terminal 12, and each member can arbitrarily acquire such information.

  In addition, since it is easy to know if any of the registered members is having a conversation, it is possible to start a conversation at any time or to interrupt a conversation that has already been performed by a member. This can be realized with a simple operation without performing reservation registration processing.

  In addition, there is a degree of freedom that a member who is in a conversation even if there is no organizer can call a member who is not currently participating in the conversation into the conversation. In contrast, as an extension of daily conversation, it is possible to enjoy multipoint video and audio communication by a plurality of members via a communication network such as the Internet 10.

  In addition, since the atmosphere of the "place", such as the excitement of the conversation so far, can be communicated in advance to the members who participated in advance, even conversation members who have participated in the middle so far Can naturally blend into the flow of water.

  As described above, according to the audio-video communication system according to the embodiment of the present invention, a general person can easily enjoy wide-area well-end conversation using a network. This makes it possible to create a new community through video and audio communication.

  The best mode for carrying out the present invention has been described above with reference to the accompanying drawings, but the present invention is not limited to such a configuration. Within the scope of the invented technical idea of the scope of claims, a person skilled in the art can conceive of various changes and modifications. The technical scope of the present invention is also applicable to these changes and modifications. It is understood that it belongs to.

The functional block diagram which shows the structural example of the audio video communication system which concerns on embodiment of this invention. The functional block diagram which shows the detailed structural example of a user terminal and a user information storage management terminal. The data block diagram which shows an example of the information table stored in a user information database. The figure which shows the relationship of each function of the audio video communication system which concerns on embodiment of this invention. The flowchart which shows operation | movement of the audio video communication system in the case of implement | achieving an operation state grasping | ascertaining function. The flowchart which shows operation | movement of the audio video communication system in the case of implement | achieving an interruption function (when accepting interruption). The flowchart which shows operation | movement of the audio video communication system in the case of implement | achieving an interruption function (when rejecting interruption). The flowchart which shows operation | movement of the audio video communication system in the case of implement | achieving a calling function.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 10 ... Internet, 11 ... User terminal, 12 ... User information storage management terminal, 13 ... Video / audio delivery management terminal, 111 ... Microphone, 112 ... Audio information input unit, 113 ... Audio encoding unit, 114 ... Video input camera, 115: Video input unit, 116: Video encoding unit, 210 ... User information generation unit, 211 ... Conversation information acquisition unit, 212 ... Conversation information storage unit, 213 ... Operation information acquisition unit, 214 ... Operation information storage unit, 215 ... Corresponding user registration unit, 216 ... partner user storage unit, 310 ... user information request unit, 411 ... speaker, 412 ... audio information output unit, 413 ... audio decoding unit, 414 ... video display screen, 415 ... video information output unit, 416 ... Video decoding unit, 510 ... Communication processing unit, 610 ... User information registration unit, 611 ... Conversation information storage unit, 612 ... Conversation information registration unit, 613 ... Operation Information storage unit, 614 ... operation information registration unit, 615 ... partner user storage unit, 616 ... partner user registration unit, 710 ... user information search unit, 711 ... user information search result storage unit, 712 ... user information database, 713 ... operation Information table 714 ... Conversation information table 715 User information table 810 Communication processing unit

Claims (8)

In an audio / video communication system that relays audio and video communication between a plurality of user terminals via a communication network,
Obtaining means for obtaining operation information including terminal identification information of each user terminal;
An audio / video communication system comprising: transmission means for transmitting operation information acquired by the acquisition means to any of the plurality of user terminals. The audio / video communication system according to claim 1,
The audio / video communication system, wherein the transmission means transmits the operation information acquired by the acquisition means to a user terminal designated in advance by a user terminal corresponding to terminal identification information included in the operation information. In the audio and video communication system according to claim 1 or 2,
The operation information further includes power on / off information of the user terminal, audio information transmitted from the user terminal, and operation status information indicating a status of an operation performed by the user terminal. The audio / video communication system according to any one of claims 1 to 3,
The operation information includes communication status information indicating whether or not the user terminal is communicating, and, if the user terminal is communicating, audio and video further including terminal identification information of the user terminal of the communication partner Communications system. The audio / video communication system according to any one of claims 1 to 4,
Participation request receiving means for receiving participation request information transmitted from a user terminal that wishes to participate in communication between the plurality of user terminals,
When the participation request information is received by the participation request receiving means, the transmission means is requested to participate in the terminal identification information of the user terminal that is the transmission source of the participation request information and the participation request information. An audio / video communication system that transmits to the plurality of user terminals that are performing communication and transmits operation information of the plurality of user terminals to the user terminal that is the transmission source. The audio / video communication system according to claim 5,
In response to participation request information transmitted by the transmission means, when participation permission information is transmitted from each user terminal performing communication desired to participate, the first member receives the participation permission information. Means for receiving participation consent information,
When the participation consent information is received by the first participation permission information receiving means, the user terminal that is the transmission source of the participation request information to the communication performed between the user terminals that transmitted the participation permission information And an audio / video communication system further comprising first communication participation permission means for permitting participation. The audio / video communication system according to any one of claims 1 to 6,
When the terminal identification number of the user terminal that wants to participate in the communication is transmitted from any of the user terminals participating in the communication, the transmission means is a user corresponding to the terminal identification number. Send the operation information of the terminal to each user terminal participating in the communication,
In response to the operation information transmitted by the transmission means, when participation consent information is transmitted from each user terminal participating in the communication, second participation permission information is received for receiving the participation permission information. Means,
When the participation consent information is received by the second consent information receiving means, the second user terminal is allowed to participate in the communication performed between the user terminals that transmitted the participation permission information. An audio / video communication system further comprising communication participation permission means. In the audio and video communication system according to claim 6 or 7,
The communication participation permitting means only participates in a new user terminal in this communication when the participation consent information receiving means receives participation permission information from all user terminals participating in the corresponding communication. An audio / video communication system that permits

Images