JP6152961B1 - Video conferencing equipment - Google Patents

Abstract

In a video conference apparatus, even when the number of bases is large, video data from each base is displayed in an easy-to-view manner for viewers. A communication control unit 103 receives video data and audio data from a plurality of conference terminal devices 10-2 to 24 at other bases. The video / audio synthesis unit 105 determines a screen layout and a plurality of video data to be displayed according to the number of bases participating in the video conference and the priority of each base, and a plurality of video data to be displayed according to the screen layout. To generate synthesized video data. At this time, the video / audio synthesizing unit 105 always displays the video data of all the bases having the first priority, and switches and displays the video data of some bases having the second priority lower than the first priority. To generate composite video data. The video / audio output control unit 106 displays the composite video data on the screen of the display device 500. [Selection] Figure 1

Description

  The present invention relates to a video conference apparatus that can be simultaneously connected to apparatuses installed in a plurality of bases.

  Video conferencing systems that can perform remote conferences by connecting a plurality of bases have become widespread. Patent Document 1 describes a video conference apparatus that simultaneously displays video data of three sites on a monitor screen.

JP 2012-231428 A

  In recent years, video conference apparatuses that can be connected simultaneously with many sites (for example, 24 sites) have been developed.

  If video data from each base is displayed in a region having the same area, the display area of each video data becomes small when the number of bases is large, resulting in a screen that is difficult for viewers to see.

  An object of the present invention is to provide a video conference apparatus that can display video data from each base in an easy-to-view manner even when the number of bases is large.

The video conference device of the present invention is a video conference device provided at a host site and connectable simultaneously with a video conference device at a plurality of other sites, and a video input unit that captures the host site and acquires video data; An audio input unit that collects audio from the host site and acquires audio data; a communication control unit that receives video data and audio data from the conference terminal devices at the plurality of other sites; and a video conference. A screen layout and a plurality of video data to be displayed are determined according to the number of bases participating and the priority of each base, and composite video data is generated by combining the plurality of video data to be displayed according to the screen layout. comprising a display control unit for displaying on the screen, said display control unit, the entire screen, smaller than the total number of bases participating in the video conference, and the first priority The set screen layout divided into many split screen than the total number of bases in the split screen, always to display the image data of all the bases of the first priority, and lower than the first priority The video data of some bases of the second priority are sequentially switched and displayed so that all the video data of all the bases of the second priority are displayed at a part of the predetermined time. .

  According to the present invention, even when the number of bases is large, video data from each base can be displayed in an easy-to-view manner for the viewer.

1 is a block diagram showing a configuration of a video conference apparatus according to Embodiment 1 of the present invention. State transition diagram showing state transition of the video conference apparatus according to Embodiment 1 of the present invention The flowchart which shows operation | movement of the video conference apparatus based on Embodiment 1 of this invention. The flowchart which shows the control operation of the screen layout of the video conference apparatus concerning Embodiment 1 of this invention The figure which shows an example of the screen layout of the synthetic | combination video data displayed on the screen of the video conference apparatus based on Embodiment 1 of this invention. The flowchart which shows the control operation of the screen layout of the video conference apparatus concerning Embodiment 2 of this invention The figure which shows an example of the screen layout of the synthetic | combination video data displayed on the screen of the video conference apparatus based on Embodiment 2 of this invention. The figure which shows an example of the screen layout of the synthetic | combination video data displayed on the screen of the video conference apparatus based on Embodiment 3 of this invention.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings as appropriate. In the following, a video conference system in which the number of sites that can be connected simultaneously is 24 will be described as an example.

(Embodiment 1)
In the first embodiment, a second priority lower than the first priority is present, where there is a first priority speech base where there is a participant who mainly speaks and a participant who does not speak and basically only listens. A case will be described in which the hearing base is fixed.

<Configuration and connection of video conference equipment>
First, the configuration and connection relationship of the video conference apparatus 10 according to Embodiment 1 of the present invention will be described in detail with reference to FIG.

  A video conference device 10 is installed at each base. The video conference apparatus 10-1 at the host site (multi-site connection device (MCU), site number 1) is connected to each video conference device 10-2 to 24 installed at each of the other sites (base numbers 2 to 24). And connected via the network 20 to transmit / receive audio data and video data. The network 20 is typically the Internet.

  The video conference device 10-1 includes a main device 100, a user operation input device 200, a video input device 300, an audio input device 400, and a display device 500.

  The main device 100 is connected to the user operation input device 200, the video input device 300, the audio input device 400, and the display device 500.

  The user operation input device 200 detects an operation of selecting a base by the user, and transmits a signal including selected base information indicating the selected base to the main body device 100 by wire or wireless. The user operation input device 200 is typically a remote control or a touch panel.

  The video input device 300 outputs video data obtained by photographing the location where the main device 100 is installed to the main device 100. The video data output from the video input device 300 includes video data saved by a PC, video data reproduced by a DVD player, and the like in addition to video data captured by a camera.

  The voice input device 400 outputs voice data and the like obtained by collecting the voice of the site where the main device 100 is installed to the main device 100. The audio data output from the audio input device 400 includes audio data collected by a microphone, video data stored in a PC and audio data set, video data reproduced by a DVD player, and audio data set. There are data.

  The display device 500 displays the video data output from the main device 100 on a screen and outputs the audio data output from the main device 100 from a speaker (not shown).

  The main device 100 includes a user instruction receiving unit 101, a conference control unit 102, a communication control unit 103, a video / audio encoding / decoding unit 104, a video / audio synthesis unit 105, and a video / audio output control unit 106. And a still image holding unit 107, a video input control unit 108, and an audio input control unit 109. The video / audio synthesis unit 105 and the video / audio output control unit 106 constitute a display control unit.

  The user instruction receiving unit 101 receives a signal transmitted from the user operation input device 200, extracts selected base information included in the received signal, and outputs it to the conference control unit 102. The selected base information includes an IP address (or ISDN number) of each base participating in the video conference and a flag indicating a priority (whether it is a speech base or a listening base).

  The conference control unit 102 receives data from the communication control unit 103, the video / audio encoding / decoding unit 104, and the video / audio synthesis unit 105 based on the selected base information input from the user instruction receiving unit 101. Control output timing. In addition, the conference control unit 102 outputs the selected base information input from the user instruction receiving unit 101 to the video / voice synthesis unit 105. In addition, the conference control unit 102 controls the transmission processing and call establishment processing in the communication control unit 103 based on the selected base information, and monitors whether video data has been received.

  The communication control unit 103 operates at a timing according to the control of the conference control unit 102. The communication control unit 103 establishes a call with the other video conference apparatuses 10-2 to 24-24. Then, after establishing the call, the communication control unit 103 receives the video data and audio data transmitted from the other video conference apparatuses 10-2 to 24 through the network 20, and receives the video / audio encoding / decoding unit. To 104. Also, after establishing the call, the communication control unit 103 transmits the video data and audio data input from the video / audio encoding / decoding unit 104 to the other video conference apparatuses 10-2 to 24 through the network 20. To do. The communication control unit 103 operates according to a predetermined communication protocol. The communication protocol is typically SIP or H.264. H.323.

  The video / audio encoding / decoding unit 104 operates at a timing according to the control of the conference control unit 102. The video / audio encoding / decoding unit 104 encodes the video data input from the video / audio synthesis unit 105 and the audio data input from the audio input control unit 109 and outputs the encoded data to the communication control unit 103. Also, the video / audio encoding / decoding unit 104 decodes video data and audio data from the other video conference apparatuses 10-2 to 24-24 input from the communication control unit 103 and outputs them to the video / audio synthesis unit 105. .

  The video / audio synthesis unit 105 operates at a timing according to the control of the conference control unit 102. The video / audio synthesizer 105 is based on the video data from the other video conference apparatuses 10-2 to 24-24 input from the video / audio encoding / decoding unit 104 and the video data input from the video input control unit 108. In accordance with the number of bases of the selected base information input from the conference control unit 102, composite video data obtained by combining a plurality of video data is generated and output to the video / audio output control unit 106. The video / audio synthesis unit 105 outputs the synthesized video data so that the still image held in the still image holding unit 107 is displayed until the video data is received from each of the video conference apparatuses 10-2 to 24-24. Generate.

  Also, the video / audio synthesis unit 105 synthesizes the audio data input from the video / audio encoding / decoding unit 104 and the audio data input from the audio input control unit 109 with the audio data input from the other video conference apparatuses 10-2 to 10-24. The synthesized voice data is generated and output to the video / audio output control unit 106. Further, the video / audio synthesis unit 105 outputs the video data input from the video input control unit 108 to the video / audio encoding / decoding unit 104.

  In addition, the video / audio synthesis unit 105 changes the screen layout of the synthesized video data according to the number of bases of the selected base information, the priority of each base, and the time measurement result of the built-in timer. A specific example of the layout change of the synthesized video data by the video / audio synthesizer 105 will be described later.

  The video / audio output control unit 106 displays the synthesized video data input from the video / audio synthesis unit 105 on the screen of the display device 500 and outputs the synthesized audio data from the speaker of the display device 500 as audio.

  The still image holding unit 107 holds in advance still image data for displaying a predetermined still image on the screen of the display device 500 during a period until video data is received from the other video conference apparatuses 10-2 to 10-24. ing.

  The video input control unit 108 outputs the video data input from the video input device 300 to the video / audio synthesis unit 105.

  The audio input control unit 109 outputs the audio data input from the audio input device 400 to the video / audio encoding / decoding unit 104 and the video / audio synthesis unit 105.

<Transition of video conferencing equipment connection status>
Next, the transition of the connection state of the video conference apparatus 10-1 will be described in detail with reference to FIG.

  The video conference apparatus 10-1 starts operating when the power is turned on. The video conference apparatus 10-1 is in a non-communication state immediately after being powered on (S1).

  In the non-communication state (S1), the video conference apparatus 10-1 is connected to the other video conference apparatus 10-i (i is an integer from 2 to 24), whereby the video conference apparatus 10-i. And a one-to-one communication state (1: 1 communication state) (S2). Then, in the 1: 1 communication state (S2), the video conference device 10-1 becomes a non-communication state when the connection with the video conference device 10-i in the communication state is disconnected (S1). In addition, the video conference apparatus 10-1 ends the operation when the power is turned off in the non-communication state (S1).

  In addition, the video conference apparatus 10-1 is further connected to another video conference apparatus 10-j (j is an integer from 2 to 24 other than i) from the 1: 1 communication state (S2). A communication state (MCU communication state) is established with the video conference apparatuses 10-i, j at a plurality of bases (S3).

  Then, the video conference apparatus 10-1 is in a one-to-one communication state when the connection with the video conference apparatus 10-j in communication is cut off (S2), and further, with the video conference apparatus 10-i in communication state If the connection is disconnected, the communication state is turned off (S1).

  In addition, the video conference apparatus 10-1 transmits all the other video conference apparatuses 10-2 to 24 at the same time in the non-communication state (S1), thereby transmitting all the other video conference apparatuses 10-2 to 10-2. 24 and a communication state (MCU communication state) (S3). And the video conference apparatus 10 will be in a non-communication state, if the connection with all the other video conference apparatuses 10-2-24 is cut | disconnected all at once (S1).

  As a method of transmitting all at once, a method in which a user manually inputs a destination to the video conference device 10-1 at the time of outgoing or a plurality of destination information stored in advance in the video conference device 10-1 is registered. A method of allowing the user to select a list can be considered. Further, as a method for specifying the destination, an IP address, a telephone number, an identification code, or the like can be considered.

<Operation of video conference device>
Next, operation | movement of the video conference apparatus 10-1 is demonstrated in detail using FIG. FIG. 3 is a flow in the case where the video conference apparatus 10-1 transmits all other video conference apparatuses 10-2 to 24 all at once.

  First, the user instruction receiving unit 101 receives a signal from the user operation input device 200, extracts selected base information included in the received signal, and outputs it to the conference control unit 102.

  The conference control unit 102 performs communication control so that simultaneous transmission is performed to the video conference apparatuses 10-2 to 24 installed in each of the N locations (N is an integer of 1 or more, N = 23 in FIG. 3) of the selected location information. The unit 103 is controlled. Thereby, the communication control part 103 performs simultaneous transmission to the video conference apparatuses 10-2-24 of a selection base (S11). Specifically, when the selected base information is information of one list in which a plurality of destination information is recorded, the conference control unit 102 determines the number of bases based on the number of destinations of the destination information registered in the list. N can be recognized.

  In addition, the video / sound synthesis unit 105 generates a screen layout (hereinafter referred to as “initial screen layout”) having (N + 1) or more divided areas based on the number of bases of the selected base information input from the conference control unit 102. Determine (S12). Note that one of the bases is associated with each divided region.

  In addition, the communication control unit 103 establishes a call with each of the video conference apparatuses 10-2 to 24 at other bases (S13).

  Next, the video / audio synthesizing unit 105 displays the video data of the video conference device 10-1 input from the video input control unit 108 and the video data of the other video conference devices 10-2 to 10-24 as initial screens. Composite video data (hereinafter referred to as “initial composite video data”) is generated so as to be displayed in the corresponding divided area of the layout. Then, the video / audio output control unit 106 displays the initial synthesized video data input from the video / audio synthesis unit 105 on the screen of the display device 500 (S14) (see FIG. 5A). Note that still image data is displayed in the corresponding divided areas until video data is received from the other video conference apparatuses 10-2 to 10-24.

  After receiving the video data from all the other video conference apparatuses 10-2 to 24 (S15: YES), the video / audio synthesizing unit 105 creates new synthesized video data (hereinafter referred to as a screen layout different from the initial synthesized video data). , “Updated composite video data”). Then, the video / audio output control unit 106 displays the updated synthesized video data input from the video / audio synthesis unit 105 on the screen of the display device 500 (S16). The updated composite video data is video data laid out so that the video data of the video conference apparatuses 10 at all the speech bases and the video data of some of the listening bases are displayed (see FIG. 5B).

  After that, the video conference apparatus 10-1 performs a process of controlling the screen layout of the updated synthesized video data in the video / audio synthesis unit 105 and the video / audio output control unit 106 while the bidirectional communication is continued. (S17).

  Details of the screen layout control operation (S17) of the updated composite video data will be described below with reference to FIG.

  First, the video / audio synthesis unit 105 starts a timer (S21).

  When the timer has expired (the predetermined time T has been counted) (S22: YES), the screen layout of the updated composite video data is changed (see FIGS. 5C, 5D, and 5E). Then, the video / audio output control unit 106 displays the new updated synthesized video data input from the video / audio synthesis unit 105 on the screen of the display device 500 (S23).

  In addition, the video / audio synthesizer 105 restarts the timer (S24). Thereafter, the flow returns to S22.

  The layout is not changed until the timer expires (S22: NO).

<Specific example of layout change>
Next, a specific example of the layout change of the synthesized video data by the video / audio synthesis unit 105 will be described in detail with reference to FIG. In FIG. 5, the numbers written in each area in the screen correspond to the base numbers. For example, video data captured by the video conference apparatus 10-1 with the site number 1 is displayed in the area marked “1”.

  FIG. 5A shows an example of initial synthesized video data. FIGS. 5B, 5C, 5D, and 5E show examples of updated composite video data, respectively.

  The video conference device 10-1 performs initial transmission based on the selected base information, and then displays the initial synthesized video data on the screen of the display device 500 (S14 in FIG. 3). As shown in FIG. 5A, the initial composite video data is video data (or still images) corresponding to each divided area equally divided into (N + 1) or more (25 in FIG. 5A). Image data) is displayed.

  The video conference apparatus 10-1 displays the updated composite video data on the screen of the display device 500 (S16 in FIG. 3) after the calls with all the bases are established (S15 in FIG. 3: YES). As shown in FIG. 5 (b), the updated composite video data is stored in the first area (thick line frame in FIG. 5 (b)) in all the speech bases (base numbers 1, 2, 3, 4) is displayed, and in a second area other than the first area, a predetermined number q (q = 5 in FIG. 5B) of listening sites (in FIG. 5B, site numbers 5, 6, 7, 8, 9) is displayed so that the video data is displayed.

  Then, when a predetermined time T has elapsed after the display of the updated composite video data in FIG. 5B is started (S22: YES in FIG. 4), the video conference apparatus 10-1 in FIG. As shown, the video data of the hearing base in the second area is switched while the display state of the first area is maintained, and the other listening bases (the base numbers 10, 11, 12, 13 in FIG. 5C) are switched to the second area. 14), the screen layout of the updated composite video data is changed so that the video data is displayed (S23 in FIG. 4).

  Thereafter, every time the predetermined time T elapses, the video conference device 10-1 updates the composite video data so as to switch the video data of the listening base in the second area, as shown in FIGS. 5 (d) and 5 (e). Change the screen layout.

  Furthermore, when a predetermined time T has elapsed since the display of the updated composite video data in FIG. 5 (e) has started, the video conference device 10-1 again displays the updated composite video as shown in FIG. 5 (b). Change the screen layout of the data.

  As a result, the video data of all the listening bases are displayed on the screen for a certain time. Note that the video data of all the speech bases are always displayed on the screen.

  Further, as is clear from the comparison between FIG. 5A and FIG. 5B, the updated composite video data that displays only the video data of some bases displays the video data of all bases. The display area of each video data can be made larger than the initial synthesized video data.

<Effect>
As described above, in this embodiment, the screen layout is controlled so that the video data of all the speech bases are always displayed and the video data of some of the listening bases are sequentially switched and displayed. As a result, the video data of all the speech bases can always be displayed on the screen, and the video data of all the hearing bases can be displayed on the screen for a certain period of time. And since the display area of each video data can be enlarged compared to the case where video data of all bases is displayed, even when there are many bases, video data from each base is displayed in an easy-to-view manner for viewers. be able to.

(Embodiment 2)
In the second embodiment, a case will be described in which the speech bases are not fixed and all the bases can be speech bases.

<Configuration and connection of video conference equipment>
Since the configuration and connection relationship of the video conference apparatus 10 of the present embodiment are the same as those shown in FIG. 1 described in the first embodiment, description thereof is omitted. However, the following functions are added to the video / audio encoding / decoding unit 104 and the video / audio synthesis unit 105.

  The video / audio encoding / decoding unit 104 detects the level of audio data of each video conference device 10-1 to 24 (level detection unit). Then, the video / audio encoding / decoding unit 104 outputs the detection result to the video / audio synthesis unit 105.

  The video / speech synthesizer 105 determines the priority of each site (whether it is a speech site or a listening site) according to the level of the audio data.

<Operation of video conference device>
Since the entire operation of the video conference apparatus 10-1 of the present embodiment is the same as that shown in FIG. 3 described in the first embodiment, description thereof is omitted. The present embodiment is different from the first embodiment only in the screen layout control operation (S17) of the updated composite video data.

  Details of the screen layout control operation (S17) of the updated composite video data in the video conference apparatus 10-1 of the present embodiment will be described below with reference to FIG.

  First, the video / audio synthesizer 105 starts a main timer (S31).

  If the main timer has expired (the predetermined time T1 has been counted) (S32: YES), the screen layout of the updated composite video data is changed so as to switch the video data at the listening base in the second area. Then, the video / audio output control unit 106 displays the new updated synthesized video data input from the video / audio synthesis unit 105 on the screen of the display device 500 (S33).

  In addition, the video / audio synthesizer 105 restarts the timer (S34). Thereafter, the flow returns to S32.

  At the timing when the main timer has not expired (S32: NO), the video / audio encoding / decoding unit 104 detects the level of the audio data of each of the video conference apparatuses 10-1 to 24 and displays the detection result as the video. Output to the speech synthesizer 105 (S35).

  The video / speech synthesizer 105 recognizes that the level of the voice data is equal to or higher than the threshold among the video conference apparatuses 10-1 to 24 as the speech base, and recognizes the other as the hearing base. Then, the video / speech synthesizer 105 determines whether or not a new speech base has occurred (S36).

  When a new speech base is generated (S36: YES), the video / voice synthesis unit 105 starts an individual timer for the speech base (S37). In addition, the video / audio synthesis unit 105 changes the screen layout of the updated synthesized video data so that the video data of the speech base is displayed in the first area. Then, the video / audio output control unit 106 displays the new updated synthesized video data input from the video / audio synthesis unit 105 on the screen of the display device 500 (S38). Thereafter, the flow returns to S32.

  On the other hand, when a new speech base has not occurred (S36: NO), the video / speech synthesizer 105 determines whether or not a participant at an existing speech base has made a new speech (S39).

  When a participant at an existing speech base makes a new speech (S39: YES), the video / speech synthesizer 105 restarts the individual timer (S40). Thereafter, the flow returns to S32.

  On the other hand, when the participant at the existing speech base does not make a new speech (S39: NO), the video / speech synthesizer 105 determines whether or not the individual timer has expired (the predetermined time T2 has been counted). (S41).

  When the individual timer expires (S41: YES), the video / audio synthesis unit 105 changes the screen layout of the updated synthesized video data so that the video data of the speech base is not displayed in the first area. Then, the video / audio output control unit 106 displays the new updated synthesized video data input from the video / audio synthesis unit 105 on the screen of the display device 500 (S38). Thereafter, the flow returns to S32.

  If the individual timer has not expired (S41: NO), the flow returns to S32.

<Specific example of layout change>
Next, a specific example of the layout change of the synthesized video data by the video / audio synthesis unit 105 will be described in detail with reference to FIG. In FIG. 7, the numbers written in each area in the screen correspond to the base numbers. For example, video data captured by the video conference apparatus 10-1 with the site number 1 is displayed in the area marked “1”.

  FIGS. 7A, 7B, 7C, 7D, 7E, and 7F show examples of updated composite video data, respectively.

  The video conference apparatus 10-1 displays the updated composite video data on the screen of the display device 500 (S16 in FIG. 3) after the calls with all the bases are established (S15 in FIG. 3: YES). As shown in FIG. 7A, the updated composite video data includes video data of all the speech bases (base number 1 in FIG. 7A) in the first area (thick line frame in FIG. 7A). Displayed in a second area other than the first area, a predetermined number q (q = 5 in FIG. 7A) of the listening bases (base numbers 2, 3, 4, 5, 6 in FIG. 7A) The video data is laid out to be displayed. At this time, the display area of the video data at the speech base may be laid out so as to be larger than the display area of the video data at the hearing base.

  Then, when a predetermined time T1 has elapsed since the start of the display of the updated composite video data in FIG. 7A (S32 in FIG. 6: YES), the video conference apparatus 10-1 changes to FIG. 7B. As shown, the video data of the listening base in the second region is switched while maintaining the display state of the first region, and the other listening bases (base numbers 7, 8, 9, 10 in FIG. 7B) are switched to the second region. 11), the screen layout of the updated composite video data is changed so that the video data is displayed (S33 in FIG. 6).

  Thereafter, when a new message base (site number 2) is generated before the predetermined time T1 has elapsed since the start of the display of the updated composite video data in FIG. 7B (S32: NO in FIG. 6) ( 6 (S36 in FIG. 6), the video conference apparatus 10-1 changes the screen layout of the updated composite video data so that the video data of the new speech base is added to the first area as shown in FIG. 7C. (S38 in FIG. 6). At this time, when the number of the divided areas of the second area increases or decreases, the number of listening bases that display the video data is increased or decreased accordingly. In the example of FIG. 7C, video data of base numbers 12, 13, and 14 are additionally displayed.

  Thereafter, the participant with the base number 2 makes a new remark (S39 in FIG. 6: YES), and before the predetermined time T2 has elapsed since the most recent remark, the updated composite video data display in FIG. 7C is displayed. When the predetermined time T1 has elapsed since the start of the operation (S32: YES in FIG. 6), the video conference apparatus 10-1 maintains the display state of the first area as shown in FIG. The video data of the two sites is switched, and the video data of the other sites (base numbers 15, 16, 17, 18, 19, 20, 21, 22 in FIG. 7D) are displayed in the second region. Thus, the screen layout of the updated composite video data is changed (S33 in FIG. 6).

  Thereafter, when the participant with the base number 2 does not make a new statement (S39: NO in FIG. 6) and the predetermined time T2 has passed since the latest statement (S41: YES in FIG. 6), the video conference apparatus 10-1 As shown in FIG. 7E, the screen layout of the updated composite video data is changed so that the video data of the speech base 2 is removed from the first area (S38 in FIG. 6).

  Thereafter, when the predetermined time T1 elapses, the video conference device 10-1 changes the screen layout of the updated composite video data so as to switch the video data of the listening base in the second area as shown in FIG. change.

  As a result, the video data of all the listening bases are displayed on the screen for a certain time. Note that the video data of all the speech bases are always displayed on the screen.

  In addition, the updated composite video data that displays only the video data of some sites can have a larger display area of each video data than the initial composite video data that displays the video data of all sites.

<Effect>
As described above, in this embodiment, the screen layout is controlled so that the video data of all the speech bases are always displayed and the video data of some of the listening bases are sequentially switched and displayed. Furthermore, in this embodiment, the base where the participant speaks is added to the speech base, the video data of the base is displayed, the base where the participant does not speak for a certain period of time from the latest speech is removed from the speech base, and the base The screen layout is controlled to stop the display of the video data. Thereby, even when the speech base is not fixed, the video data of all speech bases can be always displayed on the screen, and the video data of all the hearing bases can be displayed on the screen for a certain period of time. And since the display area of each video data can be enlarged compared to the case where video data of all bases is displayed, even when there are many bases, video data from each base is displayed in an easy-to-view manner for viewers. be able to.

(Embodiment 3)
In the third embodiment, a speech base where there is a participant who mainly speaks and a hearing base where there is a participant who does not speak basically and only listens are determined in advance. A case where a statement is sometimes made will be described.

<Configuration and connection of video conference equipment>
Since the configuration and connection relationship of the video conference apparatus 10 of the present embodiment are the same as those shown in FIG. 1 described in the first embodiment, description thereof is omitted. The additional functions of the video / audio encoding / decoding unit 104 and the video / audio synthesizing unit 105 are the same as those described in the second embodiment, and a description thereof will be omitted.

<Operation of video conference device>
Since the entire operation of the video conference apparatus 10-1 of the present embodiment is the same as that shown in FIG. 3 described in the first embodiment, description thereof is omitted. Further, the control operation (S17) of the screen layout of the updated composite video data in this embodiment is the same as that shown in FIG. 6 described in the second embodiment, and thus the description thereof is omitted.

<Specific example of layout change>
Next, a specific example of the layout change of the synthesized video data by the video / audio synthesizer 105 will be described in detail with reference to FIG. In FIG. 8, the numbers written in the respective areas in the screen correspond to the base numbers. For example, video data captured by the video conference apparatus 10-1 with the site number 1 is displayed in the area marked “1”.

  8 (a), (b), (c), (d), (e), and (f) each show an example of updated composite video data.

  8 (a) and 8 (b) are the same as FIGS. 7 (a) and 7 (b) described in the second embodiment, and a description thereof will be omitted.

  When a predetermined time T1 elapses after the start of the display of the updated composite video data in FIG. 8B (S32: NO in FIG. 6), the hearing base of the base number 2 makes a question or the like ( 6 (S36 in FIG. 6), the listening base with the base number 2 becomes a new speech base, and the video conference apparatus 10-1 is a part of the second area (FIG. 8B) as shown in FIG. The area where the video data of the site number 7 of () is displayed) is the first area, and the screen layout of the updated composite video data is changed so that the video data of the new speech base (base number 2) is added thereto ( S38 of FIG. 6).

  Thereafter, the participant with the base number 2 makes a new remark (S39 in FIG. 6: YES), and before the predetermined time T2 has elapsed since the most recent remark, the updated composite video data display in FIG. 7C is displayed. When the predetermined time T1 has elapsed since the start of the operation (S32: YES in FIG. 6), the video conference apparatus 10-1 maintains the display state of the first area as shown in FIG. 8D. The video data of the two listening areas is switched, and the video data of the other listening bases (the base numbers 12, 13, 14, and 15 in FIG. 8D) are displayed in the second area. The screen layout is changed (S33 in FIG. 6).

  Thereafter, when the participant with the base number 2 does not make a new statement (S39: NO in FIG. 6) and the predetermined time T2 has passed since the latest statement (S41: YES in FIG. 6), the video conference apparatus 10-1 Removes the video data of the speech base 2 from the first area (S38 in FIG. 6).

  After that, when the predetermined time T1 has elapsed, the video conference apparatus 10-1 changes the screen layout of the updated composite video data so as to switch the video data of the listening base in the second area as shown in FIG. 8 (e). change.

  After that, when the predetermined time T1 further elapses, the video conference apparatus 10-1 displays the screen layout of the updated composite video data so as to switch the video data of the listening base in the second area as shown in FIG. 8 (f). To change.

  As a result, the video data of all the listening bases are displayed on the screen for a certain time. Note that the video data of all the speech bases are always displayed on the screen.

  In addition, the updated composite video data that displays only the video data of some sites can have a larger display area of each video data than the initial composite video data that displays the video data of all sites.

<Effect>
As described above, in this embodiment, the screen layout is controlled so that the video data of all the speech bases are always displayed and the video data of some of the listening bases are sequentially switched and displayed. Furthermore, in this embodiment, the base where the participant speaks is added to the speech base, the video data of the base is displayed, the base where the participant does not speak for a certain period of time from the latest speech is removed from the speech base, and the base The screen layout is controlled to stop the display of the video data. Thereby, even when the speech base is not fixed, the video data of all speech bases can be always displayed on the screen, and the video data of all the hearing bases can be displayed on the screen for a certain period of time. And since the display area of each video data can be enlarged compared to the case where video data of all bases is displayed, even when there are many bases, video data from each base is displayed in an easy-to-view manner for viewers. be able to.

  The present invention is not limited to the above-described embodiments in terms of the type, arrangement, number, etc. of the members, and departs from the gist of the invention, such as appropriately replacing the constituent elements with those having the same operational effects. It is possible to change appropriately within the range not to be.

  Specifically, in the above embodiment, the case where a still image is displayed before displaying a video has been described, but the present invention is not limited thereto, and character information such as a message other than a still image is displayed. Alternatively, the black screen may be left as it is.

  In the above embodiment, the video conference system in which the number of sites that can be connected simultaneously is 24 has been described as an example. However, the present invention has no limitation on the number of sites that can be connected simultaneously.

  In the present invention, display video data and transmission video data can be generated separately according to user settings. For example, the video data output from the video input control unit 108 can be used as display video data, and the video data synthesized by the video / audio synthesis unit 105 can be used as transmission video data.

  The present invention is suitable for use in a video conference apparatus that is provided at a host site and can be connected simultaneously with counterpart devices at a plurality of sites different from the host site.

DESCRIPTION OF SYMBOLS 10 Video conference apparatus 100 Main body apparatus 101 User instruction | indication receiving part 102 Conference control part 103 Communication control part 104 Video | voice / audio encoding / decoding part 105 Video | voice / synthesizer 106 Video | voice / audio output control part 107 Still image holding part 108 Video input Control unit 109 Audio input control unit 200 User operation input device 300 Video input device 400 Audio input device 500 Display device

Claims (4)

A video conference device provided at a host site and connectable simultaneously with a video conference device at a plurality of other sites,
A video input unit that captures the host site and obtains video data;
A voice input unit that collects voice of the host site and acquires voice data;
A communication control unit that receives each video data and audio data from the conference terminal device at the plurality of other sites,
A screen layout and a plurality of video data to be displayed are determined according to the number of bases participating in the video conference and the priority of each base, and composite video data obtained by combining the plurality of video data to be displayed according to the screen layout A display control unit for generating and displaying on the screen;
Comprising
The display control unit
Setting a screen layout that divides the entire screen into divided screens that are smaller than the total number of sites participating in the video conference and larger than the total number of sites of the first priority ,
The split screen, always to display the image data of all the bases of the first priority, and the image data of a portion of the base of the second priority lower than the first priority, the second priority In order to display all of the video data of all the bases at a part of the predetermined time, it is sequentially switched and displayed.
Video conferencing equipment. The display control unit
Displaying video data of some other bases of the second priority when a predetermined first time has elapsed since displaying the video data of some bases of the second priority.
The video conference apparatus according to claim 1. A level detector for detecting the level of the audio data;
The display control unit
A site where the level of the audio data is equal to or higher than a threshold is recognized as the first priority site.
The video conference apparatus according to claim 1 or 2. The display control unit
If the first priority base does not detect voice data at a level equal to or higher than the threshold at a predetermined second time, the base is recognized as the second priority base.
The video conference apparatus according to claim 3.

Images