KR101427278B1 - Video conference server and video conference terminal and video conference method using the same - Google Patents

Abstract

A video conference server, a terminal, and a video conference method using the same according to the present invention include: a data generator for processing a plurality of video and audio data to generate a single video and a single audio data; A command processing unit for generating a first image selection message based on a first control signal corresponding to a first image and first voice data included in the plurality of image and voice data; And a control unit for selecting either one of the plurality of image data and the generated single image data based on the generated first image selection message and outputting the selected image data and the generated single sound data A plurality of video and audio data are processed in a predetermined manner and output to a plurality of terminals connected to the video conferencing server as a single video and a single voice data to reduce waste of bandwidth, So that the performance of the conference system can be improved.

Video conference, video conference server, video conference terminal, video conference system

Description

TECHNICAL FIELD [0001] The present invention relates to a video conferencing server, a terminal, and a video conferencing method using the video conferencing server,

The present invention relates to a video conferencing server, a terminal, and a video conferencing method using the same, and more particularly, to a video conferencing server, a terminal, and a video conferencing method using the video conferencing server, The present invention relates to a video conference server and a terminal for outputting selected image data and the generated single voice data according to whether or not a DTMF signal included in the plurality of voice data is detected among data and single picture data, will be.

2. Description of the Related Art Generally, a video conference system receives a picture and voice input from a plurality of terminals through a gateway or the like and retransmits or relays the input picture and voice to different terminals, so that each user using the plurality of terminals Way communication system that exchanges information with each other while looking at the two-way communication system.

The video conference system and the video conference method according to the related art require additional software for the multiple access management and the data retransmission which are variable in all or part of the functional operation in some or all of the terminals in order for each terminal to share picture / , So the function of each terminal should be added accordingly.

In addition, each terminal according to the prior art is connected using a packet data based service such as the Internet, and the packet data based service has a higher cost than the circuit based service.

Further, in the case of using packet data based service according to the related art, as the number of users participating in video conferencing increases, the network bandwidth required for transmission of video / audio data increases in proportion to a bandwidth used for video conferencing .

It is an object of the present invention to provide a video conferencing server, a terminal, and a video conferencing method using the circuit-based service to provide a single video and a single voice data to a plurality of terminals connected to the video conferencing server.

It is another object of the present invention to provide an image processing apparatus and a method for processing image and sound data input from a plurality of terminals, The present invention provides a video conferencing server and a terminal that provide selected image data and the generated single voice data to the plurality of terminals, respectively, according to whether or not a DTMF signal included in voice data of the terminal is detected, and a video conferencing method using the same .

According to an aspect of the present invention, there is provided a video conferencing server comprising: a data generating unit for processing a plurality of video and audio data to generate a single video and a single audio data; A command processing unit for generating a first image selection message based on a first control signal corresponding to a first image and first voice data included in the plurality of image and voice data; And a controller for selecting one of the plurality of image data and the generated single image data based on the generated first image selection message and outputting the selected image data and the generated single voice data .

In order to achieve the above-mentioned objects, a video conference terminal according to the present invention includes a plurality of video conference terminals connected to a video conference server, To a transmitting unit; A receiving unit for receiving a predetermined processed and output image and single voice data from the video conference server; And an output unit for outputting the received image and single voice data.

According to another aspect of the present invention, there is provided a video conferencing method comprising: a first step of processing a plurality of video and audio data to generate a single video and a single audio data; A second step of generating a first image selection message based on a first control signal corresponding to a first image and first voice data included in the plurality of image and voice data; A third step of selecting one of the plurality of image data and the generated single image data based on the generated first image selection message; And outputting the selected image data and the generated single voice data.

In order to accomplish the above objects, a video conference method according to the present invention is a video conference terminal connected to a video conferencing server, the method comprising: inputting a first image and first audio data and a first control signal, To a first step; A second step of receiving an image and a single voice data that have been processed and output the first image and the first voice data transmitted by the video conference server; And a third step of outputting the received image and single voice data.

According to another aspect of the present invention, there is provided a video conferencing method comprising the steps of: receiving image and audio data and a control signal transmitted from a plurality of terminals; A second processing unit for performing predetermined processing on the received plurality of image and voice data to generate a single image and single voice data and transmitting selected image data based on the plurality of control signals and the generated single voice data to the corresponding terminal, / RTI >

A video conference server, a terminal, and a video conference method using the video conference server according to an embodiment of the present invention provide a single image and a single voice data using a circuit data based service to a plurality of terminals connected to a video conference server, It is possible to realize a low-cost video conferencing system.

In addition, the video conferencing server, the terminal, and the video conferencing method using the video conferencing server according to the embodiment of the present invention convert image and voice data input from a plurality of terminals into a single image and single voice data of a predetermined single standard, A single image and a single voice data are provided to each of the plurality of terminals, thereby effectively utilizing the bandwidth.

In addition, the video conferencing server, the terminal, and the video conferencing method using the video conferencing server according to the embodiment of the present invention convert image and voice data input from a plurality of terminals into a single image and single voice data of a predetermined single standard, It is unnecessary to add software for variable access management and data retransmission in order to realize video conferencing for each terminal by providing a single picture and single voice data to each of the plurality of terminals, There is an effect that can be done.

Hereinafter, preferred embodiments of a video conferencing server, a terminal, and a video conferencing method using the same will be described in detail with reference to Figs. 1 to 9. Fig.

FIG. 1 is a block diagram showing a video conferencing server 100 according to a first embodiment of the present invention. As shown in FIG. 1, a plurality of video and audio data are subjected to predetermined processing to generate a single image and single voice data An instruction processing unit (120) for generating a first image selection message based on a first control signal corresponding to a first image and first voice data included in the plurality of image and voice data, A controller 130 for selecting one of the plurality of image data and the generated single image data based on the generated first image selection message and outputting the selected image data and the generated single voice data, And an output unit 140 for outputting the selected image data output by the control unit 130 and the generated single voice data.

2, the data generation unit 110 includes an image decoding unit 111 that decodes the plurality of image data, and a scaling unit that scales the decoded plurality of image data to a predetermined resolution An image scaling unit 112 for generating a plurality of scaled image data and a plurality of divided image data of the plurality of divided image data, An image data generation unit (113) for generating a single picture data by encoding a picture, a speech decoding unit (114) for decoding the plurality of speech data, And an audio data generation unit 115 for generating data.

The image decoding unit 111 decodes the image data according to the standard according to a codec (CODEC) which is a formatted standard of the plurality of image data.

The image scaling unit 112 scales a plurality of image data decoded by the image decoding unit 121 with a resolution of a predetermined standard.

In addition, the image scaling unit 112 scales the decoded plurality of image data according to the number of the plurality of image data in one of a plurality of predefined specifications or resolutions.

In addition, the image scaling unit 112 may scale the decoded plurality of image data according to the number of the plurality of image data by an arbitrary standard (horizontal × vertical) predetermined by the user or at an arbitrary resolution have. Here, scaling the decoded plurality of image data is to reduce or enlarge the decoded plurality of image data to the size (horizontal × vertical) or arbitrary resolution of arbitrary image data.

The image data generation unit 113 sets the predetermined unique image number (for example, set to "0") or the arbitrary (random method) unique image number for the generated single image data do.

Further, the image data generation unit 113 may generate the single image screen of the predetermined size based on the number of the plurality of image data or the number of screen divisions preset by the user, And allocates the plurality of scaled image data to the plurality of divided screens, respectively, to form one full screen. Further, the image data generation unit 113 generates a single image data by encoding a single image screen composed of the one full screen.

3 (a) to 3 (f), the single image screen 181 is divided into a single image screen 181 (FIG. 3) according to the number of the plurality of image data or the number of screen divisions preset by the user (Fig. 3 (a)) in which the single image screen 181 is divided into upper and lower portions, a two-divided screen (Fig. 3 (b) (Not shown), a quad screen (not shown), a quad screen (not shown), a quad screen (Fig. 3 (d) In Picture) screen (FIG. 3 (f)).

In addition to the above-mentioned configuration, the plurality of divided screens may be configured in various forms by a designer.

In addition, the predetermined standard may be a common intermediate format (CIF), a quarter common intermediate format (QCIF), a quad quarter common intermediate format (QQCIF), a video graphics array (VGA), a quarter video graphics array (QVGA) Quadruple Extended Graphics Array (QGAGA), Quadruple Extended Graphics Array (QXGA), Quadrature Extended Graphics Array (QXGA), Quadrature Extended Graphics Array ), UXGA (Ultra Extended Graphics Array), and UWXGA (Ultra Wide Extended Graphics Array).

The voice data generating unit 115 mixes a plurality of voice data decoded by the voice decoding unit 114 to generate a single voice data.

When there is voice data including a DTMF signal among the plurality of voice data, the voice data generation unit 115 removes the corresponding DTMF signal by a predetermined signal processing, and when the DTMF signal is removed Mixes the voice data with the other voice data to generate a single voice data, or mixes the voice data (original voice data in which the DTMF signal is not removed) containing the DTMF signal with the other voice data, As shown in FIG.

That is, the single voice data generated by mixing the plurality of voice data may be configured to include a DTMF signal, or the corresponding DTMF signal may be removed.

The command processing unit 120 may generate a first control signal based on the first control signal including information on a unique image number set in each of the plurality of image data and the single image data, To generate a first image selection message. At this time, the first control signal includes a dual tone multi-frequency (DTMF) signal included in the received voice data.

In addition, the command processing unit 120 generates a plurality of image selection messages each including information on a unique image number included in each of the plurality of control signals including the first control signal.

In addition, the command processing unit 120 detects the presence or absence of a DTMF signal included in the plurality of voice data. At this time, the command processing unit 120 detects the presence or absence of the DTMF signal for each of the plurality of voice data. That is, when the first to N-th voice data are included in the plurality of voice data, the presence or absence of the DTMF signal is detected for each of the first voice data to the N-th voice data.

In addition, when a DTMF signal is detected among a plurality of pieces of voice data, the command processing unit 120 filters the frequency component of the detected DTMF signal and outputs digit information or digits corresponding to the DTMF signal, ("*" Or "#").

In addition, the command processing unit 120 generates an image selection message including unique image number information corresponding to the DTMF signal, based on the numerical information according to the DTMF signal. At this time, the unique image number information corresponding to the DTMF signal is information corresponding to the numeric information according to the DTMF signal.

In addition, the command processing unit 120 may include an image selection message including numeric information other than special characters among the information obtained by combining the numbers and special characters based on information obtained by combining numbers and special characters according to the DTMF signal, .

For example, the command processing unit 120 may be configured to select one of a plurality of voice data (Voice Data 1 (hereinafter referred to as 'VD 1') to Voice Data N (hereinafter referred to as 'VD N' When the DTMF signal is detected in the first voice data VD1 and the third voice data VD3, the frequency components are filtered for the first voice data VD1 and the third voice data VD3, , And obtains information corresponding to the DTMF signal or a combination of digits and special characters ("*" or "#"). Further, the DTMF signal of the first voice data VD 1 includes the numeric information "3", and the DTMF signal of the third voice data VD 3 contains the information "5 #" , The command processing unit 120 generates a first picture selection message including information corresponding to the numeric information "3 " for the first speech data VD 1. Further, the command processing unit 120 includes information corresponding to the number "5" excluding the special character among the information "5 #" of the combination of the number and the special character with respect to the third voice data VD 3 Lt; / RTI >

In addition, when no DTMF signal is detected among the plurality of audio data, the command processing unit 120 may select an image including unique image number information corresponding to a default stored value (or numerical information) Message.

For example, if the DTMF signal is not detected from the second audio data (VD 2) among the plurality of audio data (VD 1 to VD N), the command processing unit 120 corresponds to the preset numeric information "0" A second image selection message including information to be used for the second image selection.

The control unit 130 selects one of the generated single image data and the plurality of image data based on the generated plurality of image selection messages.

At this time, the image selection message corresponds to the unique image number information included in the plurality of image data set by the controller 130 or the single image data, respectively.

In addition, the setting of the unique image number for the plurality of image data and the predetermined unique image number setting for the generated single image data are performed by the control unit 130 so that the image conference server 100 can receive arbitrary image data If it is input or exists, a unique image number is set for each of the image data. In addition, a unique image number set in advance by the control unit 130 is set for the single image data generated by the image data generation unit 113 as well.

Also, the control unit 130 selects image data having a unique image number corresponding to each of the generated plurality of image selection messages, from among the plurality of image data and the single image data.

For example, it is possible to set a unique image number from "1" to "N" sequentially for the plurality of image data, to set a unique image number of "0" in the generated single image data, When the message corresponds to the numerical information "3 ", the control unit 130 selects, from among the single image data and the plurality of image data, the unique image number corresponding to the numeric information" 3 & And selects image data having information. That is, image data having a unique image number "3" is selected from among the plurality of image data.

In another example, a unique image number from "1" to "N" is sequentially set for the plurality of image data, a unique image number of "0" is set for the generated single image data, When the second image selection message includes numeric information "0 ", for the second image selection message including the numeric information" 0 ", the control unit 130 determines that the single image data and the plurality of image data , The single image data having the unique image number corresponding to the numeric information "0 " is selected. That is, the single image data whose unique image number is "0 " is selected.

The output unit 140 includes a display device such as a display and a speaker, and outputs the selected image data output by the control unit 130 and the generated single voice data. The output image data and the single audio data are data in which synchronization is established between the image data and the audio data under the control of the data generation unit 110 or the control unit 130. [

4 is a block diagram illustrating a video conferencing terminal according to a second embodiment of the present invention.

4, the video conferencing terminal 200 according to the second embodiment of the present invention includes an input unit 210 including a camera and / or a microphone The control unit 220 performs predetermined processing on the first image and the first audio data input through the input unit 210 and / or the first control signal input through the input unit 210, A receiving unit 240 receiving the image and the single voice data output from the video conferencing server 100 in a predetermined process and outputting the data and / or the first control signal to the video conferencing server 100; A control unit 220 for performing predetermined processing on the received image and single voice data, and an output unit 250 for outputting the image and single voice data output by the control unit 220. [

The input unit 210 includes a camera or a microphone, and receives the first image and / or the first audio data through the camera or the microphone.

In addition, the input unit 210 receives a first control signal by input means such as a microphone, a keyboard, a keypad, and a touch screen.

The first control signal includes a DTMF signal input through the microphone.

The first control signal may be a unique image number for selecting any one of a plurality of images input from a plurality of terminals participating in a video conference and a single image data generated by the video conferencing server 100 .

The control unit 220 processes the first image and the first audio data and / or the first control signal input by the input unit 210 in accordance with a codec used in the terminal 200.

The transmitting unit 230 transmits the first image and the first audio data and / or the first signal processed by the control unit 220 to the outside (including the video conferencing server 100).

The operation configuration for the video conferencing server 100 is specifically described in the first embodiment of the present invention.

In addition, the video conferencing server 100 transmits the first picture and the first voice data transmitted by the transmitting unit 230, the image data and the single voice data using the first control signal, To the receiving unit (240) of the terminal (200).

The receiving unit 240 receives the image data transmitted from the video conferencing server 100 and the single voice data.

The image data received by the receiving unit 240 is image data corresponding to the unique image number included in the first control signal.

The control unit 220 processes the image and the single voice data received by the receiving unit 240 according to a codec (or a predetermined standard) used in the terminal 200 and outputs the processed image.

The output unit 250 includes a display device and / or a speaker, and outputs a single processed image and a single voice data output by the control unit 220.

The image data output by the output unit 250 may be image data for one participant participating in the video conference or single image data generated by the video conferencing server 100 , Figs. 3A to 3F).

If the image data output by the output unit 250 is image data for one arbitrary participant participating in the video conference, the user information (user name or nickname) 183 for the participant and the voice data And outputs detection result 184. That is, in the case of image data for a specific participant among a plurality of attendees participating in a video conference, the user information 183 for the participant and the voice data sending / leaving state 184 of the participant are output.

When the image data output by the output unit 250 is single image data generated by the video conferencing server 100, the image data 182 of a plurality of participants in the single image screen 181, (183) and voice data detection flag (184) for each participant on each side of the image data (182).

The terminal 200 includes a video conferencing terminal, a portable terminal, a personal digital assistant (PDA), a notebook computer, a WiBro terminal, an Internet Protocol Television (IPTV) terminal, and a telematics terminal do.

According to this configuration, the terminal 200 does not need any additional software for implementing the video conference system by performing predetermined processing on the image and voice data input from the plurality of terminals.

5 is a block diagram illustrating a video conferencing system according to a third embodiment of the present invention.

5, the video conferencing system 900 according to the third embodiment of the present invention includes a plurality of terminals 201, 202, ..., 20N (not shown) for transmitting video and audio data and control signals for respective terminals ), A plurality of image and voice data transmitted from the plurality of terminals (201, 202, ..., 20N) are subjected to predetermined processing to generate a single image and single voice data, and generated And a video conference server (100) for transmitting the selected image data and the generated single voice data to a corresponding terminal corresponding to the plurality of voice data, based on the plurality of image selection messages.

The plurality of terminals 201, 202, ..., 20N include the technical features described in the configuration of the videoconference terminal 200 of FIG.

Each of the terminals 201, 202, ..., 20N includes a display device, a camera, a microphone, a speaker, and the like, and stores image and audio data input by the cameras and microphones To the video conferencing server 100 via a wired and / or wireless communication network.

The plurality of terminals 201, 202, ..., 20N transmit and receive image and / or voice data and control signals to and from the video conferencing server 100 according to a predetermined communication protocol.

In addition, the plurality of terminals 201, 202, ..., 20N connected to the video conferencing system 900 may be terminals using the same protocol or terminals using a heterogeneous protocol .

The plurality of terminals 201, 202, ..., and 20N and the video conferencing server 100 connected to the video conferencing system 900 are connected to the video conference server 100 through the ITU Telecommunication Standardization Sector (ITU- It is designed to follow the recommendation, and videoconferencing is possible regardless of the terminal type.

The video conferencing server 100 is configured by further adding the following components to the components described in the first embodiment of the present invention.

5, the video conferencing server 100 includes a data generating unit 110, a command processing unit 120, a control unit 130, and an output unit 140, A receiving unit 150 for receiving a plurality of images (or images) and audio data transmitted from the image processing apparatuses 201, 202, ..., 20N; A transmission unit 160 for transmitting the generated single voice data to at least one of the plurality of terminals 201, 202, ..., 20N, And a storage unit 170 for storing the generated single image and single voice data.

The receiving unit 150 identifies each of the protocols used by the plurality of terminals 201, 202, ..., and 20N, and transmits the plurality of (Image and / or voice data) and control signals transmitted from the terminals 201, 202, ..., 20N of the mobile station.

At this time, the control signal includes image number information for selecting an arbitrary image or an arbitrary image number. That is, the control signal includes information corresponding to a unique image number set in each of the plurality of image data and the generated single image data or a unique image number set in advance.

The receiving unit 150 randomly sets a unique image number for each of the plurality of received image data. That is, a unique image number is assigned to each image data. That is, setting of the unique image number in the plurality of image data can be performed by the receiving unit 150 or the control unit 130.

The transmission unit 160 transmits the selected image data and the generated single voice data outputted under the control of the controller 130 to at least one of the plurality of terminals 201, Lt; / RTI >

The transmission unit 160 performs predetermined processing on the image data and single voice data according to the same protocol (or communication standard) used by the plurality of terminals 201, 202, ..., 20N, To the terminal.

As described above, even if the plurality of terminals 201, 202, ..., 20N use the same protocol or different protocols (or heterogeneous protocols), the protocols of the receiving unit 150 and / And the processing function, the arbitrary terminal can be configured to perform communication with the video conferencing server 100 according to a corresponding protocol used by an arbitrary terminal.

In addition, although the receiving unit 150 and the transmitting unit 160 are separately configured in the embodiment of the present invention, they may be configured as one transmitting and receiving unit.

The storage unit 170 is configured to store the plurality of image and voice data, and the generated single image and single voice data.

When the call between the terminals 201, 202, ..., 20N and the video conferencing server 100 is established, the storage unit 170 stores the video conference server 100, And attribute information for the corresponding terminal, which is transmitted to the terminal 100, respectively. Here, the attribute information of the corresponding terminal to be transmitted includes information necessary for call setup, user information (name or nickname) of the terminal, communication protocol of the terminal, information on a predetermined unique image number, and the like.

In addition, when the controller 130 is requested to transmit the image / voice data stored in the storage unit 170 from the terminal participating in the video conference or from any terminal after the video conference is terminated, After the authentication and billing procedure is performed, the requested image / voice data may be transmitted to the terminal.

The data generation unit 110 or the command processing unit 120 receives a plurality of images and audio data received from the receiving unit 150 and generates a plurality of image data and audio data, (110) or the command processing unit (120).

The image data generation unit 113 included in the data generation unit 110 encodes a single image screen composed of the one full screen to generate the single image data.

3, a plurality of image data 182 decoded and scaled by the image decoding unit 111 and the image scaling unit 112 are stored in the single image screen 181, (Name or nickname) 183 of user information allocated to screens divided according to the number of image data (or the number of terminals) and included in the attribute information transmitted from each terminal at the time of call setup, The audio data is detected on one side of the decoded and scaled image data 182 and the audio data detection 184 in the audio decoding unit 124 is displayed on one side of the decoded and scaled image data 182 As shown in FIG.

The display of the voice data detection flag 184 in the single image screen 181 is for displaying a participant who is going to make a doctor's utterance among a plurality of participants participating in the video conference and is provided with a light emitting diode (E.g., red or green) when voice data is detected from the terminal on one side of the image data 182 in the single image screen 181, such as an on / off function, (For example, white or the background color of the single image screen 181) when voice data is not detected from the terminal.

In addition, when the DTMF signal is not detected among the plurality of voice data, the command processing unit 120 determines whether the DTMF signal is not detected, And generate an image selection message including the corresponding numerical information based on the information.

In addition, when receiving the voice data including the DTMF signal, the command processing unit 120 generates an image selection message based on the DTMF signal included in the voice data.

Also, the command processing unit 120 analyzes a control signal transmitted from a terminal such as a notebook having a camera and / or microphone not including a DTMF signal, and transmits the analyzed result to the corresponding terminal And generates an image selection message including information on the unique image number included in the control signal based on the image selection message.

In this manner, the command processing unit 120 is configured to analyze the received control signal and generate an image selection message based on the analyzed result, and when the DTMF signal is included in the control signal, the DTMF Signal to generate an image selection message.

The control unit 130 may select image data having a unique image number corresponding to the image selection message generated when the image data includes the DTMF signal among the plurality of image data and the generated single image data Alternatively, image data having a unique image number corresponding to the image selection message generated based on the control signal is selected.

In addition, when the new terminal is connected to a currently open and operating video conference room (or a video conference session), or when an arbitrary terminal currently connected is trying to cancel the connection, And a series of control operations for releasing the call.

In addition, one full screen configured by the video conferencing server 100 may be one or more, depending on the design of the user. In addition, the plurality of one full screen may be respectively encoded to generate a plurality of single image data.

That is, the single image data is configured to generate at least one image data according to a designer's need, and when the single image data is generated in plurality, the image data generating unit 113 generates the single image data , Different unique image numbers are set.

For example, when the number of the plurality of image screens is four, the four plurality of screens may be configured as shown in FIG. 3 (d) or as shown in FIG. 3 (f). 3A and 3B, the first and second image screens are displayed on the first and second divided images at predetermined time intervals, , And the third and fourth image screens are repeatedly displayed on the second upper / lower two-divided screen.

In addition, the video conferencing server 100 transmits information (including information on a unique image number) about a plurality of image data that can be provided by the video conferencing server 100 to the plurality of terminals. Thereafter, the information about the image data selected by the user of each terminal (including information on the unique image number) is transmitted to the video conference server 100 for each terminal based on the transmitted information, The control unit 100 may generate an image selection message based on information on image data transmitted for each terminal. That is, it provides information about a plurality of image data that can be provided by the video conferencing server 100 to each terminal, selects any one of information on the provided plurality of image data for each terminal, Server 100, and the video conferencing server 100 may transmit the image data selected for each terminal to the corresponding terminals.

In such a video conferencing system 900, there is no need to add software for variable access management and data retransmission in order to implement video conferencing for each terminal.

In addition, by using the circuit data based service for the communication method between each terminal and the video conferencing server, the cost can be reduced as compared with the service based on the packet data.

In addition, in the video conferencing server, a single image screen is generated and the generated single image screen is transmitted to each terminal, so that the network bandwidth required for transmission of the image and / or audio data is constant, It becomes unnecessary to secure additional bandwidth. Therefore, efficient bandwidth usage becomes possible.

Hereinafter, a video conference method according to the present invention will be described in detail with reference to FIGS. 1 to 5. FIG.

6 is a flowchart illustrating a first video conference method according to an embodiment of the present invention.

First, the image decoding unit 111 decodes a plurality of image data set by the control unit 130 for each image with a unique image number. The image scaling unit 112 scales a plurality of image data decoded by the decoding unit 111, respectively. At this time, the image data scaled by the image scaling unit 112 scales by a predetermined number (or a resolution) according to the number of the plurality of image data or a predetermined number by the user. Thereafter, the plurality of image data scaled by the image scaling unit 112 are respectively allocated and encoded by the image data generation unit 113 to a predetermined divided portion of a single image screen of a preset standard, Thereby obtaining a single image data constituting the image. At this time, the single image screen of the predetermined standard is divided into a plurality of divided screens based on the number of the image data or the number of screen divisions preset by the user, and the scaling A plurality of image data are allocated to each of the plurality of image data to constitute one full screen. Then, the single full screen image is encoded to generate the single image data.

In addition, the control unit 130 sets a predetermined unique image number (e.g., "0") or an arbitrary (or randomly) unique image number to the generated single image data (S10).

Thereafter, the voice decoding unit 114 decodes the plurality of voice data, and the voice data generation unit 115 mixes the plurality of voice data decoded by the voice decoding unit 114 into one voice data, Voice data is obtained (S20).

Thereafter, a plurality of image selection messages are generated based on a result of analyzing a plurality of control signals corresponding to the plurality of image and sound data, respectively. That is, the first control signal is analyzed for the first control signal for the first picture and the first speech data, and the second control signal is analyzed for the first control signal, One image selection message is generated (S30).

Thereafter, on the basis of the plurality of image selection messages generated corresponding to the plurality of control signals, a plurality of image selection messages corresponding respectively to the plurality of image selection messages generated from the plurality of image data and the generated single image data And selects image data. The image data to be selected includes an image having a unique image number corresponding to unique image number information included in the first image selection message among the plurality of image data and the single image data each having a unique image number, Data.

That is, any image data having the unique image number information included in the first image selection message among the plurality of image data and the single image data is selected based on the generated first image selection message. For example, when the first control signal includes unique image number information of "3" and the first image selection message is generated including unique image number information of "3" included in the first control signal , The image data including the unique image number information of the "3" among the plurality of image data each having a unique image number and the single image data is selected (S40).

Then, the image data selected for each of the plurality of image selection messages is output together with the generated single voice data.

That is, the image data selected based on the first image selection message and the generated single voice data are output (S50).

7 is a flowchart illustrating a second video conference method according to an embodiment of the present invention.

First, step S110 of generating single image data and step S120 of generating single voice data are the same as steps S10 and S20 described in the first embodiment of the present invention shown in Fig.

Thereafter, a plurality of image selection messages are generated based on a result of analyzing a plurality of control signals corresponding to the plurality of image and sound data, respectively. At this time, some or all of the plurality of control signals are DTMF signals included in the plurality of voice data. That is, the presence or absence of a DTMF signal, which is a control signal included in part or all of the plurality of voice data, is detected. For example, it is determined whether the DTMF signal is included in the first speech data of any of the plurality of speech data (S130).

The DTMF signal processing unit performs filtering and predetermined signal processing on the frequency components of the detected DTMF signal and outputs the DTMF signal as a DTMF signal when the DTMF signal is detected from any one of the plurality of voice data, Or a combination of numbers and special characters.

Thereafter, an image selection message including unique image number information corresponding to the detected DTMF signal is generated based on the obtained numerical information (information corresponding to an arbitrary unique image number) or information obtained by combining numbers and special characters do. That is, when a DTMF signal included in the first audio data is detected, a first image selection message including a unique image number corresponding to the detected DTMF signal corresponding to the first audio data is generated (S140) .

When a DTMF signal is not detected in any one of the plurality of voice data as a result of the detection, generating an image selection message including unique image number information corresponding to a preset value, And generates an image selection message including unique image number information included in the control signal based on a result of analyzing the corresponding control signal. That is, when a DTMF signal is not detected in the first audio data, a first image selection message including unique image number information corresponding to the preset value corresponding to the first audio data is generated, The first image selection message is generated based on the result of analyzing the first control signal corresponding to the voice data (S150).

Thereafter, on the basis of the plurality of image selection messages generated corresponding to the plurality of voice data, the plurality of image selection messages corresponding to the plurality of image selection messages generated from the plurality of image data and the generated single image data, respectively And selects image data.

That is, one of the plurality of image data and the single image data is selected based on the generated first image selection message. The image data to be selected includes an image having a unique image number corresponding to unique image number information included in the first image selection message among the plurality of image data and the single image data each having a unique image number, (S160).

Then, the image data selected for each of the plurality of image selection messages is output together with the generated single voice data. That is, the image data selected based on the first image selection message and the generated single voice data are output (S170).

8 is a flowchart illustrating a third video conference method according to an embodiment of the present invention.

First, image and voice data and / or control signals transmitted from a plurality of terminals 201, 202, ..., 20N are received through a receiving unit 150 included in the video conferencing server 100. In addition, a unique image number is set for each of the plurality of received image data. When a call is established between the plurality of terminals 201, 202, ..., 20N and the video conferencing server 100, the correspondence transmitted from the plurality of terminals 201, 202, ..., And stores the attribute information of the terminal in the storage unit 170. The control unit 130 included in the video conferencing server 100 controls the call setup and release of the plurality of terminals and the video conferencing server 100, and the session management for video conferencing. Also, when homogeneous or heterogeneous terminals are connected to the video conferencing server 100, the video conferencing server 100 is configured to transmit and receive various data including control signals with the corresponding terminals according to the standards of the corresponding terminals. In addition, a circuit-based service may be used between the plurality of terminals 201, 202, ..., 20N and the video conferencing server 100, and a packet-based service may be used by a designer in step S210.

Thereafter, the receiver 150 decodes the plurality of image data. And scales the decoded plurality of image data with a predetermined resolution based on the number of the plurality of terminals or a predetermined number by the user, respectively. In addition, the scaled plurality of image data is allocated and encoded to a predetermined divided portion of a single image screen of a predetermined standard to obtain single image data constituting one full screen.

Further, the decoding unit decodes the plurality of received voice data, and mixes the plurality of decoded voice data into one voice data to generate single voice data. The step of generating the single image and the single voice data is similar to the steps S10 and S20 described in the first embodiment of the present invention shown in FIG. 5 (S220).

Thereafter, the presence or absence of a DTMF signal included in the plurality of voice data is detected for the plurality of voice data.

When a DTMF signal is detected from any of the plurality of voice data as a result of detection of the presence or absence of the DTMF signal, filtering and performing a predetermined signal processing on a frequency component of the detected DTMF signal, Information or a combination of numbers and special characters is obtained. Then, an image selection message including the numeric information or the combination of numbers and special characters is generated.

When a DTMF signal is not detected in any of the plurality of voice data as a result of detection of the presence or absence of the DTMF signal and the corresponding voice data for which the DTMF signal is not detected is transmitted, And checks whether the attribute information about the corresponding terminal stored in the storage unit 170 includes information on the unique image number.

If it is determined that the attribute information for the corresponding terminal includes information on the unique image number, the image selection message including information on the unique image number is generated.

If it is determined that the attribute information for the corresponding terminal does not include information on the unique image number, the controller analyzes the transmitted control information, and analyzes the control information for the unique image number included in the control information And generates an image selection message containing information.

As described above, when the DTMF signal is included in the audio data, the image selection message containing the information on the unique image number corresponding to the numeric information is generated by using the numeric information included in the DTMF signal, When the DTMF signal is not included in the control signal, information on a predetermined unique image number included in the attribute information about the terminal transmitted when the call is set, or information on the inherent image number included in the control signal And may generate an image selection message including information on the number (S230).

Then, based on the generated plurality of image selection messages including the unique image number information, the plurality of image data having the unique image number and the unique image included in the image selection message Image data having image numbers corresponding to the number information are selected (S240).

Then, the selected image data and the generated single voice data are transmitted to the terminals corresponding to the selected image data through the transmission unit 160 included in the video conferencing server 100, respectively.

That is, for the first terminal 201 that has transmitted the first image data and the first audio data to the video conferencing server 100, a first image selection message And selects one of the plurality of image data and the generated single image data based on the generated first image selection message. Thereafter, the video conferencing server 100 transmits the generated first image selection message, the first image data, or the generated image data to the first terminal device 201 corresponding to the first voice data, (S250).

Each of the terminals, which have received the image data and the single voice data transmitted from the video conferencing server 100, processes the received image data and the single voice data, And an audio output unit) (S260).

9 is a flowchart illustrating a fourth video conference method according to an embodiment of the present invention.

First, in the video conferencing terminal connected to the video conferencing server, the first control unit 220 determines whether the first image and the first audio data and / or the first control signal input to the video conferencing terminal 200 And transmits the processed signal to the video conferencing server. At this time, the first control signal transmitted includes a DTMF signal input through a device provided in the video conferencing terminal. The first control signal includes a unique control signal for selecting one of a plurality of images input from a plurality of terminals participating in a video conference and a single image data generated by the video conferencing server 100 .

In addition, the first picture and the first voice data to be transmitted are data processed 310 according to a codec used in the video conference terminal.

Thereafter, the video conferencing server 100 receives the transmitted first image and the first audio data and a single processed output image and single audio data. The image and single voice data outputted by the video conferencing server 100 are the contents described in one embodiment of the present invention (FIGS. 6 to 8) (S320).

Thereafter, the control unit 220 processes the received image and the single voice data according to a codec included in the corresponding terminal, and outputs the processed image.

At this time, the received image data is image data corresponding to the unique image number contained in the first control signal. The received single voice data is single voice data generated by mixing a plurality of voice data input from a plurality of terminals connected to the video conference server.

The predetermined processed image data may be image data for a single participant participating in the video conference selected by the first control signal or image data for one participant participating in the video conference selected by the first control signal or single image data generated by the video conferencing server 100 (For example, Figs. 3A to 3F) (S330).

As described above, a plurality of terminals connected to the video conferencing server can provide the image data and the single voice data selected by the control among the plurality of image data and the single image data by using the circuit-based service .

In addition, a single screen can be divided into a plurality of image data based on the number of the plurality of image data or the predetermined number by the user, and the plurality of image data can be allocated to constitute one single screen.

According to the video conference server, the terminal, and the video conference method using the video conference server of the present invention, a plurality of terminals connected to the video conference server are controlled by the user among the plurality of video data and the single video data using the circuit- By providing the selected image data and the single voice data, it is possible to provide a video conferencing server and a video conferencing terminal which are efficient and low-cost, stable, and relatively inexpensive.

1 is a block diagram illustrating a video conferencing server according to a first embodiment of the present invention.

2 is a diagram illustrating an operation process of a data generating unit according to an embodiment of the present invention.

3 is a diagram illustrating an example of a plurality of divided screens of a single image screen according to an embodiment of the present invention.

4 is a block diagram illustrating a video conferencing terminal according to a second embodiment of the present invention.

5 is a block diagram illustrating a video conferencing system according to a third embodiment of the present invention.

6 is a flowchart illustrating a first video conference method according to an embodiment of the present invention.

7 is a flowchart illustrating a second video conference method according to an embodiment of the present invention.

8 is a flowchart illustrating a third video conference method according to an embodiment of the present invention.

9 is a flowchart illustrating a fourth video conference method according to an embodiment of the present invention.

Claims (42)

A data generating unit for performing predetermined processing on a plurality of image and audio data to generate a single image and single audio data; A command processing unit for generating a first image selection message based on a first control signal corresponding to a first image and first voice data included in the plurality of image and voice data; And a control unit for selecting either one of the plurality of image data and the generated single image data based on the generated first image selection message and outputting the selected image data and the generated single voice data The video conference server comprising: The apparatus of claim 1, An image decoding unit decoding each of the plurality of image data; An image scaling unit for scaling the decoded plurality of image data at a predetermined resolution; A plurality of scaled image data are allocated to a plurality of divided predetermined portions of a single image screen of a predetermined standard to form one full screen, and the single full screen image is encoded, An image data generation unit to generate the image data; A voice decoding unit for decoding the plurality of voice data, respectively; And a voice data generation unit for generating the single voice data by mixing the plurality of decoded voice data. 3. The image processing apparatus according to claim 2, And scales the decoded plurality of image data to one of a plurality of predefined resolutions according to the number of the plurality of image data. The image processing apparatus according to claim 2, And divides the single image screen into a plurality of divided screens in accordance with the number of the plurality of image data or the preset number of screen divisions. The method according to claim 4, Wherein the video conference screen is one of a top / bottom 2-split, left / right 2-split, 3-split, 4-split, 5-split, 6-split, 8-split or PIP (Picture In Picture). 3. The method of claim 2, Wherein the video conference server is any one of CIF, QCIF, QCIF +, QQCIF, VGA, QVGA, QQVGA, SVGA, XGA, SXGA, SXGA +, WSXGA, WSXGA +, QXGA, UXGA and UWXGA. 2. The method of claim 1, And information on a unique image number of the unique image number or a predetermined unique image number set in each of the plurality of image data and the single image data. 2. The method of claim 1, Wherein the first voice data is a DTMF signal included in the first voice data. 9. The apparatus according to claim 7 or 8, And generates an image selection message including information on a unique image number included in the first control signal. 9. The apparatus according to claim 8, And generates an image selection message including unique image number information corresponding to the detected DTMF signal when the DTMF signal included in the first audio data is detected. 9. The apparatus according to claim 8, And generates an image selection message including unique image number information corresponding to a predetermined value if a DTMF signal is not detected with respect to the first audio data. The apparatus of claim 1, And sets a unique image number in each of the plurality of image data and the single image data. 13. The apparatus according to claim 12, And selects image data having a unique image number corresponding to the first image selection message from among the plurality of image data and the single image data. A plurality of video conference terminals connected to a video conference server, A first transmission unit for signal processing the first image, the first audio data, and the first control signal to a preset standard by the first control unit and transmitting the signal to the video conferencing server; A first receiving unit for receiving a predetermined processed and output image and single voice data from the video conference server; And a first controller for signal processing and outputting the received image and single voice data according to the preset standard. 15. The video conferencing server of claim 14, A second receiver for receiving the plurality of image and voice data and a plurality of control signals transmitted from the plurality of terminals; A data generating unit for performing predetermined processing on the received plurality of image and sound data to generate a single image and single sound data; A command processor for generating a first image selection message based on a first control signal included in the received plurality of control signals; Setting a unique image number in each of the plurality of image data and the single image data and selecting either one of the plurality of image data and the generated single image data based on the generated first image selection message A second controller for outputting the selected image data and the generated single voice data; And a second transmitter for transmitting the selected image data output by the control unit and the generated single voice data to the corresponding terminal. 16. The method according to claim 14 or 15, And information on the unique image number. 17. The apparatus of claim 16, And generates an image selection message including information on a unique image number included in the first control signal. 16. The apparatus of claim 15, And selects image data having a unique image number corresponding to the first image selection message from among the plurality of image data and the single image data. 15. The image processing method according to claim 14, Wherein the image data is image data corresponding to a unique image number included in the first control signal. A first step of processing a plurality of image and sound data to generate a single image and a single sound data; A second step of generating a first image selection message based on a first control signal corresponding to a first image and first voice data included in the plurality of image and voice data; A third step of selecting one of the plurality of image data and the generated single image data based on the generated first image selection message; And a fourth step of outputting the selected image data and the generated single voice data. 21. The method of claim 20, And sets a unique image number in each of the plurality of image data and the generated single image data. 21. The method of claim 20, A first step of decoding each of the plurality of image data; A second step of scaling the decoded plurality of image data at a predetermined resolution; A third step of allocating the plurality of scaled image data to a plurality of divided predetermined parts of a single image screen of a predetermined standard to form one full screen; A fourth step of generating the single image data by encoding the screen composed of one full screen; A fifth step of decoding each of the plurality of audio data; And a sixth step of mixing the decoded plural audio data and generating the single audio data. 23. The method according to claim 22, And scaling the decoded plurality of image data to one of a plurality of predefined resolutions according to the number of the plurality of image data. 23. The method of claim 22, Wherein the single image screen is divided into a plurality of divided screens in accordance with the number of the plurality of image data or the predetermined number of screen divisions. 21. The method of claim 20, wherein the first control signal comprises: Wherein the information includes information on a unique image number set in each of the plurality of image data and the single image data or one of unique image numbers set in advance. 21. The method of claim 20, wherein the first control signal comprises: Wherein the DTMF signal is a DTMF signal included in the first audio data. 26. The method according to claim 25 or 26, And generates an image selection message including information on a unique image number included in the first control signal. 27. The method of claim 26, And generates an image selection message including unique image number information corresponding to the detected DTMF signal when the DTMF signal included in the first audio data is detected. 27. The method of claim 26, And generates an image selection message including unique image number information corresponding to a predetermined value if a DTMF signal is not detected for the first audio data. 21. The method of claim 20, Wherein image data having a unique image number corresponding to the first image selection message is selected from among the plurality of image data and the single image data. A plurality of video conference terminals connected to a video conference server, A first step of signal processing the input first image, the first audio data and the first control signal to a predetermined standard by the first control unit, and transmitting the processed signal to the video conferencing server; A second step of receiving an image and a single voice data that have been processed and output the first image and the first voice data transmitted by the video conference server; And a third step of signal processing and outputting the received image and single voice data to the predetermined standard by the first control unit. 32. The method of claim 31, A first process of receiving the plurality of image and voice data and a plurality of control signals transmitted from the plurality of terminals in the video conferencing server; A second step of processing a plurality of received image and sound data to generate a single image and a single sound data; A third step of generating a first image selection message based on a first control signal included in a plurality of control signals transmitted from the terminal; A fourth step of selecting one of the plurality of image data and the generated single image data based on the generated first image selection message; A fifth step of outputting the selected image data and the generated single voice data; And transmitting the selected image data and the generated single voice data to the corresponding terminal. 33. The method of claim 32, wherein the first control signal comprises: Wherein the information includes information on a unique image number set in each of the plurality of image data and the single image data or one of unique image numbers set in advance. 33. The method as claimed in claim 32, And sets a unique image number in each of the plurality of image data and the single image data. 33. The method as claimed in claim 32, And generates an image selection message including information on a unique image number included in the first control signal. 33. The method as claimed in claim 32, Wherein image data having a unique image number corresponding to the first image selection message is selected from among the plurality of image data and the single image data. The image processing method according to claim 31, wherein the image data received in the second step includes: Wherein the image data is image data corresponding to a unique image number included in the first control signal. A first step of receiving image and voice data and a control signal transmitted from a plurality of terminals; A second processing unit for performing predetermined processing on the received plurality of image and voice data to generate a single image and single voice data and transmitting the selected single voice data and the selected single voice data to the corresponding terminal respectively based on the plurality of control signals, The method comprising the steps of: 39. The method of claim 38, A first process of performing predetermined processing on the received plurality of image and voice data to generate a single image and a single voice data; A second step of generating a plurality of image selection messages based on the plurality of control signals; A third step of selecting one of the plurality of image data and the generated single image data based on the generated plurality of image selection messages; And transmitting the selected plurality of image data and the generated single voice data to a terminal corresponding to the plurality of image selection messages, respectively. 40. The method of claim 39, And sets a unique image number in each of the plurality of image data and the single image data. 40. The method of claim 39, Decoding each of the plurality of image data; Scaling the decoded plurality of image data at a predetermined resolution; Allocating the scaled plurality of image data to a plurality of divided predetermined portions of a single image screen of a predetermined standard to form one full screen; Generating the single image data by encoding the one full screen image; Decoding each of the plurality of audio data; And generating the single voice data by mixing the plurality of decoded voice data. 41. The method of claim 40, And generates a plurality of image selection messages each including information on a unique image number included in each of the plurality of control signals.

Images