KR101366317B1 - Method for Multipoint Video Telepony in Mobile Terminal - Google Patents

Abstract

The present invention relates to a multi-party video call method of a mobile communication terminal, in particular, for transmitting a different image for each video call counterpart using a limited frequency region in a multi-party video call of the mobile communication terminal.

According to an aspect of the present invention, a mobile communication terminal includes a wireless transmitter / receiver for performing a multi-party video call with two or more first and second terminals, an image input unit for inputting a real-time image, and at least one substitute image. When the first terminal is designated as a receiver of the real-time image and the second terminal is designated as a receiver of the substitute image during the multi-party video call with a storage unit, the real-time image and the substitute image are transmitted through the wireless transmitter / receiver. It is configured to include a control unit for transmitting to the first and second terminals.

Conference call, video call, video synthesis, mobile communication terminal

Description

Method for Multipoint Video Telepony in Mobile Terminal}

1 is a view showing a method for transmitting a substitute image in a video call according to the present invention.

2 is a diagram illustrating a method of transmitting and receiving an image in a multi-party video call according to the present invention.

3 is a block diagram showing a schematic internal configuration of a mobile communication terminal according to an embodiment of the present invention.

4 is a flowchart illustrating a multi-party video call method according to an embodiment of the present invention.

5 is a diagram illustrating a method for transmitting and receiving an image in a multi-party video call according to an embodiment of the present invention.

6 illustrates a multi-party video call system according to an embodiment of the present invention.

7 is a diagram illustrating a screen implementing a whisper function in a multi-party video call according to an embodiment of the present invention.

FIG. 8 is a diagram illustrating a screen implementing emotion expression using a character in a multi-party video call according to an embodiment of the present invention. FIG.

The present invention relates to a multi-party video call method using the mobile communication terminal, in particular.

Recently, as the demand for Internet access increases, users' demand for a new wireless Internet supporting mobility using mobile communication devices is increasing. Accordingly, a wireless Internet service using a mobile communication terminal is provided by a communication method such as CDMA 1x EV-DO, WCDMA, and the like, and the demand thereof is also increasing.

In general, the third generation mobile communication service is classified into IMT-2000. Since the second generation of providing voice and short message (SMS) mobile communication services, mobile service providers are now moving to third generation technology capable of providing high-speed data services. Third-generation mobile communication technologies can provide new types of data services using higher bandwidths (1.9 GHz and above) than second generation (1.8 GHz and below), while consumers are not limited by time and place. Make the service available.

One of the features of the IMT-2000 is that it can provide a wireless multimedia service capable of high-speed data and video services by breaking away from the existing voice-oriented service. Accordingly, advanced functions such as a color display, a large memory, a digital camera, a wireless Internet platform, a multiplex sound, an MP3 function, and a VOD function are being adopted in the mobile communication terminal. In other words, the development of mobile communication service technology and the demands of consumers are accelerating the multimediaization of mobile communication terminals. Seamless video call is possible with CDMA 2000 EV-DO or CDMA 2000 EV-DV.

In addition to the video input in real time, the video call may transmit a substitute video such as a still image or a video stored in the terminal, and may perform a video conference using a multi-party call.

1 is a diagram illustrating a method of transmitting a substitute image in a video call according to the present invention.

According to FIG. 1, a first terminal displays an image A input in real time through a camera, a substitute image A 'stored in a storage unit, and an image B received from a second terminal which is a video call counterpart on a screen. The substitute image A 'includes a video, a still image, and an animation.

The first terminal uses the real time image A to transmit a substitute image A 'to the second terminal during a video call with the second terminal. Then, the first terminal inputs a signal instructing to transmit the A 'image while transmitting the A image.

The images are transmitted in the form of packet data, and are loaded with the A 'image data packet and transmitted to the second terminal. In this case, the data packet includes a control command for displaying the A 'image data packet, which is a substitute image, among the data packets transmitted from the first terminal.

The data packet transmitted from the first terminal is received by the second terminal through a 3G network, and the second terminal analyzes the received data packet and displays the screen on the screen of the terminal according to a control command included in the data packet. A 'is displayed.

2 is a diagram illustrating a method for transmitting and receiving an image in a multi-party video call according to the present invention.

According to Fig. 2, the first terminal, the second terminal, and the third terminal make a multi-party video call. The multi-party video call is controlled by a multipoint call control unit (hereinafter referred to as "MCU") of a 3G network to select video and audio. The multi-party video call can simultaneously communicate with a plurality of terminals using a channel having the same bandwidth (64 Kbps) as a conventional 1: 1 video call.

The first terminal transmits a real-time video A to the 3G network. Then, the MCU located in the 3G network transmits the A video to the second terminal and the third terminal in the video call.

Meanwhile, the real time image B of the second terminal is also transmitted to the first terminal and the third terminal through the MCU of the 3G network, and the real time image C of the third terminal is also transmitted through the MCU of the 3G network in the same manner. It is transmitted to the terminal and the second terminal.

However, the mobile communication terminal according to the related art has a disadvantage in that only the same image provided from each of the call partners is provided even during the multi-party video call.

SUMMARY OF THE INVENTION An object of the present invention is to provide a method for transmitting different images for each video call counterpart using a limited frequency region in a multi-party video call of a mobile communication terminal.

One feature of a mobile communication terminal according to the present invention for achieving the above object is a wireless transmission and reception unit for performing a multi-party video call with two or more first and second terminals, and a video input unit for receiving a real-time video And, when the first terminal is designated as a receiver of the real-time video and the second terminal is designated as a receiver of the replacement video during the multi-party video call, the storage unit including at least one substitute video. And a controller for transmitting the real time image and the substitute image to the first and second terminals through a transceiver.

In addition, the present invention for achieving the above object, in the method for a multi-party video call with two or more first and second terminals, connecting the first and second terminals and the multi-party video call, and When the real time image and the substitute image is input as the image to be transmitted to the first and second terminals, the first terminal is designated as the receiver of the real time image, and the second terminal is designated as the receiver of the substitute image, And transmitting the real time image and the substitute image to the first and second terminals.

More preferably, the substitute image includes a moving image, a still image, and an animation.

More preferably, a combination of the images is controlled by using a frame sequence of the real time image and the substitute image.

More preferably, the images are compressed and transmitted in the H.245 protocol.

More preferably, the images and the control commands are transmitted via a 3G mobile communication network.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, a configuration and an operation of an embodiment of the present invention will be described with reference to the accompanying drawings, and the configuration and operation of the present invention shown in and described by the drawings will be described as at least one embodiment, The technical idea of the present invention and its essential structure and action are not limited.

3 is a block diagram illustrating a schematic internal configuration of a mobile communication terminal according to an embodiment of the present invention, and FIG. 4 is a flowchart illustrating a multi-party video call method according to an embodiment of the present invention.

According to FIG. 3, the mobile communication terminal includes an image input unit 110, a storage unit 120, a controller 130, and a wireless transmitter 140.

First, the mobile communication terminal performs a multi-party video call with other terminals using a real-time image input through the image input unit 110 [S210]. At this time, the data for the video call is made through a 3G network, a multi-party video call control device (MCU) located in the 3G network controls the video and audio transmission for the multi-party video call.

If a video call is to be transmitted to each of the video call counterparts using the real-time input image, the controller 130 may store the storage unit 120 of the terminal in addition to the real-time image input through the video input unit 110. Combining the images to simultaneously transmit the replacement image stored in the [S220, S230].

The real time image and the substitute image are transmitted in the form of a data packet, and the two image data are combined to simultaneously transmit the two images. In general, the image transmission encodes and transmits a frame sequence constituting the image. If the simultaneous transmission of the real time image and the substitute image is performed, the frames of the real time image and the substitute image are transmitted. Frame sequences are constructed by combining them in the desired order and frequency.

The combined frame sequence includes image configuration information for recognizing a video call counterpart to which each frame should be transmitted. The video configuration information uses H.245's User Input Indication transmission method that supports the interaction of user-defined symbols in 3G-324M, and exists in the form of a synchronized flag in each of the combined frame sequences. The User Input Indication transmission method uses a User Input Indication field defined in the H.245 standard which is in charge of 3G-324M video call protocol call control, and enables real-time interaction between terminals. Representative functions of the user input indication transmission method include DTMF (Dual Tone Multi Frequency) and video chat, which transmits keypad input of a terminal.

For example, the video configuration information is information that is transmitted together when simultaneously transmitting the real-time image and the substitute image to other terminals, a control command for controlling to display the real-time image to the first terminal of the other terminals; The second terminal of the other terminals is information including a control command for controlling the replacement image to be displayed. The information is synchronized for each corresponding frame to identify a video call counterpart to receive the images and the control commands.

Thereafter, the controller 130 encodes and compresses the combined image using the H.245 protocol, and then transmits the combined image through the wireless transmitter 140 [S240, S250].

5 is a diagram illustrating a method of transmitting and receiving an image in a multi-party video call according to an embodiment of the present invention.

According to FIG. 5, in addition to the image B received from the second terminal and the image C received from the third terminal during the multi-party video call, the first terminal includes the real-time image A and the first terminal input in real time to the first terminal. The substitute image A 'stored in the storage unit is displayed on the screen.

The first terminal transmits a real time image A to the second terminal, and simultaneously transmits a substitute image A 'to the third terminal. Then, the first terminal combines the A image and the A 'image and transmits them to the 3G communication network.

In this case, the image combination is to combine the frame sequence constituting the images to be combined in a desired order and frequency. In this case, the combined frame sequence includes image configuration information for recognizing a video call counterpart to be transmitted for each frame. The video configuration information uses the H.245 user input indication transmission scheme, and exists in the form of a flag synchronized to each of the combined frame sequences.

The combined image is transmitted to a multi-party video call control device (MCU) located in the 3G communication network in the form of a data packet. The MCU receiving the data separates the combined image and analyzes image composition information of the separated images. As a result of analyzing the video configuration information, a control command to display on the second terminal is synchronized to a frame corresponding to the real-time video A, and a control command to display on a third terminal is synchronized to a frame corresponding to the substitute image A '. It is. Then, the MCU transmits the real time image A to the second terminal and the substitute image A 'to the third terminal according to the analysis result.

6 is a diagram illustrating a multi-party video call system according to an embodiment of the present invention.

According to FIG. 6, the first terminal combines real-time video A and substitute video A 'to transmit to the MCU that controls the multi-party video call located in the 3G network.

In this case, the combination of the real time image and the substitute image is achieved by generating a frame sequence combining the frames constituting the two images in a desired order and frequency. Each of the combined frames includes additional information about the video call partner who will receive the frame. The video frame and the additional information use H.245's User Input Indication transmission scheme that supports user-defined symbol interaction in 3G-324M.

The MCU receiving the combined video analyzes video call partner information included in each frame, and transmits the real-time video A to the second terminal and transmits the replacement video to the third terminal according to the analysis result.

Therefore, the first terminal transmits different images to the second terminal and the third terminal, respectively, thereby expressing emotions, whispering functions, and caraden functions using a multi-party call. There is an advantage that can be implemented.

7 is a diagram illustrating a screen implementing a whisper function in a multi-party video call according to an embodiment of the present invention.

According to FIG. 7, the first terminal is in a multi-party video call with the second terminal and the third terminal using the real-time video A. FIG. At this time, the first terminal is to transmit the image taken in the zoo only to the third terminal.

Then, the first terminal executes a "whisper" function menu with respect to the third terminal, selects a zoo photographed image A 'stored in a storage unit of the first terminal, and combines with the real-time video for a multi-party video call. Transfer to the control unit (MCU).

In this case, the A image displayed on the screen of the first terminal is a real-time image input to the first terminal, the A 'image is a zoo photographing image stored in the storage of the first terminal, the B image is the second terminal The image received from the C image, the image received from the third terminal.

The MCU, having received the combined image, transmits the real-time image A to the second terminal and the zoo photographed image A 'to the third terminal according to the selection of the "whisp" function set in the first terminal. .

Therefore, the first terminal can transmit the story that was in the zoo only to the third terminal by using the "whisper" function.

8 is a diagram illustrating a screen on which an emotion expression using a character is implemented in a multi-party video call according to an embodiment of the present invention.

According to FIG. 8, the first terminal is in a multi-party video call using the real-time image A with the second terminal and the third terminal. At this time, the first terminal intends to deliver an emotional expression of "angry" only to the third terminal.

Then, the first terminal executes an "emotion expression" function menu with respect to the third terminal during the video call, and loads an animation character stored in the storage unit of the first terminal. Subsequently, when anger, "anger," which is an emotion to be expressed in the animation character, is selected, the character is changed to an angry expression. The character image A 'expressing the emotion is combined with the real-time image A being transmitted to the video call counterpart and transmitted to the multi-party video call controller (MCU). The terminal user arbitrarily selects an animation character to be used for the emotion and the emotion expression to be expressed.

In this case, the A image displayed on the screen of the first terminal is a real time image input to the first terminal, the A 'image is a character image expressing the emotion of the first terminal, and the B image is received from the second terminal. And the C image is an image received from the third terminal.

The MCU receiving the combined image transmits a real-time image A to the second terminal and a character image A to which the emotion is expressed in the third terminal according to the selection of the "emotional expression" function set in the first terminal. Send '.

Therefore, the first terminal can deliver a character carrying its emotion only to the third terminal by using the "expression of emotion" function.

Those skilled in the art will appreciate that various changes and modifications can be made without departing from the spirit of the present invention. Therefore, the technical scope of the present invention should not be limited to the contents described in the embodiments, but should be defined by the claims.

As described above, the present invention transmits a different image to each video call counterpart, so that only the video call counterpart can express emotions or use a whisper function.

Claims (10)

A wireless transmitter / receiver for performing communication for a multi-party video call with two or more first and second terminals; An image input unit to which a real time image is input; A storage unit provided with at least one substitute image; And When the first and second terminals are designated as the receivers of the real time video and the substitute video, respectively, during the multi-party video call, the first and second terminals indicating that each receiver of the real time video and the substitute video are the first and second terminals. And a control unit for generating 2 information and controlling the generated first and second information to be included in the real time image and the substitute image, respectively. delete The method according to claim 1, The controller transmits the real-time video and the substitute video including the first and second information to a multi-party video call control device for providing a multi-party video call with the first and second terminals, respectively. And the multi-party video call control device transmits the received real time video and the substitute video to the first and second terminals, respectively, based on the received first and second information. The method of claim 3, The controller transmits data including one of the real time image and the substitute image, each including the first and second information, to the multi-party video call control device. The multi-party video call control apparatus may classify the real time image and the substitute image based on the first and second information in the received data, and classify the separated real time image and the substitute image into the first and second terminals. Mobile communication terminal, characterized in that for transmitting to each. In the method for a multi-party video call with two or more first and second terminals, Connecting a multi-party video call with the first and second terminals; First and second information indicating that each receiver of the designated real time image and the substitute image are the first and second terminals when the real time image and the substitute image are respectively designated as images to be transmitted to the first and second terminals, respectively. Generating a; And And transmitting the generated first and second information to the first and second terminals, respectively, in the real time image and the substitute image, respectively. delete 6. The method of claim 5, The transmitting may include transmitting the real-time image and the substitute image including the first and second information to a multi-party video call control device providing a multi-party video call with the first and second terminals, respectively. The multi-party video call control device transmits the received real-time video and the substitute video to the first and second terminals, respectively, based on the received first and second information. Call way. 8. The method of claim 7, The transmitting may include transmitting data including one of the real time image and the substitute image, each of which includes the first and second information, to the multi-party video call control device. The multi-party video call control apparatus may classify the real time image and the substitute image based on the first and second information in the received data, and classify the separated real time image and the substitute image into the first and second terminals. Multi-way video call method of the mobile communication terminal, characterized in that for transmitting each. delete delete

Images