KR100686076B1 - Wireless Communication Terminal with Message Transmission According to Feeling of Terminal-User and Method of Message Transmission Using Same - Google Patents

Abstract

The present invention relates to a wireless communication terminal having a message output function corresponding to an emotional state of a subject and a message output method using the same.

The present invention provides a subject including a camera for photographing a subject's face and a controller configured to analyze image information provided from the camera to determine an emotional state of the subject, and to output a message corresponding to the determined emotional state. A wireless communication terminal having a message output function corresponding to an emotional state of the present invention and a message output method using the same are provided.

Therefore, according to the present invention, by using the image recognition technology to determine the emotional state of the subject, and by outputting a message corresponding thereto, it is possible to bring the subject out of the bad emotional state to have fun and to entertain and entertain.

Wireless communication terminal, image recognition, emotional state, message

Description

Wireless communication terminal having a message output function corresponding to the emotional state of the subject and a message output method using the same {Wireless Communication Terminal with Message Transmission According to Feeling of Terminal-User and Method of Message Transmission Using Same}

1 is a block diagram of a wireless communication terminal according to a first embodiment of the present invention.

2 is a block diagram of a wireless communication terminal according to a second embodiment of the present invention.

3 is a message output method according to a third preferred embodiment of the present invention.

4 is a message output method according to a fourth preferred embodiment of the present invention.

The present invention relates to a wireless communication terminal, and more particularly, to a wireless communication terminal having a message output function corresponding to an emotional state of a subject to allow the subject to move from a bad emotional state to a pleasant and happy emotional state, and a message output method using the same. It is about.

In the present invention, a wireless communication terminal is a mobile communication terminal, a personal mobile communication terminal (PCS), a personal digital terminal (PDA), a smart phone, a next generation mobile communication terminal (IMT-2000), wireless communication while carrying an individual such as a wireless LAN terminal Say this is possible terminal.

In addition, in the present invention, the message refers to various messages that can be recognized by the user of the terminal, such as voice message, music, text message (SMS), MMS (Multimedia Message Service), video, still image, and the like.

Recently, due to the development of information and communication technology, image recognition technology acquires an image of a user's face and converts the face image into another image according to a specified facial expression, and attaches a communication terminal to a vehicle to monitor driver's drowsiness. Technology is disclosed (for example, "eye image-based drowsiness detection method and apparatus" -patent application 10-2004-0071732), in recent years to monitor drowsiness using the movement of the eye through the camera recognition system How to do it is being studied. In addition, according to the related art, the image of the face of the subject may be acquired and analyzed through the pre-stored database and internal analysis algorithm to the expression of the face and even the emotional state of the subject.

Recent advances in wireless communication technology have resulted in the development of technologies that make these functions beneficial to users of the terminal as wireless communication terminals have multiple functions that go beyond simple communication and information transfer. have.

The present invention has been proposed in accordance with the recent trend, and the present invention analyzes the movement of the human eye, such as eyes, pupils, and eyebrows of the subject's face using a widely known image recognition technology to determine the emotional state of the subject. The present invention provides a message output device and a method for responding to an emotional state of a subject in a wireless communication terminal having a camera that outputs a message corresponding to the subject so that the subject can escape from a bad emotional state and have fun and be entertained and happy. The purpose is.

As one aspect of the present invention for achieving the above object, a wireless communication terminal having a message output function corresponding to the emotional state of the subject according to the present invention, the camera for photographing the subject's face and the image provided from the camera And a controller configured to analyze the information to determine an emotional state of the subject and to output a message corresponding to the determined emotional state.

According to another aspect of the present invention for achieving the above object, the message output method corresponding to the emotional state of the subject using the wireless communication terminal according to the present invention, the method comprising the steps of acquiring the image information of the face of the subject; Analyzing the image information to determine an emotional state of the subject and outputting a message corresponding to the determined emotional state of the subject according to the determination result.

The above objects, features and advantages of the present invention will become more apparent from the following detailed description taken in conjunction with the accompanying drawings. Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings. Like numbers refer to like elements throughout. In addition, when it is determined that the detailed description of the known function or configuration related to the present invention may unnecessarily obscure the subject matter of the present invention, the detailed description thereof will be omitted.

1 is a block diagram of a wireless communication terminal according to a first embodiment of the present invention.

Referring to FIG. 1, a first embodiment of a wireless communication terminal having a message output function corresponding to an emotional state of a subject according to the present invention will be described.

The wireless communication terminal according to the first embodiment includes an image information acquisition unit 100, a storage unit 110, a control unit 120, and an output device unit 130.

The image information acquisition unit 100 obtains image information of a face of a subject through a camera built in a wireless communication terminal. The memory unit 110 stores various messages. The controller 120 receives an image signal from the image information acquisition unit 100 to determine an emotional state of a subject using an emotional state analysis algorithm, and outputs a message corresponding to the determined emotional state to the memory device unit ( Read at 110). The message is output to the outside of the terminal through the output device 130.

Here, the image information acquired by the image information acquisition unit 100 may be a still image of the face of the subject photographed at a specific time, or may be a video indicating the movement of the face of the subject photographed for a predetermined time.

In addition, the memory device 110 may be an external storage medium that can be attached to or detached from the wireless communication terminal, or an internal flash memory that can write or erase data. Examples of external storage media include Mini-SD, transflash, RS-MMC SD, and other removable memory cards. Here, the message stored in the storage unit 110 may be received from the outside to the terminal through an interface device such as USB, short-range wireless communication module.

In addition, the message may be stored in the storage unit 110, a voice message, music, text message (SMS), MMS (Multimedia Message Service), video, still image, or can be controlled by a wireless communication terminal Combinations thereof, and the like.

In addition, the emotional state analysis algorithm is an algorithm for determining the emotional state of the subject by analyzing the image information of the face of the subject based on the conventional image recognition technology. For example, the emotional state of the subject may be determined by analyzing still images or movements of the middle of the subject's face (eyes, eyes, eyebrows, etc.).

In addition, the output device 130 is a voice output device 130a such as a speaker that can output a voice signal, such as a voice message, music to the outside of the terminal, or outputs a video signal such as a still image, a video, etc. to the outside of the terminal It may be an image output device 130b. In addition, according to the present invention, the wireless output device 130c may transmit the message to a third party through a wireless communication base station and an exchange station.

2 is a block diagram of a wireless communication terminal according to a second embodiment of the present invention.

Referring to FIG. 2, a second embodiment of a wireless communication terminal having a message output function corresponding to an emotional state of a subject according to the present invention will be described.

The wireless communication terminal 230 according to the second embodiment includes an image information acquisition unit 100, a storage unit 110, a control unit 200, a transmitter 210, a receiver 220, and an output device 130. It is configured to include.

The image information acquisition unit 100 obtains image information of a face of a subject through a camera attached to a wireless communication terminal. The controller 200 receives an image signal from the image information acquisition unit 100 and determines an emotional state of the subject using an emotional state analysis algorithm. The transmitter 210 transmits the emotional state of the subject determined by the controller 200 to a service provider providing various messages using a wireless communication network. The service provider has a server that stores various messages, and the service provider specifies a message corresponding to the emotional state of the received subject, and then a service specific message is specified by the service provider through the wireless communication network. Is received. The message received by the terminal may be output directly to the outside of the terminal through the output device 130 or may be stored in the memory device 110 and output to the outside of the terminal through the output device 130. .

3 is a message output method according to a third preferred embodiment of the present invention.

Referring to FIG. 3, a third embodiment of a message output method corresponding to an emotional state of a subject using a wireless communication terminal according to the present invention will be described.

First, image information of a face of a subject is obtained (S300). The obtained image information may be a still image of a face of a subject photographed at a specific time through a camera built in the terminal, or a motion image representing the movement of the face of the subject photographed for a predetermined time. In addition, the obtained image information may be a still image or a moving image of capturing the other's face during a video call with a third party.

Thereafter, the image signal obtained in the image information obtaining step (S300) is analyzed using an emotional state analysis algorithm, and the emotional state of the subject is determined (S310). The emotional state analysis algorithm is the same as the emotional state analysis algorithm described above.

Thereafter, a message corresponding to the determined emotional state of the subject is specified (S320). Here, the method of specifying the message corresponding to the emotional state may vary. For example, if the emotional state of the subject is analyzed as angry, you can specify a voice message, a video, or a funny picture with interesting humor. If the emotional state of the subject is analyzed as happy, the congratulatory message is included. You can also specify a message. In another example, when the emotional state of the subject is analyzed as a depressed state, pleasant music may be specified. In addition, when specifying a message in this step, the message stored in the storage device of the terminal can be searched and specified.

Thereafter, the specified message is output to the outside of the terminal (S330). In this case, the specified message may be output through a voice output device or an image output device or transmitted to a third party through a wireless communication network. In particular, when the subject is a third party, the emotional state of the third party may be changed by transmitting a message to the third party through the wireless communication network.

4 is a message output method according to a fourth preferred embodiment of the present invention.

Referring to FIG. 4, a fourth embodiment of a message output method corresponding to an emotional state of a subject using a wireless communication terminal according to the present invention will be described.

First, image information of a face of a subject is obtained (S400). The obtained image information may be a still image of the face of the subject photographed at a specific time through a camera built in the terminal, or a moving image representing the movement of the face of the subject photographed for a predetermined time. In addition, the obtained image information may be a still image or a moving image of capturing the other's face during a video call with a third party.

Thereafter, the image signal obtained in the image information acquiring step (S400) is analyzed using an emotional state analysis algorithm and the emotional state of the subject is determined (S410). The emotional state analysis algorithm is the same as the emotional state analysis algorithm described above.

Thereafter, the emotion state of the specified subject is transmitted to a service provider providing various messages using a wireless communication network (S420). Here, the service provider specifies a message corresponding to the emotional state of the received subject.

Thereafter, the service provider receives a specific message to the terminal through the wireless communication network (S430). Here, the message received by the terminal may be stored in a storage device such as a memory of the terminal.

Thereafter, the terminal outputs the received message to the outside of the terminal (S440). In this case, the specified message may be output through a voice output device or an image output device or transmitted to a third party through a wireless communication network. In particular, when the subject is a third party, the emotional state of the third party may be changed by transmitting a message to the third party through the wireless communication network. In addition, the message received by the terminal may be output directly to the outside of the terminal through the output device, or may be stored in the storage device and then output to the outside of the terminal through the output device.

The present invention described above is capable of various substitutions, modifications, and changes without departing from the spirit of the present invention for those skilled in the art to which the present invention pertains. It is not limited by the drawing.

The effects of the message output device and method corresponding to the emotional state of the subject in the wireless communication terminal with a camera according to the present invention described above are as follows.

First, according to the present invention, by using the image recognition technology to analyze the movement of the eye, eyes, eyebrows, etc. of the subject's face to determine the emotional state of the subject, and outputs a message corresponding to the subject in a bad emotional state You can get away from it and have fun and be happy.

Second, according to the present invention, after photographing a face of a third party, such as a colleague or a friend who is not a terminal user, the third party has a bad emotional state by analyzing the third party's emotional state and transmitting a corresponding message to the third party. You can get away from it and get to a good emotional state.

Third, according to the present invention, since a character input is not required through the keypad of the terminal, the same effect can be obtained by easily implementing the present invention in any language region of the world.

Claims (22)

A camera for photographing the face of the subject; And Wireless communication having a message output function corresponding to the emotional state of the subject including a control unit for analyzing the image information provided from the camera to determine the emotional state of the subject, and outputs a message corresponding to the determined emotional state terminal. The method of claim 1, The wireless communication terminal having a message output function corresponding to the emotional state of the subject, characterized in that it further comprises an output device for outputting the message to the outside according to the control signal of the controller. The method of claim 2, wherein the output device unit, A voice output device for outputting a voice signal to the message; An image output device for outputting the message as an image signal; And And a message output function corresponding to an emotional state of a subject, characterized in that it comprises at least one of a wireless communication module for transmitting the message to an external terminal. The method of claim 3, wherein the wireless communication module, And a message output function corresponding to an emotional state of a subject, wherein the message is transmitted to a terminal in which the subject is registered as a user. The method of claim 1, wherein the control unit, And a message output function corresponding to the emotional state of the subject, wherein the emotional state of the subject is determined using an emotional state analysis algorithm. The method of claim 1, wherein the message, As the determined emotional state is provided to an external service provider, the message received from the external service provider is a message corresponding to the provided emotional state, and has a message output function corresponding to the emotional state of the subject. Communication terminal. Obtaining image information of a face of a subject; Determining the emotional state of the subject by analyzing the acquired image information; And And outputting a message corresponding to the determined emotional state of the subject according to the determination result. The method of claim 7, wherein the obtaining step, And receiving video information of a face of a user of a counterpart terminal when a video call is in progress using the wireless communication terminal. The method of claim 7, wherein the determining step, A message output method corresponding to an emotional state of a subject using a wireless communication terminal, characterized by using an emotional state analysis algorithm. The method of claim 7, wherein the output step, Outputting the message through a speaker; Outputting the message through a display device; And And at least one of transmitting the message to an external terminal through a wireless communication module. The method of claim 7, wherein Providing the determined emotional state of the subject to an external service provider; Receiving a message corresponding to the provided emotional state from the external service provider, The outputting step, the message output method corresponding to the emotional state of the subject using a wireless communication terminal, characterized in that for outputting a message received from the external service provider. delete delete delete delete delete delete delete delete delete delete delete

Images