KR20200068058A - Method and apparatus for helping self-development using artificial intelligence learning - Google Patents

Abstract

The present invention relates to a method for helping self-development of a user through artificial intelligence learning, and more particularly, to a method for helping active development of a user for a specific activity by setting a goal for activities of a user by providing emotional feedback generated by analyzing the behaviors of the user, analyzing communication information with the user, emotions of the user, and movement information of the user to primarily provide a main content suitable for the user, and secondarily providing an auxiliary content based on a result of performing the content.

Description

Method and apparatus for helping self-development using artificial intelligence learning

Provides a method and apparatus for assisting the user's self-development through artificial intelligence learning by initiation, and in particular, self-development customized to the user by acquiring the user's behavior pattern and learning the information obtained through communication with the user It is about a method and a device that can help.

As the demand for mobile devices such as smart phones, smart watches, and tablets has rapidly increased, research on user interface methods related to touch screens provided in smart phones and tablets has been actively conducted. In particular, research is being conducted so that a smartphone or tablet can provide an interface method close to an intuition related to a user's experience, and accordingly, an interface method corresponding to various types of user intuition has been disclosed. .

In addition, the development of applications that can be used in smartphones or tablets is rapidly increasing, and in particular, the development of applications that can help users learn and develop themselves is actively progressing. Conventional self-learning management applications adopt a format in which target values and allocation values are directly input from a user and only display learning information. Therefore, the user is forced to check only the learning inputted by the user and to check the learning trend, and thus, active participation is difficult. Accordingly, the needs of applications that allow users to be actively managed for self-development have increased.

Artificial intelligence is a field of computer science and information technology that studies how computers can do thinking, learning, and self-development. It means that computers can imitate human intelligent behavior. Also, artificial intelligence does not exist by itself, but has many connections directly or indirectly with other fields of computer science. Particularly in modern times, attempts have been made to actively use artificial intelligence elements in various fields of information technology to solve problems in those fields.

In addition, recently, due to the development of artificial intelligence technology, the performance of speech recognition and natural language processing has greatly increased, and accordingly, various speech-based artificial intelligence services have been developed and commercialized. For example, the voice UI of an artificial intelligence speaker or smart phone provides a service through a voice conversation with a user. Simply, a simple command of a user is recognized to provide a service or perform a response, and furthermore, a response or service can be provided by exchanging a conversation with a user and extracting information from the conversation.

Republic of Korea Patent Publication No. 10-2016-0009353 (2016.01.26 published) Republic of Korea Patent Publication No. 10-2016-0105573 (2016.08.19 public)

The technical task according to one start is to learn AI using information through communication with the user (for example, voice-based communication) and activity information of the user to help the user self-development, and based on the learned result. It is to provide a method and device that can provide information, content, notifications, etc. about activities that can help users develop themselves.

According to the first embodiment, a method for assisting self-development through artificial intelligence learning is provided, and obtaining information related to a user's activity goal through communication with a user, and monitoring a user's behavior Based on the result of learning the user monitoring step of acquiring the user's emotion information by generating the user's behavior information and sensing the user's sentiment, the relationship between the acquired behavior information and the sensed emotion information and the user's activity ability Generating an artificial intelligence learning model by using the generated artificial intelligence learning model, and assigning different weights to the user's behavior information and emotion information, thereby generating an action map for the user's activity, based on the activity map Providing main content to help achieve the goal of the activity, determining the goal achievement rate for the user's activity through communication with the user running the main content, and providing auxiliary content related to the user's activity according to the goal achievement rate And providing emotional feedback to the user according to the target achievement rate for the user's activity.

According to a second embodiment, an apparatus for assisting self-development through artificial intelligence learning is provided, and the apparatus includes a user interface capable of performing communication with a user, a processor, and a memory storing instructions executable by the processor. Including, by executing instructions, the processor obtains information related to the goal of the user's activity through communication with the user, generates the user's behavior information by monitoring the user's behavior, and senses the user's emotion Based on the result of learning the relationship between the acquired behavior information and sensed emotion information and the user's activity ability, the user who acquires the emotion information of the user is monitored, and the generated artificial intelligence learning model is used. By assigning different weights to the user's behavior information and emotion information, generating the action map for the user's activity, providing the main content to help achieve the activity goal based on the activity map, and executing the main content Through communication with the user, it is possible to determine the target achievement rate for the user's activity, provide supplemental content related to the user's activity according to the goal achievement rate, and provide emotional feedback to the user according to the goal achievement rate for the user's activity. have.

According to the third embodiment, it is possible to provide a computer-readable recording medium in which a program for assisting self-development is recorded through any artificial intelligence learning disclosed herein.

According to one disclosure, personalized self-development information may be provided by recommending activities and contents necessary for a user based on communication information with the user.

According to one disclosure, there is an advantage that the user's learning area can be expanded by recommending and providing content by expanding the user's activity area.

The goal set by the user by providing ancillary activities that may cause the user's interest and ancillary activities that can effectively reach the target set by the user through an action map that expands the user's behavior pattern by initiating work It can provide an effect that can be reached more effectively.

1 is a view for explaining a method for assisting self-development through artificial intelligence learning according to an embodiment.
2 is a flow chart for explaining a method for assisting self-development through artificial intelligence learning by one initiation.
FIG. 3 is a diagram for explaining a case in which a device that assists self-development through artificial intelligence learning by initiation is a robot.
FIG. 4 is an exemplary diagram for explaining a method of assisting a user in achieving his or her goal through a device for assisting self-development through artificial intelligence learning according to one disclosure.
5 is a diagram for explaining an artificial intelligence learning model that generates an action map using information of a user according to one disclosure.
6 is a view for explaining an activity map for a user's activity by one start.
7 is a view showing the configuration of a device that assists self-development through artificial intelligence learning by one initiation.

Terms used in the specification will be briefly described, and the present invention will be described in detail.

The terminology used in the present invention has been selected, while considering the functions in the present invention, general terms that are currently widely used are selected, but this may vary according to the intention or precedent of a person skilled in the art or the appearance of a new technology. In addition, in certain cases, some terms are arbitrarily selected by the applicant, and in this case, their meanings will be described in detail in the description of the applicable invention. Therefore, the terms used in the present invention should be defined based on the meanings of the terms and the contents of the present invention, not simply the names of the terms.

When a part of the specification "includes" a certain component, this means that other components may be further included instead of excluding other components, unless specifically stated to the contrary. In addition, terms such as "... unit" and "module" described in the specification mean a unit that processes at least one function or operation, which may be implemented in hardware or software, or a combination of hardware and software. .

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art to which the present invention pertains may easily practice. However, the present invention can be implemented in many different forms and is not limited to the embodiments described herein. In addition, in order to clearly describe the present invention in the drawings, parts irrelevant to the description are omitted, and like reference numerals are assigned to similar parts throughout the specification.

In this specification, sentiment (Sentiment) is information obtained through sentimental analysis (Sentimental analysis), and includes information that can be obtained from the user's voice, video information captured by the user, and conversation with the user. For example, the emotional information of the user includes information about the user's attitude, emotion, and intention, and may more specifically include information about the user's affection, attachment, interest, anxiety, confidence, joy, sadness, and indifference. However, it is not limited thereto.

Emotional analysis is obtained by acquiring the user's thoughts or opinions across various topics, and for example, information for emotional analysis can be obtained by collecting the user's emotional reaction or context to documents, content, interactions, events, etc. . The user's reaction or context can be obtained through the user's speech, text, or other means.

The user's attitude can be understood as a meaning encompassing judgment or evaluation, attachment stage, emotional state, and intended emotional communication, and the type of the specific object is not limited.

In addition, according to an embodiment, the emotion information may include biometric information of the user, and the biometric information of the user may include information on the state and change of the user's body collected using one or more sensors. For example, the bio-information may include a user's body temperature information, sweat discharge amount information, skin characteristic information, heart rate information, blood pressure information, and activity information, which may be used for user emotion analysis.

1 is a view for explaining a method for assisting self-development through artificial intelligence learning according to an embodiment.

Hereinafter, the device 100 that helps self-development through artificial intelligence learning will be described as a self-development helper device 100. The self-development helper device 100 may be a device equipped with artificial intelligence learning ability. For example, the self-development helper device 100 may be a robot in the shape of a person, or a device capable of accessing big data through a network.

In one embodiment, the self-development helper device 100 is disposed at a desk of a user's home or office to communicate with a user and assists self-development according to an embodiment disclosed below, in the form of a desk bot It may, but is not limited to this.

The self-development assistant device 100 includes a mobile phone, a smart phone, a laptop computer, a tablet PC, an e-book terminal, a digital broadcasting terminal, PDA (Personal Digital Assistants), PMP (Portable Multimedia Player), and navigation. , MP3 players, digital cameras, glasses, wristwatches (for example, smart watches) may include wearable devices and electronic devices, and according to an embodiment, an application for performing the self-development help method disclosed below It can be installed and operated.

By one start, the self-development helper device 100 may be a robot. The self-development helper device 100 may assist the user 200 in achieving a goal through communication with the user 200, and may assist the user in self-development in various ways.

By one start, the self-development helper device 100 may obtain information related to a user's activity goal through communication with the user 200. For example, the self-help assistant device 100 may receive a target for improving French proficiency among activities related to language ability from the user 200.

In the present embodiment, setting a goal for improving French proficiency and providing a coaching service accordingly is only disclosed as an example for specifically describing the present invention. The self-development helper device and the self-development service providing method using the same according to the disclosed embodiments can be used not only to help learning French but also other languages, as well as various learning, work, and physical training depending on the user's settings , Can help achieve various self-improvement goals, such as leisure life, and the object is not limited.

For example, the self-help assistant device 100 may set a user's goal through voice input of the user 200, user input through an app, etc., and the method of setting the user's goal is not limited.

The self-development helper device 100 may acquire the emotion of the user 200, a motion signal, and activity data by the user's input while performing an activity related to learning French. For example, emotional information of the user 200 may be obtained based on the user's voice and the image of the user.

In addition, as shown in FIG. 1, information on a user's learning activity may be acquired through a voice input of the user 200. For example, the user 200 may input information that he is learning French through the French proficiency test app provided by the self-development helper device 100, and further, may provide information about external activities related to the French speaking activity. You can type.

The self-development helper device 100 may grasp a behavior pattern during a user's activity related to language learning based on the acquired user's data. For example, it is possible to obtain information that the heart rate increases, the sweat on the skin surface increases, and the movement of the eye becomes active when speaking, rather than performing reading and writing during French learning. . The self-development helper device 100 may determine that learning of a user's speaking activity is necessary. The self-development helper device 100 may recommend content that helps the user's speaking activity by starting the work.

For example, the self-development assistant device 100 may classify whether the user enjoys the learning content or is insecure or difficult based on the user's biometric information, and can present different self-development guidelines according to the classification result. have.

The self-development assistance device 100 may determine a matching rate between a user's current learning state and a target set by the user through artificial intelligence learning by starting one. The self-development helper device 100 may determine the achievement rate of the target set by the user 200 and inform the user 200. In addition, a new app or content may be recommended according to a user's current state.

It will be described in detail below.

2 is a flow chart for explaining a method for assisting self-development through artificial intelligence learning by one initiation.

In one block, the self-development assistance device 100 may provide a step of acquiring information related to a user's activity goal through communication with the user in block 201.

By one start, the self-development assistance device 100 may communicate with the user by receiving a user's voice signal, a gesture signal, and a signal through the user interface, and answering the received signal.

More specifically, the self-help assistant device 100 may provide a plurality of question messages for activities and receive a plurality of answer messages from a user. In addition, the self-development helper device 100 receives a plurality of answer messages, and simultaneously includes a user's eye movement information, heart rate information, facial expression information, body movement information, and language information of a user who creates a plurality of response messages. Information can be monitored.

For example, the self-development helper device 100 provides a problem related to French learning as a question message, and acquires the user's eye movement information, heart rate information, facial expression information, body movement information, and language information for the question message By doing so, it is possible to determine what emotion the user feels when dealing with the question message. The self-development assistant device 100 may determine a user's learning level through a question message of various aspects of the activity.

Also, the self-help assistant device 100 may provide a step of generating new question message and feedback gesture information based on the monitored user information. Here, the new question message may include an in-depth question of the previous question message, or may include a question of another aspect.

The feedback information and the gesture information may be provided as a reward for the user's learning, and may be generated by reflecting the gesture information of the user monitored during the activity.

According to one disclosure, the self-development helper device 100 may provide a step of performing a feedback gesture while providing a new question message. For example, the self-development helper device 100 may provide a familiarity to a user by expressing a gesture frequently used by a user during a French learning activity, and may provide feedback to help the user learn.

In one embodiment, the self-help assistant device 100 may be difficult to follow the user's gesture equally due to morphological or mechanical limitations. In this case, the self-development helper device 100 may simplify the user's gesture, and may perform a simplified gesture within the shape and mechanical action radius of the self-help helper device 100.

In one block, the self-development assistance device 100 may provide a user monitoring step of acquiring the user's emotion information by generating the user's behavior information by monitoring the user's behavior and sensing the user's emotion in block 202. .

By one start, the self-development helper device 100 may acquire information about the user's emotional state, such as the user's posture, reaction, movement, and facial expression, based on the image information captured by the user, and in addition, image analysis Through this, it is possible to collect information on whether the user is wearing a garment or whether the user looks tired or exhausted, and based on this, the user's emotional analysis can be performed.

According to another disclosure, the self-help device 100 measures a user's body temperature, a temperature sensor that measures the user's sweat discharge, a sensor that measures the user's skin characteristics, and a user's heart rate. The user may obtain biometric information of the user by using a sensor unit including at least one of a heart rate sensor, a blood pressure sensor measuring a user's blood pressure, and a motion sensor measuring the user's activity. In addition, the self-development helper device 100 may generate management information for the user's emotions by considering at least one of the user's body temperature information, sweat discharge information, skin characteristic information, heart rate information, blood pressure information, and activity information. have.

As a result, the self-development helper device 100 in block 203 learns the relationship between the user's activity and the user's behavior information and emotion information based on the behavior information and the sensed emotion information acquired during the user's activity. Based on the above, it is possible to provide a step of generating an artificial intelligence learning model and generating an action map for a user's activity using the generated artificial intelligence learning model.

By starting the work, the step of generating the action map takes into account the user's body temperature information, sweat discharge information, skin characteristic information, heart rate information, blood pressure information, body movement information and content usage information obtained during the user's activity, It may provide a step of determining the user's interest in the activity.

For example, the self-development helper device 100 may determine whether the user is expressing interest based on the emotion information of the user collected in the French listening activity through the drama while the user is learning French, and thereby, The user's interest level can be determined.

In another embodiment, if the user's heart rate increases, blood pressure rises, and body movement increases, it may be determined that the user is showing interest, thereby determining the user's interest level.

In addition, the self-development helper device 100 may provide a step of determining a layer for a plurality of actions required in performing a user's activity according to a user's interest.

In step 204, the self-development assistance device 100 assigns different weights to the user's action information and emotion information based on the activity map, and provides main content related to the user's activity based on the weights by starting one day. Can provide.

By one start, the self-development helper device 100 compares the hierarchical information of the activity map with the hierarchical difference of the target for the user's activity in the step of providing the main content, and determines at least one content allocated to the activity map Can provide the steps. That is, the self-development helper device 100 may determine how much the user's current learning activity level has reached a target set by the user, and this difference becomes a hierarchical difference. In addition, the self-development helper device 100 may determine a learning field required by the user in order to fill up to an unachieved target value. The self-development helper device 100 may determine at least one content related to a learning field to fill an under-achieved target value.

In addition, the self-development helper device 100 may provide a step of assigning a higher weight to the at least one content as the user's movement is more observed and a higher weight to the user's emotion. For example, the self-development helper device 100 may give a high weight to content with a lot of user movement or a reaction of the sympathetic nerve. Here, the weight means the preference of the user, and is based on the fact that the more the user feels more interesting, the more activity he or she does.

As a result, the self-help assistant device 100 may determine suitable main content to achieve a user's activity goal based on the weight. Furthermore, the self-development helper device 100 may provide the determined main content.

The self-development assistance device 100 in block 205 may provide a step of determining a target achievement rate for a user's activity through communication with a user who executes the main content by a start.

According to one disclosure, the self-development assistant device 100 may generate test content related to a target for the user's activity based on the content of the main content and the auxiliary content performed during the user's activity.

The self-development assistant device 100 may provide test content to the user, receive an answer message from the user, and determine a goal achievement rate for the user's activity according to the correct answer rate of the answer message.

In a step of determining a goal achievement rate for a user's activity by starting a job, the self-development assistant device 100 compares a result of performing the main content with a user's activity goal, and a goal achievement part and a part that does not reach the goal You can create this marked goal achievement map.

For example, if the main content was language learning using a French drama, the goal is achieved depending on whether the user has not completed the number of dramas to be learned for a certain period, or in which areas of listening, writing, or speaking have not been completed. You can create a map.

According to one disclosure, the self-development helper device 100 may provide a step of determining at least one auxiliary content determined to have a higher score as the size of a portion that does not reach the goal is larger, based on the goal achievement map. For example, if it is determined that the dictation field is vulnerable in language learning using the French drama, which is the main content, the French dictation app may be determined as an auxiliary content, or another drama containing an easier level of language may be recommended. At this time, the secondary content may be determined by giving a higher score to the field that the user has determined to be vulnerable.

In addition, the self-help assistant device 100 may sequentially provide at least one auxiliary content according to a high score.

In one block, the self-development assistance device 100 may provide a step of providing auxiliary content related to a user's activity according to a target achievement rate in block 206. The self-development assistance device 100 may directly execute auxiliary content or transmit it to another user's terminal.

The self-development helper device 100 may generate a goal achievement map in which the goal achievement part and the part that has not reached the goal are displayed by comparing the result of performing the main content with the user's activity goal, and based on the goal achievement map In addition, the larger the size of the part that does not reach the target, it is possible to determine at least one auxiliary content determined to have a high score.

In addition, the self-help assistant device 100 may sequentially provide at least one auxiliary content according to a high score.

According to one disclosure, the self-development assistance device 100 in block 207 may provide a step of providing emotional feedback to the user according to a target achievement rate for the user's activity.

The step of providing emotional feedback by starting the work is generated based on the behavioral information and emotional information monitored as the user performs the activity, the goal achievement rate for the activity, information on the goal, activity attributes, and activity duration Emotional feedback information. For example, if the emotion information and monitoring behavior information acquired during a user's French speaking activity are related to pleasure, the self-development assistance device 100 may reflect the user's emotion information and provide emotional feedback.

By one initiation, the emotional feedback information may include visual feedback, olfactory feedback, and tactile feedback related to emotion. For example, when the self-development helper device 100 is a human-shaped robot, it may transmit a good scent, vibration, and the like with words of praise to the user. In addition, the robot can give a visual effect through movement.

FIG. 3 is a diagram for explaining a case in which a device that assists self-development through artificial intelligence learning by initiation is a robot.

By one start, the self-help assistant device 100 may communicate with other devices, other servers, or the like using wired or wireless communication. For example, the self-development helper device 100 may communicate with a content providing server in order to provide content suitable for a user in order to help achieve a target set by the user.

In this specification, the server may mean a server based on hardware installed in a specific location, but may also mean a cloud server. That is, the self-development assistant device 100 according to the disclosed embodiment is connected to a server or a cloud to upload information, download content, and back up necessary information. The server or cloud stores information, and can serve to provide necessary content.In addition, an artificial intelligence model can be used to process information to generate a response, and according to an embodiment, a SaaS type application is provided. The self-development helper device 100 may assist in performing a specific task.

By one start, the self-development assistance device 100 may include at least one camera capable of monitoring a user's behavior, and may move the camera in pursuit of the user's movement. In addition, the self-development assistance device 100 may record a user's movement.

By one disclosure, the self-help assistant device 100 may include a display, a camera, a recorder, and a speaker to communicate with a user. For example, the self-help assistant device 100 may acquire a user's voice signal and a gesture signal using a recorder and a camera, and may use a display and a speaker to transmit a feedback signal to the user.

In addition, the self-development helper device 100 may be a robot that resembles a human shape, and thus may include a portion similar to a human joint. For example, the self-development assistance device 100 may move a head, arm, leg, or body using a moving unit to follow a user's action or transmit a feedback signal to the user.

FIG. 4 is an exemplary diagram for explaining a method of assisting a user in achieving his or her goal through a device for assisting self-development through artificial intelligence learning according to one disclosure.

By one start, the self-development helper device 100 may acquire the user's information in real time through continuous communication with the user or the user's terminal 201. In addition, an objective related to the user's learning may be input from the user, and an activity map for the user's learning activity may be generated using the user's record or acquired user information.

At this time, the user's terminal 201 includes a mobile phone, a smart phone, a notebook computer, a terminal for digital broadcasting, a PDA (Personal Digital Assistants), a portable multimedia player (PMP), a camera, navigation, and a tablet computer ( tablet computer), an e-book terminal, and a smart watch.

In addition, the self-development assistance device 100 may periodically transmit a question message to the user. In addition, the self-development helper device 100 may assist the self-development of a user located at a remote location by transmitting a question message to the user's terminal 201.

In addition, the self-development assistance device 100 may help the user's self-development by transmitting a learning notification message to the user's terminal 201 according to the learning schedule. In addition, the self-development helper device 100 may expand the direction of the user's self-development by recommending other content related to learning.

5 is a diagram for explaining an artificial intelligence learning model that generates an action map using information of a user according to one disclosure.

By one start, the self-help assistant device 100 may generate an action map using information of a user related to the activity. The self-development helper device 100 may obtain information related to a user's activity goal through communication with the user.

According to one disclosure, the artificial intelligence learning model may learn interests and abilities of the user's use of the content by using the user's activity information, the user's content usage information, the user's behavior information, and the user's emotion information. The artificial intelligence learning model can learn interests and abilities of users' use of content by using big data about interests and abilities of other users' use of content.

The self-development helper device 100 may monitor the user's behavior to generate the user's behavior information, and sense the user's emotion to obtain the user's emotion information.

In addition, an artificial intelligence learning model is generated based on a result of learning a relationship between a user's activity and a user's behavior information and emotion information based on the acquired behavior information and sensed emotion information among the user's activities, and the generated Using an AI learning model, an action map for a user's activity can be generated.

By one start, the self-development helper device 100 may modify the action map using user information updated in real time, and may share it with other users.

6 is a view for explaining an activity map for a user's activity by one start.

By one initiation, the activity map can be used to determine what learning is needed to achieve the learning activities and goals for the user-specified activities.

By one initiation, the activity map may be generated by an artificial intelligence learning model, and the user's preferred activity based on the activity record by the physical change, emotional change, content use, etc. that the user shows in performing a specific activity, Maps can be created for activities required by the user.

By one start, the self-development assistance device 100 may change the activity map while periodically tracking the user's activity and physical changes. In addition, when a new activity is added, an activity map for a new activity may be created using a previously created activity map.

7 is a view showing the configuration of a device that assists self-development through artificial intelligence learning by one initiation.

As illustrated in FIG. 7, the self-development assistance device 100 according to an embodiment may include a control unit 1300, a communication unit 1500, and a memory 1700. However, not all of the components shown in FIG. 7 are essential components of the self-development helper device 100. The self-development helper device 100 may be implemented by more components than the components shown in FIG. 7, or the self-help helper device 100 may be implemented by fewer components than the components shown in FIG. 7 have.

For example, as illustrated in FIG. 7, the self-development assistance device 100 according to an embodiment includes a user interface 1100 and an output unit in addition to the control unit 1300, the communication unit 1500, and the memory 1700. 1200, a sensing unit 1400, and an A/V input unit 1600 may be further included.

For example, the self-development helper device 100 according to an embodiment may basically include a control unit 1300, a user interface 1100, and a memory 1700, and the self-help helper device according to an embodiment ( 100), in addition to the control unit 1300, the communication unit 1500, and the memory 1700, further includes at least one of the communication unit 1500, the output unit 1200, the sensing unit 1400, and the A/V input unit 1600 Self-development helper device 100 may be.

The user interface 1100 refers to a means for a user to input data for controlling the self-development assistance device 100. For example, the user interface 1100 includes a key pad, a dome switch, and a touch pad (contact capacitive type, pressure resistive film type, infrared sensing type, surface ultrasonic conduction type, integral type) Tension measurement method, piezo effect method, etc.), a jog wheel, a jog switch, and the like, but are not limited thereto.

The user interface 1100 may receive a user input for user input to control the operation of the module installed in the self-help development device 100.

According to one disclosure, the user interface 1100 may be included in the self-development assistance device 100 or may be remotely located. According to one disclosure, the user interface 1100 may include at least one open hardware platform that supports the Internet of Things (IoT). For example, the user may transmit the user input to the self-help assistant device 100 through at least one open hardware platform in the form of video, voice, text, and the like.

Furthermore, the customized self-help assistant device 100 is wirelessly linked with a separate external device such as a speaker, a loudspeaker, a microphone, a camera, a display device, and a drone based on the Internet of Things (IoT) technology, and through these external devices. User input can be received.

The output unit 1200 may output an audio signal, a video signal, or a vibration signal, and the output unit 1200 may include a display unit 1210, an audio output unit 1220, and a vibration motor 1230. have. In one embodiment, the output unit 1200 may output a notification message in the form of audio, video, and/or vibration.

The display unit 1210 displays and outputs information processed by the self-development assistance device 100.

The audio output unit 1220 outputs audio data received from the communication unit 1500 or stored in the memory 1700. In addition, the sound output unit 1220 outputs sound signals related to functions (for example, call signal reception sound, message reception sound, and notification sound) performed by the self-development assistance device 100. For example, the sound output unit 1220 may output an alarm sound for notifying that an event has occurred.

The control unit 1300 controls the overall operation of the self-development assistance device 100. By one disclosure, the control unit is also referred to as a processor. For example, the control unit 1300, by executing the programs stored in the memory 1700, the user interface 1100, the output unit 1200, the sensing unit 1400, the communication unit 1500, the A/V input unit 1600 ) Etc. can be controlled overall. In addition, the control unit 1300 may execute the functions stored in the memory 1700 to perform the function of the self-help helper device 100. The control unit 1300 may include at least one processor. The controller 1300 may include a plurality of processors or a single processor in an integrated form according to its function and role. In one embodiment, the control unit 1300 may include at least one processor to provide a notification message by executing at least one program stored in the memory 1700.

The sensing unit 1400 may detect a state of the self-development helper device 100, a user's state, or a state around the self-development helper device 100 and transmit the sensed information to the control unit 1300.

The sensing unit 1400 includes a magnetic sensor 1410, an acceleration sensor 1420, a temperature/humidity sensor 1430, an infrared sensor 1440, a gyroscope sensor 1450, and a position sensor (Eg, GPS) 1460, a barometric pressure sensor 1470, a proximity sensor 1480, and may include at least one of an RGB sensor (RGB sensor) 1490, but is not limited thereto. The function of each sensor can be intuitively deduced by a person skilled in the art from the name, so a detailed description will be omitted.

The communication unit 1500 may include one or more components that enable the self-development assistance device 100 to communicate with other devices and other servers. For example, the communication unit 1500 may include a short-range communication unit 1510, a mobile communication unit 1520, and a broadcast reception unit 1530. Other user devices may be computing devices or sensing devices, but are not limited thereto.

The short-range wireless communication unit (1500) 1510 includes a Bluetooth communication unit 1500, a Bluetooth Low Energy (BLE) communication unit 1500, a near-field wireless communication unit 1500 (Near Field Communication unit), and a WLAN ( Wi-Fi) communication unit 1500, Zigbee communication unit 1500, infrared data association (IrDA) communication unit 1500, WFD (Wi-Fi Direct) communication unit 1500, ultra wideband (UWB) communication unit 1500 , Ant+ communication unit 1500, and the like, but is not limited thereto.

The mobile communication units 1500 and 1520 transmit and receive wireless signals to and from at least one of a base station, an external terminal, and a server on a mobile communication network. Here, the wireless signal may include various types of data according to transmission and reception of a voice call signal, a video call signal, or a text/multimedia message.

The broadcast receiving unit 1530 receives a broadcast signal and/or broadcast-related information from the outside through a broadcast channel. The broadcast channel may include a satellite channel and a terrestrial channel. Depending on the implementation example, the self-help assistant device 100 may not include the broadcast receiving unit 1530.

In one embodiment, the communication unit 1500 may receive a video sequence including a plurality of frames (frames) from a camera installed in the self-development assistance device 100. In one embodiment, the communication unit 1500 may transmit a command for controlling the operation of the module installed in the self-development helper device 100 to the module installed in the self-help helper device 100.

The A/V (Audio/Video) input unit 1600 is for inputting an audio signal or a video signal, which may include a camera 1610 and a microphone 1620. The camera 1610 may obtain an image frame such as a still image or a video through an image sensor in a video call mode or a shooting mode. The image captured through the image sensor may be processed through the control unit 1300 or a separate image processing unit (not shown). For example, an image photographed by the camera 1610 may be used as information for determining whether an event has occurred.

The microphone 1620 receives external sound signals and processes them as electrical voice data. For example, the microphone 1620 may receive an acoustic signal from an external device or user. The microphone 1620 may use various noise removal algorithms to remove noise generated in the process of receiving an external sound signal.

The memory 1700 may store a program for processing and control of the control unit 1300, and may store data input to or output from the self-development helper device 100.

The memory 1700 is a flash memory 1700 type, a hard disk type, a multimedia card micro type, a card type memory 1700 (for example, SD or XD memory (1700, etc.), RAM (RAM, Random Access Memory) SRAM (Static Random Access Memory), ROM (ROM, Read-Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM (Programmable Read- Only Memory), a magnetic memory 1700, a magnetic disk, an optical disk may include at least one type of storage medium.

Programs stored in the memory 1700 may be classified into a plurality of modules according to their functions. Here, the plurality of modules are software, not hardware, which means a functionally operating module, for example, a UI module ( 1710), a touch screen module 1720, a notification module 1730, and the like.

The UI module 1710 may provide specialized UIs, GUIs, and the like, which are interlocked with the self-development assistance device 100 for each application. The touch screen module 1720 may detect a touch gesture on the user's touch screen and transmit information regarding the touch gesture to the controller 1300. The touch screen module 1720 according to an embodiment may recognize and analyze a touch code. The touch screen module 1720 may be configured with separate hardware including a controller.

The notification module 1730 may generate a signal for notifying the occurrence of an event. The notification module 1730 may output a notification signal in the form of a video signal through the display unit 1210, or may output a notification signal in the form of an audio signal through the sound output unit 1220, or the vibration motor 1230. It is also possible to output a notification signal in the form of a vibration signal.

The method according to an embodiment of the present invention may be implemented in the form of program instructions that can be executed through various computer means and recorded in a computer readable medium. The computer-readable medium may include program instructions, data files, data structures, or the like alone or in combination. The program instructions recorded on the medium may be specially designed and configured for the present invention, or may be known and available to those skilled in computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical media such as CD-ROMs, DVDs, and magnetic media such as floptical disks. Includes hardware devices specifically configured to store and execute program instructions such as magneto-optical media, and ROM, RAM, flash memory, and the like. Examples of program instructions include high-level language code that can be executed by a computer using an interpreter, etc., as well as machine language codes produced by a compiler.

Although the embodiments of the present invention have been described in detail above, the scope of the present invention is not limited thereto, and various modifications and improvements of those skilled in the art using the basic concept of the present invention defined in the following claims are also provided. It belongs to the scope of rights.

Claims (8)

Obtaining information related to a target for the user's activity through communication with the user;
A user monitoring step of acquiring behavior information of the user by monitoring the behavior of the user, and acquiring emotion information of the user by sensing the emotion of the user;
Based on a result of learning the relationship between the acquired behavior information and sensed emotion information and the user's activity ability, an artificial intelligence learning model is generated, and the generated artificial intelligence learning model is used to generate the user's behavior information and emotion. Generating action maps for the user's activities by assigning different weights to the information;
Providing main content to help achieve a goal for the activity based on the activity map;
Determining a target achievement rate for the user's activity through communication with a user who executes the main content;
Providing auxiliary content related to the user's activity according to the target achievement rate; And
And providing emotional feedback to the user according to a target achievement rate for the user's activity. A method of assisting self-development through artificial intelligence learning. According to claim 1,
The step of providing the emotional feedback,
It includes behavior information and emotional information obtained while the user performs the user's activity, and emotional feedback information generated based on a goal achievement rate, goal information, activity attribute, and activity duration for the activity, ,
The emotional feedback information includes visual feedback, olfactory feedback, and tactile feedback related to emotion. A method of assisting self-development through artificial intelligence learning. According to claim 1,
The step of generating the action map,
Analyzing the emotion of the user based on the user's voice information and video information obtained during the user's activity, and determining the user's interest in the activity in consideration of the user's emotion analysis result and content usage information ; And
And determining a hierarchy of a plurality of actions required to perform the user's activity according to the user's interest level. A method of helping self-development through artificial intelligence learning. According to claim 1,
To communicate with the user,
Providing a plurality of question messages for the activity and receiving a plurality of answer messages from the user;
Monitoring the user information including eye movement information, heart rate information, facial expression information, body movement information and language information of a user who composes the plurality of response messages while receiving the plurality of response messages;
Generating new question message and feedback gesture information based on the monitored user information; and
A method of assisting self-development through artificial intelligence learning, including; performing a feedback gesture while providing the new question message. According to claim 1,
The step of providing the main content,
Determining at least one content allocated to the activity map by comparing hierarchical information of the activity map with a hierarchical difference of a target for the user's activity;
Assigning a higher weight to the at least one content as the user's movement is more observed, and assigning a higher weight to the user's emotion when the change width is greater;
Determining suitable main content to achieve the user's activity goal based on the weight; and
Providing the determined main content; including, a method of assisting self-development through artificial intelligence learning. According to claim 1,
Determining a target achievement rate for the user's activity,
Comparing the result of performing the main content with the user's activity goal, and generating a goal achievement map in which the goal achievement part and the part that did not reach the goal are displayed;
Determining, based on the goal achievement map, at least one auxiliary content determined to have a higher score as the size of a portion that does not reach the goal is large; and
And providing the at least one auxiliary content sequentially according to a high score. According to claim 1,
Determining a target achievement rate for the user's activity,
Generating test content related to a goal for the user's activity based on the content of the main content and the auxiliary content performed during the user's activity;
Providing the test content to a user and receiving an answer message from the user; and
And determining a target achievement rate for the user's activity according to the correct answer rate of the answer message. A method of assisting self-development through artificial intelligence learning. A user interface capable of receiving user input;
Processor; And
And a memory for storing instructions executable by the processor, wherein the processor includes:
By executing the above commands,
Acquire information related to the goal of the user's activity through communication with the user, generate the user's behavior information by monitoring the user's behavior, and sense the user's emotion by sensing the user's emotion Monitoring the acquired user, generating an artificial intelligence learning model based on a result of learning the relationship between the acquired behavior information and sensed emotion information and the user's activity ability, and using the generated artificial intelligence learning model to By assigning different weights to the user's behavior information and emotion information, an action map for the user's activity is generated, and main content that helps to achieve a goal for the activity is provided based on the activity map. The target achievement rate for the user's activity is determined through communication with the user who executes the main content, the auxiliary content related to the user's activity is provided according to the goal achievement rate, and the target achievement rate for the user's activity is determined. A device that provides self-development through artificial intelligence learning that provides emotional feedback to the user.

Images