KR20190094080A - Interactive ai agent system and method for actively providing an order or reservation service based on monitoring of a dialogue session among users, computer readable recording medium - Google Patents

Abstract

Provided is a method of providing an active order or reservation service based on monitoring of a conversation session between a plurality of users provided by an interactive AI agent system. According to the present invention, the method comprises: a step of receiving user input from one or more among the plurality of users during the conversation session wherein the user input is the conversation input exchanged between the plurality of users; a step of determining, based on a predetermined knowledge base, a predetermined user intent corresponding to the user input; a step of determining, based on the received user intent, whether a user intention, which desires a predetermined order or reservation for a predetermined number or more of the plurality of users, has been obtained; a step of generating a conversation flow consistent with the user intent in response to determining that the user intent, which desires a predetermined order or reservation for a predetermined number or more of users, has been obtained; and a step of performing a conversation and/or a task for a given order or reservation based on the generated conversation flow.

Description

INTERACTIVE AI AGENT SYSTEM AND METHOD FOR ACTIVELY PROVIDING AN ORDER OR RESERVATION SERVICE BASED ON MONITORING OF A DIALOGUE SESSION AMONG USERS, COMPUTER READABLE RECORDING MEDIUM}

TECHNICAL FIELD This disclosure relates to active monitoring and intervention for an online conversation session between users by an interactive AI agent system, and more specifically, an interactive AI agent system monitors an online conversation session between users and separates from the user. Without explicit and specific request, the present invention relates to a technology for actively providing an order or reservation service for a plurality of users participating in the conversation session, if actively determined as necessary.

In recent years, with advances in the field of artificial intelligence, in particular in the field of understanding natural language, the user has moved away from the operation of the traditional machine-oriented command input / output schemes, thereby allowing users to use natural language in a more human-friendly manner, such as speech and / or text. Increasingly, the development and use of interactive AI agent systems (e.g., chatbots), which enable the operator to operate the machine in a mediated manner and obtain the desired service from the machine. Accordingly, in a variety of fields, including but not limited to online counseling centers, online shopping malls, and the like, the user can provide the desired information or service to the interactive AI agent system through natural language conversations in the form of voice and / or text. You can request and get the results you want from it.

On the other hand, with the expansion of smartphones, the use of various online conversation services (eg, instant messenger services) has exploded, and a large part of people's conversations in their lives is now made through online conversations. Online conversations allow people to exchange conversations on a variety of topics in real time with one or more remote parties. In particular, in recent years, an instant messenger service has been increasingly combined with an interactive AI agent system to allow people to obtain desired information or services from the interactive AI agent system as if they are talking to a friend through instant messages. .

Patent Document 1: Korean Patent Application No. 10-2015-0175948

However, until now, when a user wants to use an interactive AI agent system, the user has to actively step forward and make an explicit and direct request for desired information or service for the interactive AI agent system. In particular, when an online conversation session between multiple users requires an order or reservation service for some or all of the multiple users (e.g., when multiple users want to order food for delivery together, or when they want to book a concert together) Until now, each of the multiple users has explicitly requested a separate service for themselves for the interactive AI agent system, or a representative of the multiple users has come up with the interactive AI agent system for services for themselves and others. Had to be explicitly requested separately. This process not only causes interruption of the existing conversation but also involves cumbersome procedures, which is inconvenient for the user.

According to one aspect of the present disclosure, there is provided a method of providing an active order or reservation service based on monitoring of a multi-user conversation session provided by an interactive AI agent system. A method of the present disclosure includes receiving user input from one or more of a plurality of users during a chat session, wherein the user input is a chat input to and from a plurality of users, the user input being based on a predetermined knowledge base. Determining a predetermined user intention, and determining, based on the received user intention, whether a user intention that desires a predetermined order or reservation for a predetermined number or more of a plurality of users has been obtained; In response to determining that a user intent that desires a predetermined order or reservation for a predetermined number or more of users has been obtained, generating a conversation flow consistent with the user intent; And performing a conversation and / or task for a predetermined order or reservation based on the generated conversation flow.

According to one embodiment of the present disclosure, a given order or reservation is associated with one of food, goods and services, and performing a conversation and / or task comprises: food, goods and service associated with a given order or reservation Performing conversations and / or tasks to determine a vendor to provide one of.

According to one embodiment of the present disclosure, performing the conversation and / or task comprises: performing a conversation and / or task for determining each desired item associated with a given order or reservation for each of a predetermined number of users. It may include.

According to one embodiment of the present disclosure, performing the conversation and / or task may include proceeding with a payment associated with a given order or reservation.

According to one embodiment of the present disclosure, performing the conversation and / or task may include obtaining confirmation regarding the progress of the order or reservation by at least one of the predetermined number of users.

According to an embodiment of the present disclosure, the performing of the dialog and / or the task for determining the business may include: providing a list of a plurality of companies, one of a plurality of companies from each of a predetermined number of users Receiving a selection of, and based on a result of receiving a selection of the business from each of the predetermined number of users or more, determining the business.

According to one embodiment of the present disclosure, performing a conversation and / or task for determining each desired item associated with a given order or reservation for each of the predetermined number of users comprises: providing a list of a plurality of items And receiving a selection of an item from a list of the plurality of items from each of the predetermined number of users.

According to one embodiment of the present disclosure, the step of making a payment associated with a predetermined order or reservation may include the step of making a payment with respect to each of a predetermined number or more of users or a representative of the predetermined number or more of users.

According to another aspect of the present disclosure, a computer readable recording medium comprising one or more instructions, wherein the one or more instructions, when executed for a computer, cause the computer to perform the method of any one of claims 1 to 8. A computer readable recording medium is provided for carrying out.

According to yet another aspect of the present disclosure, an interactive AI agent system is provided that is configured to provide monitoring for multiple user talk sessions and provide active ordering or reservation services based thereon. The interactive AI agent system of the present disclosure includes a communication module, an NLU module, and a chat session monitoring / intervention module, wherein the communication module comprises: user input from one or more of the plurality of users during the chat session, wherein the user input is a multi-user Is a conversation input to and from the communication device, and the NLU module is configured to determine, based on a predetermined knowledge base, a predetermined user intention corresponding to the user input, and the conversation session monitoring / intervention module is configured to receive the received message. Based on the user intention, it is determined whether a user intention that desires a predetermined order or reservation for a predetermined number or more of the plurality of users is obtained, and that the user intention that desires a predetermined order or reservation for a predetermined number or more of users is obtained. In response to the determination, generate a conversation flow in accordance with the user intention, and Based on the conversation flow, configured to perform the conversation and / or task for a given order or reservation.

According to the present disclosure, during a conversation with another user through an online conversation session, the user does not have to actively open a separate conversation session or make a separate specific request for the interactive AI agent system. You can immediately get the information or services you want from them. According to the present disclosure, since the interactive AI agent system operates as if it is another human user participating in a conversation between users, the user can conveniently obtain appropriate services in a timely manner.

1 is a diagram schematically illustrating a system environment in which an interactive AI agent system may be implemented, according to an embodiment of the present disclosure.
2 is a functional block diagram schematically illustrating the functional configuration of the user terminal 102 of FIG. 1, according to an embodiment of the disclosure.
3 is a functional block diagram schematically illustrating the functional configuration of the interactive AI agent server 108 of FIG. 1, in accordance with an embodiment of the present disclosure.
4 provides for monitoring of a chat session between users through an online chat service server 106 and provision of an order / reservation service based thereon, performed by the interactive AI agent server 108, according to one embodiment of the disclosure. Is a flow diagram illustrating an exemplary operational flow for the purpose.
5A through 5E illustrate that, according to an embodiment of the present disclosure, the interactive AI agent server 108 intervenes a conversation session between users through an online conversation service server 106 to perform a corresponding conversation session. This is a screen showing an exemplary chat window when a predetermined order service is provided on the screen.

Hereinafter, exemplary embodiments of the present disclosure will be described in detail with reference to the accompanying drawings. In the following, when it is determined that there is a risk of unnecessarily obscuring the subject matter of the present disclosure, a detailed description of already known functions and configurations will be omitted. In addition, it should be understood that what is described below is only related to an embodiment of the present disclosure, but the present disclosure is not limited thereto.

The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the present disclosure. For example, a component expressed in the singular should be understood as a concept including a plurality of components unless the context clearly indicates the singular. It is to be understood that the term "and / or" as used in this disclosure encompasses all possible combinations by one or more of the listed items. The terms 'comprise' or 'having' as used in the present disclosure are merely intended to designate that there exists a feature, number, step, operation, component, part, or combination thereof described on the present disclosure. It is not intended to exclude the possibility of the presence or the addition of one or more other features or numbers, steps, actions, components, parts or combinations thereof by use.

In the exemplary embodiment of the present disclosure, the module or the unit means a functional part that performs at least one function or operation, and may be implemented in hardware or software or in a combination of hardware and software. Also, a plurality of 'modules' or 'units' may be integrated by at least one software module and implemented by at least one processor, except for 'modules' or 'units', which need to be implemented by specific hardware. have.

In an embodiment of the present disclosure, the interactive AI agent system may be a natural language input (eg, a natural language) input from a user through an interactive interaction with a user through a natural language in the form of voice and / or text. Receive and interpret commands, statements, requests, questions, etc.) from the identified user to determine the user's intent and perform the necessary actions based on the user's intent, i.e. provide appropriate conversational responses and / or tasks It may refer to any information processing system capable of providing performance of, but is not limited to any particular form.

In an embodiment of the present disclosure, the dialogue response provided by the 'interactive AI agent system' may be in visual, auditory and / or tactile form (eg, voice, sound, text, video, image, symbol, emoticon, hyperlink, It may be included in various forms such as, but not limited to, animation, various knots, motion, haptic feedback, and the like. Tasks performed by the 'interactive AI agent system' in an embodiment of the present disclosure may include, for example, searching for information, placing an order, making a reservation or making a payment, writing an SMS message, writing an email, making a call, searching a user location, and the like. It may include various types of tasks (however, they are illustrative only and not limiting).

In addition, all terms used in this disclosure, including technical or scientific terms, unless otherwise defined, have the same meaning as commonly understood by one of ordinary skill in the art to which this disclosure belongs. It is to be understood that the terms used in the dictionary, which are generally used, should be interpreted as having a meaning consistent with the contextual meaning of the related art, and shall not be construed as being excessively limited or extended unless clearly defined otherwise in this disclosure. .

Hereinafter, exemplary embodiments of the present disclosure will be described in detail with reference to the accompanying drawings.

1 is a diagram schematically illustrating a system environment 100 in which an interactive AI agent system may be implemented, in accordance with an embodiment of the present disclosure. As shown, the system environment 100 includes a plurality of user terminals 102a-102n, a communication network 104, an online chat service server 106, an interactive AI agent server 108, and an external service server 110. ).

According to one embodiment of the present disclosure, each of the plurality of user terminals 102a-102n may be any user electronic device having a wired or wireless communication function. Each of the user terminals 102a-102n may be various wired or wireless communication terminals including, for example, a smartphone, a tablet PC, a music player, a smart speaker, a desktop, a laptop, a PDA, a game console, a digital TV, a set-top box, and the like. It should be understood that it is not limited to any particular form.

According to an embodiment of the present disclosure, each of the user terminals 102a-102n may communicate with the online chat service server 106, that is, transmit and receive necessary information through the communication network 104. According to one embodiment of the present disclosure, each of the user terminals 102a-102n, via a communication network 104 and an online chat service server 106, establishes a chat session with one or a plurality of other user terminals 102a-102n. And establish and exchange real-time conversations with one or more other user terminals 102a-102n in a voice and / or text manner. According to one embodiment of the present disclosure, each of the user terminals 102a-102n receives a user input in the form of voice and / or text from the outside and establishes it via the communication network 104 and the online chat service server 106. Through the chat session, the user input can be provided to other user terminals 102a-102n participating in the chat session.

According to one embodiment of the present disclosure, each of the user terminals 102a-102n may communicate with the interactive AI agent server 108, that is, send and receive necessary information, through the communication network 104. According to one embodiment of the present disclosure, each of the user terminals 102a-102n may communicate with the external service server 110, that is, transmit and receive necessary information, through the communication network 104. According to an embodiment of the present disclosure, each of the user terminals 102a-102n may receive user input in the form of voice, text, and / or touch from the outside, and may be configured as an interactive AI agent server through the communication network 104 ( 108 and / or operation results corresponding to the above user input (eg, providing a specific conversation response and / or obtained through communication with an external service server 110 (and / or processing within user terminals 102a-102n)). To perform specific tasks, etc.) to the user.

In an embodiment of the present disclosure, performing a task as an operation corresponding to a user input may be performed in various ways including, for example, searching for information, placing an order, making a reservation, or making a payment, writing an SMS message, writing an email, making a phone call, searching a user location, and the like. It may include performing (but not limited to) forms of tasks. According to one embodiment of the present disclosure, each of the user terminals 102a-102n may have a conversational response as a result of an operation corresponding to a user input in a visual, audio, and / or tactile form (eg, voice, sound, text, video, And images, symbols, emoticons, hyperlinks, animations, various notes, motions, haptic feedback, and the like, but are not limited thereto.

According to one embodiment of the present disclosure, communication network 104 may include any wired or wireless communication network, such as a TCP / IP communication network. According to one embodiment of the present disclosure, the communication network 104 may include, for example, a Wi-Fi network, a LAN network, a WAN network, an Internet network, and the like, but the present invention is not limited thereto. According to one embodiment of the present disclosure, the communication network 104 may include, for example, Ethernet, GSM, Enhanced Data GSM Environment (EDGE), CDMA, TDMA, OFDM, Bluetooth, VoIP, Wi-MAX, Wibro, and any other various wired or wireless. It may be implemented using a communication protocol.

According to one embodiment of the present disclosure, the online chat service server 106 may communicate with the user terminals 102a-102n via the communication network 104. According to one embodiment of the present disclosure, the online chat service server 106 may be connected to one or more of the corresponding user terminals 102a-102n according to a request received from the user terminals 102a-102n through, for example, the communication network 104. A conversation session may be established between the plurality of other user terminals 102a-102n, and a real time conversation may be performed between the user terminals 102a-102n participating in the conversation session. According to an embodiment of the present disclosure, the online chat service server 106 may be an instant messenger service providing server. According to one embodiment of the present disclosure, when the online chat service server 106 establishes a chat session between the user terminals 102a-102n in response to a request from the user terminals 102a-102n, the online chat service server 106 according to a user selection is selected. It is possible to determine whether to use one or more interactive AI agent systems for the corresponding conversation session (in this embodiment, the monitoring session and the service provision by the interactive AI agent system, which will be described later, may be the corresponding conversation session). If selected to use the interactive AI agent system at the time of establishment). According to one embodiment of the present disclosure, user input in the form of voice and / or text received on each user terminal 102a-102n is established through a communication network 104 and an online chat service server 106. Through, it may be delivered to other user terminals 102a-102n participating in the conversation session.

According to one embodiment of the present disclosure, the interactive AI agent server 108 may communicate with the user terminals 102a-102n via the communication network 104. According to one embodiment of the present disclosure, the interactive AI agent server 108 receives, in advance, user input in the form of voice, text, and / or touch from the user terminals 102a-102n, for example, via the communication network 104. Based on the prepared knowledge models, the received user input can be processed to determine the intent of the user. According to one embodiment of the present disclosure, the interactive AI agent server 108 may generate, for example, a specific conversation response that matches the user's intent and send it to the user terminals 102a-102n.

According to one embodiment of the present disclosure, the interactive AI agent server 108 establishes a chat session between the plurality of user terminals 102a-102n via the online chat service server 106, for example, via the communication network 104. Monitor and receive respective user natural language inputs transmitted and received between user terminals 102a-102n on the conversation session. According to one embodiment of the present disclosure, the interactive AI agent server 108 may determine the intent of each user by processing the received natural language input based on previously prepared knowledge models.

According to one embodiment of the present disclosure, the interactive AI agent server 108 may, based on a user intent obtained from a chat session between the user terminals 102a-102n via the online chat service server 106, perform a corresponding chat. It may be determined whether an order or reservation service for some or all of the user terminals 102a-102n participating in the session is required. According to one embodiment of the present disclosure, when the interactive AI agent server 108 determines that the order or reservation service is required, the interactive AI agent server 108 generates a corresponding conversation and task flow, intervenes in the corresponding conversation session, and generates the conversation. Conversations and task performance can be provided.

According to an embodiment of the present disclosure, the interactive AI agent server 108 generates, in voice and / or text form, a conversation response corresponding to the determined user intention, and generates the generated response through the communication network 104. The user terminal 102a-102n and / or the online chat service server 106. According to one embodiment of the present disclosure, the conversation response generated by the interactive AI agent server 108 may be accompanied by other visual elements such as images, videos, symbols, and emoticons, in addition to the aforementioned natural language responses in the form of voice and / or text. Or other acoustic elements such as sound, sound, or other tactile elements. According to one embodiment of the present disclosure, the same type of response on the interactive AI agent server 108, depending on the type of user input received on the user terminals 102a-102n (eg, voice or text input). Can be generated (e.g., a voice response is generated if a voice input is given and a text response is generated if a text input is given), but the invention is not so limited. In accordance with another embodiment of the present disclosure, it should be appreciated that responses in the form of voice and / or text may be generated and provided regardless of the form of user input.

According to an embodiment of the present disclosure, the interactive AI agent server 108 may allow a task corresponding to the determined user intention to be performed. According to one embodiment of the present disclosure, the interactive AI agent server 108 intervenes in a chat session between the user terminals 102a-102n via, for example, the online chat service server 106 to the user's intention on the chat session. A specific task fulfillment procedure (e.g., an order or a reservation) may be made to proceed. According to the present disclosure, the interactive AI agent server 108 may connect to the external service server 110 through the communication network 104 to perform a specific task that matches user intent.

According to one embodiment of the present disclosure, the interactive AI agent server 108 may communicate with the external service server 110 via the communication network 104, as mentioned above. The external service server 110 may be, for example, various online reservation center servers, various food order service servers, online shopping mall servers, information retrieval servers, various payment agency servers, location search servers, and the like, but the present disclosure is not limited thereto. According to one embodiment of the present disclosure, the response based on the user intention, which is transmitted from the interactive AI agent server 108 to the user terminals 102a-102n and / or the online chat service server 106, is for example an external service server. It should be understood that the data content may include data content retrieved and obtained from 110.

In this figure, the interactive AI agent server 108 is shown as a separate physical server configured to communicate with the external service server 110 through the communication network 104, but the present disclosure is not limited thereto. According to another embodiment of the present disclosure, the interactive AI agent server 110 may include, for example, various online reservation center servers, various food order service servers, online shopping mall servers, information retrieval servers, various payment agency servers, location search servers, and the like. It should be understood that it may be included as part of the service server.

2 is a functional block diagram schematically showing the functional configuration of the user terminal 102 shown in FIG. 1, according to an embodiment of the present disclosure. As shown, the user terminal 102 includes a user input receiving module 202, a sensor module 204, a program memory module 206, a processing module 208, a communication module 210, and a response output module ( 212).

According to an embodiment of the present disclosure, the user input receiving module 202 may input various types of inputs from a user, for example, natural language inputs such as voice inputs and / or text inputs (and additionally other types of inputs such as touch inputs). ) Can be received. According to an embodiment of the present disclosure, the user input receiving module 202 may include, for example, a microphone and an audio circuit, and may acquire a user voice input signal through the microphone and convert the obtained signal into audio data. According to an embodiment of the present disclosure, the user input receiving module 202 may include various pointing devices such as a mouse, a joystick, a trackball, a keyboard, a touch panel, a touch screen, a stylus, and the like. The user may acquire text input and / or touch input signals input from the user through these input devices. According to an embodiment of the present disclosure, the user input received by the user input receiving module 202 may be associated with performing a predetermined task, for example, executing a predetermined application or retrieving predetermined information, but the present invention is limited thereto. It is not.

According to one embodiment of the present disclosure, the sensor module 204 includes one or more different types of sensors, through which the status information of the user terminal 102, such as the physical state of the corresponding user terminal 102, The software and / or hardware state or information about the environment state of the user terminal 102 may be obtained. According to an embodiment of the present disclosure, the sensor module 204 may include, for example, an optical sensor, and detect an ambient light state of the corresponding user terminal 102 through the optical sensor. According to an embodiment of the present disclosure, the sensor module 204 may include, for example, a movement sensor, and detect whether the corresponding user terminal 102 is moved through the movement sensor. According to an embodiment of the present disclosure, the sensor module 204 may include, for example, a speed sensor and a GPS sensor, and may detect a position and / or orientation state of the corresponding user terminal 102 through these sensors. According to another embodiment of the present disclosure, it should be appreciated that the sensor module 204 may include other various types of sensors, including temperature sensors, image sensors, pressure sensors, contact sensors, and the like.

According to an embodiment of the present disclosure, the program memory module 206 may be any storage medium in which various programs, for example, various application programs and related data, which may be executed on the user terminal 102, are stored. According to one embodiment of the present disclosure, program memory module 206 includes various application programs, including, for example, instant messaging applications, dialing applications, email applications, map applications, web browser applications, payment and / or remittance applications, and the like. Data related to the execution of these programs can be stored. According to an embodiment of the present disclosure, the program memory module 206 may be configured to include various types of volatile or nonvolatile memory such as DRAM, SRAM, DDR RAM, ROM, magnetic disk, optical disk, flash memory, and the like. .

According to one embodiment of the present disclosure, the processing module 208 may communicate with each component module of the user terminal 102 and perform various operations on the user terminal 102. According to one embodiment of the present disclosure, the processing module 208 may drive and execute various application programs on the program memory module 206. According to one embodiment of the present disclosure, the processing module 208 may receive the signals obtained by the user input receiving module 202 and the sensor module 204 and perform appropriate processing on these signals, if necessary. have. According to one embodiment of the present disclosure, the processing module 208 may perform appropriate processing on a signal received from the outside through the communication module 210 if necessary.

According to one embodiment of the present disclosure, the communication module 210 is configured such that the user terminal 102 is connected to the online chat service server 106, the interactive AI agent server 108, and / or via the communication network 104 of FIG. 1. Or to communicate with an external service server 110. According to an embodiment of the present disclosure, the communication module 210 may be configured such that, for example, signals acquired on the user input receiving module 202 and the sensor module 204 may be connected to the online chat service server through the communication network 104 according to a predetermined protocol. 106, interactive AI agent server 108 and / or external service server 110. According to one embodiment of the present disclosure, the communication module 210 receives from the online chat service server 106, the interactive AI agent server 108 and / or the external service server 110, for example, via the communication network 104. Various signals, for example, response signals including natural language responses in the form of voice and / or text, various control signals, and the like can be received, and appropriate processing can be performed according to a predetermined protocol.

According to an embodiment of the present disclosure, the response output module 212 may output a response corresponding to a user input in various forms such as visual, auditory, and / or tactile. According to one embodiment of the present disclosure, the response output module 212 includes various display devices such as a touch screen based on technologies such as LCD, LED, OLED, QLED, etc., and responds to user input through these display devices. Visual responses such as text, symbols, videos, images, hyperlinks, animations, various notes, and the like, to the user. According to one embodiment of the present disclosure, the response output module 212 includes, for example, a speaker or a headset, and provides an audible response, such as a voice and / or acoustic response, to the user via the speaker or the headset, corresponding to a user input. can do. According to an embodiment of the present disclosure, the response output module 212 may include a motion / haptic feedback generator, thereby providing a tactile response, eg, motion / haptic feedback, to a user. In accordance with one embodiment of the present disclosure, it should be appreciated that the response output module 212 can simultaneously provide any two or more combinations of text response, voice response, and motion / haptic feedback corresponding to user input.

3 is a functional block diagram schematically illustrating the functional configuration of the interactive AI agent server 108 of FIG. 1, in accordance with an embodiment of the present disclosure. As shown, the interactive agent server 108 may include a communication module 302, a speech-to-text (STT) module 304, a natural language understanding (NLU) module 306. ), Conversation understanding knowledge base 308, user database 310, conversation session monitoring / intervention 312, conversation management module 314, conversation generation module 316, and speech synthesis (Text-To-Speech; TTS) module 318.

According to one embodiment of the present disclosure, the communication module 302 is configured such that the interactive AI agent server 108 communicates with the user terminal 102 via the communication network 104 according to a predetermined wired or wireless communication protocol. Enable communication with service server 106 and / or external service server 110. According to one embodiment of the present disclosure, the communication module 302 is a user input (eg, touch input, transmitted from the user terminal 102 and / or the online chat service server 106) via the communication network 104. Voice input and / or text input, and the like, but not limited thereto). According to one embodiment of the present disclosure, the communication module 302 is transmitted from the user terminal 102 or the like via the communication network 104, together with or separately from the user input described above, to the user terminal 102. It can receive the state information of. According to one embodiment of the present disclosure, the state information may include, for example, various state information related to the corresponding user terminal 102 at the time of the user input (for example, the physical state of the user terminal 102 and the software of the user terminal 102). And / or hardware status, environmental status information around the user terminal 102, and the like. According to one embodiment of the present disclosure, the communication module 302 may further include a conversation response generated by the interactive AI agent server 108 in response to the received user input (eg, natural language in the form of voice and / or text). Chat response, etc.) and / or control signals, may be performed through the communication network 104, appropriate measures necessary to communicate to the user terminal 102 and / or the online chat service server 106.

According to an embodiment of the present disclosure, the STT module 304 may receive a voice input among user inputs received through the communication module 302 and convert the received voice input into text data based on pattern matching or the like. have. According to one embodiment of the present disclosure, the STT module 304 may generate a feature vector sequence by extracting features from a user's voice input. According to an embodiment of the present disclosure, the STT module 304 may include a dynamic time warping (DTW) method, a HMM model (Hidden Markov Model), a GMM model (Gaussian-Mixture Mode), a deep neural network model, an n-gram model, and the like. Based on a variety of statistical models of, a text recognition result, such as a sequence of words, can be generated. According to an embodiment of the present disclosure, the STT module 304 may refer to each user characteristic data of the user database 310 to be described later when converting the received voice input into text data based on pattern matching. .

According to one embodiment of the present disclosure, the NLU module 306 may receive a text input from the communication module 302 or the STT module 304. According to one embodiment of the present disclosure, text input received at the NLU module 306 is received from the user terminal 102 and / or the online chat service server 106 via the communication network 104, for example, in the communication module 302. It may be a text recognition result, eg, a sequence of words, generated at STT module 304 from a user text input that was received, or from a user voice input received at communication module 302. According to one embodiment of the present disclosure, the NLU module 306, along with or after receiving the text input, state information associated with the user input, such as state information of the user terminal 102 at the time of the user input. And the like. As described above, the status information may include, for example, various status information related to the corresponding user terminal 102 at the time of user voice input and / or text input (eg, physical state of the user terminal 102 and software). And / or hardware status, environmental status information around the user terminal 102, and the like.

According to one embodiment of the present disclosure, the NLU module 306 may correspond to the received text input with one or more user intents based on the conversation understanding knowledge base 308 described below. According to one embodiment of the present disclosure, the user intent here may be associated with a series of action (s) that may be understood and performed by the interactive AI agent server 108 in accordance with the user intent. According to one embodiment of the present disclosure, the NLU module 306 may refer to the aforementioned state information in mapping the received text input to one or more user intentions. According to one embodiment of the present disclosure, the NLU module 306 may refer to each user characteristic data of the user database 310 described below in mapping the received text input to one or more user intentions.

According to one embodiment of the present disclosure, conversation understanding knowledge base 308 may include, for example, a predefined ontology model. According to one embodiment of the present disclosure, the ontology model may be represented, for example, in a hierarchical structure between nodes, where each node is a "intent" node or a child "attribute" linked to a "intent" node corresponding to a user's intention It can be one of the nodes. According to an embodiment of the present disclosure, the ontology model may be dynamically changed by adding or deleting nodes, or modifying relationships between nodes. According to one embodiment of the present disclosure, the conversation understanding knowledge base 308 may be configured to include domains that respectively correspond to all intents, for example, that the interactive AI agent system can understand and perform operations corresponding thereto. have.

According to one embodiment of the present disclosure, intent nodes and attribute nodes of each domain in the ontology model may be associated with words and / or phrases related to user intents or attributes corresponding thereto, respectively. According to one embodiment of the present disclosure, the dialogue understanding knowledge base 308 comprises an ontology model consisting of nodes in a hierarchy and a set of words and / or phrases associated with each node, for example in the form of a lexical dictionary (specific (Not shown), the NLU module 306 may determine user intention based on the ontology model implemented in the form of a lexical dictionary. For example, according to one embodiment of the present disclosure, upon receiving text input or a sequence of words, the NLU module 306 may determine which words of which domain in the ontology model are associated with each word in the sequence, Based on such a determination, it is possible to determine the corresponding domain, ie user intention.

According to an embodiment of the present disclosure, the user database 310 may be a database that stores and manages characteristic data for each user. According to an embodiment of the present disclosure, the characteristic data for each user included in the user database 310 may include, for example, a previous conversation / behavior record of the user for each user, pronunciation characteristic information of the user, user vocabulary preferences, and the location of the user. , Settings language, contact / friend list, and various other user specific information.

According to an embodiment of the present disclosure, as described above, the STT module 304 refers to each user characteristic data of the user database 310, for example, a pronunciation characteristic for each user, when converting a voice input into text data. You can get more accurate text data. According to one embodiment of the present disclosure, the NLU module 306 may make more accurate user intention determination by referring to each user characteristic data of the user database 310, for example, each user characteristic or context, when determining the user intention. Can be. According to one embodiment of the present disclosure, as described below, the conversation generating module 316 may refer to user characteristic data of the user database 310 when generating a conversation response.

In the figure, a user database 310 for storing and managing characteristic data for each user is illustrated as being arranged in the interactive AI agent server 108, but the present invention is not limited thereto. According to another embodiment of the present disclosure, a user database 310 for storing and managing characteristic data for each user may exist, for example, in the user terminal 102, and the user terminal 102 and the interactive AI agent server 108. It should be noted that they may be distributed in

According to one embodiment of the present disclosure, the chat session monitoring / intervention 312 is configured for each chat item on the chat session established between the plurality of user terminals 102 via the online chat service server 106, that is, each user. The input can be monitored. According to one embodiment of the present disclosure, the chat session monitoring / intervention 312 is provided from each user terminal 102 on a chat session between the plurality of user terminals 102 via the online chat service server 106. Based on the conversation item, ie, each user input, each corresponding user intent obtained from the NLU module 306 may be determined.

According to one embodiment of the present disclosure, the chat session monitoring / intervention unit 312 may determine whether the interactive AI agent server 108 should intervene in the chat session based on the user intention. According to one embodiment of the present disclosure, the interactive AI agent server 108 may have one or more user intentions corresponding to one or more user inputs obtained, for example, on a conversation session between a plurality of user terminals 102. If it is desired to execute a given order or reservation for all or some of the 102) (but the present invention is not so limited), it should be determined in advance that it must intervene in the conversation session to provide the necessary services. Can be.

According to one embodiment of the present disclosure, when the conversation session monitoring / intervention unit 312 determines that the interactive AI agent server 108 should intervene in the conversation session based on user intention, the conversation management module (described later) 314 and the conversation response generated by the conversation generation module 316 or the like may be provided on the corresponding conversation session through the online conversation service server 106.

According to one embodiment of the present disclosure, the conversation management module 314 may generate a series of operation flows corresponding thereto according to a user intention determined by the NLU module 306. According to one embodiment of the present disclosure, the conversation management module 314 is based on a certain conversation flow management model, for example, in response to user intentions received from the NLU module 306, for example, any conversation progress and / or Alternatively, it may be determined whether to perform a task, and a detailed operation flow may be generated accordingly.

According to one embodiment of the present disclosure, the conversation generation module 316 may generate a conversation response to be provided to the user based on the conversation flow generated by the conversation management module 314. According to an embodiment of the present disclosure, the conversation generating module 316 may, in the generation of the conversation response, user characteristic data (eg, a previous conversation record of the user, pronunciation characteristic information of the user, and the like) of the user database 310 described above. User vocabulary preferences, user's location, setting language, contact / friend list, each user's previous conversation, etc.).

According to one embodiment of the present disclosure, the TTS module 318 may receive a conversation response generated to be sent to the user terminal 102 by the conversation generation module 316. The conversation response received at the TTS module 318 may be a natural language or a sequence of words in text form. According to an embodiment of the present disclosure, the TTS module 318 may convert the received text form input into a speech form according to various types of algorithms.

In the embodiment of the present disclosure described above with reference to FIGS. 1 to 3, the interactive AI agent system includes a user terminal 102 and an interactive AI agent server 108 in a client-server model, in particular a client only with user input / output functions. All other functions of the interactive AI agent system are provided as described and implemented based on a so-called "thin client-server model," which is delegated to a server, but the invention is not so limited. According to another embodiment of the present disclosure, the interactive AI agent system should be aware that the functions may be implemented by being distributed between the user terminal and the server, or alternatively, may be implemented as a standalone application installed on the user terminal. . In addition, when the interactive AI agent system distributes the functions between the user terminal and the server according to an embodiment of the present disclosure, the distribution of each function of the interactive AI agent system between the client and the server may vary from embodiment to embodiment. It should be appreciated that other implementations may be made. In addition, in the embodiments of the present disclosure described above with reference to FIGS. 1 to 3, for convenience, a specific module has been described as performing certain operations, but the present invention is not limited thereto. According to another embodiment of the present disclosure, it should be understood that the operations described as performed by any particular module in the above description may be performed by a separate module from each other.

4 provides for monitoring of a chat session between users and an order / reservation service accordingly through an online chat service server 106, performed by the interactive AI agent server 108, according to one embodiment of the disclosure. Is a flow diagram illustrating an exemplary operational flow for the purpose. 5A through 5E illustrate that, according to an embodiment of the present disclosure, the interactive AI agent server 108 intervenes a conversation session between users through an online conversation service server 106 to perform a corresponding conversation session. This is a screen showing an exemplary chat window when a predetermined order service is provided on the screen. Hereinafter, an exemplary operation flow of the interactive AI agent server 108 according to an embodiment of the present disclosure will be described with reference to FIGS. 4 and 5.

First, referring to FIG. 4, in step 402, the interactive AI agent server 108, on a chat session established between a plurality of user terminals 102 via an online chat service server 106, each user terminal. Each user input from 102 may be received. According to one embodiment of the present disclosure, the received user input may be a text and / or voice input received on each corresponding user terminal 102.

Next, at step 404, the interactive AI agent server 108 may analyze each user input obtained at step 402 and determine each corresponding user intent. According to one embodiment of the present disclosure, the interactive AI agent server 108 may map each user input to one or more user intentions based on a predetermined knowledge base. According to one embodiment of the present disclosure, the interactive AI agent server 108 may be specialized for providing a service in the field of ordering or reservation. In such a case, the knowledge base of the interactive AI agent server 108 is specialized in that area of expertise and may allow user intentions related to that field to be more accurately determined.

In step 406, the interactive AI agent server 108, based on each user intent obtained, has a predetermined number or more (all participants or some participants) among the user terminals 102 participating in the corresponding conversation session. It may be determined whether an intention to desire a predetermined order or reservation for the user terminals 102 has been obtained, and based on that, it may be determined whether to participate in the conversation session to start providing the order or reservation service. According to one embodiment of the present disclosure, the interactive AI agent server 108 includes a plurality of participants participating in the conversation session, for example, on a conversation session between the plurality of user terminals 102 via the online conversation service server 106. Have acquired a user intent to commonly order food or goods for a predetermined number or more of the user terminals 102 (e.g., all or part of a session participant) or want to reserve a product or service It is possible to determine whether to start providing a corresponding service according to a determination result of whether or not the user intention is obtained. According to one embodiment of the present disclosure, for example, as shown in FIG. 5A, the interactive AI agent server 108 intends to order a delivery food for lunch for all users participating in the conversation session. If it is obtained, it may be determined to start the order service of the delivery food for the whole user by intervening the corresponding conversation session. According to one embodiment of the present disclosure, the intention to desire a predetermined order or reservation for a predetermined number of users may be explicitly obtained from each user, but from the interpretation of the intent of some of the parties participating in the chat session. It should be noted that it may be implicitly obtained (ie, a particular user on a chat session may represent multiple users on behalf of them with the intention of wanting a common order or reservation together).

If it is determined in step 406 that the intention to wish for a predetermined order or reservation for a predetermined number or more of the user terminals 102 has not yet been obtained, then the procedure returns to step 402 and the interactive AI agent server 108. ) Can continue to monitor the conversation afterwards, providing no response.

Alternatively, at step 406, the interactive AI agent server 108 has acquired the intention to wish a predetermined order or reservation for a predetermined number or more of the user terminals 102 and thus participate in the conversation session to place the order. Or if it is determined to start providing the reservation service, the procedure proceeds to step 408 and the interactive AI agent server 108 proceeds to the flow of operations (providing a conversation and / or performing a task) for the corresponding predetermined order or reservation. And the like). According to one embodiment of the present disclosure, the interactive AI agent server 108 may, in connection with a corresponding order or reservation, determine who will be the provider of food, goods, or services that are the subject of the order or reservation. You can create an operational flow. According to one embodiment of the present disclosure, the interactive AI agent server 108, in connection with a corresponding order or reservation, from each user terminal 102 who wished to place the order or reservation, food related to the order or reservation, An operation flow may be created that determines specific items (kinds) of goods or services. According to one embodiment of the present disclosure, the interactive AI agent server 108 may generate an operational flow for proceeding with payment for the order or reservation in relation to the corresponding order or reservation.

Then, in step 410, the interactive AI agent server 108 communicates between the user terminals 102 through the online chat service server 106 according to the predetermined operational flow generated in step 408 above. By intervening in the session, conversations and / or tasks may be performed to determine who will be the provider of food, goods, or services that are the subject of that order or reservation. According to one embodiment of the present disclosure, if the interactive AI agent server 108 decides to initiate an ordering service of a delivery meal for a plurality of users who participated in a conversation session, for example, intervening on the conversation session, Prompt selection of restaurants to order food and receive and collect responses from user (s) thereon. According to one embodiment of the present disclosure, the interactive AI agent server 108 provides a list of restaurants that can order food for delivery, e.g., intervening on a corresponding chat session, and from each user terminal 102 each. Receive and collect vendor choices. According to one embodiment of the present disclosure, the interactive AI agent server 108 selects from each user terminal 102, for example, by first searching for vendors capable of ordering delivery food at the current location and providing the searched results on the corresponding chat session. Can receive and collect.

According to one embodiment of the present disclosure, for example, as shown in FIG. 5B, the interactive AI agent server 108 may provide a list of predetermined vendors, from the user terminals 102. Receive the selection of each company. According to one embodiment of the present disclosure, the interactive AI agent server 108 collects a vendor's selection from each user terminal 102 and based on the collected result, according to a predetermined criterion, the corresponding order or reservation As a provider of food, goods or services that are subject to the According to one embodiment of the present disclosure, for example, as shown in FIG. 5B, the interactive AI agent server 108 is selected by the largest number of user terminals 102 among the collected company selections. Chinese restaurant OO can be selected as the target of the delivery food order. According to an embodiment of the present disclosure, for example, as shown in (b) of FIG. 5, when there is a user terminal 102 determined as a target company by a company other than the company selected by the user terminal 102. The interactive AI agent server 108 may query the user terminal 102 whether to continue participating in the order or reservation service. According to another embodiment of the present disclosure, the interactive AI agent server 108 may select a company selected by the user terminal 102 for each user terminal 102 that wishes to place the corresponding order or reservation. You may also decide to be the subject of an order or reservation.

After the provider of the food, goods or service that is the subject of the order or reservation is selected in step 410, the procedure proceeds to step 412, where the interactive AI agent server 108 participates in each order or reservation. A conversation and / or task may be performed for the user terminal 102 to identify each specific order or item of the reservation (eg, the specific item of the food to be ordered, the specific item of the service to be booked, etc.). According to one embodiment of the present disclosure, for example, for a plurality of user terminals 102 participating in a chat session, the interactive AI agent server 108 may request each order or reservation for a plurality of users participating in the chat session. , Prompting the user to select a product or item of service and receiving and collecting each answer from the user terminals 102 thereon. According to one embodiment of the present disclosure, the interactive AI agent server 108 provides a list of items for ordering or booking, for example, via a corresponding chat session, and selecting each item from each user terminal 1202. Can receive and collect. According to one embodiment of the present disclosure, for example, as shown in FIGS. 5A and 5B, the interactive AI agent server 108 delivers lunch for all user terminals 102 participating in a chat session. If the food is to be ordered to the Chinese restaurant OO, as shown in Fig. 5 (c), present the menu plate of the Chinese restaurant OO on the conversation session, and receives each food item from each user terminal 102 can do.

According to one embodiment of the present disclosure, after a selection of each item is received from each user terminal 102, the procedure proceeds to step 414 and the interactive AI agent server 108 receives the order or reservation received so far. It is possible to obtain confirmation from one or more user terminals 102 by presenting options and the like. According to one embodiment of the present disclosure, as shown in FIG. 5D, the interactive AI agent server 108 will order food from the Chinese restaurant OO for users A to C, and for user A ① Jajangmyeon, for user B ② Fried rice, for user C ③ Jajangmyeon, and for all of users A to C ④ Sweet and sour pork will be ordered. However, in accordance with another embodiment of the present disclosure, it should be appreciated that the interactive AI agent server 108 may omit the procedure of obtaining confirmation from the user terminals 102 of step 414.

In step 414, if a confirmation regarding the order or reservation is obtained from the user terminal 102, the procedure proceeds to step 416, and the interactive AI agent server 108 makes a payment regarding the order or reservation. You can proceed. According to one embodiment of the present disclosure, the interactive AI agent server 108 may provide options for payment on a chat session, for example, as shown in FIG. You can proceed with the required payment process. According to one embodiment of the present disclosure, payment for an order or a reservation for a plurality of users may be performed for each user, or for one representative for all users (see FIG. 5 (e)). It should be understood that the invention is not limited to any particular example. According to one embodiment of the present disclosure, when payment is made by one representative for all users, a subsequent transfer process of an amount related to itself from each user to the representative may be separately performed, but the present invention is limited thereto. It doesn't happen. According to one embodiment of the present disclosure, it should be understood that the payment process may be made through a connection to a separate server for payment or a separate app execution, and the like, and is not limited to the specific embodiment of the present disclosure. do.

In the present specification, mainly, the interactive AI agent server 108 depends only on its own judgment (eg, whether the user intention requires the provision of an order or reservation service by the interactive AI agent server 108). It should be noted that the present invention is described as determining whether to intervene in a conversation session between users, but the present invention is not limited thereto. According to another embodiment of the present disclosure, the interactive AI agent server 108 does not communicate when the user calls a predetermined name (eg, a name predetermined to refer to the corresponding interactive AI agent) during the conversation session. Intervene in the session to proceed with the order or reservation. However, even in this case, since the interactive AI agent server 108 has continuously performed monitoring of each user input of the corresponding chat session, it means that the user receives the final confirmation of the intervention into the chat session by simply calling the user. It should be noted that the user does not need to explicitly request the desired service from the interactive AI agent server 108 again.

In the present specification, the description has been mainly focused on an instant message in which a conversation content of a conversation session is presented on a screen, but the present invention is not limited thereto. It should be appreciated that the conversation session of the present invention may be based on real time voice conversations between users, for example via intelligent speakers.

As will be appreciated by those skilled in the art, the present invention is not limited to the examples described herein but may be variously modified, reconfigured and replaced without departing from the scope of the present invention. It should be understood that the various techniques described herein may be implemented by hardware or software, or a combination of hardware and software.

A computer program according to an embodiment of the present disclosure may include a storage medium readable by a computer processor or the like, such as an EPROM, an EEPROM, a nonvolatile memory such as a flash memory device, a magnetic disk such as an internal hard disk and a removable disk, a magneto-optical disk, and It may be implemented in a form stored in various types of storage media, including a CDROM disk. In addition, the program code (s) may be implemented in assembly or machine language. All modifications and changes that fall within the true spirit and scope of the present invention are intended to be covered by the following claims.

Claims (10)

A method of providing an active order or reservation service based on monitoring of a dialogue session between multiple users, provided by an interactive AI agent system,
Receiving user input from one or more of the plurality of users during the chat session, wherein the user input is a chat input exchanged between the plurality of users;
Determining a predetermined user intention corresponding to the user input based on a predetermined knowledge base,
Determining, based on the received user intentions, a user intention that desires a predetermined order or reservation for a predetermined number or more of the plurality of users;
In response to determining that a user intention that desires the predetermined order or reservation for the predetermined number of users has been obtained, generating a conversation flow that conforms to the user intent; And
Performing a conversation and / or task for the predetermined order or reservation based on the generated conversation flow
Including, an active order or reservation service providing method. The method of claim 1,
The predetermined order or reservation is associated with one of food, goods and services,
Performing the conversation and / or task includes performing a conversation and / or task to determine a company that will provide one of the food, goods and services associated with the given order or reservation. Or how to provide reservation services. The method of claim 1,
Performing the conversation and / or task includes performing a conversation and / or task for determining each desired item associated with the given order or reservation for each of the predetermined number of users. Or how to provide reservation services. The method of claim 1,
Performing the conversation and / or task comprises making a payment associated with the given order or reservation. The method of claim 1,
And performing the conversation and / or task includes obtaining confirmation regarding the progress of the order or reservation by at least one of the predetermined number or more of users. The method of claim 2,
Performing a dialogue and / or task for determining the business may include providing a list of a plurality of business,
Receiving a selection of one company from the list of companies from each of the predetermined number of users, and
Determining the business based on a result of receiving the selection of the business from each of the predetermined number of users or more;
Including, an active order or reservation service providing method. The method of claim 3,
Performing a conversation and / or task for each of the predetermined number or more of users to determine each desired item associated with the given order or reservation,
Providing a list of a plurality of items, and
Receiving a selection of an item from the list of the plurality of items from each of the predetermined number of users
Including, an active order or reservation service providing method. The method of claim 4, wherein
The step of making a payment associated with the predetermined order or reservation includes the step of making the payment with respect to each of the predetermined number or more of users or a representative of the predetermined number or more of users. . A computer readable recording medium comprising one or more instructions,
The computer readable recording medium of the one or more instructions, when executed for a computer, causes the computer to perform the method of any one of claims 1 to 8. An interactive AI agent system configured to provide monitoring of a conversation session between multiple users and an active order or reservation service based thereon,
Communication module,
NLU module, and
Dialog session monitoring / intervention module
Including,
The communication module is configured to receive user input from one or more of the plurality of users during the conversation session, the user input being a conversation input to and from the plurality of users;
The NLU module is configured to determine a predetermined user intention corresponding to the user input based on a predetermined knowledge base.
The chat session monitoring / intervention module,
Based on the received user intent, determining whether a user intention that desires a predetermined order or reservation for a predetermined number or more of the plurality of users has been obtained,
In response to determining that a user intent that desires the predetermined order or reservation for the predetermined number of users has been obtained, generate a conversation flow that conforms to the user intent,
Based on the generated conversation flow, configured to perform a conversation and / or task for the given order or reservation,
Interactive AI Agent System.

Images