JP7527496B1 - Character interaction system and character interaction method - Google Patents

Abstract

The technology disclosed in this specification is a technology for making it easier for users to interact when presenting information. A character interaction system related to the technology disclosed in this specification includes an information processing unit for processing facility information, which is information about facilities provided within a limited space, and a response processing unit for providing the facility information in response to input from a user, and the response processing unit is connected to an input/output device so as to convey the facility information to the user through a character displayed on at least one display device provided in the input/output device.

Description

The technology disclosed in this specification relates to user interaction.

There have traditionally been information provision systems that can centrally manage and process information inside and outside a building and provide that information in real time (see, for example, Patent Document 1).

JP 2023-26205 A

The technology shown in Patent Document 1 conveys information about inside and outside the building to users, but it is specialized in displaying one-way content and does not function sufficiently as a target for user interaction.

The technology disclosed in this specification has been developed in consideration of the problems described above, and is a technology designed to make it easier for users to interact with information when it is presented.

A character interaction system, which is a first aspect of the technology disclosed in the present specification, comprises an information processing unit for processing facility information including building management information , and a response processing unit for providing the facility information in response to input from a user, wherein the response processing unit is connected to an input/output device so as to convey the facility information to the user through a character displayed on at least one display device provided in the input/output device, and the building management information is obtained from an entrance/ exit management device.

According to at least the first aspect of the technology disclosed in the present specification, a character is displayed when facility information is presented, making it easier for users to interact through the character.

Furthermore, the objects, features, aspects and advantages associated with the technology disclosed in the present specification will become more apparent from the detailed description and accompanying drawings set forth below.

FIG. 1 is a diagram conceptually illustrating an example of the configuration of a character interaction system according to an embodiment. FIG. 2 is a diagram conceptually illustrating an example of the configuration of an input/output device. FIG. 13 is a diagram showing an example of a character. FIG. 2 is a diagram showing an example of the relationship between a moving object and a processing unit in a character interaction system. FIG. 2 is a diagram showing an example of the relationship between a building management panel and a processing unit in a character interaction system. 13 is a diagram showing an example in which information is acquired from a building control panel by a processing unit, and a character displayed on a display device provides information to a user based on the acquired information. FIG. FIG. 11 is a diagram showing another example in which information is acquired from a building control panel by a processing unit, and a character displayed on a display device provides information to a user based on the acquired information. FIG. 11 is a diagram showing another example in which information is acquired from a building control panel by a processing unit, and a character displayed on a display device provides information to a user based on the acquired information. FIG. 11 is a diagram showing another example in which information is acquired from a building control panel by a processing unit, and a character displayed on a display device provides information to a user based on the acquired information. 1 is a diagram showing an example of the relationship between an Internet communication unit and a processing unit in a character interaction system. FIG. 1 is a diagram showing an example of the relationship between an Internet communication unit, an operator, and a processing unit in a character interaction system. FIG. FIG. 1 is a diagram conceptually illustrating an example of the configuration of a character interaction system according to an embodiment of the present invention. FIG. 13 is a diagram showing an example in which characters displayed sequentially on a plurality of display devices provide information to a user. 13A and 13B are diagrams showing another example in which characters displayed sequentially on a plurality of display devices provide information to a user. 13A and 13B are diagrams showing another example in which characters displayed sequentially on a plurality of display devices provide information to a user. 13A and 13B are diagrams showing another example in which characters displayed sequentially on a plurality of display devices provide information to a user. 13A and 13B are diagrams showing another example in which characters displayed sequentially on a plurality of display devices provide information to a user. 2 is a diagram illustrating a schematic example of a hardware configuration when the character interaction system illustrated in FIG. 1 is actually operated. FIG. 2 is a diagram illustrating a schematic example of a hardware configuration when the character interaction system illustrated in FIG. 1 is actually operated. FIG.

Hereinafter, the embodiments will be described with reference to the attached drawings. In the following embodiments, detailed features are shown to explain the technology, but they are merely examples and not all of them are necessarily essential features for the embodiments to be implementable.

Note that the drawings are schematic, and for ease of explanation, components may be omitted or simplified as appropriate in the drawings. Furthermore, the relative sizes and positions of components shown in different drawings are not necessarily described accurately and may be changed as appropriate. Furthermore, hatching may be used in drawings such as plan views that are not cross-sectional views to make it easier to understand the contents of the embodiments.

In addition, in the following description, similar components are illustrated with the same reference numerals, and their names and functions are also similar. Therefore, detailed descriptions of them may be omitted to avoid duplication.

In addition, in the descriptions provided in this specification, when a certain component is described as "comprising," "including," or "having," unless otherwise specified, this is not an exclusive expression that excludes the presence of other components.

In addition, even if ordinal numbers such as "first" or "second" are used in the descriptions in this specification, these terms are used for convenience to facilitate understanding of the contents of the embodiments, and the contents of the embodiments are not limited to the orders that may result from these ordinal numbers.

First Embodiment
The character interaction system and the character interaction method according to this embodiment will be described below.

<Character interaction system configuration>
Fig. 1 is a diagram conceptually illustrating an example of the configuration of a character interaction system according to the present embodiment. As illustrated in Fig. 1, the character interaction system 1 includes a limited space 100, a processing unit 110, and an input/output device 120 that displays a character 130. The character interaction system 1 performs smooth interaction with a user 140 via the input/output device 120.

The limited space 100 refers to a space that is highly public and has an administrator, such as a building, an underground shopping mall, or an amusement facility. Such a limited space 100 has many facilities and is designed to ensure that users 140 can spend their time there comfortably.

The processing unit 110 includes an information processing unit 111 and a response processing unit 112. The information processing unit 111 processes equipment information related to equipment installed within the limited space 100, and displays the equipment information on the input/output device 120. Specifically, the information processing unit 111 manages, acquires, and sends (transmits) data of the equipment information (visual information or audio information) displayed on the input/output device 120. The response processing unit 112 refers to the equipment information, analyzes the instructions and response contents for the user 140, and generates the response contents.

Figure 2 is a conceptual diagram showing an example of the configuration of the input/output device 120. As shown in the example in Figure 2, the input/output device 120 includes a display device 121, an audio output 122, an audio input 123, a video input 124, and other sensor inputs/outputs 125.

The input/output device 120 transmits information to the user 140 via the display device 121 or the audio output 122. The input/output device 120 also receives voice instructions from the user 140 via the audio input 123.

The input/output device 120 transmits the spoken content of the user 140 to the processing unit 110 in Figure 1 via the audio input 123 or the video input 124, and also outputs the video data or audio data returned from the processing unit 110 on the display device 121 or the audio output 122.

In addition, the input/output device 120 may input and output data using radio frequency identification (RFID), Bluetooth low energy (BLE; Bluetooth is a registered trademark), or a Wi-Fi location information system built into an additional electronic device such as a smartphone or smartwatch owned by the user 140, other sensor input/output 125 that inputs and outputs sensor information, and video data or audio data returned from the processing unit 110.

The other sensor input/output 125 may be a light detection and ranging (LiDAR) or a motion sensor installed in the external environment. By using the other sensor input/output 125, it is possible to identify the position or individual of the user 140, making it possible to provide services tailored to the individual even in a public space.

The character 130 is an animal, a person, or a virtual creature that has a target face and is suitable as an interaction target. The response processing unit 112 conveys the facility information to the user 140 through the character 130 displayed on the display device 121.

Figure 3 is a diagram showing an example of a character 130. The character 130 may be animated, with its mouth moving in response to conversation, or may have changeable facial expressions or clothing. The character 130 may also be selected according to the time, place, and occasion, such as for emergencies or for children. The character 130 may also be given personality traits, such as trustworthiness, tolerance, or cuteness.

Figure 4 is a diagram showing an example of the relationship between a moving body 150 and a processing unit 110 in a character interaction system. As shown in the example in Figure 4, the processing unit 110 performs intermediate processing to exchange information with the moving body 150.

The mobile object 150 may be an elevator itself, a service robot that cleans, guards, or transports objects, or a communication robot. The mobile object 150 can communicate with the processing unit 110 (information processing unit 111) and can receive tasks such as movement from the processing unit 110. The mobile object 150 can also exchange facility information (including information about functions installed in the mobile object 150) with the character interaction system 1 or indirectly with the user 140 via the processing unit 110 (information processing unit 111).

Here, the processing unit 110 may intervene between the user 140 and the moving object 150 to allow the user 140 to control the moving object 150, or may provide information regarding the expected behavior of the moving object 150 using a character 130 displayed on the display device 121. It is difficult for a simple moving object 150 alone that does not have a voice recognition function or a voice production function to have a natural interaction at a level that allows it to converse with a human. However, by displaying a character 130 with high interaction capabilities on the display device 121 and having it intervene, it becomes possible to have a natural interaction at a level that allows it to converse with a human.

Figure 5 is a diagram showing an example of the relationship between the building management panel 151 and the processing unit 110 in the character interaction system. As shown in the example in Figure 5, the processing unit 110 may exchange information with the building management panel 151.

In this way, the processing unit 110 can obtain information about the facilities installed in the building, such as elevator operation information, congestion information about stores in the building, images from environmental cameras, building management information obtained from an entrance/exit management device (not shown here), etc. In this way, the processing unit 110 can communicate to the user 140 via the input/output device 120 that the elevator is crowded and difficult to get on, an approximate waiting time for the elevator or store, the optimal route for the user 140, places the user 140 should stop at, that the robot can be made to wait and the entrance/exit management device (not shown here) can be used to move on, or an episode about the robot, etc.

Figure 6 is a diagram showing an example in which information is acquired from the building management panel 151 by the processing unit 110, and based on that information, the character 130 displayed on the display device 121 provides information to the user 140. In Figure 6a, the character 130 displayed on the display device 121 of the character interaction system 1 notifies the user 140, who is unsure whether to pass through the entrance/exit management system 202, that the robot 200 is in a waiting state (conversationally communicating this), thereby appropriately guiding the user 140, who would otherwise be unable to make a decision based on the notification from the robot 200 itself.

7 is a diagram showing another example in which information from the building management panel 151 is acquired by the processing unit 110, and the character 130 displayed on the display device 121 provides information to the user 140 based on the information. In FIG. 7, the character 130 displayed on the display device 121 of the character interaction system 1 informs the user 140 located near the robot 204 of the operation content (episode) of the robot 204 (communicated in a conversational format). In addition, the character 130 displayed on the display device 121 of the character interaction system 1 informs the user 140 located near the robot 206 of information about the building near the robot 206 (communicated in a conversational format). In addition, the character 130 displayed on the display device 121 of the character interaction system 1 informs the user 140 located near the elevator 208 of the waiting time for the elevator 208 (communicated in a conversational format).

Figure 8 is a diagram showing another example in which information is acquired from the building control panel 151 by the processing unit 110, and the character 130 displayed on the display device 121 provides information to the user 140 based on the acquired information. In Figure 8, the character 130 displayed on the display device 121 of the character interaction system 1 notifies the user 140, who is waiting in front of the elevator, that the robot 210 is coming out of the elevator (communicating in a conversational format).

Figure 9 is a diagram showing another example in which information is acquired from the building control panel 151 by the processing unit 110, and based on that information, the character 130 displayed on the display device 121 provides information to the user 140. In Figure 9, the character 130 displayed on the display device 121 of the character interaction system 1 notifies the user 140, who is waiting in the elevator, that the robot 212 is waiting outside the elevator (communicating in a conversational format).

In addition, the user 140 can communicate the task they want the robot to perform to the processing unit 110 via the character 130, making it possible to transport an object or request confirmation of a specific location. Furthermore, when the user 140 is about to enter an elevator, the processing unit 110 can indicate the direction in which the robot will emerge via the character 130, thereby avoiding a collision between the two.

Figure 10 is a diagram showing an example of the relationship between the Internet communication unit 152 and the processing unit 110 in a character interaction system. As shown in the example in Figure 10, the processing unit 110 may exchange information with the Internet communication unit 152.

In this way, the processing unit 110 can obtain a wider range of information, such as weather or local information, in addition to information about the limited space 100. In addition, the processing unit 110 can call a taxi or a shared car to a specific location outside the limited space 100, or accept a request for a service at a specific location outside the limited space 100.

Figure 11 is a diagram showing an example of the relationship between the Internet communication unit 152 and the operator 153 and the processing unit 110 in the character interaction system. As shown in the example in Figure 11, the processing unit 110 may communicate with the Internet communication unit 152 and the operator 153.

In this way, when an abnormality occurs, the operator 153 can remotely take over the input/output of the input/output device 120, and can return a response that was not determined in advance to the user 140. The operator 153 may communicate with the processing unit 110 directly, or may be connected to the processing unit 110 from the outside via the Internet communication unit 152.

When a character 130 with a face is displayed on the display device 121 and speaks, the attention of the user 140 is directed toward the display device 121, and the user 140 tries to converse in that direction. Therefore, by increasing the sensitivity of the microphone in the direction (toward the display device 121) when the character 130 is displayed, it is possible to improve noise resistance while also increasing the accuracy of verbal communication.

In addition, when a character 130 with a face is displayed on the display device 121 and speaks, if the direction in which the user 140 is located is not known, the character 130 may speak facing a direction different from the direction in which the user 140 is located, which may cause the user 140 to feel uncomfortable. In such a case, the character 130 can turn its gaze and face in various directions, making the user 140 feel as if it is speaking to the user. In addition, by measuring the position of the user 140 in the other sensor input/output 125 and turning the face of the character 130 in that direction, or by using the audio output 122 with added directionality to direct the audio output to the position of the user 140, effective verbal communication can be carried out.

The processing unit 110 is also capable of simulating the responses of systems used within the space, such as the mobile object 150 or the building control panel 151, by using an AI model constructed by incorporating all source code and carrying out machine learning. Therefore, the processing unit 110 is capable of automatically updating the model when the source code of the system used within the space is changed.

When the user 140 inputs the current state, movement route, or task of the mobile object 150 or the building control panel 151 into the AI model, the processing unit 110 can estimate the arrival time of the mobile object 150 or the rest time for charging. In addition, the processing unit 110 can respond to unexpected questions from the user 140 using the AI model, and the number of conversation patterns can be increased by increasing the amount of information that can be conveyed.

Second Embodiment
A character interaction system and a character interaction method according to the present embodiment will be described. In the following description, components similar to those described in the above embodiment will be illustrated with the same reference numerals, and detailed description thereof will be omitted as appropriate.

<Character interaction system configuration>
Fig. 12 is a diagram conceptually illustrating an example of the configuration of a character interaction system according to this embodiment. As illustrated in the example in Fig. 12, the character interaction system 1A includes a processing unit 110 and an input/output device 120A that displays a character 130. The input/output device 120A includes a plurality of display devices 121A, 121B, and 121C.

Display device 121A, display device 121B, and display device 121C are connected to each other directly or via processing unit 110. Character 130 displayed on input/output device 120A can be displayed by moving between display device 121A, display device 121B, and display device 121C, and can provide services to user 140 continuously across multiple display devices. At this time, processing unit 110 needs to acquire position information of display device 121A, display device 121B, display device 121C, and user 140 (and further mobile object 150).

For example, in a service such as navigation, the same character 130 can provide services such as route guidance, introductions to exhibits, or requests to stop a robot that is not visible to the user 140 in accordance with its movement, in line with the user's 140 movements. Note that the number of display devices does not need to be limited to three, such as display device 121A, display device 121B, and display device 121C, and may be even greater, such as ten.

Figure 13 is a diagram showing an example in which characters 130 displayed in sequence on multiple display devices provide information to a user 140. In Figure 13, characters 130 are displayed in the order of display device 121D, display device 121A, display device 121B, and display device 121C of the character interaction system 1 in accordance with the movement of the user 140, and introduce exhibits at each location (communicating in a conversational format).

Figure 14 is a diagram showing another example in which a character 130 displayed sequentially on multiple display devices provides information to a user 140. In Figure 14, the character 130 displayed in turn on display device 121A and then display device 121B of the character interaction system 1 in accordance with the movement of the user 140 notifies the user 140 (in a conversational format) that a robot 214 located in the user's blind spot will pass in front of the user 140.

15, 16, and 17 are diagrams showing another example in which a character 130 displayed sequentially on multiple display devices provides information to a user 140. In FIG. 15, 16, and 17, it is assumed that a microphone 221A is mounted on the display device 121A, and a microphone 221B is mounted on the display device 121B (the mounting positions in the figures are examples). In FIG. 15, 16, and 17, the character 130 displayed on the display device 121A and then on the display device 121B of the character interaction system 1 guides the user in accordance with the user's movement. In this case, the character 130 is displayed by fading in and out sequentially on each display device so that it appears to move continuously between the display device 121A and the display device 121B (depending on the arrangement of the display devices, it may be displayed while temporarily spanning multiple display devices).

When a character 130 with a face is displayed on display device 121A, display device 121B, or display device 121C and speaks, the attention of user 140 is directed to the display device on which character 130 is displayed, and user 140 tries to talk in that direction. Therefore, by increasing the sensitivity of the microphone in that specific direction (the direction toward the display device on which character 130 is displayed) when character 130 is displayed, it is possible to increase noise resistance while improving the accuracy of verbal communication.

For example, when a character 130 is displayed on display device 121A, the sensitivity of microphone 221A close to the position of user 140 can be increased based on the position information of display device 121A and the position information of user 140. If character 130 that was displayed on display device 121A subsequently moves to display device 121B, the sensitivity of microphone 221B close to the position of user 140 can be increased based on the position information of display device 121B and the position information of user 140.

The display device may be the display screen of a smartphone carried by the user 140. In this case, by linking the location information of the user 140 with the movement of the mobile object 150 using an app on the smartphone, it is possible to stop the service of the mobile object 150 when the user 140 focuses on the smartphone, or conversely, to stop the movement of the smartphone when the user 140 focuses on the mobile object 150.

<Hardware configuration for the character interaction system>
18 and 19 are diagrams illustrating an example of a hardware configuration when the character interaction system shown in FIG. 1 is actually operated.

Note that the hardware configurations illustrated in Figures 18 and 19 may not match the numbers, etc., of the configuration illustrated in Figure 1, but this is because the configuration illustrated in Figure 1 represents a conceptual unit.

Therefore, at least the following cases can be envisaged: a configuration illustrated in FIG. 1 is composed of multiple hardware configurations illustrated in FIG. 18 and FIG. 19; a configuration illustrated in FIG. 1 corresponds to a part of a hardware configuration illustrated in FIG. 18 and FIG. 19; and further, multiple configurations illustrated in FIG. 1 are provided in a single hardware configuration illustrated in FIG. 18 and FIG. 19.

In Fig. 18, the hardware configuration for realizing the processing unit 110 and the input/output device 120 in Fig. 1 includes a processing circuit 1102A that performs calculations, a storage device 1103 that can store information, an input device 1104A that can input information such as a mouse, a keyboard, a touch panel, or various switches, and an output device 1105A (including cases where it is shared with the input device 1104A) that can output information such as a display, a liquid crystal display device, or a lamp. This configuration is similar in all of the above embodiments.

In Fig. 19, the hardware configuration for realizing the processing unit 110 and the input/output device 120 in Fig. 1 includes a processing circuit 1102B that performs calculations, an input device 1104B that can input information, such as a mouse, keyboard, touch panel, or various switches, and an output device 1105B (including cases where it is shared with the input device 1104B) that can output information, such as a display, liquid crystal display device, or lamp. This configuration is similar in all of the above embodiments.

The storage device 1103 may be, for example, a hard disk drive (HDD), random access memory (RAM), read only memory (ROM), flash memory, erasable programmable read only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), or other volatile or non-volatile semiconductor memory, a magnetic disk, a flexible disk, an optical disk, a compact disk, a mini disk, or a DVD, or any other memory medium to be used in the future.

The processing circuit 1102A may execute a program stored in the storage device 1103, an external CD-ROM, an external DVD-ROM, or an external flash memory. That is, the processing circuit 1102A may be, for example, a central processing unit (CPU), a microprocessor, a microcomputer, or a digital signal processor (DSP).

When the processing circuit 1102A executes a program stored in the storage device 1103, an external CD-ROM, an external DVD-ROM, or an external flash memory, the processing unit 110 and the input/output device 120 are realized by software, firmware, or a combination of software and firmware, in which the program stored in the storage device 1103 is executed by the processing circuit 1102A. Note that the functions of the processing unit 110 and the input/output device 120 may be realized, for example, by multiple processing circuits working together.

The software and firmware may be written as a program and stored in the memory device 1103. In this case, the processing circuit 1102A realizes the above functions by reading and executing the program stored in the memory device 1103. In other words, the memory device 1103 may store a program that, when executed by the processing circuit 1102A, results in the above functions being realized.

Processing circuit 1102B may also be dedicated hardware, i.e., a single circuit, a composite circuit, a programmed processor, a parallel programmed processor, an application specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or a combination thereof.

When the processing circuit 1102B is a dedicated hardware, the processing unit 110 and the input/output device 120 are realized by the operation of the processing circuit 1102B. Note that the functions of the processing unit 110 and the input/output device 120 may be realized by separate circuits or by a single circuit.

The functions of the processing unit 110 and the input/output device 120 may be partly realized in a processing circuit 1102A which executes a program stored in the memory device 1103, and partly realized in a processing circuit 1102B which is dedicated hardware.

Furthermore, the input/output device 120 is realized by the input device 1104A or the input device 1104B.

In addition, the input/output device 120 is realized by the output device 1105A or the output device 1105B (which may be shared with the input device).

<Effects of the above-described embodiments>
Next, examples of effects produced by the above-described embodiments are shown. In the following description, the effects are described based on the specific configurations shown as examples in the above-described embodiments, but may be replaced with other specific configurations shown as examples in this specification as long as the same effects are produced. In other words, for convenience, only one of the corresponding specific configurations may be described as a representative below, but the representatively described specific configuration may be replaced with another corresponding specific configuration.

Moreover, the replacement may be made across multiple embodiments. In other words, configurations shown as examples in different embodiments may be combined to produce the same effect.

According to the embodiment described above, the character interaction system includes an information processing unit 111 and a response processing unit 112. The information processing unit 111 processes facility information, which is information related to facilities provided within a limited space. The response processing unit 112 provides the facility information in response to an input from a user 140. The response processing unit 112 is connected to the input/output device 120 (or the input/output device 120A) so as to convey the facility information to the user 140 through a character 130 displayed on at least one display device 121 (or the display device 121A, the display device 121B, the display device 121C) provided in the input/output device 120 (or the input/output device 120A).

Furthermore, according to the embodiment described above, the character interaction system includes an input device 1104A, an output device 1105A, a processing circuit 1102A that executes a program, and a storage device 1103 that stores the program to be executed. The processing circuit 1102A executes the program to realize the following operations:

That is, facility information, which is information about facilities installed within a limited space, is processed. Then, the facility information is provided in response to input from the user 140. Here, the facility information is provided so as to convey the facility information to the user 140 through a character 130 displayed on at least one display device 121 (or display device 121A, display device 121B, display device 121C) provided in the input/output device 120 (or input/output device 120A).

Furthermore, according to the embodiment described above, the character interaction system includes an input device 1104B, an output device 1105B, and a processing circuit 1102B which is dedicated hardware. The processing circuit 1102B which is dedicated hardware performs the following operations:

That is, the processing circuit 1102B, which is dedicated hardware, processes facility information, which is information about facilities installed within a limited space. Then, the facility information is provided in response to an input from the user 140. Here, the facility information is provided by conveying the facility information to the user 140 through a character 130 displayed on at least one display device 121 (or display device 121A, display device 121B, display device 121C) installed in the input/output device 120 (or input/output device 120A).

With this configuration, the character 130 is displayed when facility information is presented, making it easier for the user 140 to recognize the character 130 as an interface and interact with it. Since the character 130 has a face, the user 140 can recognize the character 130's face as a target, lowering the barrier to interaction.

Furthermore, the same effect can be achieved even if other configurations, examples of which are shown in this specification, are added to the above configuration as appropriate, i.e., other configurations in this specification that were not mentioned as the above configuration are added as appropriate.

Furthermore, according to the embodiment described above, the information processing unit 111 communicates with the mobile body 150 and processes equipment information of the equipment installed in the mobile body 150. According to such a configuration, although it is difficult for a mobile body such as an elevator or a robot to interact with the user 140, by interacting with the character 130 as an interface intermediary, the threshold for interaction is effectively lowered and the user 140 can easily grasp the status of the mobile body.

Furthermore, according to the embodiment described above, the character interaction system includes an input/output device 120 (or an input/output device 120A). With such a configuration, a character 130 is displayed when facility information is presented, making it easier for a user 140 to recognize the character 130 as an interface and interact with it.

Furthermore, according to the embodiment described above, the information processing unit 111 communicates with the building management panel 151 to process facility information for facilities installed within the building. With this configuration, information within the building, including elevators, robot positions, service status, and the like, can be effectively provided to the user 140 via the character 130.

According to the embodiment described above, the input/output device 120A is provided with a plurality of display devices 121A (or display devices 121B, 121C). The response processing unit 112 continuously displays the characters 130 between the plurality of display devices 121A (or display devices 121B, 121C) to transmit facility information to the user 140. According to such a configuration, by linking the plurality of display devices to display the characters 130, the user 140 can easily understand the connection between the display devices through the characters 130. As a result, a continuous and consistent service can be provided to the user 140 in a large space, and the user 140 can be given the illusion that the character 130 is in a real three-dimensional space. Therefore, the user 140 can deepen his/her understanding of spatial navigation in particular. In addition, by linking the characteristics of the display devices at different spatial positions and continuously displaying them on the signage reflected in the user's field of vision, the user 140 can recognize that the same character 130 has moved smoothly between them.

In addition, according to the embodiment described above, the response processing unit 112 can be remotely operated by an operator. With such a configuration, in an emergency, in a character interaction system via a character 130, it is possible to switch between an automatic response and a response by a manned operator, thereby increasing the flexibility of responses in emergency situations.

Furthermore, according to the embodiment described above, the display device 121 (or the display device 121A, the display device 121B, the display device 121C) is equipped with a microphone 221A (or the microphone 221B). Then, the response processing unit 112 increases the sensitivity of the microphone 221A (or the microphone 221B) in the vicinity where the character 130 is displayed. With this configuration, when the character 130 having a face speaks, it is possible to induce the user 140 to turn towards the character 130 and interact with it. Therefore, information can be effectively provided to the user 140 even in a high-noise environment.

Furthermore, according to the embodiment described above, the response processing unit 112 displays the character 130 on the display device 121 to turn its gaze and face in multiple directions when conversing with the user 140. With this configuration, regardless of the direction in which the user 140 is facing, the gaze and face of the character 130 can be directed in various ways to mislead the user 140 into thinking that the interaction is successful.

Furthermore, according to the embodiment described above, the response processing unit 112 outputs facility information as a response provided in response to an input from the user 140, using a trained model generated by machine learning. With such a configuration, it is possible to improve the accuracy of the response. Also, by creating a trained model using the source code (machine language) of the system as is, it is possible to reduce the update cost of the trained model and also to increase the number of responses to questions from the user 140.

Furthermore, according to the embodiment described above, the response processing unit 112 acquires at least the location information of the user 140 and the location information of the display device 121. Then, based on the location information of the user 140, the response processing unit 112 causes the display device 121 having the corresponding location information to display the character 130. According to such a configuration, the content of the facility information provided can be changed depending on the location of the user 140, and various services can be provided.

According to the embodiment described above, in the character interaction method, facility information, which is information relating to facilities provided within a limited space, is processed. Then, the facility information is provided in response to an input from the user 140. Here, the facility information is provided by transmitting the facility information to the user 140 through the character 130 displayed on at least one display device 121 (or display device 121A, display device 121B, display device 121C) provided in the input/output device 120 (or input/output device 120A).

With this configuration, the character 130 is displayed when facility information is presented, making it easier for the user 140 to recognize the character 130 as an interface and interact with it.

In addition, unless there are special restrictions, the order in which each process is performed may be changed.

Furthermore, the same effect can be achieved even if other configurations, examples of which are given in this specification, are added to the above configuration, as appropriate, i.e., other configurations in this specification that were not mentioned as the above configuration are added as appropriate.

<Modifications of the above-described embodiments>
In the multiple embodiments described above, the dimensions, shapes, relative positional relationships, and implementation conditions of each component may be described, but these are merely examples in all aspects and are not limiting.

Therefore, countless variations and equivalents not shown are assumed within the scope of the technology disclosed in the present specification. For example, this includes modifying, adding, or omitting at least one component, and further including extracting at least one component in at least one embodiment and combining it with a component in another embodiment.

Furthermore, unless a contradiction arises, when it is stated in the embodiments described above that "one" component is provided, "one or more" of that component may be provided.

Furthermore, the descriptions in this specification are incorporated by reference for all purposes related to the present technology, and none of them are admitted to be prior art.

Furthermore, each of the components described in the embodiments described above is envisaged as either software or firmware, or as corresponding hardware, and as software it is referred to as, for example, a "unit", and as hardware it is referred to as, for example, a "processing circuit" (circuitry).

In addition, the technology disclosed in this specification may also be implemented in a form such as a system in which each component is distributed across multiple devices, i.e., a combination of multiple devices.

1 Character interaction system, 1A Character interaction system, 100 Space, 110 Processing section, 111 Information processing section, 112 Response processing section, 120 Input/output device, 120A Input/output device, 121 Display device, 121A Display device, 121B Display device, 121C Display device, 121D Display device, 122 Audio output, 123 Audio input, 124 Video input, 125 Sensor input/output, 130 Character, 140 User, 150 Mobile body, 151 Building management panel, 152 Internet communication section, 153 Operator, 200 Robot, 202 Entrance/exit management system, 204 Robot, 206 Robot, 208 Elevator, 210 Robot, 212 Robot, 214 Robot, 221A Microphone, 221B Microphone, 1102A Processing circuit, 1102B Processing circuit, 1103 memory device, 1104A input device, 1104B input device, 1105A output device, 1105B output device.

Claims (12)

an information processing unit for processing facility information including building management information ;
a response processing unit for providing the facility information in response to an input from a user,
The response processing unit is connected to the input/output device so as to convey the facility information to the user through a character displayed on at least one display device provided in the input/output device;
The building management information is acquired from an entrance and exit management device.
Character interaction system. an information processing unit for processing facility information including building management information ;
a response processing unit for providing the facility information in response to an input from a user,
The response processing unit is connected to the input/output device so as to convey the facility information to the user through a character displayed on at least one display device provided in the input/output device;
The building management information is obtained from an elevator .
Character interaction system. The input/output device includes an input/output function for connecting to the information processing unit and the response processing unit according to claim 1 or 2 , and transmits the facility information to the user through the character displayed on the display device.
Character interaction system. an information processing unit for processing facility information including building management information ;
a response processing unit for providing the facility information in response to an input from a user;
an input/output device having an input/output function for connecting to the information processing unit and the response processing unit and transmitting the facility information to the user through a character displayed on at least one display device;
The response processing unit is connected to the input/output device so as to convey the facility information to the user through the character displayed on the display device provided in the input/output device;
The building management information is acquired from an entrance and exit management device.
Character interaction system. an information processing unit for processing facility information including building management information ;
a response processing unit for providing the facility information in response to an input from a user;
an input/output device having an input/output function for connecting to the information processing unit and the response processing unit and transmitting the facility information to the user through a character displayed on at least one display device;
The response processing unit is connected to the input/output device so as to convey the facility information to the user through the character displayed on the display device provided in the input/output device;
The building management information is obtained from an elevator .
Character interaction system. 3. A character interaction system according to claim 1 or 2 ,
The information processing unit communicates with a building management panel to process the equipment information of the equipment installed in the building.
Character interaction system. 3. A character interaction system according to claim 1 or 2 ,
The response processing unit is remotely operable by an operator.
Character interaction system. 3. A character interaction system according to claim 1 or 2 ,
The display device is equipped with a microphone,
The response processing unit increases the sensitivity of the microphone in the vicinity where the character is displayed.
Character interaction system. 3. A character interaction system according to claim 1 or 2 ,
the response processing unit displays the character on the display device so as to turn its gaze and face in a plurality of directions when conversing with the user;
Character interaction system. 3. A character interaction system according to claim 1 or 2 ,
The response processing unit outputs the facility information as a response provided in response to the input from the user, using a trained model generated by machine learning.
Character interaction system. The computer
processing facility information , the facility information including building management information ;
providing the facility information in response to an input from a user;
Run
The step of providing the facility information is performed by conveying the facility information to the user through a character displayed on at least one display device provided in an input/output device;
The building management information is acquired from an entrance and exit management device.
Character interaction methods. The computer
processing facility information , the facility information including building management information ;
providing the facility information in response to an input from a user;
Run
The step of providing the facility information is performed by conveying the facility information to the user through a character displayed on at least one display device provided in an input/output device;
The building management information is obtained from an elevator .
Character interaction methods.

Images