JP6681429B2 - Network system, server, and information processing method - Google Patents

Description

  The present invention relates to a technique for causing a communication terminal to output a voice message.

  BACKGROUND ART Conventionally, a technique for outputting a voice message to various terminals via a network is known. For example, Japanese Patent Laying-Open No. 2017-220248 (Patent Document 1) discloses a network system, a server, and an information processing method. According to Patent Document 1, a network system transmits at least one device capable of storing a plurality of types of audio data and a first instruction for causing at least one device to acquire the audio data, And a server for transmitting a second instruction for outputting a voice based on the data at a timing different from that of the first instruction.

JP, 2017-220248, A

  An object of the present invention is to provide a network system, a server, or an information processing method capable of outputting a voice message more efficiently than before.

  According to an aspect of the present invention, the first communication terminal, the second communication terminal, and the first communication terminal are caused to output voice or text while the first communication terminal is out, and the first communication terminal A network system is provided that includes a server for causing the second communication terminal to output a voice while at home.

  As described above, the present invention provides a network system, a server, or an information processing method capable of outputting a voice message more efficiently than before.

It is an image figure which shows the whole structure and operation outline of the network system 1 concerning 1st Embodiment. It is a block diagram showing a configuration of a server 100 according to the first exemplary embodiment. It is an image figure which shows the user data 121 concerning 1st Embodiment. It is an image figure which shows the apparatus data 122 concerning 1st Embodiment. It is an image figure which shows the message data 123 concerning 1st Embodiment. 5 is a flowchart showing information processing of the server 100 according to the first embodiment. It is a block diagram showing a configuration of a home communication terminal 200 according to the first embodiment. FIG. 3 is a block diagram showing a configuration of mobile communication terminal 300 according to the first embodiment. It is an image figure which shows the user data 121B concerning 2nd Embodiment. It is an image figure which shows the user data 121D concerning 4th Embodiment. It is an image figure which shows the specific example of the message data concerning 1st Embodiment. It is an image figure which shows the specific example of the condition data concerning 1st Embodiment.

Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the following description, the same parts are designated by the same reference numerals. Their names and functions are also the same. Therefore, detailed description thereof will not be repeated.
<First Embodiment>
<Overall configuration of network system 1>

First, the overall configuration of the network system 1 according to the present embodiment will be described with reference to FIG. The network system 1 according to the present embodiment mainly includes a server 100 for providing a voice message, a communication terminal that is likely to be used in a home such as a robot 200A, a speaker, and a home electric appliance, and a wearable terminal 300A. It includes a communication terminal that is often carried by a user such as the smartphone 300B and used outside the home. Hereinafter, communication terminals that are likely to be used in the home such as the robot 200A, the speaker, and the home appliances are collectively referred to as the home communication terminal 200, and are used by the user such as the wearable terminal 300A and the smartphone 300B to be used outside the home. Communication terminals that are often used are also collectively referred to as mobile communication terminals 300.
<Outline of operation of network system 1>

  Next, a first operation outline of the network system 1 according to the present embodiment will be described. As shown in FIG. 1A, when a message to be output to a user is prepared, the server 100, when the user is at home, the home communication terminal 200 associated with the user. To output the message by voice. Then, as shown in FIG. 1B, when the user, that is, the mobile communication terminal 300 goes out, the server 100 causes the mobile communication terminal 300 to output a message for the user by voice. However, the mobile communication terminal 300 may display the message in text based on the data from the server 100. Then, as shown in FIG. 1C, when the user returns home, the server 100 causes the home communication terminal 200 to output a message for the user by voice.

As described above, in the network system 1 according to the present embodiment, when the user is out, the mobile communication terminal 300 carried by the user is caused to output a voice, and when the user returns home, the home communication is placed in the home. Causes the terminal 200 to output sound. Hereinafter, a specific configuration of the network system 1 for realizing such a function will be described in detail.
<Hardware configuration of server 100>

  First, one aspect of the configuration of the server 100 configuring the network system 1 according to the present embodiment will be described. Referring to FIG. 2, server 100 includes a CPU (Central Processing Unit) 110, a memory 120, a display 130, an operation unit 140, and a communication interface 160 as main components.

  The CPU 110 controls each unit of the server 100 by executing the program stored in the memory 120. For example, the CPU 110 executes a program stored in the memory 120 and refers to various types of data to execute various types of processing described below.

  The memory 120 is realized by various types of RAM, various types of ROM, and the like, and may be included in the server 100, removable from various interfaces of the server 100, or the server 100. It may be a recording medium of another device accessible from. The memory 120 stores a program executed by the CPU 110, data generated by execution of the program by the CPU 110, input data, and a database used for other services according to the present embodiment. For example, the memory 120 according to the present embodiment stores user data 121, device data 122, message data 123, and other various data used for voice providing services.

  As shown in FIG. 3, the user data 121 according to the present embodiment mainly shows a correspondence relationship such as a user ID, a user name, a user's e-mail address, and a user's home address for each user. Including. The home address of the user and the like may include GPS information that is inferred from the home communication terminal 200 or the mobile communication terminal 300.

  As shown in FIG. 4, the device data 122 according to the present embodiment mainly includes, for each electric device, an ID that can uniquely identify the electric device, a type of the electric device, a user ID, and a home flag. It includes correspondences such as the number of steps before going out, the number of steps after going out, the period of going out, and the moving distance. The device data 122 is not limited to such data, and may include information on acceleration that the mobile communication terminal 300 can acquire, a user command that the home communication terminal 200 can acquire, and the like.

  Further, in the present embodiment, CPU 110 of server 100 recognizes that the type of communication device is a mobile communication terminal 300 when the type is a highly portable communication device such as a wearable terminal or a smartphone, and a robot or speaker is used. If it is a communication device that is unlikely to be carried when going out, such as a personal computer or a television, it is recognized as the home communication terminal 200.

  As shown in FIG. 5, the message data 123 according to this exemplary embodiment includes, for each message, a message ID, a condition for outputting the message, and a correspondence relationship such as the content of the message. The conditions for outputting the message are registered such that the condition cannot be determined without referring to various data obtained by the mobile communication terminal 300 when going out, and that the condition is satisfied even when there is no various data when going out. ing.

  Specifically, for example, the memory 120 stores, as message data, messages corresponding to conditions A to F and time zones as shown in FIG. Then, as shown in FIG. 12, the memory 120 stores, as condition data, a correspondence relationship between the user's step count or moving distance, the user's outing time, and conditions A to F. That is, the CPU 110 identifies the condition applicable to each user by referring to the condition data, and determines the message corresponding to the condition by referring to the message data.

  Returning to FIG. 2, the display 130 displays a text or an image based on a signal from the CPU 110. The operation unit 140 receives a command from a service manager or the like and inputs the command to the CPU 110.

The communication interface 160 transmits the data from the CPU 110 to another device such as the home communication terminal 200 or the mobile communication terminal 300 via the Internet, a carrier network, a router, or the like. Conversely, the communication interface 160 receives data from other devices such as the home communication terminal 200 and the mobile communication terminal 300 via the Internet, a carrier network, a router, etc., and transfers the data to the CPU 110.
<Information processing of server 100>

  Next, with reference to FIG. 6, information processing of the server 100 according to the present embodiment will be described. The CPU 110 of the server 100 according to the present embodiment periodically acquires various data from the mobile communication terminal 300 and the home communication terminal 200. In the present embodiment, CPU 110 executes the following processing when receiving data from mobile communication terminal 300 or home communication terminal 200.

  The CPU 110 refers to the user data 121 and the device data 122 and determines whether or not the mobile communication terminal 300 corresponding to the user is at the user's home (step S102). When mobile communication terminal 300 is out (NO in step S102), CPU 110 causes mobile communication terminal 300 to output a message for going out by voice through communication interface 160 (step S130). However, the mobile communication terminal 300 may display a message based on the data from the server 100.

  When mobile communication terminal 300 is at home (YES in step S102), CPU 110 refers to user data 121 and device data 122 and registers home communication terminal 200 corresponding to the user of mobile communication terminal 300. It is determined whether or not (step S104). If home communication terminal 200 is not registered (NO in step S104), CPU 110 causes mobile communication terminal 300 to output a message for home communication by voice through communication interface 160 (step S140). However, the mobile communication terminal 300 may display a message based on the data from the server 100.

  If home communication terminal 200 is registered (YES in step S104), CPU 110 thereafter switches the voice output device of the message to home communication terminal 200 until mobile communication terminal 300 goes out (step S106). ).

  The CPU 110 uses the communication interface 160 and various data that can be acquired using the mobile communication terminal 300 via the home communication terminal 200, for example, the data acquired using the user's step count, moving distance, or an acceleration sensor. And the like are inquired to the user (step S112). Note that the process of step S112 may be performed without asking for permission each time the user returns home, etc., as long as the user's consent is obtained by some means.

  When the user's consent is obtained (YES in step S112), CPU 110 transmits various data from mobile communication terminal 300 via communication interface 160, such as the number of steps taken while out, the distance traveled, the destination, and the like. The outing period, the acceleration data of the mobile communication terminal 300, and the like are acquired and registered in the device data 122 (step S114). Based on the acquired data, the CPU 110 refers to the message data 123 and identifies the first message to be voice output. The first message preferably relates to the user's outing. The CPU 110 outputs the first message by voice to the home communication terminal 200 via the communication interface 160 (step S116).

  For example, when the moving distance while going out is 100 m or more and 10 km or less, the CPU 110 refers to the message data 123 and causes the home communication terminal 200 to voice-output a message saying “Welcome home. For example, when the distance traveled while going out is 10 km or more and 100 km or less, the CPU 110 refers to the message data 123 and instructs the at-home communication terminal 200 to send a message saying “Welcome home. Thank you for your work today”. Output audio. For example, when the distance traveled while going out is 100 km or more, the CPU 110 refers to the message data 123 and informs the home communication terminal 200, “I'm tired because I went a long distance today. Please take a rest slowly.” Let's give a voice output of a message of "Onionai". When the moving distance during going out is within 100 m, the CPU 110 refers to the message data 123 and does not particularly output a message by voice.

  For example, the CPU 110 may refer to the device data 122 and calculate the number of steps during going out based on the number of steps before going out and the number of steps after going out. Then, the CPU 110 may refer to the message data 123 based on the number of steps while going out, and output a message of a longing. Alternatively, since the step count measurement consumes a large amount of power, the CPU 110 refers to the message data 123 and issues a message prompting the charging of the mobile communication terminal 300 when the number of steps while out is a predetermined value or more. You may make 200 output a voice.

  Alternatively, when a large acceleration is detected a large number of times, the CPU 110 refers to the message data 123 and outputs a voice of a longing message such as "You are tired today. Please rest slowly." On the other hand, when a large acceleration is not detected so much, the CPU 110 refers to the message data 123 and outputs a message saying "A recommended movie will be broadcast today."

If the user's consent has not been obtained (NO in step S112), the CPU 110 does not need the data while out, and the second general message, for example, "Today is a nice weather. You should be able to see it. " CPU 110 voice-outputs a general second message to home communication terminal 200 via communication interface 160 (step S120).
<Configuration of home communication terminal 200>

  Next, with reference to FIG. 7, one aspect of the configuration of the home communication terminal 200 that constitutes the network system 1 will be described. Home communication terminal 200 according to the present embodiment has, as main components, CPU 210, memory 220, display 230, operation unit 240, communication interface 260, speaker 270, microphone 280, and device drive unit 290. Including and

  The CPU 210 controls each unit of the home communication terminal 200 by executing a program stored in the memory 220 or an external storage medium.

  The memory 220 is realized by various RAMs, various ROMs, and the like. The memory 220 stores a cooking program or another program executed by the CPU 210, data generated by executing the program by the CPU 210, data received from the server 100 or the server 100, data input via the operation unit 240, and the like. Remember.

  The display 230 outputs characters, images, etc. based on the signal from the CPU 110. The operation unit 240 is realized by buttons, a touch panel, and the like, receives an instruction from the user, and inputs the instruction to the CPU 210. The display 230 and the operation unit 240 may form a touch panel 250.

  The communication interface 260 is realized by a communication module such as an antenna and a connector. The communication interface 260 exchanges data with other devices by wire communication or wireless communication via a router or the like. In the present embodiment, CPU 210 receives various control commands from other devices such as server 100 and mobile communication terminal 300 via communication interface 260, and other of server 100 and mobile communication terminal 300. Send various information to the device.

  The speaker 270 outputs sound based on the signal from the CPU 210. The microphone 280 creates a voice signal based on a voice from the outside and inputs it to the CPU 210.

The device driving unit 290 controls each unit of the electric device (motor, actuator, heater, infrared ray transmitting device for remote controller, etc.) based on a signal from the CPU 210.
<Configuration of mobile communication terminal 300>

  Next, one aspect of the configuration of the mobile communication terminal 300 that constitutes the network system 1 will be described with reference to FIG. The mobile communication terminal 300 according to the present embodiment has CPU 310, a memory 320, a display 330, an operation unit 340, a communication interface 360, a speaker 370, a microphone 380, an acceleration sensor 390, etc. as main components. including.

  CPU 310 controls each unit of mobile communication terminal 300 by executing a program stored in memory 320.

  The memory 320 is realized by various RAMs and various ROMs. The memory 320 is a program executed by the CPU 310 such as various application programs, data generated by the execution of the program by the CPU 310, data received from the server 100 or the home communication terminal 200, and input via the operation unit 340. Data, information for identifying the user of mobile communication terminal 300, and the like are stored.

  The display 330 displays an image or a text based on the data from the CPU 310. For example, CPU 310 causes display 330 to display a message based on the text data from server 100 via communication interface 360. The operation unit 340 includes a pointing device, a switch, and the like, and inputs various commands from the user to the CPU 310. The user terminal may have the touch panel 350 including the display 330 and the operation unit 340.

  The communication interface 360 transmits / receives data to / from other devices such as the server 100 and the home communication terminal 200 via the Internet, a carrier network, a router, or the like. For example, the CPU 310 receives a user ID, a password, and various commands via the touch panel 350 according to an application program in the memory 320, and receives the user ID, password, and various commands via the communication interface 360 from the server 100 and the home communication terminal 200. Or send it to other devices such as. Further, the CPU 310 acquires image data and audio data via the communication interface 360 and outputs them from the display 330 and the speaker 370 in accordance with the application program for audiovisual viewing.

  The speaker 370 outputs a sound based on the data from the CPU 310. For example, the CPU 310 causes the speaker 370 to output the voice data from the server 100 via the communication interface 360. The microphone 380 inputs the acquired audio signal to the CPU 310. For example, CPU 310 transmits the audio data acquired from microphone 380 to server 100 via communication interface 360.

Acceleration sensor 390 measures the acceleration of mobile communication terminal 300 and transfers it to CPU 310. The CPU 310 measures the number of steps based on the acceleration and stores various kinds of information regarding the acceleration in the memory 320. The CPU 310 provides the information to the server 100 and the home communication terminal 200 based on the user's consent.
<Second Embodiment>

  In addition to the above configuration, the server 100 may perform user authentication when obtaining the user's consent to obtain or use various data.

  More specifically, in the present embodiment, as shown in FIG. 9, user data 121B is associated with data for identifying the user's voice in association with the user. However, user authentication information, passwords, and other information may be used. Further, in the device data 122, authentication data for identifying the user may be associated with the device.

Then, for example, in step S112 of FIG. 6, when using the communication interface 160, the CPU 110 acquires a password via the mobile communication terminal 300 or the home communication terminal 200, or based on a user voice, when obtaining consent. Voiceprint authentication may be performed. Then, when the user's consent is obtained and the user authentication is successful (YES in step S112), the CPU 110 executes the processing from step S114, and the user's approval is not obtained, Alternatively, if the user authentication fails (NO in step S112), the process from step S120 is executed.
<Third Embodiment>

  If the user's consent is not obtained (NO in step S112 of FIG. 6), various data is stored in the mobile communication terminal 300, and the user's approval is obtained next time (FIG. If YES in step S112 of step 6), the mobile communication terminal 300 may collectively provide the data accumulated thus far to the server 100.

Alternatively, when the user's consent is not obtained (NO in step S112 of FIG. 6), the server 100 only acquires various data from the mobile communication terminal 300, and the CPU 110 this time The second message may be created without using the data (step S120). Then, when the user's consent is obtained next time (YES in step S112 of FIG. 6), the CPU 110 collectively makes available the data accumulated so far and creates the first message. You may do (step S116).
<Fourth Embodiment>

  Further, the home communication terminal 200 may output different voice messages for each user. More specifically, in the present embodiment, as shown in FIG. 10, in user data 121D, the type of favorite voice color of the voice message, such as gender, age, language, dialect, etc., is associated with the user. You may match.

Then, for example, in step S116 or step S120 of FIG. 6, the CPU 110 refers to the user data 121D and the message data 123 to create a voice message of the voice color of the user's liking, and moves through the communication interface 160. The voice data is transmitted to the communication terminal 300 and the home communication terminal 200.
<Fifth Embodiment>

Some or all of the roles of each device of the network system 1 of the above embodiment may be executed by another device. For example, another device plays a part or all of the roles of each of the server 100, the home communication terminal 200, and the mobile communication terminal 300, or a part or all of the roles of each of the devices is provided by a plurality of devices. You may share in. For example, a part of the role of the application program of the mobile communication terminal 300 may be realized by the server 100 or the home communication terminal 200, or the role of the server 100 may be distributed to a plurality of servers on the cloud.
<Summary>

  In the above-described embodiment, the first communication terminal 300, the second communication terminal 200, and the first communication terminal 300 are caused to output a voice when the first communication terminal 300 is out, A network system 1 is provided, which includes a server 100 for causing the second communication terminal 200 to output a voice or a text while 300 is at home.

  Preferably, the server 100 may use the data acquired by the first communication terminal 300 when the first communication terminal 300 returns home for the service related to the second communication terminal 200, or the first communication terminal 300 may return to the home. The user is asked for consent via the communication terminal 300 or the second communication terminal 200.

  Preferably, the server 100 stores the data regarding the voice of the user of the first communication terminal 300, and when the consent is obtained, the voice input via the first communication terminal 300 or the second communication terminal 200 is used. Based on this, user authentication is performed.

  Preferably, the data acquired while the first communication terminal 300 is out is accumulated in the first communication terminal 300 until consent is obtained.

  Preferably, the server 100 changes the voice message to be output to the second communication terminal 200, according to the moving distance of the first communication terminal 300 during the outing or according to the outing period of the first communication terminal 300. .

  Preferably, when the first communication terminal 300 has a long outing distance or when the first communication terminal 300 has a long outing period, the server 100 sends a second message to the user when he / she comes home. If the distance when the first communication terminal 300 is out is short, or if the first communication terminal 300 is out of the house for a short period, the communication terminal 200 outputs the sound to the second communication terminal 200 when the user returns home. Do not let

  Preferably, server 100 causes a message for charging to be output as voice via second communication terminal 200 when a predetermined condition is satisfied.

  Preferably, the predetermined condition relates to information on acceleration detected by the first communication terminal 300.

  Preferably, the predetermined condition relates to the number of steps of the user before going out and the number of steps of the user when returning home.

  Preferably, the server changes the voice message output to the second communication terminal according to the number of steps of the user before going out and the number of steps of the user when returning home.

  Preferably, the server 100 causes the second communication terminal 200 to output the message by voice in a voice color for each user of the first communication terminal 300.

  In the above embodiment, the communication interface 160 for communicating with the first communication terminal 300 and the second communication terminal 200, and the first communication terminal 160 via the communication interface 160 while the first communication terminal 300 is out. A server 100 is provided, which includes a processor 110 for causing the communication terminal 300 to output voice or text and to output voice to the second communication terminal 200 via the communication interface 160 while the first communication terminal 300 is at home. It

  In the above embodiment, an information processing method in server 100 that can communicate with first communication terminal 300 and second communication terminal 200 is provided. The information processing method includes a step of causing the first communication terminal 300 to output a voice or a text while the first communication terminal 300 is out, and to the second communication terminal 200 while the first communication terminal 300 is at home. Audio output.

  The embodiments disclosed this time are to be considered as illustrative in all points and not restrictive. The scope of the present invention is shown not by the above description but by the claims, and is intended to include meanings equivalent to the claims and all modifications within the scope.

1: Network system 100: Server 110: CPU
120: Memory 121: User data 121B: User data 121D: User data 122: Device data 123: Message data 130: Display 140: Operation part 160: Communication interface 200: Home communication terminal 200A: Robot 210: CPU
220: Memory 230: Display 240: Operation part 250: Touch panel 260: Communication interface 270: Speaker 280: Microphone 290: Device drive part 300: Mobile communication terminal 300A: Wearable terminal 300B: Smartphone 310: CPU
320: Memory 330: Display 340: Operation part 350: Touch panel 360: Communication interface 370: Speaker 380: Microphone 390: Acceleration sensor

Claims (11)

A first communication terminal,
A second communication terminal,
A server for causing the first communication terminal to output a voice or a text when the first communication terminal is out, and for causing the second communication terminal to output a voice when the first communication terminal is at home. ,
The server may use the data acquired by the first communication terminal when the first communication terminal returns home for the service related to the second communication terminal, or the first communication terminal. or Ru seeking consent to the user via the second communication terminal, the network system. The server stores data related to the voice of the user of the first communication terminal, and based on the voice input via the first communication terminal or the second communication terminal when obtaining the consent. performs user authentication, the network system according to claim 1. The consent until is obtained, the first communication terminal data acquired on the go is stored in the first communication terminal, the network system according to claim 1. The server changes the voice message to be output to the second communication terminal according to the moving distance of the first communication terminal while out, or according to the outing period of the first communication terminal. The network system according to any one of 1 to 3 . When the distance when the first communication terminal is out is long or when the first communication terminal is out of the house for a long time, the server sends a message to the user when the user comes home to the second communication terminal. If the distance during the outing of the first communication terminal is short or if the outing period of the first communication terminal is short, the second communication terminal is not allowed to output the sound when the user returns home. The network system according to any one of items 1 to 4 . The network system according to any one of claims 1 to 5 , wherein the server outputs a message prompting charging via the second communication terminal by voice when a predetermined condition is satisfied. The network system according to claim 6 , wherein the predetermined condition relates to information on acceleration detected by the first communication terminal. The server according to any one of claims 1 to 7 , wherein the server changes a voice message output to the second communication terminal according to the number of steps of the user before going out and the number of steps of the user when returning home. Network system. The network system according to any one of claims 1 to 8 , wherein the server causes the second communication terminal to output a message in a voice color for each user of the first communication terminal. A communication interface for communicating with the first communication terminal and the second communication terminal;
When the first communication terminal is out, the first communication terminal is caused to output a voice or a text through the communication interface, and when the first communication terminal is at home, the second communication terminal is operated through the communication interface. And a processor for causing the communication terminal to output voice ,
When the first communication terminal returns home, the processor may use the data acquired while the first communication terminal is out through the communication interface for a service related to the second communication terminal. , the first communication terminal or Ru seeking consent to the user via the second communication terminal, a server. An information processing method in a server capable of communicating with a first communication terminal and a second communication terminal, comprising:
Causing the first communication terminal to output voice or text while the first communication terminal is out,
Causing the second communication terminal to output a voice while the first communication terminal is at home,
When the first communication terminal returns home, the data acquired while the first communication terminal is out may be used for a service related to the second communication terminal, or the first communication terminal or the second communication terminal. An information processing method , comprising the step of asking the user for consent via the communication terminal .

Images