JP6861398B2 - Information processing method and information processing device - Google Patents

Description

The present disclosure relates to an information processing method and an information processing device.

In a system for sharing information about child-rearing, the conventional method is to diagnose the child's condition from the voice of the child and notify the parent (child-rearing person, for example, the mother of the child) of the child's condition away from the child. Proposed.

For example, Patent Document 1 discloses a technique of detecting a child's crying and notifying a guardian's terminal of the situation on condition that the child's crying is continuously emitted for a predetermined time or longer.

Japanese Patent No. 4855496

However, in the technique disclosed in Patent Document 1, only the situation of the child is diagnosed, and the diagnosis result is notified to the child-rearing person at a remote place. This technique does not allow information about the situation in which the child and the caregiver are spending together with other caregivers (eg, the child's father).

Therefore, the present invention provides an information processing method that supports further deepening the understanding of other child-rearing persons regarding the situation in which the child and the child-rearing person are spending time together.

In the information processing method according to one aspect of the present invention, a processor is used to acquire sound information obtained by collecting sound by a sound collecting device, and a child's voice and an adult's voice included in the sound indicated by the sound information are obtained. Based on the identified and identified voice of the child, the condition of the child is determined, and based on the voice of the identified adult, the condition of the adult is determined, the condition of the child determined, and the condition of the child. , The notified is generated according to the determined state of the adult and the destination of the notification about the state of the adult, and the generated notification is transmitted to the destination.

It should be noted that these comprehensive or specific embodiments may be realized in a recording medium such as a system, method, integrated circuit, computer program or computer readable CD-ROM, system, method, integrated circuit, computer program. And any combination of recording media may be realized.

The information processing method of the present invention can support the further deepening of the understanding of other child caregivers about the situation in which the child and the child caregiver are spending time together.

FIG. 1 is an explanatory diagram showing an outline of a service provided by the information processing system according to the first embodiment. FIG. 2 is a block diagram showing a function of the information processing system according to the first embodiment. FIG. 3 is an explanatory diagram of a table showing conditions used by the shared determination unit in the first embodiment for determination. FIG. 4 is an explanatory diagram of a table showing the destination of the notification and the content of the notification according to the first embodiment. FIG. 5 is a flow chart showing a flow of processing executed by the identification unit, the child state determination unit, and the mother state determination unit in the first embodiment. FIG. 6 is a flow chart showing a flow of processing executed by the shared determination unit in the first embodiment. FIG. 7 is an explanatory diagram showing a first example of an image presented by the information processing system according to the first embodiment. FIG. 8 is an explanatory diagram showing a second example of an image presented by the information processing system according to the first embodiment. FIG. 9 is a block diagram showing a function of the information processing system according to the second embodiment. FIG. 10 is an explanatory diagram of a table showing conditions used by the shared determination unit in the second embodiment for determination. FIG. 11 is a flow chart showing a flow of processing executed by the identification unit, the child state determination unit, the mother state determination unit, and the environmental sound determination unit in the second embodiment. FIG. 12 is an explanatory diagram of a table showing another condition used for determination by the shared determination unit in the second embodiment. FIG. 13 is a block diagram showing a function of the information processing system according to the third embodiment. FIG. 14 is an explanatory diagram of a table showing the transmission timing of information by the transmission unit in the third embodiment and the transmission timing showing the mode of information notification.

(Knowledge that became the basis of the present invention)
In the technique disclosed in Patent Document 1, only the situation of the child is diagnosed, and the diagnosis result is notified to the child caregiver (for example, the mother of the child) at a remote place. This technique does not inform other caregivers (eg, the child's father) or related parties (eg, the child's grandparents) of information about the caregiver spending time with the child. Therefore, this alone does not give the understanding of other child-rearing people about the information about the child-rearing person. Therefore, when trying to make other child-rearing persons or related persons grasp the situation of child-rearing, it is necessary for the child-rearing person to give notice by himself / herself. If the child-rearing person himself / herself notifies the other child-rearing person or the person concerned, there may be a problem that the other child-rearing person or the person concerned may be given an unintended and inappropriate impression. If an inappropriate impression is given, it will be necessary to give the notification again, and there may be a problem that extra time or power for the notification is consumed.

Therefore, the present invention provides an information processing method that supports further deepening the understanding of other child-rearing persons regarding the situation in which the child and the child-rearing person are spending time together.

In order to solve such a problem, the information processing method according to one aspect of the present invention uses a processor to acquire sound information obtained by sound collection by a sound collecting device, and includes the sound information indicated by the sound information. The child's voice and the adult's voice are identified, the child's condition is determined based on the identified child's voice, and the adult's condition is determined based on the identified adult's voice. , The determined state of the child, the determined state of the adult, and the destination of the notification about the state of the adult, the notification is generated, and the generated notification is transmitted to the destination. To do.

According to the above aspect, the notification generated according to the condition of the child and the adult is transmitted to the destination. In addition, the notification is generated according to the destination of the notification. If the adult is the child's caregiver (eg mother) and the notification is addressed to another child caregiver (eg father or grandparent) of the child, the notification indicating the condition of the child and mother is the destination (ie). It is generated and transmitted according to whether it is a father or a grandparent, etc.). Since the information generated according to the destination is notified, it is easy to obtain the understanding of other child-rearing people who are the destination. Therefore, it is possible to support the further deepening of the understanding of other child-rearing people about the situation in which the child and the child-rearing person are spending time together.

For example, generating the notification may include generating the notification having different expressions or contents depending on the destination.

According to the above aspect, the notification is given to the other child-rearing person to whom the notification is sent, for example, by different expressions or contents depending on the father or grandparents. By having the appropriate expression or content depending on the destination of the notification, it is possible to support the further deepening of the understanding of other child-rearing persons who are the destination of the notification.

For example, generating the notification may include generating the notification including a symbol or sentence having a different expression or content depending on the destination and indicating the state of the adult.

According to the above aspect, a notification including a design or text is transmitted. The design or text included in the notification allows other childcare workers, who are the recipients of the notification, to grasp the content of the notification more intuitively than in the case of textual information.

For example, generating the notification may include generating the notification, which may or may not include a symbol or text indicating the state of the adult, depending on the destination.

According to the above aspect, whether or not the notification includes a design or a sentence can be different depending on the destination. Depending on the destination of the notification, it may not be appropriate to include the design or text in the notification. In such a case, it is appropriate to send the notification that does not include the design or text. According to this aspect, a notification containing a symbol is sent to a destination to which a notification containing a symbol or a sentence is appropriate, and a notification containing no symbol or a sentence is sent to a destination to which a notification containing no symbol or a sentence is appropriate. Can be.

For example, the expression or content of the symbol or the sentence may differ depending on the attributes of the destination.

According to the above aspect, the expression or content of the design or sentence included in the notification can be different depending on the attribute of the destination. Here, the attribute of the destination means a man, a woman, a mother or a father, and the like. Then, it is possible to send a notification including a sentence having an appropriate expression according to the attribute of the destination.

For example, the generation of the notification calculates an index according to at least one of the determined child's condition and the determined adult's condition, and only when the calculated index is higher than the threshold value. It may include generating the notification.

According to the above aspect, it is possible to control whether or not to generate a notification based on an index calculated from the state of a child or the state of an adult. Thereby, it is possible to control whether or not to generate the notification concretely and quantitatively.

For example, generating the notification calculates an index according to at least one of the determined child's condition and the determined adult's condition, and the larger the calculated index, the larger the symbol. Including The generation of the notification may be included.

According to the above aspect, the size of the symbol included in the notification can be controlled based on the index calculated from the state of the child or the state of the adult. As a result, the size of the symbol included in the notification can be controlled concretely and quantitatively, which can contribute to further deepening the understanding of other child-rearing persons who are the recipients of the notification.

For example, generating the notification receives information indicating the state of the adult via an input device, and converts the received information into information in the form issued by the child or information indicating the state of the child. This may include generating the notification.

According to the above aspect, the information indicating the condition is converted into the information as if the child originated or the information indicating the condition of the child and transmitted to the other child-rearing person who is the destination, thereby raising another child. It can contribute to further deepening the understanding of people.

For example, the destination may be determined according to the determined state of the child and the determined state of the adult.

According to the above aspect, the destination of the notification is determined based on the condition of the child and the condition of the adult. Depending on the condition of the child and the condition of the adult, it may be inappropriate to notify a particular destination. In such a case, it is possible not to notify the specific destination.

For example, further identifying the environmental sound included in the sound indicated by the sound information and determining the state of the adult is based on the identified voice of the adult and the environmental sound, and the state of the adult. May include determining.

According to the above aspect, an environmental sound is further used to determine the condition of an adult. Then, a notification is generated and transmitted according to the state of the adult determined based on the environmental sound. As a result, the condition of the adult can be determined in more detail, and the notification is generated and transmitted based on this detailed determination.

For example, in the information processing method, further, the detection result by the sensor that detects a person is acquired and the state of the adult is determined, based on the identified voice of the adult and the detection result. It may include determining the condition of an adult.

According to the above aspect, a sensor is further used to determine the condition of an adult. Then, a notification is generated and transmitted according to the state of the adult determined based on the sensor. As a result, the condition of the adult can be determined in more detail, and the notification is generated and transmitted based on this detailed determination.

For example, in the information processing method, further acquiring the position information indicating the position of the destination and transmitting the notification to the destination means that the destination is at a predetermined position with reference to the position information. It may include sending the notification to the destination accordingly.

According to the above aspect, the notification may be transmitted according to the position of the other child-rearing person to whom the notification is sent. By sending the notification in a state where it is easy for the other child caregiver to confirm the notification, the certainty that the other child caregiver recognizes the notification may be improved.

For example, the predetermined position is a position where a boarding / alighting recorder related to a vehicle is installed, and in response to communication with the boarding / alighting recorder using proximity wireless communication by a terminal carried by a person related to the destination. , The notification may be transmitted to the destination.

According to the above aspect, the notification is transmitted in response to the other child-rearing person getting on and off the vehicle at a timing when the other child-rearing person can easily confirm the notification. This can further improve the certainty that other caregivers will recognize the notification.

Further, the information processing device according to one aspect of the present invention is identified as an identification unit that identifies a child's voice and an adult's voice, which is included in the sound indicated by the sound information obtained by collecting the sound by the sound collecting device. A child state determination unit that determines the state of the child based on the voice of the child, an adult state determination unit that determines the state of the adult based on the identified voice of the adult, and the determined child. A generation unit that generates the notification and a transmission unit that transmits the generated notification to the destination according to the state, the determined state of the adult, and the destination of the notification about the adult state. To be equipped with.

As a result, the same effect as that of the above information processing method is obtained.

It should be noted that these comprehensive or specific embodiments may be realized in a recording medium such as a system, method, integrated circuit, computer program or computer readable CD-ROM, system, method, integrated circuit, computer program. Alternatively, it may be realized by any combination of recording media.

Hereinafter, embodiments will be specifically described with reference to the drawings.

It should be noted that all of the embodiments described below show comprehensive or specific examples. Numerical values, shapes, materials, components, arrangement positions and connection forms of components, steps, order of steps, etc. shown in the following embodiments are examples, and are not intended to limit the present invention. Further, among the components in the following embodiments, the components not described in the independent claims indicating the highest level concept are described as arbitrary components.

(Embodiment 1)
In the present embodiment, an information processing method for supporting the deepening of the understanding of other child-rearing persons regarding the situation in which the child and the child-rearing person are spending time together will be described.

First, the outline of the service aimed at by the present inventors will be described with reference to FIG.

FIG. 1 is an explanatory diagram showing an outline of a service provided by the information processing system 1 according to the present embodiment.

In the technical field of notifying a child-rearing person who is remote of the child's condition, the present inventors have a negative part such as the difficulty of child-rearing that cannot be seen only from the child's condition, or a positive part such as a feeling of well-being. We are focusing on technologies shared with other childcare workers or related parties. Then, we aim to further deepen the understanding of the child-rearing situation by communicating the above-mentioned negative or positive parts to other child-rearing people or related parties.

The term "child" here refers to an infant, and more specifically, refers to a person from 0 days after birth to 6 to 7 years old, but is not limited thereto.

As shown in FIG. 1, in the information processing system 1 of the present embodiment, an input terminal 10 for acquiring sound such as a microphone is arranged in the house. Then, the information processing system 1 determines the state of each of the two by analyzing the voice of the child and the voice of the child-rearing person based on the sound acquired by the input terminal 10, and the information indicating the state is used for other child-rearing. Determine whether or not to share with others and present the information. The information presented is expected to be presented to other caregivers.

The case where the above-mentioned "child-rearing person" is the mother of the child, the above-mentioned "other child-rearing person" is the father of the child, and the "related person" is the grandparent of the child will be described as an example, but the present invention is not limited to this. .. More generally, both the above-mentioned "child-rearing person" and the above-mentioned "other child-rearing person" can apply this embodiment as long as they are adults. In addition, "adult" can also be expressed as a person who is not a child.

As a result, the father can grasp the child-rearing situation that cannot be grasped by the conventional technique. In addition to the child-rearing situation, the father can know the timing when the burden on the mother is extremely high or the timing when the mother is happy in daily child-rearing and housework. If the father knows these timings, he or she can share more information about the event, such as by giving the couple time to talk about these things later. As described above, the information processing system 1 of the present embodiment supports the further deepening of the understanding of other child-rearing persons regarding the situation in which the child and the child-rearing person are spending time together.

Hereinafter, the information processing system 1 and the like of the present embodiment will be described in detail.

FIG. 2 is a block diagram showing a function of the information processing system 1 according to the present embodiment.

As shown in FIG. 2, the information processing system 1 includes an input unit 101, an identification unit 102, a child state determination unit 103, a mother state determination unit 104, holding units 105 and 106, and a shared determination unit 107. , A generation unit 108, a transmission unit 109, and a display unit 110.

The input unit 101 is an input device that collects ambient sounds by a sound collecting device and generates sound information indicating the collected sounds. The input unit 101 is, for example, a microphone.

The identification unit 102 acquires sound information from the input unit 101, and identifies a child's voice and a mother's voice included in the sound indicated by the acquired sound information. For example, when the identification unit 102 identifies the child's voice and the mother's voice, the frequency of the child's voice is relatively high and the frequency of the mother's voice is relatively low. Low frequencies can be identified as the child's voice and frequencies higher than the predetermined frequency can be identified as the mother's voice.

The child state determination unit 103 is a processing unit that determines the state of the child by analyzing the voice of the child identified by the identification unit 102.

The mother state determination unit 104 is a processing unit that determines the state of the mother by analyzing the voice of the mother identified by the identification unit 102.

The holding unit 105 is a storage device that temporarily or permanently holds the state of the child determined by the child state determination unit 103.

The holding unit 106 is a storage device that temporarily or permanently holds the state of the mother determined by the mother state determination unit 104.

The sharing determination unit 107 is a destination (for example, a destination) in which information indicating these states is registered in advance based on the state of the child held by the holding unit 105 and the state of the mother held by the holding unit 106. It is a processing unit that determines whether or not it should be shared with the father or grandparents.

The generation unit 108 is a processing unit that generates a notification to be presented to a pre-registered destination (for example, a father or grandparent) in response to the determination by the sharing determination unit 107 that the person should be shared with a pre-registered person. Is. When generating a notification, the notification is generated according to the destination of the notification. The content of the notification will be described in detail later.

The transmission unit 109 is a processing unit that transmits the image generated by the generation unit 108 to the mobile terminal of the father or grandparents. The transmission unit 109 includes a transmission circuit for transmitting information indicating an image, a connector, an antenna, and the like.

The display unit 110 is a display unit that displays an image transmitted by the transmission unit 109. The display unit 110 is a display screen of a mobile terminal such as a mobile phone or a smartphone, for example.

The identification unit 102, the child state determination unit 103, the mother state determination unit 104, the holding units 105 and 106, the shared determination unit 107, and the generation unit 108 are stored, for example, by a processor using a memory. It can be realized by executing a predetermined program stored in a device or the like.

A technique for the identification unit 102 to identify a child's voice from the sound indicated by the sound information acquired from the input unit 101 can be realized by using, for example, xauris, which is a known child voice identification technique. xauris uses a learning model constructed using deep learning from learning data that shows the relationship between the child's voice and the state collected in advance by the developers, and uses the child's voice input in the execution environment to determine the child's state. Are classified into four types: "crying", "laughing", "guzzling", and "babbling (non-verbal speech)". Therefore, among the processes performed by the identification unit 102, the process of identifying the child's voice and the process performed by the child state determination unit 103 can be realized by xauris. In this case, as the determination result of the child state determination unit 103, four types of states of "crying", "laughing", "guzuri", and "babbling" are stored in the holding unit 105.

Further, a technique for the identification unit 102 to identify the mother's voice from the sound indicated by the sound information acquired from the input unit 101 can be realized by using a known speaker identification technique. The speaker identification technique is composed of various elemental techniques, and for example, a method of detecting using a fundamental frequency and a spectral envelope characteristic of a specific band can be adopted. However, instead of using speaker identification technology, a method of attaching or mounting a sound collecting device such as a microphone on the mother's clothing or ornament and identifying the sound acquired by this sound collecting device as the mother's sound. It may be adopted.

A technique in which the mother state determination unit 104 analyzes the voice of the mother identified by the identification unit 102 to determine the state of the mother can be realized by using a known emotion analysis engine. For example, an emotion analysis engine captures a person's voice as a "sound" rather than as a "word" and quantifies the person's emotions from the sound. The output emotions are, for example, "anger", "concentration", "confused", "excitement", "thinking", "stress", "hesitation", "happiness", "interest / interest", "sadness / sadness". There are "dissatisfaction" and so on. Here, a case where the mother state determination unit 104 outputs an emotion such as “anger” as described above will be described as an example. The determination result of the mother state determination unit 104 is stored in the holding unit 106 as a combination of emotions and numerical values, such as "anger: 5", "concentration: 8", and "confused: 2".

The information processing system 1 includes, for example, an input terminal 10, a server 20, and a display terminal 30. The input terminal 10 and the server 20 and the server 20 and the display terminal 30 are communicably connected by a network (not shown). The above-mentioned functional block included in the information processing system 1 is shared by the input terminal 10, the server 20, and the display terminal 30.

For example, the input terminal 10 may employ a mobile terminal such as a mother's smartphone, or a dedicated device having a sound collecting device and a communication function. The server 20 may employ a server device that can be communicably connected to the input terminal 10 and the display terminal 30 via a network, such as a so-called cloud server. As the display terminal 30, a mobile terminal such as a father's smartphone may be adopted.

Then, the input terminal 10 includes an input unit 101. The server 20 includes an identification unit 102, a child state determination unit 103, a mother state determination unit 104, holding units 105 and 106, a shared determination unit 107, a generation unit 108, and a transmission unit 109. The display terminal 30 includes a display unit 110.

In this case, the input terminal 10 transmits the sound information generated by the input unit 101 to the identification unit 102 of the server 20 via the network. Further, the server 20 transmits data such as an image transmitted by the transmission unit 109 to the display unit 110 of the display terminal 30 via the network.

The division of functions of each device described above is merely an example, and it is possible to adopt other division of functions.

FIG. 3 is an explanatory diagram of a table T1 showing conditions used for determination by the shared determination unit 107 in the present embodiment. Table T1 shows the first condition and the second condition which are examples of the conditions used by the shared determination unit 107 for the determination.

Whether or not the sharing determination unit 107 should share information indicating these states with the father or grandparents based on the state of the child held by the holding unit 105 and the state of the mother held by the holding unit 106. Is determined. Various conditions can be adopted for this determination. For example, a condition for determining that the above information should be shared in a negative situation (first condition) and the above information in a positive situation are used. When any of the conditions for determining that the information should be shared (second condition) is satisfied, the sharing determination unit 107 determines that the above information should be shared with the father or the like. Hereinafter, each situation, and the first and second conditions will be described.

(1) Negative situations and the first condition Negative situations refer to situations in which the child is crying or squirming and the mother has negative emotions such as anger. In such situations, the father or grandparents need help with childcare or housework, or psychological support, and it is considered that information indicating these conditions should be shared with the father or grandparents.

The first condition is a condition regarding the condition of the child stored in the holding unit 105 (also referred to as “child condition”) and a condition regarding the condition of the mother stored in the holding unit 106 (also referred to as “mother's condition”). ) And. Specifically, the first condition is that the state of the child stored in the holding unit 105 is "crying" or "guzzling" and is calculated by the following (Equation 1) based on the emotions of the mother. It can be said that one index is equal to or higher than the threshold value.

First index = (degree of "anger") + (degree of "stress") + (degree of "confused")-(degree of "happiness") (Equation 1)

Here, each emotion such as the above-mentioned "anger" is acquired from the state of the mother at the above-mentioned time point stored in the holding unit 106. Further, for example, when the degree of each emotion such as "anger" is evaluated from 0 to 10, the threshold value in the first condition is set to, for example, 15.

The first index can be said to be an index showing the importance of sharing the condition between the mother and the father. In addition to the above, the first index may be calculated as a result of subtracting one or more positive emotional degrees from the total of one or more negative emotional degrees, or one or more negative emotional degrees. It may be calculated only from the total.

In the determination of the first condition, the first condition is set only when the above-mentioned child condition and mother condition are continuously satisfied for a predetermined time (also referred to as "duration", for example, 60 seconds) or more. It may be determined that the condition is satisfied. This is because even if a negative situation occurs in a short period of time, such as a few seconds, regarding the condition of the child and the condition of the mother, it is considered that there is relatively little need to share the information with the father or the like. Hereinafter, a case where it is determined that the first condition is satisfied when the condition of the child and the condition of the mother are continuously satisfied for a predetermined duration will be described.

(2) Positive situation and the second condition A positive situation refers to a situation in which the child is laughing or babbling, and the mother has positive emotions such as happiness. In such situations, it is desirable to have the father or grandparents have similar feelings, and it is considered that information indicating these conditions should be shared with the father or grandparents.

The second condition is defined by a condition regarding the condition of the child stored in the holding unit 105, that is, a condition of the child, and a condition regarding the condition of the mother stored in the holding unit 106, that is, a condition of the mother. .. Specifically, the second condition is that the state of the child stored in the holding unit 105 is "laughter" or "babbling" and is calculated by the following (Equation 2) based on the emotions of the mother. It can be said that the two indicators are equal to or higher than the threshold value.

Second index = (degree of "happiness") + (degree of "concentration") + (degree of "interest")-(degree of "stress") (Equation 2)

Here, each emotion such as the above-mentioned "happiness feeling" is acquired from the state of the mother at the above-mentioned time point stored in the holding unit 106. Further, for example, when the degree of each emotion such as "happiness" is evaluated from 0 to 10, the threshold value in the first condition is, for example, 15.

Similar to the first index, the second index can be said to be an index showing the importance of sharing the condition between the mother and the father. Like the first index, the second index may be calculated as a result of subtracting one or more negative emotions from the total of one or more positive emotions, or one or more positive emotions. It may be calculated only from the total degree.

In the determination of the second condition, as in the case of the first condition, only when the above-mentioned child condition and mother condition are continuously satisfied for a predetermined time (that is, duration) or longer, the second condition is determined. It may be determined that the condition is satisfied. Hereinafter, a case where it is determined that the second condition is satisfied when the condition of the child and the condition of the mother are continuously satisfied for a predetermined duration will be described.

FIG. 4 is an explanatory diagram of a table T2 showing the destination of the notification and the content of the notification in the present embodiment. Table T2 shows the notification destination and the content of the notification for each notification destination when each of the first condition and the second condition is satisfied. The destination of the notification is determined according to the condition of the child and the condition of the adult.

(1) When the first condition is satisfied When the shared determination unit 107 determines that the first condition is satisfied, the generation unit 108 presents it to the father of the child and the maternal grandparent of the child, respectively. Generate notifications for.

For example, as a notification to be presented to the father of the child, a predetermined image is added at a position corresponding to the time when it is determined that the first condition is satisfied on the graph showing the state of the child and the mother in chronological order. Generate an image. Here, the predetermined image is, for example, an image showing an illustration (design) of a cat's hand. This is because the situation of the mother at the time when this predetermined image is added is the time when she is extremely busy, that is, the situation where she wants to get the help of a cat (an expression derived from Japanese proverbs). In addition, the predetermined image may be an image showing words as if the child had uttered the situation at that time, such as the message "I have troubled my mom".

Also, for example, the notification to be presented to the maternal grandparents of the child may be an image showing words such as the message "It's really hard", as if the mother had said the situation at that time.

(2) When the second condition is satisfied When the shared judgment unit 107 calculates the second index, the generation unit 108 presents it to the father of the child, the maternal grandparents, and the paternal grandparents, respectively. Generate notifications for.

For example, in the case of a child's father and paternal grandparents, a predetermined image is added at a position corresponding to the time when it is determined that the second condition is satisfied on the graph showing the state of the child and the mother in chronological order. Generate the image. Here, the predetermined image is, for example, an image showing an illustration of a smiling face of a mother and child. In addition, the predetermined image may be an image showing words as if the child had uttered the situation of the mother and the child at that time, such as the message "It's so much fun!".

Also, for example, as a notification to be presented to the maternal grandparents of the child, it may be an image showing the words that the mother said at that time, such as the message "There was a lot of fun!" Good.

In this way, the generation unit 108 may generate a notification having a different expression or content depending on the destination of the notification. As a result, the notification is sent to the other child-rearing person to whom the notification is sent, for example, with different expressions or contents depending on the father or grandparents. By having the appropriate expression or content depending on the destination of the notification, it is possible to support the further deepening of the understanding of other child-rearing persons who are the destination of the notification.

In addition, the generation unit 108 may generate a notification including a symbol or a sentence indicating the state of the mother. As a result, a notification including a design or text is transmitted. The design or text contained in the notification allows other childcare workers who are the recipients of the notification to more intuitively understand the content of the notification.

Then, when generating the notification, the generation unit 108 may generate a different notification depending on the destination, depending on whether or not the generated notification includes a symbol or a sentence indicating the state of the mother. Further, when generating a notification, the generation unit 108 may generate a notification in which the content of the design or the text differs depending on the destination. Thereby, whether or not the notification includes a design or a sentence can be different depending on the destination. Depending on the destination of the notification, it may not be appropriate to include the design or text in the notification. In such a case, it is appropriate to send the notification that does not include the design or text. According to this aspect, a notification containing a symbol or text is sent to a destination to which a notification containing a symbol or text is appropriate, and a notification containing no symbol or text is sent to a destination to which a notification containing no symbol or text is appropriate. Can be sent.

Further, when generating a notification, the generation unit 108 may generate a notification in which the expression or content of the design or text included in the generated notification differs depending on the destination. As a result, the expression or content of the design or text included in the notification can be different depending on the destination. Then, a notification including a design or sentence of an appropriate expression or content may be transmitted depending on the destination.

Further, when generating the notification, the generation unit 108 may generate a notification in which the expression of the text differs depending on the attribute of the destination. As a result, the expression of the text included in the notification can be different depending on the attribute of the destination. Here, the attribute of the destination means a man, a woman, a mother or a father, and the like. Then, it is possible to send a notification including a sentence having an appropriate expression according to the attribute of the destination.

When generating the notification, the generation unit 108 calculates an index indicating the importance of the notification according to at least one of the child's condition and the mother's condition, and when the calculated index is higher than the threshold value. Only notifications may be generated. The above-mentioned first index and second index are examples of indexes indicating the importance of notification according to the condition of the mother. Instead of the above-mentioned first and second indicators, it is possible to adopt an indicator indicating the importance of notification according to the child's condition. This makes it possible to control whether or not to generate a notification based on an index calculated from the state of a child or the state of an adult. Thereby, it is possible to control whether or not to generate the notification concretely and quantitatively.

When generating the notification, the generation unit 108 calculates an index indicating the importance of the notification according to at least one of the child's condition and the mother's condition, and the larger the calculated index, the more. Notifications containing large symbols may be generated. Specifically, the size of the above-mentioned illustration of the cat's hand or the illustration showing the smile of the mother and child may be made larger. Thereby, the size of the symbol included in the notification can be controlled based on the index calculated from the state of the child or the state of the adult. As a result, the size of the symbol included in the notification can be controlled concretely and quantitatively, which can contribute to further deepening the understanding of other child-rearing persons who are the recipients of the notification.

The processing flow of the information processing apparatus configured as described above will be described with reference to specific examples and drawings.

FIG. 5 is a flow chart showing a flow of processing executed by the identification unit 102, the child state determination unit 103, and the mother state determination unit 104 in the present embodiment.

In step S1, the identification unit 102 acquires sound information from the input unit 101, and identifies the child's voice and the mother's voice included in the sound indicated by the acquired sound information.

In step S2, the identification unit 102 determines whether or not the child's voice has been identified in step S1. If it is determined that the child's voice has been identified (Yes in step S2), the process proceeds to step S3, and if not (No in step S2), the process proceeds to step S4.

In step S3, the child state determination unit 103 determines the child's state based on the voice of the child identified in step S1, and stores the child's state in the holding unit 105.

In step S4, the identification unit 102 determines whether or not the mother's voice has been identified in step S1. If it is determined that the mother's voice has been identified (Yes in step S4), the process proceeds to step S5, and if not (No in step S4), a series of processes shown in this flow chart is terminated.

In step S5, the mother state determination unit 104 determines the state of the mother based on the voice of the mother identified in step S1, and stores the state of the mother in the holding unit 106.

The above process will be stated in more detail while applying specific examples.

Here, an example of a scene in which a mother stands in the kitchen while preparing dinner one evening and a two-year-old child who is a little hungry starts to want her mother. The child was crying and trying to take her mother out of the kitchen, and because she wanted to eat rice quickly, she disturbed her mother's work by saying words such as "Achi-Achii!" And "Hochii!" I started crying. On the other hand, the mother said "I can't do it now!", "I can't eat rice? Is it okay !?", "Dame!" Suppose it continues.

First, the identification unit 102 identifies the child's voices "Acchi-Acchii!" And "Hochii!" Included in the sound information acquired from the input unit 101. In addition, the identification unit 102 identifies the mother's voice "I can't eat now!", "Can't eat rice? Is it okay !?" and "Dame!" Included in the sound information acquired from the input unit 101. (Step S1).

The child state determination unit 103 determines that the child's condition is "guzuri" based on the child's voices "Acchi-Acchii!" And "Hochii!" Identified in step S1, and determines the determination result. It is stored in the holding unit 105 (step S3).

The mother condition determination unit 104 determines the mother's condition based on the mother's voices "I can't do it now!", "Can't eat rice? Is it okay !?" and "Dame!" Identified in step S1. It is determined that "anger: 8", "confused: 8", "stress: 9", and "happiness: 1", and the determination result is stored in the holding unit 106 (step S5).

Next, the processing by the shared determination unit 107 will be described.

FIG. 6 is a flow chart showing a flow of processing executed by the shared determination unit 107 in the present embodiment.

In step S11, the sharing determination unit 107 acquires the state of the child from the holding unit 105 and the state of the mother from the holding unit 106.

In step S12, the sharing determination unit 107 determines whether or not the state of the child acquired in step S11 is “crying” or “guzzling”. If the child's condition is "crying" or "guzzling" (Yes in step S12), the process proceeds to step S13, and if not (No in step S12), the process proceeds to step S21.

In step S13, the sharing determination unit 107 calculates the first index using the above (Equation 1) based on the state of the mother acquired in step S11.

In step S14, the shared determination unit 107 determines whether or not the calculated first index is equal to or greater than the threshold value. If the first index is equal to or greater than the threshold value (Yes in step S14), the process proceeds to step S15, and if not (No in step S14), the process of this flow diagram ends.

In step S15, the shared determination unit 107 has the most recent state, that is, the state in which the child's state is "crying" or "guzzling" and the first index based on the mother's emotion is equal to or higher than the threshold value. Determine if it continues for a second. If the current state continues for the last 60 seconds (Yes in step S15), the process proceeds to step S16, and if not (No in step S15), the processing of this flow diagram ends.

In step S16, the generation unit 108 generates a notification based on the first index calculated by the shared determination unit 107 in step S13. As described above, the generated notification may include different expressions or contents depending on the destination of the notification.

In step S17, the transmission unit 109 transmits the notification generated in step S16 and displays it on the display unit 110. When the process of step S17 is completed, a series of processes shown in this flow chart is completed.

In step S21, the sharing determination unit 107 determines whether or not the state of the child acquired in step S11 is “laughter” or “babbling”. If the child's state is "laughing" or "babbling" (Yes in step S21), the process proceeds to step S22, and if not (No in step S21), the process of this flow diagram ends.

In step S22, the sharing determination unit 107 calculates the second index using the above (Equation 2) based on the state of the mother acquired in step S11.

In step S23, the shared determination unit 107 determines whether or not the calculated second index is equal to or greater than the threshold value. If the second index is equal to or greater than the threshold value (Yes in step S23), the process proceeds to step S24, and if not (No in step S23), the process of this flow diagram ends.

In step S24, the shared determination unit 107 has the most recent state, that is, the state in which the child's state is "laughter" or "babbling" and the second index based on the mother's emotion is equal to or higher than the threshold value 60. Determine if it continues for a second. If the current state continues for the last 60 seconds (Yes in step S24), the process proceeds to step S25, and if not (No in step S24), the processing of this flow diagram ends.

In step S25, the generation unit 108 generates a notification based on the second index calculated by the shared determination unit 107 in step S22. As described above, the generated notification may include different expressions or contents depending on the destination of the notification. After finishing step S25, the process proceeds to step S17.

As described above, in steps S16 and S25, the generation unit 108 generates the notification according to the state of the child and the state of the mother and the destination of the notification about the state of the mother. This will help other caregivers to better understand the situation in which the child and the caregiver are spending time together.

A more specific description will be given with reference to specific examples.

In step S11 above, the shared determination unit 107 acquired "guzuri" as the child's condition and "anger: 8", "confused: 8", "stress: 9", and "happiness: 1" as the mother's condition. And. In this case, the child's condition is "guzzling" (Yes in step S12), the first index is calculated to be 24 from the following (Equation 3) (Step S13), and the threshold value is exceeded 15.

First index = 8 + 9 + 8-1 = 24 (Equation 3)

Further, since the child's state is "guzzling" and the state in which the first index exceeds the threshold value continues for 60 seconds or more (Yes in step S14), the generation unit 108 is based on the first index. Generate a notification (step S16).

Next, the generation unit 108 generates an image for notification for each notification destination (specifically, the father of the child and the maternal grandparent of the child) (step S16). For example, the generation unit 108 generates an image in which an illustration of a cat's hand is added on a graph showing the states of the child and the mother in chronological order as an image to be sent to the father. In addition, the generation unit 108 generates an image including a message of "extremely difficult" as sent by the mother of the child as an image to be sent to the maternal grandparents. The generation unit 108 provides the generated image to the display unit 110 via the transmission unit 109 (step S17).

The image presented by the information processing system 1 by the above series of processes will be described.

FIG. 7 is an explanatory diagram showing a first example of an image presented by the information processing system 1 in the present embodiment.

The display unit 110 of the display terminal 30 shown in FIG. 7A shows an image with an illustration 40 of a cat's hand showing the state of the mother together with a graph showing the state of the child and the mother in chronological order. it's shown. More specifically, in this graph, the frequency of voices emitted by the child and the mother as an example of the state of the child and the mother is shown on the vertical axis, and the passage of time is shown on the horizontal axis. Note that the voice intensity may be used instead of the voice frequency.

As a result, the father can grasp the child-rearing situation, which cannot be grasped by the conventional technique, together with the quantitative information. The mother can then share the child-rearing situation with the father or related parties. In addition, the information processing system 1 notifies the father or a person concerned of the timing when the load on the mother is extremely high or the timing when the mother is happy and the event in daily childcare and housework. As a result, the father or the person concerned can be interested in the information, the understanding of childcare can be further deepened, and the family life can be enriched.

It goes without saying that sharing information on childcare and housework in this way is a major step toward smooth subsequent childcare support at home. It also leads to a change in father's consciousness and fostering the so-called "Ikumen" spirit.

By generating images that differ depending on the notification destination, the generation unit 108 can perform the notification in a format suitable for each notification destination, and further understanding by the notification destination person can be obtained.

The format of the notification is not limited to the one showing the image showing the state of the mother together with the graph showing the state of the child and the mother in chronological order as described above. For example, as shown in FIG. 7B, a short notification on the display terminal 30, for example, a so-called push notification 41 on the lock screen of a smartphone may be used.

The image included in the notification may be accompanied by a character string input by the mother. This will be specifically described with reference to FIG.

FIG. 8 is an explanatory diagram showing a second example of the image presented by the information processing system 1 in the present embodiment.

FIG. 8A shows an image 42 including a character string showing the state of the mother together with the graph. Image 42 is an image including the character string "again awakened" received from the mother. This allows the information entered by the mother to be shared with the father or related parties.

Further, in this case, the notification may be generated by converting the character string received from the mother into the information in the format issued by the child or the information indicating the state of the child. For example, a notification may be generated including an image 43 in which the above character string "again awakened" is converted into information "has awakened again" in the format issued by the child (FIG. 8 (b)). ). At this time, since the information before conversion and the information after conversion both express the state of the mother, the intention is generally maintained although the expression method is different. It is possible that the mother's condition can be shared more appropriately with the father or the person concerned by expressing the mother's condition in terms as if it was uttered by a child, rather than expressing the mother's condition in terms of the mother's expression. Is. This can contribute to further deepening the understanding of other child-rearing people by converting the information indicating the condition into information as if it was emitted by the child and sending it to the other child-rearing person who is the destination. .. In addition, by adding a child's illustration 44, it is possible to emphasize the atmosphere in which the child utters the word.

Regarding the determination of the mother's condition by the mother condition determination unit 104, the condition was determined only based on the mother's voice, but the presence or absence of the ON / OFF sound of the cooking appliance, for example, the IH cooking heater, or the sound of running water in the sink. Etc. may be detected and used to determine the condition of the mother. In addition, status information may be obtained and used directly from equipment such as cooking appliances. Further, the information of the sensor mounted on the home electric appliance, for example, temperature, humidity, and human behavior may be detected and used for analysis of the mother's condition.

As described above, the information processing system of the present embodiment transmits the notification generated according to the state of the child and the adult to the destination. In addition, the notification is generated according to the destination of the notification. If the adult is the child's caregiver (eg mother) and the notification is addressed to another child caregiver (eg father or grandparent) of the child, the notification indicating the condition of the child and mother is the destination (ie). It is generated and transmitted according to whether it is a father or a grandparent, etc.). Since the information generated according to the destination is notified, it is easy to obtain the understanding of other child-rearing people who are the destination. Therefore, it is possible to support the further deepening of the understanding of other child-rearing people about the situation in which the child and the child-rearing person are spending time together.

(Embodiment 2)
In the present embodiment, an information processing method for supporting the deepening of the understanding of other child-rearing persons regarding the situation in which the child and the child-rearing person are spending time together will be described. The information processing method of the present embodiment determines the situation in which the child and the child-rearing person are spending time together based on the voice of the child and the child-rearing person (mother) and the environmental sound, and other child-rearing persons. We will support you to deepen your understanding of.

FIG. 9 is a block diagram showing the functions of the information processing system 2 according to the present embodiment.

As shown in FIG. 9, the information processing system 2 includes an input unit 101, an identification unit 102A, a child state determination unit 103, a mother state determination unit 104, holding units 105 and 106, and a shared determination unit 107A. , A generation unit 108, a transmission unit 109, a display unit 110, an environmental sound determination unit 112, and a holding unit 113.

Here, among the functional blocks of the information processing system 2, the functional blocks excluding the identification unit 102A, the environmental sound determination unit 112, and the holding unit 113 are the same as those in the first embodiment, and thus a detailed description will be given. Omit. Further, the server 20A corresponds to the server 20 in the first embodiment.

The identification unit 102A acquires sound information from the input unit 101, and identifies a child's voice, a mother's voice, and an environmental sound included in the sound indicated by the acquired sound information. Here, the identification unit 102A differs from the identification unit 102 in that it identifies the environmental sound. The environmental sound is a sound excluding the child's voice and the mother's voice among the ambient sounds picked up by the input unit 101 by the sound collecting device. Specifically, the environmental sounds include operation sounds and operation sounds of home appliances (for example, IH cooking heaters, microwave ovens, washing machines or toys), sounds generated by household affairs (for example, running water sounds of kitchen sinks, door opening / closing sounds, etc.). Includes sounds produced when cutting objects with a kitchen knife, sounds generated by non-household movements (for example, sounds produced by musical instruments, clapping sounds, footsteps produced by dancing or walking, etc.).

The environmental sound determination unit 112 is a processing unit that determines a state related to the environment by analyzing the environmental sound identified by the identification unit 102A.

The holding unit 113 is a storage device that temporarily or permanently holds the state related to the environment determined by the environmental sound determination unit 112.

The shared determination unit 107A is based on the state of the child held by the holding unit 105, the state of the mother held by the holding unit 106, and the state of the environment held by the holding unit 113. It is a processing unit that determines whether or not information indicating a state should be shared with a pre-registered destination (for example, a father or grandparent). More specifically, the shared determination unit 107A determines whether the mother is doing household chores or playing with the child from the state related to the environment.

FIG. 10 is an explanatory diagram of a table T3 showing conditions used for determination by the shared determination unit 107A in the present embodiment. Table T3 shows the first condition and the second condition which are examples of the conditions used by the shared determination unit 107A for the determination.

The shared determination unit 107A is first based on the state of the child held by the holding unit 105, the state of the mother held by the holding unit 106, and the state of the environment held by the holding unit 113. Determine if the condition and the second condition are met.

(1) About the first condition As the first condition, in addition to the first condition of the first embodiment, the condition based on the state regarding the environment is further considered. Specifically, the first condition is that when the state of the child stored in the holding unit 105 is "crying" or "guzzling", the first index calculated based on the mother's emotion is equal to or higher than the threshold value. Or, it can be that the mother is doing household chores.

If the mother is doing household chores when the child is crying or squirming, the father or grandparents need help with childcare or household chores, or psychological support, regardless of the mother's emotions. This is because it can be said that information indicating these conditions should be shared with the father or grandparents.

(2) Regarding the second condition In addition to the second condition of the first embodiment, the second condition further considers the condition based on the state regarding the environment. Specifically, the second condition is that when the state of the child stored in the holding unit 105 is "laughter" or "babbling", the second index calculated based on the mother's emotion is equal to or higher than the threshold value. Or, it can be said that the mother and the child are playing together.

If the mother and the child are playing together when the child is laughing or babbling, it is desirable to have the father or grandparents have positive emotions such as happiness, regardless of the mother's emotions. Therefore, it can be said that information indicating these conditions should be shared with the father or grandparents.

The processing flow of the information processing system 2 configured as described above will be described with reference to the drawings.

FIG. 11 is a flow chart showing a flow of processing executed by the identification unit 102A, the child state determination unit 103, the mother state determination unit 104, and the environmental sound determination unit 112 in the present embodiment.

Since the processes (steps S2 to S5) executed by the child state determination unit 103 and the mother state determination unit 104 are the same as those in the first embodiment, detailed description thereof will be omitted.

In step S1A, the identification unit 102A acquires sound information from the input unit 101, and identifies the child's voice, the mother's voice, and the environmental sound included in the sound indicated by the acquired sound information.

In steps S2 to S5, the state of the child determined by the child state determination unit 103 is stored in the holding unit 105, and the state of the mother determined by the mother state determination unit 104 is stored in the holding unit 106 (details are in the embodiment). See 1).

In step S6, the identification unit 102A determines whether or not the environmental sound has been identified in step S1. If it is determined that the environmental sound has been identified (Yes in step S6), the process proceeds to step S7, and if not (No in step S6), a series of processes shown in this flow chart is terminated.

In step S7, the environmental sound determination unit 112 determines the state of the environment based on the sound of the environmental sound identified in step S1, and stores the determined environmental state in the holding unit 113. In a specific example, it is determined that household chores are being performed based on the operation sound of the IH cooking heater, which is the environmental sound identified in step S1, and the determination result is stored in the holding unit 113.

When the series of processes shown in this flow chart is completed, the sharing determination unit 107A shares information indicating these states with the father or grandparents based on the state of the child, the state of the mother, and the state related to the environment. Calculate an index showing the degree to be done. This process is the same as the process shown in FIG. 6, except that the processes in steps S14 and S23 are different. Specifically, the condition for the determination in step S14 is "is the first index equal to or higher than the threshold value, or is the mother doing household chores?". Further, the condition of the determination in step S23 is "is the second index equal to or higher than the threshold value, or is the mother playing a game?".

As described above, the information processing system 2 discriminates the child's voice, the adult's voice, and the environmental sound when discriminating the child's voice and the adult's voice, and determines the adult's condition. The condition of an adult may be determined based on the identified adult voice and environmental sound.

By doing so, the information processing system 2 determines the situation in which the child and the child-rearing person are spending time together based on the voice of the child and the mother as well as the environmental sound, and of the other child-rearing person. We will support you to deepen your understanding.

Further, another example of the condition used by the shared determination unit 107A for the determination will be further described.

FIG. 12 is an explanatory diagram of a table T4 showing another condition used for determination by the shared determination unit 107A in the present embodiment. The table T4 shown in FIG. 12 may be used in place of the table T3 shown in FIG. 10 or may be used in combination with the table T3.

(1) First Condition As the first condition, in addition to the first condition of the first embodiment, a condition based on the movement of a person (that is, a child or a mother) is further considered. Specifically, the first condition is that when the state of the child stored in the holding unit 105 is "crying" or "guzzling", the first index calculated based on the mother's emotion is equal to or higher than the threshold value. Or, it can be said that the movement of a person is an irregular movement. Here, it is assumed that a person's irregular movement is a movement caused by a negative event such as running around, moving in a hurry, or moving with a loud voice.

If the mother is behaving irregularly when the child is crying or squirming, the father or grandparents need help with childcare or household chores, or psychological support, regardless of the mother's emotions. Therefore, it can be said that information indicating these conditions should be shared with the father or grandparents.

(2) Regarding the second condition In the second condition, in addition to the second condition of the first embodiment, a condition based on the movement of a person (that is, a child or a mother) is further considered. Specifically, the second condition is that when the state of the child stored in the holding unit 105 is "laughter" or "babbling", the second index calculated based on the mother's emotion is equal to or higher than the threshold value. Or, it can be said that the movement of a person is an irregular movement. Here, the irregular movement of a person is different from the irregular movement in (1) above, in which both hands are raised (high and high), continuously moving at a slow speed (chasing), and up and down movement. It is assumed that the movement is caused by a positive event such as "Peek-a-boo".

When the mother and the child are playing together when the child is laughing or babbling, it is a good idea to make the father or grandparents have positive feelings such as happiness regardless of the mother's feelings. This is because it is desirable to share information indicating these conditions with the father or grandparents.

As described above, the information processing system 2 further acquires the detection result by the sensor that detects the adult's body, and when determining the state of the adult, is based on the identified adult's voice and the detection result. The condition of an adult may be determined.

As described above, according to the information processing method according to the present embodiment, the environmental sound is further used to determine the state of an adult. Then, a notification is generated and transmitted according to the state of the adult determined based on the environmental sound. As a result, the condition of the adult can be determined in more detail, and the notification is generated and transmitted based on this detailed determination.

In addition, sensors are further used to determine the condition of the adult. Then, a notification is generated and transmitted according to the state of the adult determined based on the sensor. As a result, the condition of the adult can be determined in more detail, and the notification is generated and transmitted based on this detailed determination.

(Embodiment 3)
In the present embodiment, an information processing method for supporting the deepening of the understanding of other child-rearing persons regarding the situation in which the child and the child-rearing person are spending time together will be described. In the information processing method of the present embodiment, the certainty of recognizing the notification can be improved by giving the notification at a timing that is easier for the person related to the notification destination to confirm, in other words, it is possible to prevent omission of communication.

FIG. 13 is a block diagram showing the functions of the information processing system 3 according to the present embodiment.

As shown in FIG. 13, the information processing system 3 includes an input unit 101, an identification unit 102, a child state determination unit 103, a mother state determination unit 104, holding units 105 and 106, and a shared determination unit 107. , A generation unit 108, a transmission unit 109A, a display unit 110, and a position acquisition unit 115.

The position acquisition unit 115 is a processing unit that acquires position information indicating the position of the destination of the notification. Specifically, the position acquisition unit 115 is a position sensor that acquires the position information of the mobile terminal 32 carried by the person to whom the notification is sent. When the position acquisition unit 115 receives, for example, from the system of the ticket gate of a railway company, information indicating that the owner of the mobile terminal 32, that is, the father of the child has passed the ticket gate of a predetermined station, the position acquisition unit 115 of the child The father generates position information indicating the position near the point of the ticket gate. The mobile terminal 32 is, for example, a smartphone or a mobile phone that performs close-range wireless communication with a ticket gate, a contactless IC card, or the like. The position acquisition unit 115 may be another means as long as it can acquire the position information of the mobile terminal 32. The position acquisition unit 115 may acquire the position of the mobile terminal 32 from, for example, a GPS (Global Positioning System) receiver mounted on the mobile terminal 32. The mobile terminal 32 may be the same terminal as the display terminal 30. Further, instead of communicating with the ticket gate, communication with a communication device (also referred to as a boarding / alighting recorder) used when using a vehicle such as a bus fare payment machine may be used.

The transmission unit 109A controls the transmission timing of the information generated by the generation unit 108 and the mode of information notification according to the position information acquired by the position acquisition unit 115. Specifically, the transmission unit 109A refers to the position information acquired by the position acquisition unit 115, and transmits a notification to the destination according to the fact that the destination is located at a predetermined position. For example, when the position information of the boarding / alighting recorder of the vehicle is known, the transmission unit 109A sends a notification according to the communication with the boarding / alighting recorder by using the proximity wireless communication by the terminal carried by the person concerned with the destination. Send to. More specifically, a notification is transmitted to the destination at the timing when the person concerned with the destination passes the ticket gate of the station by using the proximity wireless communication by the terminal carried by the person.

FIG. 14 is an explanatory diagram of a table T5 showing the transmission timing of information by the transmission unit 109A in the present embodiment and the transmission timing showing the mode of information notification.

As shown in FIG. 14, table T5 shows information about the time zone 51, the position 52, and the aspect 53 of the notification for each entry. Each entry indicates how to notify the display terminal 30 owned by the father when a time zone and a position are given.

The time zone 51 is information indicating a time zone for notification by the display terminal 30. The time zone 51 specifies, for example, a time zone such as morning, afternoon, 7 o'clock, and 15 o'clock. The time length of the time zone may be any, and may be several hours or several minutes.

The position 52 is information indicating the position of the display terminal 30 when the display terminal 30 gives a notification. The position 52 may be in any format as long as it is information that can uniquely identify the position, such as a set of latitude and longitude, an address, and a name of a building as a landmark.

The notification mode 53 is information indicating a mode in which the display terminal 30 gives a notification. For example, the notification mode 53 includes "image update" or "push notification".

As described above, according to the information processing method according to the present embodiment, the notification can be transmitted according to the position of the other child-rearing person who is the destination of the notification. By sending the notification in a state where it is easy for the other child caregiver to confirm the notification, the certainty that the other child caregiver recognizes the notification may be improved.

In addition, at a timing when it is easy for other childcare workers to confirm the notification, a notification is sent when the other childcare worker gets on and off the vehicle. This can further improve the certainty that other caregivers will recognize the notification.

In each of the above embodiments, each component may be configured by dedicated hardware or may be realized by executing a software program suitable for each component. Each component may be realized by a program execution unit such as a CPU or a processor reading and executing a software program recorded on a recording medium such as a hard disk or a semiconductor memory. Here, the software that realizes the information processing system of each of the above embodiments is the following program.

That is, this program uses a processor in a computer to acquire sound information obtained by sound collection by a sound collecting device, and identifies a child's voice and an adult's voice included in the sound indicated by the sound information. The state of the child is determined based on the identified voice of the child, the state of the adult is determined based on the identified voice of the adult, and the determined state of the child and the determination are made. An information processing method for generating the notification and transmitting the generated notification to the destination is executed according to the state of the adult and the destination of the notification about the state of the adult.

Although the information processing system and the like according to one or more aspects have been described above based on the embodiment, the present invention is not limited to this embodiment. As long as the gist of the present invention is not deviated, various modifications that can be conceived by those skilled in the art are applied to the present embodiment, and a form constructed by combining components in different embodiments is also within the scope of one or more embodiments. May be included within.

The present invention is useful as an information sharing method for sharing a situation such as child-rearing between a child (infant) and a child-rearing person (for example, a mother) with another child-rearing person (for example, a father) or a related person (for example, a grandparent). is there.

1, 2, 3 Information processing system 10 Input terminal 20, 20A Server 30 Display terminal 32 Mobile terminal 40, 44 Illustration 101 Input unit 102, 102A Identification unit 103 Child condition determination unit 104 Mother condition determination unit 105, 106, 113 Holding unit 107, 107A Shared judgment unit 108 Generation unit 109, 109A Transmission unit 110 Display unit 112 Environmental sound judgment unit 115 Position acquisition unit T1, T2, T3, T4, T5 table

Claims (14)

Using a processor
Acquires the sound information obtained by collecting the sound by the sound collecting device,
Identify the child's voice and the adult's voice included in the sound indicated by the sound information.
Based on the identified voice of the child, the condition of the child is determined.
Based on the identified voice of the adult, the condition of the adult is determined.
The notification is generated according to the determined state of the child, the determined state of the adult, and the destination of the notification about the state of the adult.
Send the generated notification to the destination,
Information processing method. The information processing method according to claim 1, wherein generating the notification includes generating the notification having different expressions or contents depending on the destination. The information according to claim 2, wherein generating the notification includes generating the notification including a symbol or sentence having a different expression or content depending on the destination and indicating the state of the adult. Processing method. Generating the notification comprises generating the notification, wherein the generated notification includes or does not include a symbol or text indicating the condition of the adult, depending on the destination. Information processing method described in. The information processing method according to claim 3, wherein the symbol or the expression or content of the sentence differs depending on the attribute of the destination. The generation of the notification calculates an index according to at least one of the determined child's condition and the determined adult's condition, and only when the calculated index is higher than the threshold value. The information processing method according to any one of claims 1 to 5, which comprises generating. Generating the notification calculates an index according to at least one of the determined child's condition and the determined adult's condition, and the larger the calculated index is, the larger the symbol is included. The information processing method according to any one of claims 1 to 6, which comprises generating a notification. Generating the notification
Information indicating the condition of the adult is received via the input device, and the information is received.
The information according to any one of claims 1 to 7, including generating the notification by converting the received information into information in the form issued by the child or information indicating the state of the child. Processing method. The information processing method according to any one of claims 1 to 7, wherein the destination is determined according to the determined state of the child and the determined state of the adult. Further, the environmental sound included in the sound indicated by the sound information is identified, and the environmental sound is identified.
Determining the condition of the adult
The information processing method according to any one of claims 1 to 9, which comprises determining the state of the adult based on the identified voice of the adult and the environmental sound. In the information processing method, the detection result by the sensor that detects a person is further acquired.
Determining the condition of the adult
The information processing method according to any one of claims 1 to 10, which comprises determining the state of the adult based on the identified voice of the adult and the detection result. In the information processing method, further, position information indicating the position of the destination is acquired, and the position information is obtained.
Sending the notification to the destination
The information processing method according to any one of claims 1 to 11, further comprising transmitting the notification to the destination in response to the destination being at a predetermined position with reference to the location information. The predetermined position is a position where a boarding / alighting recorder for a vehicle is installed.
The information processing method according to claim 12, further comprising transmitting the notification to the destination in response to communication with the boarding / alighting recorder using proximity wireless communication by a terminal carried by the person related to the destination. An identification unit that identifies the voice of a child and the voice of an adult included in the sound indicated by the sound information obtained by collecting the sound by the sound collecting device.
A child state determination unit that determines the state of the child based on the identified voice of the child, and
An adult state determination unit that determines the state of the adult based on the identified voice of the adult,
A generation unit that generates the notification according to the determined state of the child, the determined state of the adult, and the destination of the notification about the state of the adult.
An information processing device including a transmission unit that transmits the generated notification to the destination.

Images