WO2019240070A1

WO2019240070A1 - Action verifying system

Info

Publication number: WO2019240070A1
Application number: PCT/JP2019/022897
Authority: WO
Inventors: 大輔桐生
Original assignee: 本田技研工業株式会社
Priority date: 2018-06-11
Filing date: 2019-06-10
Publication date: 2019-12-19
Also published as: WO2019240065A1; JPWO2019240070A1; JP7523347B2; JP7424974B2; JPWO2019240065A1

Abstract

This information communication system (1) is provided with a first terminal (2) and a control unit (42). The first mobile terminal (2) is carried by a travelling person. The control unit (42) is provided in a data center (4) capable of communication with the first mobile terminal (2). The control unit (42) acquires actions of the travelling person. On the basis of the travelling person's actions, the control unit (42) determines that a prescribed action has been performed.

Description

Operation confirmation system

The present invention relates to an operation confirmation system.
This application claims priority based on Japanese Patent Application No. 2018-111419 filed in Japan on June 11, 2018 and Japanese Patent Application No. 2018-146316 filed in Japan on August 2, 2018 And their contents are incorporated herein.

2. Description of the Related Art Conventionally, a system for monitoring the safety of a child at the time of going to and from school or the like by a camera, a speaker and a transmitter / receiver attached to a carrying bag carried by the child and a terminal device including a transmitter / receiver, a monitor and a microphone is known. (For example, refer to Patent Document 1).

Japanese Unexamined Patent Publication No. 2006-285749

By the way, the system according to the above prior art takes an image of the front of the child with a camera attached to the carrying bag, and transmits the image obtained by the imaging to a terminal device operated by a child's guardian or the like via a communication network. To do. Further, the voice of the guardian or the like collected by the microphone of the terminal device is transmitted via the communication network and output from the speaker on the back.
However, according to the camera attached to the carrying bag, it is difficult to confirm the movement of the child in a place where there is a danger such as a position crossing an intersection or a road. For example, if it is not possible to confirm whether or not a child's prescribed actions such as a left-right confirmation action at an intersection and a hand-raising action when crossing a road are being performed, it is not possible to properly support the child's watch Occurs.

The present invention has been made in view of the above-described problems, and an object of the present invention is to provide an operation confirmation system capable of confirming a predetermined motion of a mobile person.

(1): An operation check system according to an aspect of the present invention is provided in a terminal carried by a mobile person, an operation acquisition unit that acquires the mobile user's action, and a server that can communicate with the terminal or the terminal. And an operation determination unit that determines that a predetermined operation has been performed based on the operation acquired by the operation acquisition unit.

(2): In the above aspect (1), the motion acquisition unit acquires the forward movement of the mobile person, and the motion determination unit is configured to stop the forward movement from stopping the forward movement from the forward movement. You may judge that

(3): In the aspect of the above (2), the operation acquisition unit includes a position acquisition unit that acquires a current position of the terminal, and the operation determination unit is based on the current position acquired by the position acquisition unit. You may judge.

(4): In the above aspect (3), the position acquisition unit may perform positioning using electromagnetic waves received from outside the terminal.

(5): In the aspect of (3) above, the position acquisition unit may perform positioning based on an inquiry between electromagnetic waves from surrounding objects and stored map information.

(6): In the aspect of the above (2), the operation acquisition unit includes a speed acquisition unit that acquires the movement speed of the terminal, and the operation determination unit is based on the movement speed acquired by the speed acquisition unit. You may judge.

(7): In the aspect of (6) above, the speed acquisition unit may be a detection device that is provided in the terminal and detects a physical quantity.

(8): In the above aspect (1), the motion acquisition unit acquires the motion of the head of the mobile person, and the motion determination unit swings the head to the left or right with respect to the moving direction of the mobile person. You may judge that

(9): In the aspect of (1), the motion acquisition unit acquires the orientation of the face of the mobile person, and the motion determination unit directs the orientation of the face to the left and right with respect to the movement direction of the mobile person. You may judge that

(10): In the aspect of the above (1), the motion acquisition unit acquires at least one of the position and movement of the hand of the mobile person, and the motion determination unit has the hand part of the mobile user. It may be determined that it is located in a predetermined area which is an area higher than the shoulder portion of.

(11): In any one of the above aspects (8) to (10), the motion acquisition unit is a remote detection unit that remotely detects at least one of the position and movement of an object outside the terminal. May be included.

(12): In the aspect of (11) subordinate to (10), the remote detection unit includes a reception unit that receives electromagnetic waves from the object, and the terminal includes the hand unit located in the predetermined area. You may arrange | position so that it may become in the detection range of the said receiving part.

(13): In the aspect of the above (12), the terminal may be arranged such that the head of the moving person is further within the detection range of the receiving unit.

(14): In any one aspect of the above (1) to (13), the terminal or the server stores a set position that is a geographical position set in advance so that the predetermined operation is performed. May be provided.

(15): In the aspect of (14), the set position may be set to a specific position where there is a possibility of danger to the mobile person on a road on which the mobile person passes.

(16): In the aspect of the above (15), the road may include an intersection where the road intersects, and the set position may be set at the intersection.

(17): In the aspect of (16) above, the road may include a roadway through which a vehicle passes and a sidewalk that is partitioned, and the set position may be set on the sidewalk at the intersection.

(18): In any one of the above aspects (14) to (17), the set position is based on input information related to the movement start point and the movement end point of the mover, and the movement start point and the movement end point It may be set on the route.

(19): In the aspect of (18), the terminal or the server may include a position setting unit that sets the set position on the route based on the movement start point and the movement end point.

(20): In any one of the above aspects (14) to (17), the set position may be set based on input information related to position designation for the terminal or another terminal different from the terminal. .

(21): In the above aspect (20), the input information indicates a position on a map including a road part region and a non-road part region, and when the input information is located in the non-road part region, You may provide the position correction | amendment part which correct | amends input information to the said road part area | region which adjoins.

(22): In the aspect of the above (21), the road part region includes a roadway part region and a sidewalk part region, and the position correction unit includes the input information in the non-road part region or the roadway part region. When located, the input information may be corrected to the adjacent sidewalk area.

(23): In any one of the above aspects (1) to (22), the set position which is a geographical position set in advance so that the predetermined operation is performed by the mobile person is the first set position. A second setting position different from the first setting position, and the terminal or the server performs the first determination result determined by the operation determination unit at the first setting position and the operation at the second setting position. An evaluation unit that compositely evaluates the movement of the mobile person may be provided based on the second determination result determined by the determination unit.

(24): In the aspect of (23), the terminal or the server includes an output unit that outputs the evaluation to the outside of the terminal or to another terminal provided to be communicable with the terminal or the server. You may prepare.

(25): In the aspect of (24) above, the output unit may output the evaluation outside the terminal and may not output in the vicinity of the set position.

(26): In the above aspect (24), the output unit may output the evaluation to the other terminal and sequentially output the evaluation at the set position.

(27): In any one of the above aspects (23) to (26), the operation determination unit may be provided in the terminal, and the evaluation unit may be provided in the server.

(28): In any one of the above aspects (1) to (27), the storage unit is provided in the terminal or the server and stores a set position that is a preset geographical position; And a notifying unit for notifying the approach of the terminal to the set position at a predetermined distance from the set position.

(29): In the above aspect (28), the notification unit may increase the amount of notification as the terminal approaches the set position from the remote position.

(30): In the above aspect (28) or (29), the notification unit may decrease the notification amount as the terminal moves away from the set position after the start of the notification.

(31): In any one of the aspects (28) to (30), the notification unit may stop the notification when the operation determination unit determines the predetermined operation after the start of the notification. Good.

(32): In any one of the above aspects (28) to (31), the notification unit stops the notification when the terminal is separated from the set position by a predetermined amount after the start of the notification. May be.

(33): In any one of the above aspects (28) to (32), the terminal or the server includes a position acquisition unit that acquires a current position of the terminal, and the terminal based on the current position. And a position determination unit that determines that the position is within a notification area that is closer to the set position than the position.

(34): In the aspect of (33), the position determination unit may determine that the terminal is located in the notification area based on a linear distance between the current position and the set position.

(35): In the aspect of (33) or (34), the terminal or the server includes a speed acquisition unit that acquires a movement speed of the terminal, and the notification unit reports the notification based on the movement speed. You may provide the alerting | reporting correction part to correct.

(36): In the above aspect (35), the notification correction unit may correct the start of the notification earlier as the moving speed is higher than when it is slower.

(37): In the aspect of the above (35), the notification correction unit may correct the notification amount so that the amount of the notification increases as the moving speed increases.

(38): In any one of the above aspects (28) to (32), the terminal or the server may include a speed acquisition unit that acquires a moving speed of the terminal, and the terminal based on the moving speed. A position determination unit that determines that the position has been reached may be provided.

(39): In the aspect of (38), the position determination unit may determine that the remote position has been reached based on an arrival time to the set position obtained based on the moving speed.

(40): In any one of the above aspects (1) to (39), the mobile person may be a pedestrian.

(41): In the above aspect (40), the pedestrian may be a child.

(42): In any one of the above aspects (1) to (41), the terminal may be arranged in the traveling object of the mobile person.

(43): In the above aspect (42), the carry item may be a shoulder bag.

(44): In the above aspect (43), the shoulder bag may be a shoulder bag.

According to (1) above, by providing the motion acquisition unit and the motion determination unit, it can be easily used for motion evaluation or the like of whether or not a predetermined motion has been performed.
In the case of (2) above, the results of motion acquisition and motion determination can be easily used for motion evaluation or the like as to whether or not forward movement stop has been performed as a predetermined motion.

In the case of (3) above, based on the current position of the terminal, it is possible to accurately determine a predetermined operation related to the movement of the mobile person.
In the case of (4) above, the accuracy of the current position of the terminal can be improved by positioning electromagnetic waves received from, for example, a satellite, a base station, and various facilities.
In the case of (5) above, for example, the current position of the terminal can be acquired by estimation based on sensing by a range sensor, a rider, a camera, and the like and map information.

In the case of (6) above, by acquiring the moving speed of the terminal, it is possible to improve the determination accuracy as to whether or not the forward movement stop has been performed.
In the case of (7) above, the moving speed of the terminal can be detected stably and directly with high accuracy, for example, without depending on information received from the outside.

In the case of the above (8), the determination result of the left and right movement of the head can be easily used for the operation evaluation of whether or not the left and right confirmation operation or the like has been performed as the predetermined operation.
In the case of (9) above, the determination result of the left and right face movements can be easily used for the operation evaluation of whether or not the left / right confirmation operation has been performed as the predetermined operation.
In the case of the above (10), the determination result of the position and movement of the hand can be easily used for operation evaluation or the like as to whether or not a hand raising operation or the like has been performed as a predetermined operation.

In the case of (11) above, detection can be performed in a wide range by detecting remotely.
In the case of (12) above, the position and movement of the hand can be accurately detected.
In the case of (13) above, it is possible to accurately detect head movement and face orientation.

In the case of (14) above, the results of motion acquisition and motion determination can be easily utilized for motion evaluation or the like of whether or not a predetermined motion corresponding to the set position has been performed.
In the case of the above (15), the results of motion acquisition and motion determination can be easily used for motion evaluation or the like as to whether or not a predetermined motion corresponding to a set position with a risk on a traffic road has been performed.
In the case of (16) above, the results of motion acquisition and motion judgment can be easily utilized for motion evaluation or the like of whether or not a predetermined motion corresponding to a set position with a traffic risk on a traffic road has been performed. it can.
In the case of (17), the results of motion acquisition and motion determination can be easily used for motion evaluation or the like as to whether or not a predetermined motion corresponding to the set position on the sidewalk has been performed.

In the case of (18), the results of motion acquisition and motion determination can be easily used for motion evaluation or the like as to whether or not a predetermined motion corresponding to the set position on the movement route has been performed.
In the case of (19), setting of the setting position by the user or the like can be easily supported.
In the case of (20), direct designation of the setting position by the user or the like can be easily supported.

In the case of (21) above, the results of motion acquisition and motion determination can be easily utilized for motion evaluation or the like of whether or not a predetermined motion corresponding to a set position on the road has been performed.
In the case of (22) above, the results of motion acquisition and motion determination can be easily used for motion evaluation or the like of whether or not a predetermined motion corresponding to the set position on the sidewalk has been performed.

In the case of (23) above, based on the first determination result and the second determination result of the first setting position and the second setting position, the movement of the moving person can be evaluated in a complex and accurate manner.
In the case of (24) above, confirmation of operation evaluation by the user or the like can be easily supported.
In the case of (25) above, it is possible to suppress the evaluation output from becoming excessive.
In the case of (26) above, confirmation of real-time operation evaluation at another terminal by a user or the like can be easily supported.
In the case of (27), the evaluation accuracy can be improved by performing the behavioral evaluation on the server.

In the case of the above (28), by providing a notification unit that notifies the approach to the setting position at a separation position that is separated from the setting position by a predetermined distance, it is possible to make the mobile person recognize in advance the arrival at the setting position. .
In the case of the above (29), by increasing the amount of notification as it approaches the set position, it is possible to make the mobile person recognize that it is gradually approaching the set position.
In the case of (30) above, by reducing the amount of notification as the distance from the set position increases, it is possible to allow the mobile person to recognize that the distance from the set position is gradually increased.

In the case of the above (31), it is possible to make the traveler recognize that the execution of the predetermined operation required at the set position is completed, and it is possible to suppress excessive notification.
In the case of the above (32), it is possible to suppress excessive notification when it is away from the setting position by a predetermined distance or more, and to prevent the notification from being interrupted in a range less than the predetermined position from the setting position. Can do.

In the case of (33), it is possible to improve the determination accuracy and determine more accurately that the vehicle is approaching the set position by determining that it is located in the notification area based on the current position. .
In the case of the above (34), the setting of the notification area is prevented from becoming complicated, and the determination process becomes complicated, for example, by setting a circular area according to designation of an appropriate one point. Can be suppressed.
In the case of (35) above, a more appropriate notification timing can be set according to the moving speed of the terminal.
In the case of (36) above, it is possible to suppress delay of the notification timing.
In the case of the above (37), it is possible to suppress a delay in grasping the set position by the moving person.

In the case of (38) above, even when the position of the terminal cannot be directly grasped, it can be properly determined that the remote position has been reached based on the moving speed of the terminal.
In the case of (39) above, even when the position of the terminal cannot be directly grasped, the determination accuracy can be improved based on the arrival time to the set position.

In the case of (40) above, the movement of the pedestrian can be acquired and determined.
In the case of (41) above, it is possible to acquire and determine the behavior of the child.
In the case of (42) above, it is possible to prevent the mobile person from forgetting to carry the terminal.
In the case of (43) above, the accuracy of the acquisition and determination of the operation can be improved by arranging the terminal around the shoulder of the moving person.
In the case of (44) above, the terminal is arranged from the shoulder to the back of the mobile person so that the terminal is prevented from interfering with the mobile user's various operations, and the accuracy of operation acquisition and determination is improved. Can do.

It is a figure which shows the structural example of the information communication system which concerns on embodiment of this invention. It is a figure which shows the utilization scene example of the information communication system which concerns on embodiment of this invention. It is a block diagram which shows the structural example of the 1st portable terminal which concerns on embodiment of this invention. It is a block diagram which shows the structural example of the 2nd portable terminal which concerns on embodiment of this invention. It is a flowchart of the example of a process sequence which a data center transmits the 1st portable terminal location information which concerns on embodiment of this invention to a 2nd portable terminal. It is a figure which shows the example of the 1st portable terminal position information displayed on the display part of the 2nd portable terminal which concerns on embodiment of this invention. It is a flowchart of the example of a process sequence which the data center which concerns on embodiment of this invention transmits a danger notice to a 2nd portable terminal and a 3rd portable terminal. It is a flowchart of the process sequence example when the 1st portable terminal which concerns on embodiment of this invention receives danger information. It is a flowchart of the process sequence example when the 2nd portable terminal which concerns on embodiment of this invention receives danger information. It is a figure which shows the example of the 1st portable terminal location information containing the warning image displayed on the display part of the 2nd portable terminal which concerns on embodiment of this invention. It is a figure which shows the main operation examples of the information communication system which concerns on the 1st modification of embodiment of this invention. It is a figure which shows the structural example of the information communication system which concerns on the 1st modification of embodiment of this invention. It is a figure which shows the example of the predetermined position which concerns on the 1st modification of embodiment of this invention, predetermined operation | movement, and a score. It is a flowchart of the process sequence example which the data center which concerns on the 1st modification of embodiment of this invention performs. It is a flowchart of the process sequence example which the 2nd portable terminal which concerns on the 1st modification of embodiment of this invention performs. It is an image example of the information containing the score displayed on the display part of the 2nd portable terminal which concerns on the 1st modification of embodiment of this invention. It is a flowchart of the process sequence example of the operation | movement analysis method of the temporary stop in the predetermined position which concerns on the 1st modification of embodiment of this invention. It is a flowchart of the process sequence example of the operation | movement analysis method of the right-and-left confirmation in the predetermined position which concerns on the 1st modification of embodiment of this invention. It is a flowchart of the process sequence example of the operation | movement analysis method of the hand raising operation | movement in the predetermined position which concerns on the 1st modification of embodiment of this invention. It is a figure which shows an example of a structure of the information communication system which concerns on the 2nd modification of embodiment of this invention. It is a figure which shows typically the start timing of the alerting | reporting which concerns on the 2nd modification of embodiment of this invention. It is a flowchart which shows an example of a process of the alerting | reporting part which concerns on the 2nd modification of embodiment of this invention. It is a flowchart which shows the detail of the geographical location approach alerting | reporting process of step S104 shown by FIG. It is a figure which shows an example of a structure of the 1st portable terminal device which concerns on the 3rd modification of embodiment of this invention. It is a figure which shows typically the start timing of the alerting | reporting which concerns on the 3rd modification of embodiment of this invention. It is a flowchart which shows an example of a process of the approach determination part and alerting | reporting part which concern on the 3rd modification of embodiment of this invention. It is a flowchart which shows the detail of the object approach alerting | reporting process of step S304 shown by FIG. It is a figure which shows an example of a structure of the 1st portable terminal which concerns on the 4th modification of embodiment of this invention. It is a figure which shows typically the timing which performs the recognition process of the predetermined operation | movement which concerns on the 4th modification of embodiment of this invention. It is a flowchart which shows an example of the stop process of alerting | reporting of the alerting | reporting part which concerns on the 4th modification of embodiment of this invention.

Hereinafter, embodiments of the operation confirmation system of the present invention will be described with reference to the drawings.
The operation check system of the present invention is, for example, the information communication system 1 according to the embodiment.
<Configuration example of information communication system 1>
FIG. 1 is a diagram illustrating a configuration example of an information communication system 1 according to the present embodiment. As shown in FIG. 1, the information communication system 1 includes a first mobile terminal 2 (first terminal), a second mobile terminal 3 (second terminal), a data center 4 (center), and a server 5. The first mobile terminal 2, the second mobile terminal 3, the data center 4, and the server 5 are connected to each other via a network 6.
The network 6 is a mobile communication network, for example. The mobile communication network is, for example, a fourth generation mobile communication network or a fifth generation mobile communication network. The network 6 includes a base station and the like.

The first portable terminal 2 is a terminal that is carried by a bearer (for example, a child such as a child) who is a watching target. The first portable terminal 2 is a robot having a communication function. The first mobile terminal 2 transmits at least one of position information, the same group pedestrian information, peripheral pedestrian information, and vehicle information to the data center 4 via the network 6. The first mobile terminal 2 receives at least one of traffic information, a message, and emergency information transmitted from the data center 4 via the network 6.
The configuration of the first mobile terminal 2 will be described later. The same group pedestrian information is, for example, the same group pedestrian information indicating the same group pedestrian who attends or leaves school together. The peripheral pedestrian information is information indicating a pedestrian walking around the carrier. The vehicle information is vehicle information of a road on which walking is performed.

The second mobile terminal 3 is a terminal possessed by a guardian of a carrier (for example, a child such as a child) to be watched over. The 2nd portable terminal 3 is a smart phone, a tablet terminal, or a smart watch, for example. The second portable terminal 3 receives the first portable terminal position information regarding the position of the first portable terminal 2 transmitted by the data center 4 via the network 6. Note that the first portable terminal position information is image information. The configuration of the second mobile terminal 3 will be described later.

The data center 4 includes a communication unit 41, a control unit 42, a model storage unit 43, and a storage unit 44.
The communication unit 41 outputs position information, the same group pedestrian information, surrounding pedestrian information, vehicle information, and the like received from the first mobile terminal 2 via the network 6 to the control unit 42. The communication unit 41 outputs disaster information, suspicious person information, emergency information, and the like received from the server 5 via the network 6 to the control unit 42. The communication unit 41 transmits the danger notification output by the control unit 42 to the first mobile terminal 2 via the network 6. The communication unit 41 transmits traffic information, messages, emergency information, and the like output from the control unit 42 to the first mobile terminal 2 via the network 6.
The communication unit 41 transmits the first mobile terminal position information, the emergency notification, the voice message, and the like output from the control unit 42 to the second mobile terminal 3 via the network 6. Further, the communication unit 41 receives a signal of a detection value of the acceleration sensor 28 from the first portable terminal 2 and outputs the received signal to the control unit 42.

The control unit 42 stores the position information received from the first mobile terminal 2 in the storage unit 44. The control unit 42 stores the suspicious person information received from the server 5 in the storage unit 44. The suspicious person information includes the position information where the suspicious person appears, the time when the suspicious person appears, and the like.
The control unit 42 generates a movement trajectory of the person who carries the first mobile terminal 2 based on the position information and map information stored in the storage unit 44. The control part 42 produces | generates the information which match | combined the movement locus produced | generated with map information as 1st portable terminal position information. The control unit 42 outputs the generated first mobile terminal position information to the communication unit 41.
The control unit 42 includes position information and vehicle information received from the first mobile terminal 2, emergency information, disaster information and suspicious person information received from the server 5, model information stored in the model storage unit 43, and storage unit 44. Is set on the basis of the map information and the position information stored therein, and information indicating the set dangerous place is stored in the storage unit 44. In addition, a dangerous location is a specific location where danger may occur, such as a location where a disaster has occurred, a location where there are many traffic accidents, or a location where a suspicious person appears. The control unit 42 generates a danger notification based on the map information stored in the storage unit 44 and information indicating the dangerous location and the received position information, and outputs the generated danger notification to the communication unit 41.

The control unit 42 includes position information and vehicle information received from the first portable terminal 2, emergency information received from the server 5, model information stored in the model storage unit 43, and map information and position stored in the storage unit 44. Based on the information, at least one of traffic information, a message, and emergency information is generated. The message is an audio signal, which is text information converted into an audio signal by a well-known method using a language model or a dictionary. The control unit 42 outputs the generated traffic information, message, and emergency information to the communication unit 41. The control unit 42 outputs the generated message as a voice message, and outputs emergency information to the communication unit 41 as an emergency notification.
Further, the control unit 42 associates the first portable terminal 2 possessed by the carrier with the second portable terminal 3 possessed by the guardian and stores it in the storage unit 44 based on the telephone number or identification information of the portable terminal. Let As a result, the data center 4 performs processing on a plurality of sets of the first mobile terminal 2 and the second mobile terminal 3.

The model storage unit 43 stores a statistical regional traffic model, a traffic prediction model, and the like as model information.
The statistical regional traffic model statistically indicates the traffic conditions in the area, and the data center 4 obtains data relating to map information or traffic information from mobile terminals, etc., and statistically calculates traffic information in each area. It is the model shown in.
The traffic prediction model is a model for predicting the traffic volume in the corresponding region in the future from the traffic situation in each region accumulated in the past, and may be determined based on the data from the statistical regional traffic model. For example, the traffic prediction model may be the traffic volume at the time of going to and from school on the route of the going to and from school of the carrier carrying the first mobile terminal 2.

The storage unit 44 stores map information. The map information includes, for example, a map that includes a school route from home to school, location information of stores (such as supermarkets, bookstores, and stationery stores) to which the carrier departs, and the location of a cram school or the like to go to before going home Information. The map information includes information such as sidewalks and road route networks (divergence points and branches). In addition, the storage unit 44 stores position information of the first mobile terminal 2. The storage unit 44 stores information indicating a dangerous place and suspicious person information. The memory | storage part 44 memorize | stores the predetermined value used when producing | generating danger information.

The server 5 is installed in, for example, a school and a ward office. The server 5 transmits disaster information related to natural disasters such as earthquakes and typhoons and suspicious person information to the data center 4 via the network 6. Note that the data center 4 may acquire such information through communication with the server 5.

Next, a usage scene example of the information communication system 1 will be described.
FIG. 2 is a diagram illustrating an example of a usage scene of the information communication system 1 according to the present embodiment. As shown in FIG. 2, the first mobile terminal 2 is used by being attached to a shoulder belt of a school bag, for example. As will be described later, the first mobile terminal 2 includes a microphone, a radar, a speaker, a position detection unit, and the like. For example, the first mobile terminal 2 acquires and transmits a voice spoken by a child carrying the first mobile terminal 2. In addition, the first mobile terminal 2 transmits a radar detection result signal to the data center 4. In addition, the first mobile terminal 2 receives information and messages transmitted from the data center 4 and reproduces and notifies them. A school bag is an example of a carried item, a shoulder bag, and a shoulder bag.

The data center 4 transmits the traffic information, the message, and the emergency information generated based on the information received from the first mobile terminal 2 and the information received from the server 5 to the first mobile terminal 2. Further, the data center 4 transmits the first mobile terminal location information, the emergency notification, and the voice message generated based on the information received from the first mobile terminal 2 and the information received from the server 5 to the second mobile terminal 3. To do. Note that the data center 4 has real-time information captured by the plurality of first mobile terminals 2 (for example, the current position and the same, for example) when another child has the other first mobile terminal 2 at the time of going to and from school. Group pedestrian information, surrounding pedestrian information, vehicle information, etc.) may be mutually used to generate each information.

The second portable terminal 3 receives the first portable terminal position information including the map information including the route that the child carrying the first portable terminal 2 is walking from the data center 4, and the received first portable terminal position information Is displayed as status information. The second mobile terminal 3 receives the emergency notification and voice message transmitted from the data center 4, and displays or reproduces the received emergency notification or voice message. The image displayed on the second mobile terminal 3 will be described later.

The server 5 transmits, for example, broadcast contents by the disaster prevention administrative radio to the data center 4 via the network 6.
The usage scene shown in FIG. 2 is an example, and the present invention is not limited to this.

<Configuration example of first mobile terminal 2>
Next, a configuration example of the first mobile terminal 2 will be described.
FIG. 3 is a block diagram illustrating a configuration example of the first mobile terminal 2 according to the present embodiment. As shown in FIG. 3, the first mobile terminal 2 includes a communication unit 21, a radar 22, a microphone 23, a position detection unit 24, a vibrator 25, a speaker 26, a display unit 27, an acceleration sensor 28, and a control unit 29. The first mobile terminal 2 may include an operation unit.

The communication unit 21 includes, for example, a communication IC card, a communication antenna, and a communication module.
The communication unit 21 transmits information output by the control unit 29 (for example, position information, same group pedestrian information, peripheral pedestrian information, and vehicle information) to the data center 4 via the network 6. The communication unit 21 receives information (for example, traffic information, messages, and emergency information) transmitted by the data center 4, and outputs the received information (for example, traffic information, messages, and emergency information) to the control unit 29. The communication unit 21 receives the danger information transmitted by the data center 4 and outputs the received danger information to the control unit 29.

The radar 22 includes a front radar that detects a front object around the first portable terminal 2 and a rear radar that detects an object behind the first portable terminal 2 (for example, behind the front radar). The front radar and the rear radar are, for example, millimeter wave radars. For example, the radar 22 outputs a detection signal related to the distance, relative speed, relative position, direction, and the like to an external object to the control unit 29.

The microphone 23 outputs a signal (for example, an audio signal) obtained by collecting sound to the control unit 29. Note that the microphone 23 may be a microphone array including a plurality of microphones.
The position detection unit 24 includes a positioning signal receiving antenna that receives a positioning signal from a satellite or the like. The position detection unit 24 outputs the received positioning signal to the control unit 29. In addition, the 1st portable terminal 2 may acquire the information which shows a present position based on communication with a base station, for example.

The vibrator 25 is a vibrator and generates vibrations according to the notification information output from the control unit 29.
The speaker 26 converts a signal (for example, an audio signal) output from the control unit 29 into sound.
The display unit 27 operates according to notification information output from the control unit 29. The display unit 27 includes, for example, LEDs (light emitting diodes) that emit three colors of red, green, and blue. The display unit 27 may be, for example, a liquid crystal display device, an organic EL (electroluminescence) display device, or an electronic ink display device.
The acceleration sensor 28 detects the acceleration in the three directions of the X axis, the Y axis, and the Z axis of the first mobile terminal 2 and outputs the detected acceleration signal to the control unit 29.

The control unit 29 acquires a detection signal output from the radar 22. The control unit 29 acquires an audio signal output from the microphone 23. The control unit 29 acquires the positioning information output from the position detection unit 24. The control unit 29 acquires danger information output from the communication unit 21. The control unit 29 outputs position information based on the positioning information acquired from the position detection unit 24 to the communication unit 21. For example, the control unit 29 determines whether or not a person is included using a known recognition method from the detection signal acquired from the radar 22. When a person is included in the detection signal, the control unit 29 sets the detection signal as the same group pedestrian information or the surrounding pedestrian information, and outputs the same group pedestrian information or the surrounding pedestrian information to the communication unit 21. In addition, the control part 29 discriminate | determines from a surrounding pedestrian, for example, when the magnitude | size of the person included in a detection signal is less than a threshold value, and when it is more than a threshold value, it discriminate | determines from the same group pedestrian. Moreover, the control part 29 discriminate | determines whether the vehicle is contained using a known recognition method from a detection signal. When the vehicle is included in the detection signal, the control unit 29 uses the detection signal as vehicle information and outputs the vehicle information to the communication unit 21.

The control unit 29 acquires information (for example, traffic information, messages, and emergency information) output from the communication unit 21. When the information from the communication unit 21 is an audio signal, the control unit 29 outputs the audio signal to the speaker 26. When the information from the communication unit 21 is not an audio signal, the control unit 29 outputs the information to at least one of the display unit 27 and the vibrator 25. In addition, when outputting the information from the communication part 21 to the display part 27, the control part 29 controls the color or blinking state etc. which are light-emitted according to information, for example. In addition, when the information from the communication unit 21 is output to the vibrator 25, the control unit 29 controls the vibration interval or the strength of vibration according to the information, for example.

The control unit 29 generates a voice message based on the danger information, and outputs the generated voice message to the speaker 26. Further, the control unit 29 generates notification information based on the danger information, and outputs the generated notification information to the vibrator 25.
The control unit 29 acquires the detection value output from the acceleration sensor 28 and transmits the acquired detection value to the data center 4 through the communication unit 21.

<Configuration example of second mobile terminal 3>
Next, a configuration example of the second mobile terminal 3 will be described.
FIG. 4 is a block diagram illustrating a configuration example of the second mobile terminal 3 according to the present embodiment. As shown in FIG. 4, the second mobile terminal 3 includes a communication unit 31, a microphone 32, an operation unit 33, a display unit 34, a speaker 35, a control unit 36, and a vibrator 37.

The communication unit 31 receives the first mobile terminal position information transmitted from the data center 4 and outputs the received first mobile terminal position information to the control unit 36. The communication unit 31 receives the emergency notification or voice message transmitted from the data center 4 and outputs the received emergency notification or voice message to the control unit 36.
The microphone 32 outputs a signal (for example, an audio signal) obtained by collecting sound to the control unit 36. Note that the microphone 32 may be a microphone array including a plurality of microphones.

The operation unit 33 is a touch panel sensor provided on the display unit 34, for example. The operation unit 33 outputs a signal generated by a user operation to the control unit 36.
The display unit 34 displays the first portable terminal position information output from the control unit 36. The display unit 34 is, for example, a liquid crystal display device, an organic EL display device, or an electronic ink display device.
The speaker 35 converts a signal (for example, an audio signal) output from the control unit 36 into sound.
Vibrator 37 is a vibrator, and generates vibration according to the notification information output from control unit 36.

The control unit 36 acquires the first portable terminal position information output from the communication unit 31. The control unit 36 acquires an emergency notification or a voice message output from the communication unit 31. The control unit 36 outputs the acquired first portable terminal position information to the display unit 34. When the emergency notification is image information, the control unit 36 outputs the emergency information to the display unit 34. The control unit 36 outputs the acquired voice message to the speaker 35. The control unit 36 acquires danger information output from the communication unit 31. The control unit 36 generates a voice message based on the danger information, and outputs the generated voice message to the speaker 35. Alternatively, the control unit 36 generates notification information based on the danger information, and outputs the generated notification information to the vibrator 37.

<First mobile terminal location information transmission procedure>
Next, a processing procedure example in which the data center 4 transmits the first mobile terminal position information to the second mobile terminal 3 will be described.
FIG. 5 is a flowchart of a processing procedure example in which the data center 4 transmits the first mobile terminal position information according to the present embodiment to the second mobile terminal 3.

(Step S 11) The control unit 42 receives position information from the first portable terminal 2 by the communication unit 41 via the network 6. The positional information includes received time information.
(Step S 12) The control unit 42 stores the received position information in the storage unit 44.

(Step S13) The control unit 42 generates the first portable terminal position information using the position information and map information stored in the storage unit 44. Note that the control unit 42 connects the time information included in the position information in chronological order, and generates a movement trajectory of the person who carries the first portable terminal 2. Subsequently, the control unit 42 transmits the first portable terminal position information to the second portable terminal 3 by the communication unit 41 via the network 6.

For example, when the data center 4 receives a transmission request for the first mobile terminal position information from the second mobile terminal 3, the data center 4 performs the processing illustrated in FIG. The transmission request for the first mobile terminal position information is transmitted from the control unit 36 via the communication unit 31 in response to an operation on the operation unit 33 of the second mobile terminal 3 by the guardian.
Further, the data center 4 may execute the processing shown in FIG. 5 at a preset time, for example. The preset time is, for example, the attendance time and the school leaving time of the mobile person set in accordance with the operation of the guardian on the operation unit 33 of the second mobile terminal 3.

FIG. 6 is a diagram illustrating an example of first mobile terminal position information displayed on the display unit 34 of the second mobile terminal 3 according to the present embodiment.
The first mobile terminal position information shown in FIG. 6 is, for example, the first mobile terminal position information when the mobile person leaves school. The first portable terminal position information includes information on the movement locus g11 and the current position g12 of the person who carries the first portable terminal 2.

<Procedure for sending danger notice>
Hereinafter, an example of a processing procedure in which the data center 4 transmits a danger notice to the first mobile terminal 2 and the second mobile terminal 3 will be described.
FIG. 7 is a flowchart of a processing procedure example in which the data center 4 according to the present embodiment transmits a danger notice to the first mobile terminal 2 and the second mobile terminal 3.

(Step S 21) The control unit 42 of the data center 4 accesses the server 5.
(Step S 22) The control unit 42 acquires information indicating a dangerous location and suspicious person information from the server 5 by the communication unit 41. The control unit 42 causes the storage unit 44 to store the acquired information indicating the dangerous location and the suspicious person information. The dangerous part includes, for example, a predetermined range including a position (latitude and longitude) where suspicious person information is obtained, or a range such as an address where suspicious person information is obtained. Note that the range may be set by the control unit 42.

(Step S 23) The control unit 42 acquires position information from the first mobile terminal 2. The location information may be transmitted by the first mobile terminal 2 based on a request from the data center 4 or may be transmitted by the first mobile terminal 2 at a predetermined cycle. The control unit 42 stores the acquired position information in the storage unit 44.

(Step S24) The control unit 42 calculates the distance between the dangerous location and the current position of the carrier based on the map information stored in the storage unit 44, the information indicating the dangerous location, and the location information.
(Step S 25) The control unit 42 determines whether the calculated distance is less than a predetermined value stored in the storage unit 44. When it is determined that the distance is less than the predetermined value (step S25; YES), the control unit 42 proceeds to the process of step S26. When it is determined that the distance is equal to or greater than the predetermined value (step S25; NO), the control unit 42 returns to the process of step S21.

(Step S26) The control unit 42 generates danger information. The control unit 42 notifies the danger by transmitting the generated danger information to the second portable terminal 3 through the communication unit 41. In addition, when the danger information is a notification sound, the control unit 42 increases the notification sound as the first portable terminal 2 approaches the dangerous place.
(Step S 27) The control unit 42 notifies the danger by transmitting the generated danger information to the first mobile terminal 2 through the communication unit 41. In addition, when the danger information is a notification sound, the control unit 42 increases the notification sound as the first portable terminal 2 approaches the dangerous place.

In the above-described example, the example in which the data center 4 acquires information indicating the dangerous part from the server 5 has been described. However, the present invention is not limited to this. For example, the guardian may set the dangerous part by operating the operation unit 33 of the second portable terminal 3, and the control unit 42 of the data center 4 may acquire the set information.

<Danger notification reception processing>
Next, an example of a processing procedure when the first portable terminal 2 possessed by the carrier receives the danger information will be described.
FIG. 8 is a flowchart of a processing procedure example when the first portable terminal 2 according to the present embodiment receives the danger information.

(Step S 31) The control unit 29 of the first mobile terminal 2 receives the danger information transmitted by the data center 4 by the communication unit 21.
(Step S 32) The control unit 29 generates a voice message informing the danger based on the danger information, and reproduces the generated voice message from the speaker 26. Moreover, the control part 29 produces | generates a buzzer sound, for example based on danger information, and reproduces | regenerates the produced | generated buzzer sound with the speaker 26. FIG. When the speaker 26 is a buzzer, the control unit 29 outputs a predetermined voltage to the speaker 26 based on the danger information. Thereby, the control part 29 performs the audio | voice output based on danger information. Note that the control unit 29 increases the volume as the distance between the dangerous location and the current position of the wearer decreases.

(Step S 33) The control unit 29 determines whether or not it is a vibrator mode in which sound output from the speaker 26 is prohibited. The control unit 29 may set the vibrator mode in accordance with, for example, an operation on an operation unit (not shown) provided in the first mobile terminal 2 or in response to an instruction from the second mobile terminal 3. May be executed.
When it is determined that the vibrator mode is the vibrator mode (step S33; YES), the control unit 29 proceeds to the process of step S34. On the other hand, the control part 29 returns a process to step S31, when it determines with it not being vibrator mode (step S33; NO). Note that, in the vibrator mode, the control unit 29 may not perform the process of step S32 or may blink the display unit 27 instead of the process of step S32.

(Step S34) The control unit 29 drives the vibrator 25 based on the danger information.
In addition, the control part 29 may enlarge the amplitude of the vibration of the vibrator 25, or may shorten the space | interval of a vibration, so that the distance between a dangerous location and a present | current position of a wearer becomes short.

Next, an example of a processing procedure when the second portable terminal 3 possessed by the guardian receives the danger information will be described.
FIG. 9 is a flowchart of a processing procedure example when the second portable terminal 3 according to the present embodiment receives the danger information.

(Step S 41) The control unit 36 of the second portable terminal 3 receives the danger information transmitted from the data center 4 by the communication unit 31.
(Step S 42) The control unit 36 generates a voice message informing the danger based on the danger information, and reproduces the generated voice message from the speaker 35. Or the control part 36 produces | generates a buzzer sound, for example based on danger information, and reproduces | regenerates the produced | generated buzzer sound with the speaker 35. FIG. When the speaker 35 is a buzzer, the control unit 36 outputs a predetermined voltage to the speaker 35 based on the danger information. Thereby, the control part 36 performs the audio | voice output based on danger information. Note that the control unit 36 increases the volume as the distance between the dangerous place and the current position of the wearer decreases.

(Step S43) The control unit 36 determines whether or not the vibrator mode is set. The control unit 36 sets the vibrator mode according to the result of operating the operation unit 33 of the second portable terminal 3. When the control unit 36 determines that the vibrator mode is set (step S43; YES), the control unit 36 proceeds to the process of step S44. On the other hand, when it is determined that the mode is not the vibrator mode (step S43; NO), the control unit 36 proceeds to the process of step S45. Note that, in the vibrator mode, the control unit 36 may not perform the process of step S42, or may blink the display unit 34 instead of the process of step S42.

(Step S44) The controller 36 drives the vibrator 37 based on the danger information.
Note that the control unit 36 may increase the vibration amplitude of the vibrator 37 or shorten the vibration interval as the distance between the dangerous place and the current position of the wearer becomes shorter.

(Step S45) The control unit 36 transmits a transmission request for the first portable terminal position information to the data center 4 through the communication unit 31 based on the result of the guardian operating the operation unit 33. Based on the received transmission request, the control unit 42 of the data center 4 attaches a warning image notifying the danger to the first portable terminal position information and transmits the warning image to the second portable terminal 3 by the communication unit 31. The control unit 36 receives the first portable terminal position information transmitted from the data center 4 by the communication unit 31. The control unit 36 causes the display unit 34 to display the received first portable terminal position information.

FIG. 10 is a diagram illustrating an example of first mobile terminal position information including a warning image displayed on the display unit 34 of the second mobile terminal 3 according to the present embodiment.
The first mobile terminal position information shown in FIG. 10 is, for example, the first mobile terminal position information when the mobile person leaves school. The first portable terminal position information includes information on the movement locus g11 and the current position g12 of the person carrying the first portable terminal 2, an image g21 indicating a dangerous place, and a warning image g22.
In the first mobile terminal position information shown in FIG. 10, the current position of the first mobile terminal 2 possessed by the mobile phone is within the danger area, so a predetermined wording (for example, “You are in the danger area. Please be careful! ]) Warning image g22 is superimposed or combined with other information and displayed. The warning image may be generated based on the warning information received by the control unit 36.

The control unit 29 of the first portable terminal 2 may transmit the detection signal acquired from the radar 22 to the data center 4 by the communication unit 21 as the same group pedestrian information, surrounding pedestrian information, or vehicle information.

In addition, the control unit 42 of the data center 4 uses the communication unit 41 to transmit the traffic information to the first part when the owner of the first mobile terminal 2 approaches a place with a large traffic volume based on, for example, information received from the server 5. You may transmit to the portable terminal 2. FIG.
The traffic information may be an audio signal. The control unit 29 of the first mobile terminal 2 reproduces the received traffic information. Thereby, the portable person who possesses the 1st portable terminal 2 can know that he approached the location with much traffic.
Moreover, the control part 42 of the data center 4 may transmit emergency information to the 1st portable terminal 2 and the 2nd portable terminal 3 based on the information received from the server 5, for example. The emergency information is information calling for evacuation when, for example, a disaster or accident occurs.

As described above, in the present embodiment, the location information acquired by the first portable terminal 2 carried by the carrier or attached to the bag or the like is collected in the data center 4 and the second portable terminal 3 possessed by the guardian. Send to. In the present embodiment, suspicious person information is collected from the administrative or school server 5 to the data center 4. When the data center 4 acquires the suspicious person information and the distance between the current position of the first portable terminal 2 and the dangerous location is less than a predetermined value, the data center 4 and the second portable The danger information is transmitted to the guardian who owns the terminal 3.
Thereby, according to this embodiment, when the carrier of the 1st portable terminal 2 is approaching a dangerous place, the carrier (for example, children, such as a child) of the 1st portable terminal 2, or the 2nd portable terminal 3 A danger notice can be sent to the owner (eg, a guardian, etc.).

Moreover, in this embodiment, an alarm sound etc. are enlarged as the 1st portable terminal 2 approaches a dangerous location.
Thereby, according to this embodiment, it can notify more accurately that the carrier of the 1st portable terminal 2 is approaching a dangerous place.
In the present embodiment, the second mobile terminal 3 acquires the movement locus of the first mobile terminal 2.
Thereby, according to this embodiment, the holder of the 2nd portable terminal 3 can grasp | ascertain the movement locus | trajectory (for example, a return route from a school to a home etc.) of the portable person of the 1st portable terminal 2.

<First Modification of Information Communication System>
Hereinafter, the data center 4A determines whether or not a predetermined operation to be performed at a predetermined position such as a school route is performed based on the information received from the first mobile terminal 2, and the determination result is the second mobile phone. An example of transmission to the terminal 3 will be described. As will be described later, the predetermined position may be information on a position including the above-described dangerous place.

First, a main operation example of the information communication system 1A according to the first modification of the embodiment will be described.
FIG. 11 is a diagram illustrating a main operation example of the information communication system 1A according to the first modification of the embodiment.
Symbol g100 is a diagram illustrating an example of an interaction between the first portable terminal 2 and a carrier (for example, a child such as a child) when returning home. In the figure indicated by reference sign g100, reference sign g101 is a child's utterance, and reference sign g102 is the first mobile terminal 2's utterance.

Symbol g110 is a diagram showing an example of dialogue between the child and the guardian when returning home. In the diagram indicated by reference sign g110, reference sign g111 is the utterance of the guardian, reference sign g112 is the utterance of the child, and reference sign g113 is the utterance of the first portable terminal 2.

The symbol g120 is a diagram illustrating an example of an image displayed on the second portable terminal 3. The displayed image is an image received from the data center 4. A symbol g121 is an image received from the data center 4. The image g121 includes a score image g122, a child movement trajectory image g122, and motion confirmation result images g123 and g124 at the confirmation location.

<Configuration of Information Communication System 1A>
Next, a configuration example of the information communication system 1A will be described.
FIG. 12 is a diagram illustrating a configuration example of an information communication system 1A according to the first modification of the embodiment. As illustrated in FIG. 12, the information communication system 1 A includes a first mobile terminal 2, a second mobile terminal 3, a data center 4 A (center), and a server 5. The first mobile terminal 2, the second mobile terminal 3, the data center 4 A, and the server 5 are connected to each other via a network 6. In addition, about the function part which performs the operation | movement similar to the information communication system 1, description is abbreviate | omitted or simplified using the same code | symbol. As shown in FIG. 12, the difference between the information communication system 1 and the modified information communication system 1A is a data center 4A.

As shown in FIG. 12, the data center 4A includes a communication unit 41, a control unit 42A, a model storage unit 43, a storage unit 44A, a voice recognition model storage unit 45, a voice recognition unit 46, and a scenario storage unit 47.

The voice recognition model storage unit 45 stores, for example, an acoustic model, a language model, a word dictionary, and the like. The acoustic model is a model based on the feature amount of sound, and the language model is a model of information on words and how to arrange them. The word dictionary is a dictionary with a large number of vocabularies, for example, a large vocabulary word dictionary.

The voice recognition unit 46 detects the voice signal in the utterance section with respect to the voice signal output from the control unit 42A. For the detection of the utterance section, for example, an audio signal having a predetermined threshold value or more is detected as the utterance section. Note that the speech recognition unit 46 may perform detection of the utterance section using another known method. The speech recognition unit 46 performs speech recognition on the detected speech signal in the utterance section with reference to the speech recognition model storage unit 45 using a known method. Note that the voice recognition unit 46 performs voice recognition using, for example, a technique disclosed in JP-A-2015-64554. The speech recognition unit 46 converts the recognized recognition result into text with reference to the speech recognition model storage unit 45. The speech recognition unit 46 performs morphological analysis and dependency analysis on the text information with reference to the speech recognition model storage unit 45. For the dependency analysis, for example, SVM (Support Vector Machines) is used in the shift-reduce method, the spanning tree method, and the chunk identification stage application method. The voice recognition unit 46 outputs the analysis result to the control unit 42A.

The scenario storage unit 47 stores a dialogue performed in an environment where the first mobile terminal 2 is used, for example, in a text format.

The control unit 42A performs the following processing in addition to the processing performed by the control unit 42.
The control unit 42 A receives the detection signal of the radar 22 received by the communication unit 41 from the first portable terminal 2 and the detection value of the acceleration sensor 28 received by the communication unit 41 from the first portable terminal 2. The control unit 42A determines whether or not a predetermined operation is performed at the set position based on at least one of the received detection signal of the radar 22 and the detection value of the acceleration sensor 28. The control unit 42A obtains, for example, a score when returning home based on the determined result. The control unit 42A stores the obtained score in the storage unit 44A.
The control unit 42A generates an image including a score image and an image indicating the determined result in the image of the child's movement trajectory. When receiving a score transmission request from the second portable terminal 3, the control unit 42 A transmits the generated image to the second portable terminal 3. A method for determining whether or not a predetermined operation has been performed and how to obtain a score will be described later.
Further, the control unit 42A acquires the analysis result output by the voice recognition unit 46. Based on the analysis result, the control unit 42A refers to the scenario storage unit 47 and selects a response to the audio signal received from the first portable terminal 2. The control unit 42A converts the selected response into an audio signal by, for example, a formant synthesis method, and transmits the converted audio signal to the first portable terminal 2 by the communication unit 41.

44 A of memory | storage parts associate and store a predetermined operation | movement and a score in the information (latitude / longitude, a point name) which shows a predetermined position in addition to the information which the memory | storage part 44 memorize | stores. In addition, the storage unit 44A stores, for example, the total score when returning home. In addition, the storage unit 44 stores a threshold value used when determining whether or not a predetermined operation has been performed. Furthermore, the storage unit 44 A stores face model data and arm model data used for detection of the detection signal of the radar 22.

Note that the guardian may operate the operation unit 33 of the second portable terminal 3 to set the school route in advance. In this case, the control unit 36 of the second portable terminal 3 may transmit information indicating the school route to the data center 4A by the communication unit 31. Further, the guardian may operate the operation unit 33 of the second portable terminal 3 to set a predetermined position where the predetermined operation should be performed. In this case, the control unit 36 of the second portable terminal 3 may transmit information indicating the predetermined position to the data center 4A by the communication unit 31. Further, the guardian may set the predetermined operation by operating the operation unit 33 of the second portable terminal 3. In this case, the control unit 36 of the second portable terminal 3 may transmit information indicating a predetermined operation performed at a predetermined position to the data center 4A by the communication unit 31.
For example, the data center 4A may acquire a dangerous spot from the server 5 and set the acquired dangerous spot at a predetermined position. Then, a predetermined operation may be set according to the type of the predetermined position.

Next, examples of the predetermined position, the predetermined operation, and the score will be described.
FIG. 13 is a diagram illustrating an example of the predetermined position, the predetermined operation, and the score according to the first modification example of the embodiment.
Note that the example shown in FIG. 13 is a predetermined position on the return route (return home route), a predetermined action, and a part of the score, and the total score is set to 100 points on the return route.
In the example shown in FIG. 13, the predetermined locations are the A intersection, the B intersection, and the C intersection. The predetermined operation is, for example, temporary stop and left / right confirmation at the A intersection. The score is 10 for the temporary stop and 10 for the left / right confirmation at the A intersection, for example.
The control unit 42A sets the score to 10 when the pause operation is performed at the A intersection, and sets the score to 0 when the operation is not performed. Then, the total score from school to home is obtained, and the obtained total score is stored in the storage unit 44A. Note that the control unit 42A may obtain a total score by subtracting a score of a predetermined action that has not been performed from 100 points.

Next, an example of a processing procedure performed by the data center 4A will be described.
FIG. 14 is a flowchart of a processing procedure example performed by the data center 4A according to the first modification of the embodiment. In the example illustrated in FIG. 14, the control unit 42 A determines whether or not a predetermined operation has been performed based on the detection signal of the radar 22.

(Step S51) The control unit 42A of the data center 4A receives the position information transmitted by the first mobile terminal 2.
(Step S52) The control unit 42A receives the detection signal of the radar 22 transmitted from the first mobile terminal 2. In addition, the 1st portable terminal 2 transmits a positional information and a detection signal to the data center 4A for every predetermined period.

(Step S53) When the position is a predetermined location, the control unit 42A performs an operation analysis by determining whether or not a predetermined operation has been performed based on the received detection signal.
(Step S54) The control unit 42A performs a scoring process based on the result of the operation analysis and the information stored in the storage unit 44A. The scoring process is, for example, a point addition or deduction process.

(Step S55) The control unit 42A determines whether a score transmission request is received from the second portable terminal 3. When it is determined that the request has been received from the second portable terminal 3 (step S55; YES), the control unit 42A advances the process to step S56. On the other hand, when it is determined that the request is not received from the second portable terminal 3 (step S55; NO), the control unit 42A returns the process to step S51.

(Step S56) The control unit 42A generates an image including the image of the score and the image indicating the determination result in the image of the child's movement trajectory. The control unit 42 A transmits the generated image to the second mobile terminal 3.

In the example illustrated in FIG. 14, the data center 4 A has described the example in which the information including the score is transmitted when it is determined that the request is received from the second mobile terminal 3, but the present invention is not limited thereto. For example, the data center 4A may transmit information including a score at a time set by a guardian or every predetermined period.

Next, an example of a processing procedure performed by the second mobile terminal 3 will be described.
FIG. 15 is a flowchart of a processing procedure example performed by the second mobile terminal 3 according to the first modification of the embodiment.
(Step S61) The control unit 36 of the second portable terminal 3 receives information including the score transmitted by the data center 4A.
(Step S62) The control unit 36 causes the display unit 34 to display information including the received score.
The process shown in FIG. 15 may be executed at a time set by the guardian or at a predetermined cycle when a request is transmitted from the second portable terminal 3.

FIG. 16 is an image example of information including a score displayed on the display unit 34 of the second mobile terminal 3 according to the first modification of the embodiment.
The image g200 is an image displayed on the display unit 34.
A symbol g201 indicates a school. A symbol g202 indicates a home.
Reference numeral g203 is an image showing the movement trajectory of the child.
Reference numerals g211, g212, and g213 indicate predetermined locations.

A symbol g221 represents a determination result of the predetermined operation in the symbol g211. The circles indicate that a predetermined operation has been performed.
A symbol g222 represents a determination result of the predetermined operation in the symbol g212.
A symbol g223 represents a determination result of the predetermined operation in the symbol g213. Note that a cross indicates that a predetermined operation is not performed.
A symbol g230 is an image representing the total score.

In FIG. 16, the symbols g221 and g222 when the predetermined operation is performed may be displayed in blue, for example, and the symbol g223 when the predetermined operation is not performed may be displayed in red, for example. Such an image is generated by the control unit 42A of the data center 4A.

Hereinafter, an example of an operation analysis method for pause at a predetermined position will be described.
FIG. 17 is a flowchart of a processing procedure example of an operation analysis method for pause at a predetermined position according to the first modification of the embodiment. The control unit 42A starts the following process after initializing the counter value T to zero. Further, the control unit 42A performs the following processing at a predetermined position.

(Step S71) The control unit 42A of the data center 4A receives the position information from the first mobile terminal 2. The control unit 42A stores the received position information in the storage unit 44 in association with the received time information.

(Step S72) The control unit 42A compares the previous position (position information closest to the current time) stored in the storage unit 44A with the received position information, and determines whether or not the position is the same as the previous time. Is determined. When the control unit 42A determines that the position is the same as the previous position (step S72; YES), the control unit 42A proceeds to the process of step S73. On the other hand, when the control unit 42A determines that the position is not the same as the previous position (step S72; NO), the process proceeds to step S74.

(Step S73) The control unit 42A adds 1 to the counter value T, and the process proceeds to step S75.
(Step S74) The control unit 42A assigns 0 to the counter value T, and returns the process to step S71.

(Step S75) The control unit 42A determines whether or not the counter value T is larger than a threshold value used when determining whether or not a predetermined operation has been performed. When the control unit 42A determines that the counter value T is larger than the threshold value (step S75; YES), the control unit 42A advances the process to step S76. On the other hand, when the control unit 42A determines that the counter value T is equal to or less than the threshold value (step S75; NO), the control unit 42A returns the process to step S71.
(Step S76) The control unit 42A determines that the child carrying the first mobile terminal 2 has paused at a predetermined position.

Note that the control unit 42A may perform the operation analysis of the suspension based on the detection value of the acceleration sensor 28 of the first portable terminal 2.
In this case, in step S71, the control unit 42A receives the detection value of the acceleration sensor 28. In step S72, the control unit 42A may determine that the position is the same when the difference between the previous detection value and the current detection value is within a predetermined range including zero.
The control unit 42A determines whether or not the child has performed a predetermined operation based on at least one of the detection value of the acceleration sensor 28 and other information (for example, a detection signal output by the radar 22). It may be detected.

Next, an example of a motion analysis method for checking the left and right at a predetermined position will be described.
FIG. 18 is a flowchart of a processing procedure example of the motion analysis method for checking the left and right at a predetermined position according to the first modification of the embodiment. Note that the control unit 42A performs the following processing at a predetermined position.

(Step S81) The control unit 42A of the data center 4A receives the detection signal output from the radar 22 from the first portable terminal 2.
(Step S 82) The control unit 42 A detects the face portion of the person who carries the first portable terminal 2 from the received detection signal by a known method. Subsequently, the control unit 42A stores the detected face detection signal in the storage unit 44A in association with the acquired time information.

(Step S83) The control unit 42A compares the acquired face detection signal with the previous face detection signal based on the face detection signal stored in the storage unit 44A. As a result of the comparison, the control unit 42A determines whether or not the face portion is moving left and right. When the control unit 42A determines that the face part is moving left and right (step S83; YES), the process proceeds to step S84. On the other hand, when the control unit 42A determines that the face portion has not moved left and right (step S83; NO), the control unit 42A advances the process to step S85.

(Step S 84) The control unit 42 A determines that the carrier of the first mobile terminal 2 has confirmed left and right (right and left confirmation OK).
(Step S85) 42 A of control parts discriminate | determine that the holder of the 1st portable terminal 2 has not performed right-and-left confirmation (left-right confirmation NG).

Even in the left / right confirmation process, the control unit 42A determines whether or not the face has moved to the left or right when the left / right value of the detected value changes by a predetermined value or more based on the detected value of the acceleration sensor 28. May be determined.
Note that the control unit 42A determines whether or not the user has performed a predetermined operation based on at least one of a detection value of the acceleration sensor 28 and other information (for example, a detection signal output by the radar 22). May be detected.

Below, the example of the operation | movement analysis method of the hand raising operation | movement in a predetermined position is demonstrated.
FIG. 19 is a flowchart of an example of a processing procedure of an operation analysis method for a hand raising operation at a predetermined position according to the first modification of the embodiment. Note that the control unit 42A performs the following processing at a predetermined position.

(Step S91) The control unit 42A of the data center 4A receives the detection signal output from the radar 22 from the first portable terminal 2.
(Step S 92) The control unit 42 A detects the arm portion of the holder of the first portable terminal 2 from the received detection signal by a known method. The control unit 42A stores the detected arm detection signal in the storage unit 44A in association with the acquired time information.

(Step S93) The control unit 42A determines whether or not the arm is raised depending on whether or not the arm portion has been detected. When it is determined that the arm is raised (step S93; YES), the control unit 42A advances the process to step S94. On the other hand, when it is determined that the arm is not raised (the arm cannot be detected) (step S93; NO), the control unit 42A advances the process to step S95.

(Step S94) 42 A of control parts discriminate | determine that the carrier of the 1st portable terminal 2 performed hand raising operation (hand raising OK).
(Step S95) 42 A of control parts discriminate | determine that the carrier of the 1st portable terminal 2 is not performing hand raising operation (hand raising NG).

As described above, in the first modification of the embodiment, it is determined whether a necessary action has been performed on the school road, for example, for traffic safety, and presented as a score. As a result, the child carrying the first mobile terminal 2 tries to raise the score while having fun. For this reason, according to the 1st modification of embodiment, it can carry out to a road safety education continuously with respect to the child who carries the 1st portable terminal 2. FIG. In the first modification of the embodiment, since the behavior and score of the child carrying the first mobile terminal 2 are transmitted to the second mobile terminal 3 possessed by the guardian, the guardian grasps the skill of the child. be able to. According to the first modification of the embodiment, the guardian and the child can communicate with each other while viewing the information displayed on the second mobile terminal 3, thereby increasing the chance of communication between the guardian and the child. At the same time, safety awareness is improved.

Hereinafter, an example of communication between the first mobile terminal 2 and a child who is a carrier of the first mobile terminal 2 will be described with reference to a diagram indicated by reference sign g100 in FIG.

For example, when the child returns home, he / she utters “Now!”.
The control unit 29 of the first portable terminal 2 transmits this audio signal picked up by the microphone 23 to the data center 4 A through the communication unit 21. The voice recognition unit 46 of the data center 4A performs voice recognition processing on the received voice signal. The control unit 42A generates a reply voice signal based on the result of the voice recognition process, and transmits the generated voice signal to the first portable terminal 2 by the communication unit 41. As a result, the control unit 29 of the first portable terminal 2 speaks by reproducing “Return!” Received from the data center 4A.

Subsequently, the data center 4A receives the voice signal that the child uttered “What is today's score?”, And the control unit 42A receives the voice recognition result and the information stored in the scenario storage unit 47 and the storage unit 44. Based on this, a “90 points” audio signal as a response is generated. The control unit 42A transmits an audio signal as a response to the first portable terminal 2 through the communication unit 41. As a result, the control unit 29 of the first mobile terminal 2 utters “90 points” received from the data center 4A.

Thus, in the above communication example, the audio signal collected by the first portable terminal 2 is transmitted to the data center 4A, and the response of the audio signal received by the data center 4A is transmitted to the first portable terminal 2. Thereby, it is possible to communicate between the child carrying the first portable terminal 2 and the first portable terminal 2, and continuously providing traffic safety education to the child carrying the first portable terminal 2. It can be carried out.

The audio signal transmitted from the data center 4A to the first mobile terminal 2 is “I did well!” When the score is 70 or more, for example, and “I did not pause when the score is 50 or less. Tomorrow. "Let's pause."

Hereinafter, an example of communication between the guardian, the child, and the first portable terminal 2 will be described with reference to a diagram indicated by reference numeral g110 in FIG.

In this example, the guardian and the child have a conversation to confirm the traffic safety point while viewing the image displayed on the second portable terminal 3.
Also in this example, the first portable terminal 2 or the second portable terminal 3 transmits the collected audio signal to the data center 4A. The data center 4 A transmits an audio signal of advice to the first mobile terminal 2 based on the result of the voice recognition. As a result, the first portable terminal 2 reproduces the advice audio signal “Please pause only because the pause is OK!”.
The data center 4 A may also transmit such advice audio signals to the second portable terminal 3.

As described above, in the above communication example, the voice signal picked up by the first portable terminal 2 or the second portable terminal 3 is transmitted to the data center 4A, and the response of the voice signal received by the data center 4A is sent to the first portable terminal. 2 to send. Thereby, communication can be performed between the guardian, the child, and the robot that is the first portable terminal 2, and the child carrying the first portable terminal 2 can be continuously provided for traffic safety education. it can.

In the above embodiment, an example in which a child carries the first portable terminal 2 has been described. However, for example, a mobile person, a pedestrian, or an elderly person may carry the first portable terminal 2.

<Second Modification of Information Communication System>
Below, the detail of the process which alert | reports the predetermined geographical position to the holder who carries the 1st portable terminal 2 is demonstrated. In addition, about the structure similar to embodiment mentioned above or a 1st modification, the same code | symbol is attached | subjected and description is abbreviate | omitted or simplified. The geographical position may be information on a position including the above-described dangerous place and a predetermined position.

FIG. 20 is a diagram illustrating an example of a configuration of an information communication system 1B according to a second modification of the embodiment. As illustrated in FIG. 20, the information communication system 1 B includes a first mobile terminal 2, a second mobile terminal 3, a data center 4 B, and a server 5. The data center 4B includes a communication unit 41, a control unit 42B, a model storage unit 43, a storage unit 44B, a voice recognition model storage unit 45, a voice recognition unit 46, and a scenario storage unit 47.

The storage unit 44B includes, for example, an HDD, a flash memory, an EEPROM (Electrically Erasable Programmable Read Only Memory), a ROM (Read Only Memory), or a RAM (Random Access Memory). The storage unit 44B stores, for example, map information, danger information, suspicious person information, and geographical position information. The suspicious person information includes a suspicious person pattern in addition to the position information and time at which the suspicious person appears. The suspicious person pattern is information indicating the characteristics of the behavior and behavior of the suspicious person. Details of the geographical location information will be described later.

The control unit 42B includes, for example, a notification unit 421 as a functional unit. The control unit 42B is realized by, for example, a hardware processor such as a CPU (Central Processing Unit) executing a program (software) stored in the storage unit 44B. Some or all of these components include hardware (circuitry) such as LSI (Large Scale Integration), ASIC (Application Specific Integrated Circuit), FPGA (Field-Programmable Gate Array), and GPU (Graphics Processing Unit). Part (including circuit)), or may be realized by cooperation of software and hardware.

Based on the position information of the first mobile terminal 2 and the geographical position information, the notification unit 421 informs the carrier (for example, a child such as a child) who holds the first mobile terminal 2 about the approach of the geographical position. Inform. The geographical position information is information indicating the geographical position. The geographical position is a position on a route through which the carrier of the first mobile terminal 2 passes, for example, a position where there is a possibility of danger to children. The geographical position includes, for example, an intersection on a route, a position on a sidewalk separated from a roadway, and the vicinity of a dangerous structure. The geographical position includes a point (for example, a safety confirmation point) where execution of a predetermined operation such as a stop operation, a left / right confirmation operation, and a hand raising operation is required.
In the following description, a case will be described in which the geographical position information includes a geographical position on a route where a child walks when going to and from school.

For example, the first portable terminal 2 identifies the position of the first portable terminal 2 (that is, the position of the child) based on the positioning signal received from the satellite or the like by the position detection unit 24, and position information indicating the identified position. Is transmitted to the data center 4B.

Note that the information communication system 1B may adopt a method other than the position detection unit 24 as long as it can identify the position of the child. For example, the first mobile terminal 2 may be connected to the first mobile terminal 2 by a method such as BLE (Bluetooth (registered trademark) Low Energy), PDR (Pedestrian® Dead® Reckoning), IMES (Indoor Messaging System), SLAM (Simultaneous Localization and Mapping). The position of may be specified. The first portable terminal 2 may specify the position of the first portable terminal 2 based on the peripheral information detected by the radar 22. The information communication system 1B may acquire the position of the first mobile terminal 2 from another system that specifies the position of the first mobile terminal 2, for example. For example, another system includes a detection device installed at a geographical position, and the detection device detects the first mobile terminal 2 present in the vicinity of the own device, thereby specifying the position of the first mobile terminal 2. May be.

When the child is approaching the geographical position based on the position information of the first mobile terminal 2 acquired from the first mobile terminal 2 and the geographical position information, the notification unit 421 determines that the first mobile terminal 2 A notification function provided is controlled to notify the child of the approach of the geographical position. The notification function with which the 1st portable terminal 2 is provided is vibrator 25, speaker 26, etc., for example.

Below, the alerting | reporting part 421 of the data center 4B transmits the control signal of the vibrator 25 to the 1st portable terminal 2, and the 1st portable terminal 2 operates (vibrates) the vibrator 25 based on the said control signal. A case where the child is notified of the approach of the geographical position will be described. In the following description, the notification unit 421 transmits a control signal for the vibrator 25 to the first mobile terminal 2, and the notification unit oscillates the vibrator 25 based on the control signal. It also describes that 421 vibrates the vibrator 25.

FIG. 21 is a diagram schematically illustrating the start timing of notification according to the second modification of the embodiment. In the example shown in FIG. 21, the child C1 who is the carrier of the first mobile terminal 2 goes straight in the direction of the intersection and walks along a route that turns right at the intersection (route rt shown in the drawing). The geographical position PT1 is set in advance at the position of the intersection. The geographical position PT1 is preferably set on a route rt on which the child C1 walks rather than the center of the intersection. For example, in a road in which a roadway and a sidewalk are divided, the route rt is a sidewalk, and the geographical position PT1 is set on the sidewalk (more specifically, the boundary between the sidewalk and the roadway).

The notification unit 421 operates the vibrator 25 when the child C1 approaches a position (that is, a predetermined range ARP illustrated) that is a predetermined distance (a first predetermined distance dt1 illustrated) from the geographical position PT1. The first predetermined distance dt1 is a distance of about several meters, for example. Further, the notification unit 421 may change the strength of notification (for example, the strength of vibration) according to the distance to the geographical position PT1. The child C1 walks while paying attention to the surroundings by being notified of the geographical position PT1 (that is, the intersection) by the vibrator 25. For this reason, the information communication system 1B can suppress contact between the child C1 and the vehicle m traveling in the traveling direction of the child C1.

FIG. 22 is a flowchart illustrating an example of processing of the notification unit 421 according to the second modification of the embodiment.
The notification unit 421 executes the process shown in FIG. 22 at predetermined time intervals.
First, the alerting | reporting part 421 acquires the positional information which shows the position of the child C1 from the 1st portable terminal 2 (step S100).
Next, the notification unit 421 determines whether or not the distance from the position of the child C1 to the geographical position PT1 is less than the first predetermined distance dt1 (step S102).
When the distance from the position of the child C1 to the geographical position PT1 is not less than the first predetermined distance dt1, the notification unit 421 ends the process.
On the other hand, when the distance from the position of the child C1 to the geographical position PT1 is less than the first predetermined distance dt1, the notification unit 421 advances the process to step S104.
The notification unit 421 performs a geographical position approach notification process for notifying the child C1 of the approach of the geographical position PT1 (step S104), and ends the process.

FIG. 23 is a flowchart showing details of the geographical location approach notification process in step S104 shown in FIG.
First, the alerting | reporting part 421 starts the alerting | reporting which notifies the child C1 of the approach of geographical position PT1 (step S200). In this example, the notification unit 421 starts the vibration of the vibrator 25.
Next, the alerting | reporting part 421 acquires the position of the child C1 by the position detection part 24 (step S202).
Next, the notification unit 421 determines whether or not the child C1 is approaching the geographical position PT1 based on the position of the child C1 acquired in step S100 and the position of the child C1 acquired in step S202 ( Step S204).
When the notification unit 421 determines that the child C1 is approaching the geographical position PT1 (YES in step S204), the notification unit 421 advances the process to step S206.
On the other hand, when the notification unit 421 determines that the child C1 has not approached the geographical position PT1 (NO side of step S204), the notification unit 421 advances the processing to step S208.
And the alerting | reporting part 421 increases the alerting | reporting amount of the vibrator 25 (step S206), and advances a process to step S212. Increasing the notification amount is, for example, at least one of increasing the vibration of the vibrator 25 and increasing the frequency of vibration.

Further, the notification unit 421 determines whether or not the child C1 is away from the geographical position PT1 (step S208).
When the notification unit 421 determines that the child C1 is moving away from the geographical position PT1 (YES in step S208), the notification unit 421 advances the process to step S210.
On the other hand, when the notification unit 421 determines that the child C1 has not approached or moved away from the geographical position PT1 (NO in step S208), the notification amount of the vibrator 25 is not changed, and the process proceeds to step S212. .
And the alerting | reporting part 421 reduces the alerting | reporting amount of the vibrator 25 (step S210), and advances a process to step S212. Decreasing the notification amount is at least one of reducing vibration of the vibrator 25 and reducing the frequency of vibration.

The notification unit 421 determines whether the distance from the position of the child C1 to the geographical position PT1 is equal to or greater than the first predetermined distance dt1 (step S212).
While the notification unit 421 determines that the distance from the position of the child C1 to the geographical position PT1 is less than the first predetermined distance dt1 (NO in step S212, that is, until the child C1 goes out of the predetermined range ARP). The process returns to step S204. The notification unit 421 adjusts the notification amount by repeating the processing from steps S204 to S210.
On the other hand, when the notification unit 421 determines that the distance from the position of the child C1 to the geographical position PT1 is equal to or greater than the first predetermined distance dt1 (YES side of step S212), the process proceeds to step S214.
And the alerting | reporting part 421 stops alerting | reporting (step S214).

In the above description, the case where the distance from the position of the child C1 to the geographical position PT1 is a linear distance has been described, but the present invention is not limited thereto. The distance from the position of the child C1 to the geographical position PT1 may be a distance along the route rt of the child C1. The notification unit 421 suppresses the notification for a long time by performing notification based on the distance to the geographical position PT1 along the route rt of the child C1, and the child C1 gets used to the notification state. Can be suppressed.
As described above, the information communication system 1B according to the second modification of the embodiment can more appropriately notify the child C1 of the approach of the geographical position.

<Third Modification of Information Communication System>
Hereinafter, a case where an object and a person approaching the person who carries the first portable terminal 2 are notified to the person who carries the first portable terminal 2 will be described. In addition, about the structure similar to embodiment mentioned above, a 1st modification, or a 2nd modification, the same code | symbol is attached | subjected and description is abbreviate | omitted or simplified.

FIG. 24 is a diagram illustrating an example of the configuration of the first mobile terminal 2B according to the third modification of the embodiment. As shown in FIG. 24, the first mobile terminal 2B includes a communication unit 21, a radar 22, a microphone 23, a position detection unit 24, a vibrator 25, a speaker 26, a display unit 27, an acceleration sensor 28, and the like. And a control unit 29B.

The control unit 29B includes, for example, an approach determination unit 291 as a functional unit in addition to the configuration included in the control unit 29. The control unit 29B is realized, for example, when a hardware processor such as a CPU executes a program (software) stored in a storage unit (not shown). Some or all of these components may be realized by hardware (including a circuit unit) such as LSI, ASIC, FPGA, or GPU, or by cooperation of software and hardware. Also good.

The approach determination unit 291 determines, for example, whether or not an object existing around the mobile person has approached the mobile person based on the detection result of the detection function provided in the first mobile terminal 2B. In the following description, a case where the detection function provided in the first mobile terminal 2B is the radar 22 will be described.

FIG. 25 is a diagram schematically illustrating the start timing of notification according to the third modification of the embodiment. The radar 22 included in the first mobile terminal 2B is configured to be able to detect the surroundings of the child C1, for example. The radar 22 is configured by, for example, a plurality of (two in the drawing) millimeter wave radars, and is provided in different directions so that the surroundings of the first portable terminal 2B (that is, the surroundings of the child C1) can be detected. . In the example shown in FIG. 25, the front radar and the rear radar included in the radar 22 detect different ranges (a front detection range AF and a rear detection range AR shown in the drawing). When the radar 22 is set to be able to detect the entire area of the child C1 (for example, a range of 360 degrees around the vertical axis), the front detection range AF and the rear detection range AR may overlap each other. Good. For example, the radar 22 detects the surroundings of the user at predetermined time intervals and generates a detection signal. The radar 22 may include one or a plurality of millimeter wave radars as long as it can detect the surroundings of the child C1.

Note that the first mobile terminal 2B may include a device other than the radar 22 as a configuration for detecting the surrounding environment of the user. The first portable terminal 2 B may include a detection device that performs remote detection, such as a camera, a LIDAR (Light Detection and Ranging or Laser Imaging Detection and Ranging), or an infrared sensor, instead of the radar 22.
For example, the first mobile terminal 2 B may include one or a plurality of cameras instead of the radar 22. For example, as shown in FIG. 25, the three cameras provided in the first portable terminal 2B capture images in different ranges (imaging ranges AR1 to AR3 shown). The imaging ranges AR1 to AR3 of the three cameras may overlap each other. The three cameras may capture the periphery of the user at predetermined time intervals and generate captured images (for example, still images or moving images).

Based on the detection signal generated by the radar 22, the approach determination unit 291 moves the object to a position (that is, a predetermined range ARC shown in the drawing) that is a predetermined distance (a second predetermined distance dt2 shown in the drawing) from the position of the child C1. When approaching, it determines with the object approaching the child C1, and transmits the detection signal of the radar 22 to the data center 4B. The second predetermined distance dt2 is a distance of about several meters.

The notification unit 421 of the data center 4B controls the notification function provided in the first mobile terminal 2B when an object is approaching the child C1, based on the detection signal of the radar 22 received from the first mobile terminal 2B. Inform child C1 of the approach of the object. The notification unit 421 notifies the child C1 of the approach of the vehicle m and the approach of the suspicious person among the objects approaching the child C1.

FIG. 26 is a flowchart illustrating an example of processing of the approach determination unit 291 and the notification unit 421 according to the third modification example of the embodiment.
First, the approach determination unit 291 acquires the detection signal output by the radar 22 (step S300).
Next, the approach determination unit 291 determines whether or not the distance from the child C1 to the detected object is less than the second predetermined distance dt2 based on the acquired detection signal (step S302).
When determining that the distance from the child C1 to the detected object is not less than the second predetermined distance dt2 (NO side of step S302), the approach determination unit 291 returns the process to step S300 and waits.
On the other hand, when the approach determination unit 291 determines that the distance from the child C1 to the detected object is less than the second predetermined distance dt2 (YES side of step S302), the process proceeds to step S304.
And the alerting | reporting part 421 performs the object approach alerting | reporting process which alert | reports the approach of an object to the child C1 (step S304), and complete | finishes a process.

FIG. 27 is a flowchart showing details of the object approach notification process in step S304 shown in FIG.
First, the notification unit 421 determines whether or not the size of the object indicated in the detection signal acquired in step S300 is greater than or equal to a predetermined size (step S400). The predetermined size is, for example, a general appropriate vehicle size.
When the notification unit 421 determines that the size of the object indicated by the detection signal is equal to or larger than the predetermined size (YES side of step S400), the process proceeds to step S402.
On the other hand, when the notification unit 421 determines that the size of the object is not equal to or larger than the predetermined size, the notification unit 421 advances the processing to step S410.
And the alerting | reporting part 421 determines with an object being the vehicle m (step S402).
Next, the notification unit 421 acquires a detection signal output after the detection signal acquired in step S300 (step S404).

Next, the notification unit 421 determines whether or not the speed of the vehicle m is equal to or higher than a predetermined speed based on the detection signal acquired in step S300 and the detection signal acquired in step S404 (step S406). ). The predetermined speed is, for example, about several to several tens km / h.
When the speed of the vehicle m is not equal to or higher than the predetermined speed (NO side of step S406), the notification unit 421 advances the process to step S408.
On the other hand, when the notification unit 421 determines that the speed of the vehicle m is equal to or higher than the predetermined speed (YES side of step S406), the process proceeds to step S412.
And the alerting | reporting part 421 determines whether the vehicle m finished passing the vicinity of the child C1 (step S408).
When the vehicle m has passed the vicinity of the child C1 (YES in step S408), the notification unit 421 estimates that there is no danger to the child C1 and starts to notify the child C1 of the approach of the vehicle m. The process ends.
On the other hand, when the notification unit 421 determines that the vehicle m has not passed through the vicinity of the child C1 (NO side of step S408), the notification unit 421 returns the process to step S404. When repeating steps S404 to S406, when the vehicle m approaching the child C1 is not equal to or higher than the predetermined speed (NO side of step S406), the notification unit 421 estimates that the child C1 is not dangerous even if approaching. , Do not start notification.

Also, the notification unit 421 determines whether or not the movement pattern of the object matches the suspicious person's pattern (step S410). The suspicious person's pattern is, for example, a pattern in which a specific object is encountered a predetermined number of times or more during a unit period related to the movement of the child C1 (for example, when attending school or leaving school on an appropriate day). The suspicious person's pattern is a pattern in which an object reciprocates along a path that matches the movement path of the child C1 during a unit period related to the movement of the child C1, for example. The suspicious person's pattern is, for example, a pattern in which the feature of the object matches the suspicious person's feature of the suspicious person information.
When the notification unit 421 determines that the movement pattern of the object does not match the pattern of the suspicious person (NO side of step S410), the notification unit 421 estimates that the object is not a suspicious person and starts notification that notifies the child C1 of the approach of the object. Without processing, the process is terminated.
On the other hand, when the notification unit 421 determines that the movement pattern of the object matches the suspicious person's pattern (YES in step S410, that is, the object is a suspicious person), the notification unit 421 advances the processing to step S412.
And the alerting | reporting part 421 starts the alerting | reporting which notifies the child m1 of the approach of the vehicle m or a suspicious person (step S412).

Next, the alerting | reporting part 421 acquires the detection signal output after the detection signal acquired in step S300 (step S414).
Next, the notification unit 421 determines whether the vehicle m or the suspicious person is approaching the child C1 based on the detection signal acquired in Step S300 and the detection signal acquired in Step S414 (Step S414). S416).
Informing part 421 advances processing to Step S418, when vehicle m or a suspicious person is approaching child C1 (YES side of Step S410).
On the other hand, when the vehicle m or the suspicious person is not approaching the child C1 (NO side of step S410), the notification unit 421 advances the process to step S420.

Then, the notification unit 421 increases the notification amount (step S418) and returns the process to step S416.
Further, the notification unit 421 determines whether or not the vehicle m or the suspicious person has passed near the child C1 (step S420).
When the notification unit 421 determines that the vehicle m or the suspicious person has not passed near the child C1 (NO side of step S420), the notification unit 421 returns the process to step S416 and repeats the processes of steps S416 to S418.
On the other hand, when the vehicle m or the suspicious person has passed the vicinity of the child C1 (YES side of step S420), the notification unit 421 advances the process to step S422.
The notification unit 421 stops the notification (step S422).

As described above, the information communication system 1B according to the third modification of the embodiment can more appropriately notify the child C1 of the approach of the vehicle or the suspicious person.

<Fourth Modification of Information Communication System>
In the following, a case will be described in which a predetermined movement of the user at the geographical position is recognized. In addition, about the structure similar to embodiment mentioned above, a 1st modification, a 2nd modification, or a 3rd modification, the same code | symbol is attached | subjected and description is abbreviate | omitted or simplified.

FIG. 28 is a diagram illustrating an example of the configuration of the first mobile terminal 2C according to the fourth modification example of the embodiment. The information communication system 1B according to the fourth modification of the embodiment includes a first mobile terminal 2C instead of the first mobile terminal 2B or in addition to the first mobile terminal 2B.
As shown in FIG. 28, the first mobile terminal 2C includes a communication unit 21, a radar 22, a microphone 23, a position detection unit 24, a vibrator 25, a speaker 26, a display unit 27, an acceleration sensor 28, and the like. And a control unit 29C. 29 C of control parts are provided with the approach determination part 291 and the action recognition part 292 as a function part in addition to the structure with which the control part 29 is provided, for example.

For example, the motion recognition unit 292 recognizes whether or not the wearer has performed a predetermined motion based on the detection result of the detection function (radar 22 in this example) included in the first mobile terminal 2C. The predetermined operation is an operation that is preferably performed by the wearer at the geographical location. The predetermined operation is, for example, a stop operation that stops at a geographical position. The predetermined operation is, for example, a left / right confirmation operation for confirming left / right at a geographical position. Further, the predetermined operation is, for example, a hand raising operation at a geographical position.
The detection range of the radar 22 includes the movable range of the portable person's head and the movable range of the portable person's hand. The motion recognition unit 292 recognizes a predetermined motion performed by the carrier based on the detection signal output by the radar 22, and transmits information indicating the recognized predetermined motion to the data center 4B.

FIG. 29 is a diagram schematically illustrating timing for performing recognition processing of a predetermined action according to the fourth modification example of the embodiment. As described above, the first mobile terminal 2C starts notification by the vibrator 25 at a position where the distance to the geographical position PT1 is less than the first predetermined distance dt1 (the position of “child C1 at time t” shown in the figure). To do. In the example shown in FIG. 29, the child C1 performs a stop operation that stops at the geographical position PT1. Hereinafter, processing when the motion recognition unit 292 recognizes various predetermined motions will be described.

<When recognizing stop operation>
The motion recognition unit 292 transmits the position information acquired by the position detection unit 24 to the data center 4B. The data center 4B refers to the geographical position information stored in the storage unit 44B, and specifies the geographical position PT1 existing in the vicinity of the position of the child C1 indicated by the position information. The data center 4B transmits information indicating the identified geographical position PT1 to the first mobile terminal 2C. The motion recognition unit 292 determines whether or not the position of the child C1 specified by the position detection unit 24 is the geographical position PT1. Further, based on the detection signal output by the radar 22, the motion recognition unit 292 recognizes that the child C1 is stopped when the surrounding environment acquired by the detection signal has not changed for a predetermined time. The action recognition unit 292 integrates the above-described determinations, and recognizes that the stop action has been performed when the child C1 is stopped at the geographical position PT1. Note that the motion recognition unit 292 performs a process of recognizing the stop motion from a remote position separated from the geographical position PT1 by a predetermined distance (a third predetermined distance dt3 in the illustrated example) to the geographical position PT1. Also good. In this case, the motion recognition unit 292 specifies a remote position that is a third predetermined distance dt3 in front of the geographical position PT1 in the vicinity of the current position acquired from the data center 4B, and changes the geographical position PT1 from the specified remote position. Until it arrives, processing for recognizing the stop operation may be performed.

<When recognizing left / right confirmation action>
Based on the detection signal output by the radar 22, the motion recognition unit 292 performs a left / right confirmation operation when the head of the child C1 (for example, a face) faces leftward and rightward with respect to the child C1. Recognize that

<When recognizing raising hand>
Based on the detection signal output by the radar 22, the motion recognition unit 292 recognizes that the hand raising operation has been performed when the hand portion (for example, the palm) of the child C1 is positioned upward with respect to the child C1.

The operation recognizing unit 292 transmits information indicating that the predetermined operation is recognized to the data center 4B at the timing when it is recognized that the predetermined operation has been performed. The notification unit 421 stops the notification when the notification indicating the approach of the geographical position is started to the child C1 and when the information indicating that the predetermined operation is performed is received from the motion recognition unit 292. .

Note that the motion recognition unit 292 may be able to recognize all of the predetermined operations (for example, stop operation, left / right confirmation operation, and raising hand operation), or only a part of the predetermined operation (for example, only the left / right confirmation operation and raising hand operation). Etc.) may be recognizable.

FIG. 30 is a flowchart illustrating an example of notification stop processing of the notification unit 421 according to the fourth modification of the embodiment.
First, the notification unit 421 determines whether notification has been started (step S500).
When the notification is not started (NO side of step S500), the notification unit 421 repeats the process of step S500 and waits until the notification is started.
On the other hand, when the notification unit 421 has started notification (YES in step S500), the notification unit 421 advances the process to step S502.
And the alerting | reporting part 421 determines whether the information which shows that predetermined | prescribed operation | movement was performed from the 1st portable terminal 2C was received (step S502).
When the predetermined operation is not performed (NO side of step S502), the notification unit 421 repeats the process of step S502 and waits until receiving information indicating that the predetermined operation has been performed.
On the other hand, when the notification unit 421 receives information indicating that a predetermined operation has been performed (YES in step S502), the notification unit 421 advances the process to step S504.
And the alerting | reporting part 421 stops alerting | reporting (step S504).

As described above, the information communication system 1B according to the fourth modified example of the embodiment estimates that a necessary action has been performed for traffic safety when the child C1 performs a predetermined operation at a geographical position, and is unnecessary. It is possible to prevent the notification from being continued.

<Notification method>
In addition, although the notification part 421 performed various notifications to the child C1 by vibrating the vibrator 25 in the second to fourth modifications described above, the present invention is not limited to this. The notification may be performed, for example, when the speaker 26 outputs sound. In this case, increasing the notification amount is, for example, at least one of increasing the sound volume and increasing the frequency of sound output.

<About recognition of moving speed>
Moreover, although the case where the motion recognition unit 292 recognizes the moving speed of the child C1 based on the detection signal output by the radar 22 has been described in the fourth modification described above, the present invention is not limited thereto. The moving speed of the child C1 may be recognized based on the output of the acceleration sensor 28, for example. In this case, the motion recognition unit 292 recognizes the moving speed of the child C1 by integrating the output of the acceleration sensor 28 and deriving the moving speed of the child C1.

<Notice based on moving speed>
Moreover, although the notification part 421 demonstrated the case where the alerting | reporting part 421 starts alerting | reporting based on the distance from the child C1 to the geographical position PT1 in the 2nd to 4th modification mentioned above, it is not restricted to this. The notification unit 421 may perform notification based on the moving speed of the child C1. For example, when the moving speed of the child C1 is high, the notification unit 421 may increase the notification start timing or increase the notification amount as compared to the case where the movement speed is low. Thereby, the information communication system 1B can promptly notify the child C1 who is likely to run and jump out on the road.

<About judgment of approach of geographical location>
Further, in the third modification and the fourth modification described above, the notification unit 421 is based on the position information of the child C1 acquired by the position detection unit 24 and the geographical position information, and approaches the geographical position PT1. However, the present invention is not limited to this. The notification unit 421 derives the predicted arrival time of the geographical position PT1 based on the moving speed of the child C1, and determines whether or not the geographical position PT1 is approached based on the derived predicted arrival time. Good. In this case, the notification unit 421 derives an expected arrival time to arrive at the geographical position PT1, and determines whether or not the geographical position PT1 has approached based on the derived expected arrival time.

<Regarding the geographical location>
In the second to fourth modifications described above, the geographical position PT1 is determined in advance and stored as the geographical position information in the storage unit 44B. However, the present invention is not limited to this. . The geographical location PT1 may be specified from, for example, the second mobile terminal 3 possessed by the guardian of the child C1. In this case, the second portable terminal 3 executes a program (software) used when setting the geographical position PT1 as a program (software) stored in a storage unit (not shown) of the second portable terminal 3. . For example, a map image is displayed on the display unit 34 by executing this program (software). The guardian inputs the start position and the end position of the route on which the child C1 walks when going to and from school to a reception unit (not shown) provided in the second mobile terminal 3. The reception unit is an operation device such as a button, a keyboard, and a mouse, for example.
In the following description, a case where the reception unit is a touch panel formed integrally with the display unit 34 will be described. The second portable terminal 3 superimposes a plurality of route rt candidates that the child C1 is estimated to walk on the map image based on the start position and the end position received by the reception unit, and presents them on the display unit 34. To do. The guardian selects a route rt on which the child C1 actually walks from among the plurality of presented route rt candidates.

Next, the accepting unit accepts an operation of a guardian who designates the geographical position PT1 that the child C1 wants to perform a predetermined action on the selected (designated) route rt. The information on the geographical position PT1 of the storage unit 44B includes information indicating the geographical position PT1 designated by the guardian. Thereby, the information communication system 1B can notify the child C1 of the approach of the geographical position PT1 designated by the guardian.

Note that the accepting unit may designate the route rt on which the child C1 actually walks by inputting the position of the route rt on the touch panel by the guardian with respect to the displayed map image. In addition, when the position specified by the parent's operation (for example, the start position, the end position, and the geographical position PT1 of the route rt) is not on the route rt or on the sidewalk, the control unit 36 is in the vicinity of the specified position. It may be corrected to a position on the route rt or on the sidewalk.

<Regarding notification of a predetermined operation>
Moreover, although the alerting | reporting part 421 demonstrated the case where the alerting | reporting part 421 alert | reports the approach of the geographical position PT1 or the approach of the vehicle m or a suspicious person to the child C1, it is not restricted to this. For example, the notification unit 421 may perform notification that prompts a predetermined operation at the geographical position PT1. In this case, for example, when the approach determination unit 291 determines that the child C1 has approached the geographical position PT1, the notification unit 421 confirms “pause at the intersection!” Then, raise your hand and let's cross the pedestrian crossing! "

<Notification of evaluation result of predetermined operation>
Moreover, the alerting | reporting part 421 may alert | report the evaluation result of the predetermined operation | movement which the child C1 performed. In this case, when the notification unit 421 receives information indicating that the child C1 has performed a predetermined operation from the first mobile terminal 2C, the notification unit 421 may perform notification that praises the child C1. The notification that praises the child C1 is notification that the vibrator 25 is vibrated according to a predetermined rhythm, and that the speaker 26 outputs a voice that praises the child C1 “You have confirmed right and left! .
Moreover, the alerting | reporting part 421 may alert | report the child C1 when the child C1 does not perform predetermined | prescribed operation | movement in the geographical position PT1. The notification that pays attention to the child C1 is notification that the vibrator 25 is vibrated according to a predetermined rhythm, and a sound that warns the child C1 that “It is dangerous if it does not stop properly” is output from the speaker 26. The notification unit 421 may notify the evaluation result of the predetermined operation every time the predetermined operation is performed, or whenever the distance from the child C1 to the geographical position PT1 becomes less than the first predetermined distance dt1.

In addition, the alerting | reporting part 421 does not need to alert | report the evaluation result, when notifying the approach of geographical position PT1, the vehicle m, or a suspicious person. Thereby, the alerting | reporting part 421 can suppress that alerting | reporting of the geographical position PT1 and an evaluation result disturbs alerting | reporting of the vehicle m or a suspicious person.
In addition, the notification unit 421 may not notify the evaluation result in a range within the first predetermined distance dt1 from the geographical position PT1. Thereby, the alerting | reporting part 421 can suppress that alerting | reporting of an evaluation result obstructs the alerting | reporting of geographical position PT1, the vehicle m, or a suspicious person.

<Regarding scoring of a predetermined action>
The control unit 42B may be configured to score a predetermined action performed by the child C1. The control unit 42B scores the predetermined action performed by the child C1 based on whether the child C1 performs the predetermined action at the geographical position PT1 or does not perform the predetermined action, and indicates information indicating the result of the scoring. You may transmit to the 2nd portable terminal 3 of a guardian. Further, the control unit 42B may transmit the scoring result of the predetermined operation to the second portable terminal 3 every time the child C1 approaches the geographical position PT1.

<About Information Communication System 1B>
In the second to fourth modifications described above, in the information communication system 1B, the configuration provided in the first mobile terminal 2, the first mobile terminal 2B, or the first mobile terminal 2C and the configuration provided in the data center 4B. However, the present invention is not limited to this. For example, the configuration provided in the first mobile terminal 2, the first mobile terminal 2B, or the first mobile terminal 2C may be provided in the data center 4B, and the configuration provided in the data center 4B is the first mobile terminal 2, One mobile terminal 2B or the first mobile terminal 2C may be provided. Moreover, the information memorize | stored in the memory | storage part 44B may be memorize | stored in the memory | storage part (not shown) of the 1st portable terminal 2, the 1st portable terminal 2B, or the 1st portable terminal 2C.
For example, in the second to fourth modifications described above, the notification unit 421 of the data center 4B is stored in the storage unit 44B and the position information acquired by the position detection unit 24 of the first mobile terminal 2. Although the approach between the first portable terminal 2 and the geographical position PT1 is determined based on the geographical position information that is present, the present invention is not limited to this. The proximity determination unit 291 of each of the first

mobile terminals

2B and 2C shown in the third modification and the fourth modification described above receives the geographical position information from the data center 4B, and the first mobile terminal 2 and the geographical position You may determine the approach of PT1.

In the embodiment and each modification described above, each first

mobile terminal

2, 2 B, 2 C includes the radar 22 by the front radar and the rear radar. However, the present invention is not limited to this, and instead of the radar 22, a camera, LIDAR (Light Detection and Ranging or Laser Imaging Detection and Ranging) or an infrared sensor may be provided.

A program for realizing all or part of the functions of the

data centers

4, 4A, 4B in the present invention is recorded on a computer-readable recording medium, and the program recorded on the recording medium is stored in a computer system. You may perform all or one part of the processing which each

data center

4, 4A, 4B performs by making it read and execute. Here, the “computer system” includes an OS and hardware such as peripheral devices. The “computer system” includes a WWW system having a homepage providing environment (or display environment). The “computer-readable recording medium” means a portable medium such as a flexible disk, a magneto-optical disk, a ROM and a CD-ROM, and a storage device such as a hard disk built in the computer system. Further, the “computer-readable recording medium” refers to a volatile memory (RAM) inside a computer system that becomes a server or a client when a program is transmitted via a network such as the Internet or a communication line such as a telephone line. In addition, those holding programs for a certain period of time are also included.

Further, the program may be transmitted from a computer system storing the program in a storage device or the like to another computer system via a transmission medium or by a transmission wave in the transmission medium. Here, the “transmission medium” for transmitting the program refers to a medium having a function of transmitting information, such as a network (communication network) such as the Internet or a communication line (communication line) such as a telephone line. The program may be for realizing a part of the functions described above. Furthermore, what can implement | achieve the function mentioned above in combination with the program already recorded on the computer system, what is called a difference file (difference program) may be sufficient.

The embodiment of the present invention is presented as an example, and is not intended to limit the scope of the invention. These embodiments can be implemented in various other forms, and various omissions, replacements, and changes can be made without departing from the spirit of the invention. These embodiments and their modifications are included in the scope and gist of the invention, and are also included in the invention described in the claims and the equivalents thereof.

According to the present invention, it is possible to provide an operation confirmation system capable of confirming a predetermined operation of a mobile person.

1, 1A, 1B ... Information communication system (operation check system), 2, 2B, 2C ... First mobile terminal (terminal), 3 ... Second mobile terminal (other terminals), 4, 4A, 4B ... Data center ( Server), 5 ... server, 6 ... network, 21 ... communication unit, 22 ... radar (operation acquisition unit, speed acquisition unit, remote detection unit, reception unit), 23 ... microphone, 24 ... position detection unit (position acquisition unit) , 25 ... Vibrator (notification part), 26 ... Speaker (notification part), 27 ... Display part, 28 ... Acceleration sensor (speed acquisition part, detection device), 29 ... Control part (notification part), 31 ... Communication part, 32 ... Microphone, 33 ... Operation part, 34 ... Display part (position setting part), 35 ... Speaker, 36 ... Control part (notification part, position setting part, position correction part), 41 ... Communication part, 42, 42A, 42B ... Control unit (position acquisition unit, position determination , Notification unit, operation acquisition unit, operation determination unit, evaluation unit), 43 ... model storage unit, 44, 44A, 44B ... storage unit, 45 ... voice recognition model storage unit, 46 ... voice recognition unit, 47 ... scenario storage unit 292 ... Motion recognition unit (motion determination unit, speed acquisition unit, output unit), 421 ... Notification unit (notification correction unit, output unit), ARP ... Predetermined range (separation position, notification region), C1 ... Child (moving person) , Pedestrians, children), PT1 ... Geographical position (first set position)

Claims

A device carried by a traveler,
An action acquisition unit for acquiring the movement of the mobile person;
An operation confirmation system provided with the terminal or a server communicable with the terminal, and an operation determination unit that determines that a predetermined operation has been performed based on the operation acquired by the operation acquisition unit.
The motion acquisition unit acquires the forward movement of the mobile person,
The operation check system according to claim 1, wherein the operation determination unit determines that the moving person has stopped from moving forward to stop moving forward.
The operation acquisition unit includes a position acquisition unit that acquires a current position of the terminal,
The operation check system according to claim 2, wherein the operation determination unit makes a determination based on the current position acquired by the position acquisition unit.
The operation confirmation system according to claim 3, wherein the position acquisition unit performs positioning using electromagnetic waves received from outside the terminal.
The operation confirmation system according to claim 3, wherein the position acquisition unit performs positioning based on an inquiry between electromagnetic waves from a peripheral object and stored map information.
The operation acquisition unit includes a speed acquisition unit that acquires a moving speed of the terminal,
The operation check system according to claim 2, wherein the operation determination unit makes a determination based on the moving speed acquired by the speed acquisition unit.
The operation check system according to claim 6, wherein the speed acquisition unit is a detection device that is provided in the terminal and detects a physical quantity.
The motion acquisition unit acquires the motion of the moving person's head,
The operation check system according to claim 1, wherein the operation determination unit determines that the head is swung left and right with respect to the moving direction of the mobile person.
The motion acquisition unit acquires the face orientation of the mobile person,
The operation check system according to claim 1, wherein the operation determination unit determines that the orientation of the face is directed to the left and right with respect to the moving direction of the moving person.
The motion acquisition unit acquires at least one of the position and movement of the hand of the mobile person,
The operation check system according to claim 1, wherein the operation determination unit determines that the hand portion is located in a predetermined area which is an area higher than a shoulder portion of the moving person.
The operation confirmation system according to any one of claims 8 to 10, wherein the operation acquisition unit includes a remote detection unit that remotely detects at least one of a position and a movement of an object outside the terminal.
The remote detection unit includes a reception unit that receives electromagnetic waves from the object,
The operation check system according to claim 11, which is dependent on claim 10, wherein the terminal is arranged such that the hand portion located in the predetermined area is within a detection range of the reception unit.
The operation check system according to claim 12, wherein the terminal is arranged such that a head of the mobile person is further within a detection range of the receiving unit.
The operation check according to any one of claims 1 to 13, wherein the terminal or the server includes a storage unit that stores a set position that is a geographical position set in advance so that the predetermined operation is performed. system.
The operation check system according to claim 14, wherein the set position is set to a specific position where there is a possibility of danger to the mobile person on a road on which the mobile person passes.
The road includes an intersection where the road intersects,
The operation check system according to claim 15, wherein the set position is set at the intersection.
The road includes a roadway through which vehicles pass and a sidewalk partitioned.
The operation check system according to claim 16, wherein the set position is set on the sidewalk at the intersection.
The said setting position is set on the path | route of the said movement start point and the said movement end point based on the input information regarding the movement start point and the movement end point of the said mover. The operation check system described.
The operation check system according to claim 18, wherein the terminal or the server includes a position setting unit that sets the set position on the route based on the movement start point and the movement end point.
The operation check system according to any one of claims 14 to 17, wherein the set position is set based on input information related to position designation for the terminal or another terminal different from the terminal.
The input information indicates a position on a map including a road area and a non-road area,
The operation check system according to claim 20, further comprising a position correction unit that corrects the input information to the adjacent road part area when the input information is located in the non-road part area.
The road area includes a road area and a sidewalk area,
The operation check system according to claim 21, wherein when the input information is located in the non-road part region or the roadway region, the position correction unit corrects the input information to the adjacent sidewalk part region.
The set position that is a geographical position set in advance so that the predetermined operation is performed by the mover includes a first set position and a second set position different from the first set position,
The terminal or the server, based on the first determination result determined by the operation determination unit at the first setting position and the second determination result determined by the operation determination unit at the second setting position, The operation check system according to any one of claims 1 to 22, further comprising an evaluation unit that evaluates the operation in a composite manner.
The operation check system according to claim 23, wherein the terminal or the server includes an output unit that outputs the evaluation to the outside of the terminal or another terminal provided to be communicable with the terminal or the server.
The operation check system according to claim 24, wherein the output unit outputs the evaluation to the outside of the terminal and does not output in the vicinity of the set position.
The operation check system according to claim 24, wherein the output unit outputs the evaluation to the other terminal and sequentially outputs the evaluation after the evaluation at the set position.
The operation determination unit is provided in the terminal,
27. The operation check system according to claim 23, wherein the evaluation unit is provided in the server.
A storage unit that is provided in the terminal or the server and stores a set position that is a preset geographical position;
The operation check system according to any one of claims 1 to 27, further comprising: a notifying unit that notifies the approach of the terminal to the set position at a predetermined distance from the set position.
29. The operation confirmation system according to claim 28, wherein the notification unit increases the amount of the notification as the terminal approaches the set position from the separation position.
30. The operation check system according to claim 28 or 29, wherein the notification unit decreases the notification amount as the terminal moves away from the set position after the notification is started.
The operation check system according to any one of claims 28 to 30, wherein the notification unit stops the notification when the operation determination unit determines the predetermined operation after the start of the notification.
The operation check system according to any one of claims 28 to 31, wherein the notification unit stops the notification when the terminal is separated from the set position by a predetermined distance after the notification is started.
The terminal or the server is
A position acquisition unit for acquiring a current position of the terminal;
The position determination part which determines that the said terminal is located in the alerting | reporting area | region which is an area | region closer to the said setting position than the said separation position based on the said present position is provided in any one of Claim 28 to 32. The operation check system described.
The operation check system according to claim 33, wherein the position determination unit determines that the terminal is located in the notification area based on a linear distance between the current position and the set position.
The terminal or the server includes a speed acquisition unit that acquires a moving speed of the terminal,
The operation check system according to claim 33 or 34, wherein the notification unit includes a notification correction unit that corrects the notification based on the moving speed.
36. The operation check system according to claim 35, wherein the notification correction unit corrects the notification so that the start of the notification is earlier as the moving speed is higher than when the notification is slower.
36. The operation confirmation system according to claim 35, wherein the notification correction unit corrects the notification amount so that the amount of the notification increases as the moving speed increases.
The terminal or the server is
A speed acquisition unit for acquiring the moving speed of the terminal;
The operation check system according to any one of claims 28 to 32, further comprising: a position determination unit that determines that the terminal has reached the separation position based on the moving speed.
The operation confirmation system according to claim 38, wherein the position determination unit determines that the remote position has been reached based on an arrival time to the set position obtained based on the moving speed.
The operation check system according to any one of claims 1 to 39, wherein the mobile person is a pedestrian.
The operation check system according to claim 40, wherein the pedestrian is a child.
42. The operation check system according to any one of claims 1 to 41, wherein the terminal is disposed on an object carried by the mobile person.
43. The operation check system according to claim 42, wherein the carrying item is a shoulder bag.
44. The operation check system according to claim 43, wherein the shoulder bag is a shoulder bag.