JP7414053B2 - Information processing device, program and information communication method - Google Patents

Description

The present invention relates to an information processing device, a program, and an information communication method.

2. Description of the Related Art Conventionally, a technique is known in which information received by an information processing device such as a mobile phone is transferred to an electronic device such as a smart watch worn by a user. Patent Document 1 describes this type of technology.

Patent Document 1 discloses that when a mobile phone receives data, etc., it is possible to determine whether or not the data should be transferred from the wristwatch via short-range communication, and when the data is transferred, the LCD (screen) of the wristwatch can Techniques related to configurations that can display data are described.

Japanese Patent Application Publication No. 2002-223475

However, if the only data displayed on the watch is a reception notification, and the display screen is occupied by a predetermined program running on the mobile phone, even if the smart watch is notified that the mobile phone has received a message, In order to check the contents of the message, it is necessary to temporarily stop the operation of a predetermined program on the mobile phone.

The present invention has been made in view of the above situation, and an object of the present invention is to provide an information processing device, a program, and an information communication method that can determine notification contents according to the operating status of the program.

To achieve the above object, an information processing device according to one embodiment of the present invention includes:
a communication unit capable of receiving message information including at least one of text, image, and audio from the outside and communicating with an external electronic device;
a control unit that determines whether or not at least a predetermined program for outputting an image is running regarding the own device;
Equipped with
The control unit is capable of switching the format of information to be transmitted to the external electronic device via the communication unit based on the result of the operation determination , and when the predetermined program is running, , the message information is transmitted to the external electronic device via the communication unit, and when the predetermined program is not running, incoming notification information indicating that the message information has been received is sent to the external electronic device. transmitting it to via the communication unit,
It is characterized by

According to the present invention, it is possible to provide an information processing device, a program, and an information communication method that can determine notification content according to the operating status of a program.

1 is a schematic diagram of an information communication system to which a user terminal and a wearable terminal according to an embodiment of the present invention are applied. 1 is a block diagram showing a hardware configuration of a user terminal according to an embodiment of the present invention. FIG. FIG. 1 is a functional block diagram showing part of the functional configuration of a user terminal according to an embodiment of the present invention. FIG. 1 is a block diagram showing a hardware configuration of a wearable terminal according to an embodiment of the present invention. FIG. 1 is a functional block diagram showing part of the functional configuration of a wearable terminal according to an embodiment of the present invention. FIG. 3 is a schematic diagram illustrating communication processing by a user terminal and a wearable terminal according to an embodiment of the present invention. 2 is a flowchart illustrating an example of the flow of communication processing by a user terminal according to an embodiment of the present invention. 2 is a flowchart illustrating an example of the flow of communication processing by a user terminal according to an embodiment of the present invention. It is a flowchart which shows an example of the flow of communication processing by a wearable terminal concerning one embodiment of the present invention. It is a schematic diagram of an information communication system to which a user terminal and a wearable terminal according to a modification are applied. 12 is a flowchart illustrating an example of the flow of display mode switching processing by a user terminal according to a modification. 12 is a flowchart illustrating an example of the flow of an incoming call notification process by a user terminal according to a modification. 12 is a flowchart illustrating an example of the flow of an incoming call notification process by a wearable terminal according to a modification.

Embodiments of the present invention will be described below with reference to the drawings.

<Information and communication system>
An overview of the information communication system S will be explained. FIG. 1 is a schematic diagram of an information communication system S to which a user terminal 30 and a wearable terminal 60 according to an embodiment of the present invention are applied. Note that the system here refers to an overall device composed of a plurality of devices, a plurality of means, and the like. Further, the user terminal 30 is, for example, a portable computer such as a smartphone or a tablet. The wearable terminal 60 is, for example, a wearable information processing device such as a smart watch.

The information communication system S of this embodiment is realized by a user terminal 30 and a wearable terminal 60 that perform communication processing. The user terminal 30 can receive text information such as email from an external electronic device via the network 1 such as the Internet. Further, the user terminal 30 performs pairing with the wearable terminal 60 to transmit and receive various information via short-range communication.

<User terminal>
Next, an example of the user terminal 30 will be described. FIG. 2 is a block diagram showing the hardware configuration of the user terminal 30 according to an embodiment of the present invention.

As shown in FIG. 2, the user terminal 30 includes a CPU (Central Processing Unit) 31, a ROM (Read Only Memory) 32, a RAM (Random Access Memory) 33, a bus 42, an input/output interface 43, and an input/output interface 43. The computer includes a section 34, an output section 35, a storage section 36, a communication section 37, a GNSS section 38, an acceleration sensor 39, a battery 41, and a short-range communication section 45.

The CPU 31, ROM 32, and RAM 33 are interconnected via a bus 42. The CPU 31 executes various processes according to programs recorded in the ROM 32 or programs loaded into the RAM 33.

Bus 42 is also connected to input/output interface 43. An input section 34 , an output section 35 , a storage section 36 , a communication section 37 , a GNSS section 38 , an acceleration sensor 39 , a battery 41 , and a short-range communication section 45 are connected to the input/output interface 43 . has been done.

The input section 34 and the output section 35 are user interfaces that are electrically connected to the input/output interface 43 by wire or wirelessly. The input unit 34 includes, for example, a keyboard and a mouse, and the output unit 35 includes a display that displays images, a speaker that amplifies audio, and the like. Note that the output section 35 and the input section 34 may have a structure in which the display function and the input function are integrated like a touch panel.

The storage unit 36 is composed of a semiconductor memory such as a DRAM (Dynamic Random Access Memory), and is a device that stores various data of the user terminal 30.

The communication unit 37 is a device through which the CPU 31 communicates with other computers via a network such as the Internet.

The GNSS unit 38 is a positioning information acquisition unit for acquiring position information. GNSS is an abbreviation for Global Navigation Satellite System, and the GNSS unit 38 uses a satellite positioning system such as GPS. The GNSS unit 38 includes an antenna, and specifies its own position by performing positioning based on positioning satellite signals transmitted from a plurality of positioning satellites.

The acceleration sensor 39 is a device that detects movement and acceleration in any direction. For example, the acceleration sensor 39 is a three-axis sensor of a capacitance type or a piezoresistive element type, and detects acceleration occurring in each of the three axis directions.

The battery 41 supplies power to the user terminal 30. For example, the battery 41 is composed of a lithium ion battery.

The short-range communication unit 45 is a device that communicates with the wearable terminal 60. The short-range communication unit 45 communicates with the wearable terminal 60 using a communication method based on communication standards such as BLE (Bluetooth (registered trademark) Low Energy) and Wi-Fi (Wireless Fidelity), for example.

Next, the functional configuration of the user terminal 30 will be explained. FIG. 3 is a functional block diagram showing a functional configuration for performing communication processing among the functional configurations of the user terminal 30 according to an embodiment of the present invention.

A control unit 50 that performs various controls on the user terminal 30 is realized by a CPU 31 that performs arithmetic processing.

The control unit 50 of this embodiment includes a communication processing unit (communication processing function) 51, an output processing unit (output processing function) 52, an input processing unit (input processing function) 53, and a state determination unit (state determination function). 54.

The communication processing unit 51 executes processing for communicating with an external device via the communication unit 37 and executes processing for exchanging various information with the wearable terminal 60 via the short-range communication unit 45.

The output processing unit 52 executes processing for displaying an image on the output unit 35 of the user terminal 30. For example, the output processing section 52 executes a process of displaying text information input by an input processing section 53, which will be described later, on the output section 35.

The input processing unit 53 executes processing for accepting operations on the input unit 34 by the user. For example, the input processing unit 53 executes a process of accepting text information input by a user.

The status determination unit 54 executes processing for determining the status of the program being operated by the control unit 50. Further, the status determining unit 54 performs a process of reflecting incoming notification information indicating that a message has been received from the outside on an image displayed on the output unit 35. The incoming call notification information is, for example, a pop-up display displaying the title and part of the message body. When the communication processing unit 51 receives message information from the outside via the communication unit 37, the status determination unit 54 extracts the title and part of the message body from the message information and generates incoming call notification information. The state determining unit 54 instructs the output processing unit 52 to reflect the generated call notification information in the image displayed on the output unit 35. This process will be described later.

<Wearable device>
Next, an example of the wearable terminal 60 will be described. FIG. 4 is a block diagram showing the hardware configuration of the wearable terminal 60 according to an embodiment of the present invention.

The wearable terminal 60 of this embodiment includes a CPU 61, a ROM 62, a RAM 63, an input section 64, an output section 65, a storage section 66, a communication section 67, a GNSS section 68, an acceleration sensor 69, and a biological sensor. 70, a battery 71, a bus 72, an input/output interface 73, and a short-range communication section 75. Note that configurations that are common or similar to those already described may be given the same names and detailed explanations may be omitted.

The biosensor 70, which is a configuration that the user terminal 30 does not have, will be described. The biological sensor 70 is a biological information acquisition device that acquires biological information of a user. The biological information is information such as the user's pulse and whether or not the wearable terminal 60 is in contact with the user's skin.

The biosensor 70 of this embodiment is arranged on the back side (the side that comes into contact with the user) of the wearable terminal 60. The biological sensor 70 used is, for example, an optical type or a current detection type based on electric current. In the case of an optical type, the biosensor 70 detects the user's biometric information by emitting light onto the user's skin and measuring the reflected light. In the case of a current detection type, the biosensor 70 acquires biometric information by directly detecting a weak current in the user's skin, or uses a bioimpedance method, etc. that measures heartbeat by passing a weak current through the skin. Obtain biological information.

Next, the functional configuration of wearable terminal 60 will be explained. FIG. 5 is a functional block diagram showing part of the functional configuration of wearable terminal 60 according to an embodiment of the present invention.

A control unit 80 that performs various controls on the wearable terminal 60 is realized by a CPU 61 that performs arithmetic processing. The control unit 80 of this embodiment includes a communication processing unit (communication processing function) 81, an output processing unit (output processing function) 82, an input processing unit (input processing function) 83, and a position information acquisition unit (location information acquisition function) 84, a biological information acquisition section (biological information acquisition function) 85, and a state determination section (state determination function) 86.

The communication processing unit 81 executes processing for exchanging various information with external devices via the communication unit 67 and executes processing for exchanging various information with the user terminal 30 via the short-range communication unit 75.

The output processing unit 82 executes processing for displaying an image on the output unit 65 of the wearable terminal 60. For example, the output processing unit 82 executes a process of displaying information acquired from the user terminal 30, or displaying information acquired by a biometric information acquisition unit 85, which will be described later.

The input processing unit 83 executes processing for accepting operations on the input unit 64 by the user. For example, the input processing unit 83 executes a process of switching information to be displayed based on the information displayed on the output unit 65.

The position information acquisition unit 84 executes a process of acquiring second position information indicating the current position of the wearable terminal 60 based on the positioning signal detected by the GNSS unit 68.

The biological information acquisition unit 85 acquires biological information such as information indicating the user's pulse and information indicating whether the user is wearing the wearable terminal 60 based on the signal acquired from the biological sensor 70.

The status determination unit 86 executes a process for the status determination unit 54 of the user terminal 30 to acquire information for determining the status of the program being operated by the control unit 50 . Further, the state determining unit 86 performs a process of reflecting the incoming call notification information received from the user terminal 30 on the image displayed on the output unit 65. For example, when the communication processing unit 81 receives incoming notification information from the user terminal 30 via the communication unit 67, the status determination unit 86 instructs the output processing unit 82 to display the incoming notification information on the output unit 65. Reflect it on the image. This process will be described later.

<Example of communication processing>
Next, an example of communication processing to which the present invention is applied will be described. In the present embodiment, the state determining unit 54 determines whether a predetermined program is running in order to switch the format of information transmitted to the wearable terminal 60 depending on the state of the wearable terminal 60 . The transmission information is acquired or generated by a second program different from the predetermined program. The second program is, for example, a mail application, a messenger application, etc. that manages e-mail. The predetermined program is stored in advance in the storage unit 36 as a criterion.

An example of a predetermined program will be explained. The predetermined program may be, for example, application software (hereinafter simply referred to as "app"), or may be a predetermined state when the application is started. In other words, it may be a part of the operation (program) while the application is running. For example, the predetermined program may be a program that displays the contents of the application on the output unit 35 in full screen while the application is running. Furthermore, the predetermined program may be a program that is executed on the own device, which is different from the application. For example, the predetermined program may be a program that determines whether the screen of the output unit 35 is occupied by a camera image or a moving image based on the display area.

Next, an example of a predetermined program will be explained. FIG. 6 is a schematic diagram illustrating communication processing between the user terminal 30 and the wearable terminal 60 according to an embodiment of the present invention. In the example shown in FIG. 6, a control application that is application software for controlling the drone 90 is set as a predetermined program.

The drone 90 has a short-range communication unit (not shown). The drone 90 is capable of short-range communication with the user terminal 30 via the short-range communication unit. Furthermore, the wearable terminal 60 is worn on the user's arm. Further, the user terminal 30 is held by a user. Furthermore, the above-mentioned operation application is installed on the user terminal 30.

When the piloting application is started, the output processing unit 52 causes the output unit 35 to display the controller display of the drone 90. The user operates the drone 90 via short-range communication by touching the controller display. While the pilot application is running, the screen of the output unit 35 is occupied by the controller display of the drone 90.

In the above situation, communication processing between the user terminal 30 as a smartphone and the wearable terminal 60 as a smart watch (SW terminal) will be explained using flowcharts shown in FIGS. 7 to 9. This communication process is started when the user terminal 30 and the wearable terminal 60 perform pairing. 7 and 8 are flowcharts illustrating the flow of communication processing executed by the user terminal 30 having the functional configuration shown in FIG. FIG. 9 is a flowchart illustrating the flow of communication processing executed by wearable terminal 60 having the functional configuration shown in FIG.

First, the processing of the user terminal 30 will be explained. As shown in FIG. 7, the state determining unit 54 determines whether the control unit 50 is operating the piloting application (step S10). If the operation of the piloting application is confirmed (step S10: Yes), the state determining unit 54 sends a notification that the piloting application has started (hereinafter referred to as an application start notification) to the communication processing unit 51 of the wearable terminal 60. (Step S11). Next, the status determining unit 54 determines whether the communication processing unit 51 is receiving a message from an external device (step S12).

If the communication processing unit 51 has received a message from an external device (step S12: Yes), the status determination unit 54 sends the communication processing unit 51 incoming call notification information (hereinafter referred to as (also simply referred to as "notification text information") is generated and transmitted to the wearable terminal 60 (step S13). Next, the state determining unit 54 transmits information indicating the content of the received message (hereinafter simply referred to as "content text information") to the wearable terminal 60 (step S14), and the state determining unit 54 continues the process to step S12. Transition to

On the other hand, if the communication processing unit 51 has not received a message from an external device (step S12: No), the state determination unit 54 determines whether the operation of the piloting application has ended (step S15). If the operation of the pilot application has not ended (step S15: No), the state determination unit 54 moves the process to step S12. If the operation of the operation application has ended (step S15: Yes), the communication processing unit 51 transmits a notification that the operation application has ended (hereinafter referred to as application termination notification) to the wearable terminal 60 (step S16), The state determination unit 54 ends the communication process.

Next, a case will be described in which the operation of the pilot application cannot be confirmed in step S10. If the operation of the pilot application cannot be confirmed in step S10 (step S10: No), the state determination unit 54 moves the process to step S22. Subsequently, as shown in FIG. 8, the status determining unit 54 determines whether the communication processing unit 51 is receiving a message from an external device (step S22). If the communication processing unit 51 has received a message from an external device (step S22: Yes), the status determination unit 54 causes the communication processing unit 51 to transmit notification text information to the wearable terminal 60 (step S23), The process moves to step S22. If the communication processing unit 51 has not received a message from an external device (step S22: No), the status determination unit 54 ends the communication process.

Next, the processing of the wearable terminal 60 will be explained. As shown in FIG. 9, when the communication processing unit 81 receives the application start notification (step S30: Yes), the output processing unit 82 shifts to the full text reception standby mode (step S31). When the output processing unit 82 is executing the mode, when the communication processing unit 81 receives the content text information from the user terminal 30, it is possible to cause the output unit 65 to display the content text information on the screen. .

Next, the state determining unit 86 determines whether the communication processing unit 81 has received the notification text information (step S32). When the communication processing unit 81 receives the notification text information (step S32: Yes), the output processing unit 82 displays an incoming notification of the received message and a selection screen for displaying the content of the received message. It is displayed on the output section 65 (step S33). Note that the displayed selection screen is also an input section 64 that allows the user to input selection details by touching it.

If the full text message is not to be displayed (step S34: No), the state determination unit 86 moves the process to step S32. When displaying the full text message (step S34: Yes), the output processing unit 82 causes the output unit 65 to display the content of the message (step S35), and the state determining unit 86 moves the process to step S32.

On the other hand, if the communication processing unit 81 has not received the notification text information (step S32: No), the state determination unit 86 determines whether or not an application termination notification has been received (step S36). If the application termination notification is not received (step S36: No), the state determination unit 86 moves the process to step S32. When an application termination notification is received (step S36: Yes), the output processing unit 82 terminates the full text receiving mode (step S37), and the state determination unit 86 terminates the communication process.

The user terminal 30 configured as described above includes a communication unit 37 that communicates with the wearable terminal 60, and a control unit that determines whether or not a predetermined program that outputs images or sounds is running regarding the user terminal 30. 50, the control unit 50 switches the format of the information transmitted to the wearable terminal 60 via the communication unit 37 or stops transmitting the information to the wearable terminal 60, based on the result of the operation determination. Further, the information to be transmitted is acquired or generated by a second program different from the predetermined program.

Thereby, the notification content can be determined according to the operating status of the program. Additionally, notification contents can be sent to external electronic devices according to the operating status of the program.

Furthermore, in the user terminal 30 according to the present embodiment, the communication processing unit 51 can receive message information including at least one of text, images, and audio from the outside, and the control unit 50 can receive message information including at least one of text, images, and audio. is operating, the message information is transmitted to the wearable terminal 60 via the communication processing unit 51, and when the predetermined program is not operating, the wearable terminal transmits incoming notification information indicating that the message information has been received. 60 via the communication processing unit 51.

As a result, when a message including at least one of text and images is received from the outside while a predetermined program is running on the user terminal 30 and the display screen is occupied, the user can use the predetermined program on the user terminal 30 to The message can be checked on the wearable terminal 60 while the program is running. Further, when the message is received while the predetermined program is not running, the information sent to the wearable terminal 60 can be an incoming call notification instead of the message, and power consumption can be further suppressed.

Further, the user terminal 30 according to the present embodiment includes an output unit 35 capable of displaying an image, and the control unit 50 determines that a predetermined program is running when the screen of the output unit 35 is occupied. judge.

Thereby, in the user terminal 30 according to the present embodiment, it can be determined whether the program running in the control unit 50 is a program that occupies the screen.

Further, in the user terminal 30 according to the present embodiment, the predetermined program is a program for operating the drone 90.

As a result, in the user terminal 30 according to the present embodiment, when a message is received from the outside while the program for operating the drone 90 is running, the user can use the wearable terminal while the program for operating the drone 90 is running. The message can be confirmed at 60.

The wearable terminal 60 according to the present embodiment also includes a communication processing unit 81 that communicates with the user terminal 30, an output unit 65 that displays an image, and an output unit that displays display information received from the user terminal 30 via the communication unit 67. 65, and when the control unit 80 receives operation information indicating that a predetermined program is running on the user terminal 30, the control unit 80 executes a process to be displayed on the user terminal 30 based on the operation information. Switch the format of displayed information.

As a result, even if a predetermined program is operating on the user terminal 30 and the display screen is occupied, the received message can be more easily confirmed without temporarily stopping the operation of the predetermined program.

In this embodiment, after transmitting the notification text information and content text information from the communication processing unit 51 of the user terminal 30 to the wearable terminal 60, the output processing unit 82 of the wearable terminal 60 displays the full text on the output unit 65. Although switching is performed as to whether or not to transmit the content text information, it may be possible to switch whether or not to transmit the content text information at the timing when the communication processing unit 51 in the user terminal 30 transmits it to the wearable terminal 60.

Furthermore, in the present embodiment, when the user terminal 30 receives a message while operating the drone 90 operating application, the wearable terminal 60 determines whether to display the entire text of the received message. The message to be displayed may be a part of the message instead of the entire text. Furthermore, in the present embodiment, when the user terminal 30 receives a message while operating the drone 90 operating application, the wearable terminal 60 determines whether to display the entire text of the received message. You may perform a process of displaying the information as it is without making any judgment.

Further, in the present embodiment, when the user terminal 30 receives a message while the operation application for the drone 90 is operating, the user terminal 30 transmits the notification text information from the communication processing unit 51 to the wearable terminal 60, and also sends the content text. Although information is being sent, it is not necessary to send content text information. Further, when the user terminal 30 receives a message while the drone 90 piloting application is operating, the user terminal 30 transmits only the content text information without transmitting the notification text information from the communication processing unit 51 to the wearable terminal 60. You can. Furthermore, in the present embodiment, when the user terminal 30 receives a message while the drone 90 piloting application is operating, the wearable terminal 60 displays the notification text information and switches whether or not to display the full text. However, it is also possible to only switch between displaying the full text and not displaying the notification text information.

Further, in this embodiment, the received message is text, but it may be information other than text, such as graphics or audio data. For example, if the user terminal 30 is outputting other audio data such as music when receiving audio data, the user terminal 30 transfers the received audio data to the wearable terminal 60 and outputs the audio data on the wearable terminal 60. can be output. In this case, the predetermined program may be an application that plays music or the like, or a program that causes the output unit 35 to output audio while the application is running. In addition, in the present embodiment, a case has been described in which a piloting application for the drone 90 is in operation, but applications that occupy part or all of the screen of the user terminal 30, such as a calling application, a video shooting application, or a video playback application, have been described. The present invention can also be applied to applications and game applications.

<Modified example>
In the embodiment described above, when the user terminal 30 receives a message while an application that occupies part or all of the screen of the user terminal 30 is operating, the user terminal 30 transmits notification text information as incoming call notification information to the wearable terminal 60. In addition, the user terminal 30 can be set to a call notification non-display mode in which the message notification is not displayed on the screen.

FIG. 10 is a schematic diagram of an information communication system S to which a user terminal 30 and a wearable terminal 60 according to a modification are applied. The information communication system S according to the modification includes a user terminal 30 that performs communication processing, a wearable terminal 60, a projector 100, and a screen 101. The projector 100 is a device that can perform pairing with the user terminal 30 and project an image received from the user terminal 30 via short-range communication onto the screen 101.

Note that the communication method between the projector 100 and the user terminal 30 is not limited to short-range communication, and may be a communication method via an information communication network such as a LAN or the Internet, for example. Further, since the hardware configuration and functional configuration of the user terminal 30 and the wearable terminal 60 according to the modification are similar to those of the first embodiment, they will be given the same names and detailed explanations will be omitted.

In the example shown in FIG. 10, the same content as the presentation application displayed on the user terminal 30 is projected onto the screen 101 by the projector 100. Therefore, when the user terminal 30 receives a message during a presentation, an incoming call notification displaying the title and part of the message body will be displayed on the screen of the output unit 35.

That is, the incoming call notification is also projected onto the screen 101 via the projector 100 by the operation of the projector projection application of the user terminal 30. Therefore, a third party receiving the presentation can also view the information through the incoming call notification projected on the screen 101, and there is a risk that unintended information may be disclosed. Therefore, the user terminal 30 according to the modified example has a function of performing a display mode switching process to switch the display mode of the incoming call notification to the non-display mode when the projection by the projector projection application is being performed. Even if the user terminal 30 unintentionally receives a message while the projector projection application is performing projection, the incoming call notification will not be displayed on the screen of the output unit 35 due to the non-display mode setting. That is, the notification of the arrival of the message is not projected from the projector 100 onto the screen 101.

Further, the user terminal 30 executes an incoming call notification process that sends an incoming notification of the message to the wearable terminal 60, and the wearable terminal 60 executes an incoming call notification process that displays an incoming notification on the screen based on the sent incoming call notification information. and notify the user of the incoming call.

Next, the display mode switching process executed by the user terminal 30 according to this embodiment will be described using FIG. 11. FIG. 11 is a flowchart illustrating an example of the flow of display mode switching processing by the user terminal 30 according to the modification. The display mode switching process is started at the timing when the input processing unit 53 receives an operation to start the projector projection application inputted to the input unit 34.

First, the state determining unit 54 checks whether the projector projection application has started a projection operation (step S40). When the projector projection application starts the projection operation (step S40: YES), the state determination unit 54 sets the message incoming hidden display mode to ON (step S41). Next, the state determining unit 54 checks whether the projector projection application has finished projecting (step S42).

If the projector projection application has finished projecting (step S42: YES), the state determination unit 54 sets the message incoming hidden display mode to OFF (step S43). Next, the state determining unit 54 checks whether the projector projection application has ended (step S44). If the projector projection application has not ended (step S44: NO), the state determination unit 54 moves the process to step S40. On the other hand, if the projector projection application has ended (step S44: YES), the state determination unit 54 ends the process.

Next, the incoming call notification process executed by the user terminal 30 according to this embodiment will be described using FIG. 12. FIG. 12 is a flowchart illustrating an example of the flow of incoming call notification processing by the user terminal 30 according to the modification. The incoming call notification process is started at the timing when the user terminal 30 becomes ready to receive a call. An example of the timing when the user terminal 30 becomes ready to receive a call is the timing when the user terminal 30 is powered on.

First, the status determination unit 54 determines whether a message has been received (step S50). Next, the state determining unit 54 checks whether the non-display mode for message arrival notification is ON or OFF (step S51). If the message incoming notification non-display mode is ON (step S51: YES), the state determination unit 54 moves the process to step S53.

On the other hand, if the message incoming notification hiding mode is OFF (step S51: NO), the status determination unit 54 instructs the output processing unit 52 to display the incoming notification on the screen of the output unit 35 (step S52). . Next, the state determining unit 54 instructs the communication processing unit 51 to transmit the incoming call notification information to the wearable terminal 60 as a smart watch (SW terminal) via the communication unit 37 (step S53).

Next, the state determining unit 54 checks whether the user terminal 30 is in a state where it can receive a call (step S54). An example of a state in which it is not possible to receive a call is a state in which the power of the user terminal 30 is turned off. If the user terminal 30 is in a state where it can receive a call (step S54: YES), the state determination unit 54 moves the process to step S50. On the other hand, if the user terminal 30 is not in a state where it can receive a call (step S54: NO), the state determination unit 54 ends the process.

Note that the incoming call processing by the state determination unit 54 according to the modification is not limited to the above-mentioned example. For example, when the user terminal 30 is in the non-display mode, the main text of the email is not displayed on the screen of the output unit 35 of the user terminal 30, so the status determination unit 54 sends the content text information to the wearable terminal 60 as a message containing the entire text of the email. You may also send. Note that although incoming call notification information notifying that an incoming call has arrived is projected on the screen of the output unit 35 on the projector 100, the main text of the email is not displayed. Further, when the user terminal 30 is not in the non-display mode, the state determining unit 54 causes the content text information to be displayed on the screen of the output unit 35 of the user terminal 30 and sends the message to the wearable terminal 60 without sending the entire message. The information may be limited to only message notification information.

Further, the state determination unit 54 according to the modification may transmit incoming call notification information to the wearable terminal 60 when the user terminal 30 is in the non-display mode. Further, the state determination unit 54 does not need to transmit the incoming call notification information to the wearable terminal 60 when the user terminal 30 is not in the non-display mode. In other words, the state determination unit 54 may stop transmitting information to the wearable terminal 60 while the projector projection application is not operating.

Next, the incoming call notification process executed by the wearable terminal 60 according to this embodiment will be described using FIG. 13. FIG. 13 is a flowchart illustrating an example of the flow of incoming call notification processing by the user terminal 30 according to the modification. The incoming call notification process is started at the timing when the wearable terminal 60 is paired with the user terminal 30.

First, the state determining unit 86 checks whether the communication processing unit 81 has received incoming call notification information from the user terminal 30 via the short-range communication unit 75 (step S60). If the communication processing unit 81 has not received the incoming call notification information (step S60: NO), the state determination unit 86 moves the process to step S62. On the other hand, if the communication processing unit 81 has received the incoming call notification information (step S60: YES), the status determining unit 86 instructs the output processing unit 82 to display the incoming notification information on the screen of the output unit 65 (step S60: YES). S61).

Next, the status determination unit 86 checks whether the communication processing unit 81 is performing pairing processing with the user terminal 30 (step S62). If the communication processing unit 81 is performing the pairing process with the user terminal 30 (step S62: YES), the state determination unit 86 moves the process to step S60. On the other hand, if the communication processing unit 81 is not performing the pairing process with the user terminal 30 (step S62: NO), the state determination unit 86 ends the process.

In the user terminal 30 according to the modified example configured as described above, the control unit 50 stops transmitting information to the wearable terminal 60 when a predetermined program is not running.

As a result, in the user terminal 30 according to the present embodiment, when a predetermined program is not running, the communication unit 37 stops the information transmission operation itself, and eliminates unnecessary exchange of information such as transmission and reception to the wearable terminal 60. can.

Further, the user terminal 30 according to the modified example includes an output section 35 capable of displaying an image, and a predetermined program is a projector projector that performs a process of displaying the image displayed on the screen of the output section 35 on an external projector 100. It's an app.

As a result, in the user terminal 30 according to the present embodiment, when a message is received from the outside while the projector projection application is in operation, the user can check the message on the wearable terminal 60 while the projector projection application is in operation. In addition, when the projector projection application is in operation, the information transmission operation itself can be stopped to prevent information from being unintentionally projected by the projector 100.

In addition, the control unit 50 does not reflect the incoming call notification information indicating that a message has been received in the image displayed on the output unit 35 while the projector projection application is operating, and does not reflect the incoming call notification information indicating that a message has been received in the image displayed on the output unit 35 while the projector projection application is not operating. Now, the incoming call notification information is reflected in the image displayed on the output unit 35.

As a result, in the user terminal 30 according to the present embodiment, when a message is received from the outside while the projector projection application is in operation, a message that is unintentionally received by a third party due to the image projected by the projector, etc. You can prevent it from being seen.

Note that in this modification, the display mode switching process to switch to non-display mode was performed when the projector projection application was executed, but this is not limited to this. Display mode switching processing may be performed to switch to non-display mode.

An embodiment and a modified example of the present invention have been described above. The present invention is not limited to this embodiment or modification. The above-described embodiments and modifications may be combined, and modifications, improvements, etc. within the scope of achieving the object of the present invention are included in the present invention.

Some of the steps described with reference to the flowcharts above may be omitted, steps may be added as appropriate, or conditions may be combined.

In addition, the functional configuration in this embodiment is realized by a processor that executes arithmetic processing, and processors that can be used in this embodiment include various processing units such as a single processor, a multiprocessor, and a multicore processor. In addition to those described above, the present invention includes those in which these various processing devices are combined with processing circuits such as ASIC (Application Specific Integrated Circuit) and FPGA (Field-Programmable Gate Array).

The series of processes described above can be executed by hardware or by software. In other words, the functional configurations shown in the above embodiments and modifications are merely examples, and are not particularly limited. That is, it is sufficient to have a function that can execute the series of processes described above as a whole, and what kind of functional blocks are used to realize this function is not particularly limited to the above-described embodiments or modified examples. Further, one functional block may be configured by a single piece of hardware, a single piece of software, or a combination thereof.

When a series of processes is executed by software, a program constituting the software is installed on a computer or the like from a network or a recording medium. The computer may be a computer built into dedicated hardware. Further, the computer may be a computer that can execute various functions by installing various programs, such as a general-purpose personal computer.

Furthermore, the recording medium containing the program is not only distributed separately from the device itself in order to provide the program to the user, but also includes a recording medium etc. that is provided to the user in a state that is pre-installed in the device body. You can. In addition, the step of writing a program to be recorded on a recording medium includes not only processes that are performed in chronological order, but also processes that are not necessarily performed in chronological order but are executed in parallel or individually. It also includes.

Furthermore, the hardware configurations shown in the above embodiments and modified examples are merely examples, and the present invention is not particularly limited to these configurations. In addition to those composed of individual processing devices such as single processors, multiprocessors, and multi-core processors, these various processing devices are combined with processing circuits such as ASIC (Application Specific Integrated Circuit) and FPGA (Field-Programmable Gate Array). The processor may be used as a processor to realize a functional configuration.

Below, the invention described in the original claims of this application will be added.
[Additional note 1]
a communication section that communicates with external electronic equipment;
A control unit that determines whether or not a predetermined program that outputs images or sounds is running regarding the own machine;
Equipped with
The information processing is characterized in that the control unit switches the format of information transmitted to the electronic device via the communication unit or stops transmitting information to the electronic device based on the result of the operation determination. Device.
[Additional note 2]
The information processing device according to supplementary note 1, wherein the information is acquired or generated by a second program different from the predetermined program.
[Additional note 3]
The communication unit is capable of receiving message information including at least one of text, image, and audio from the outside,
The control unit includes:
While the predetermined program is running, transmitting the message information to the electronic device via the communication unit,
Information according to appendix 1 or 2, characterized in that when the predetermined program is not operating, incoming notification information indicating that the message information has been received is transmitted to the electronic device via the communication unit. Processing equipment.
[Additional note 4]
Equipped with a display section that can display images,
The control unit includes:
4. The information processing apparatus according to any one of appendixes 1 to 3, wherein the predetermined program is determined to be running when the screen of the display unit is occupied.
[Additional note 5]
5. The information processing device according to any one of appendices 1 to 4, wherein the predetermined program is a program for operating a drone.
[Additional note 6]
The information processing device according to appendix 1 or 2, wherein the control unit stops transmitting information to the electronic device when the predetermined program is not running.
[Additional note 7]
Equipped with a display section that can display images,
7. The information processing apparatus according to any one of appendices 1 to 6, wherein the predetermined program is a program that performs a process of displaying an image to be displayed on the screen of the display unit on an external display device.
[Additional note 8]
The control unit includes:
While the predetermined program is running, incoming call notification information indicating that message information including at least one of text, image, and audio has been received is not reflected in the image displayed on the display unit;
8. The information processing apparatus according to appendix 7, wherein when the predetermined program is not operating, the incoming call notification information is reflected in an image displayed on the display unit.
[Additional note 9]
a communication unit that communicates with an external information processing device;
a display section that displays an image;
a control unit that executes a process of displaying display information received from the external information processing device via the communication unit on the display unit,
The control unit includes:
An information processing device characterized in that, when operating information indicating that a predetermined program is running on the external information processing device is received, a format of information to be displayed is switched based on the operating information.
[Additional note 10]
to the computer,
A communication function that communicates with external electronic devices,
Executing a control function for determining whether or not a predetermined program for outputting images or sounds is running regarding the own machine;
The control function is a program that controls switching the format of information transmitted to the electronic device by the communication function or stopping the transmission of information to the electronic device based on the result of the operation determination.
[Additional note 11]
An information communication method executed by an information processing device, the method comprising:
a communication step for communicating with an external electronic device;
a control step of determining whether or not a predetermined program for outputting images or sounds is running regarding the own machine;
In the control step, the information communication method performs control to switch the format of the information to be transmitted to the electronic device in the communication step or to stop transmitting the information to the electronic device based on the result of the operation determination.
[Additional note 12]
to the computer,
A communication function that communicates with an external information processing device,
A display function that displays images,
a control function that executes a process of displaying display information received from an external information processing device using the display function;
The control function includes:
When operating information indicating that a predetermined program is running on the information processing device is received, a program that performs control to switch a format of information to be displayed based on the operating information.
[Additional note 13]
An information communication method executed by an information processing device, the method comprising:
a communication step for communicating with an external information processing device;
a display step for displaying the image;
a control step that executes a process of displaying display information received from an external information processing device in the display step;
In the control step,
When operating information indicating that a predetermined program is running on the information processing device is received, an information communication method performs control to switch a format of information to be displayed based on the operating information.

30 User terminal 50 Control unit 51 Communication processing unit 60 Wearable terminal 65 Output unit 80 Control unit 81 Communication processing unit

Claims (8)

a communication unit capable of receiving message information including at least one of text, images, and audio from the outside and communicating with an external electronic device;
a control unit that determines whether or not at least a predetermined program for outputting an image is running regarding the own device;
Equipped with
The control unit is capable of switching the format of information to be transmitted to the external electronic device via the communication unit based on the result of the operation determination, and when the predetermined program is running, , the message information is transmitted to the external electronic device via the communication unit, and when the predetermined program is not running, incoming notification information indicating that the message information has been received is sent to the external electronic device. transmitting it to via the communication unit,
An information processing device characterized by: The information processing apparatus according to claim 1, wherein the information transmitted to the external electronic device is acquired or generated by a second program different from the predetermined program. The second program is an email app or a messenger app.
The information processing device according to claim 2, characterized in that: Equipped with a display section that can display images,
The control unit includes:
The information processing apparatus according to any one of claims 1 to 3, wherein the predetermined program is determined to be running when the screen of the display unit is occupied. The predetermined program is application software or operates while the application software is running;
5. The information processing apparatus according to claim 1, wherein the information processing apparatus is characterized in that: The information processing device according to any one of claims 1 to 5, wherein the predetermined program is a program for operating a drone. In the computer of the information processing device,
a communication function capable of receiving message information including at least one of text, image, and audio from the outside and communicating with an external electronic device;
Executing a control function for determining whether or not at least a predetermined program for outputting an image is running regarding the own machine;
The control function is capable of switching the format of information transmitted to the external electronic device by the communication function based on the result of the operation determination, and when the predetermined program is running, Message information is transmitted to the external electronic device, and when the predetermined program is not running, control is performed to transmit incoming notification information indicating that the message information has been received to the external electronic device. Featured programs. An information communication method executed by an information processing device, the method comprising:
a communication step of receiving message information including at least one of text, image, and audio from the outside and communicating with an external electronic device;
a control step of determining whether or not at least a predetermined program for outputting an image is running with respect to the own machine;
In the control step, it is possible to switch the format of information to be transmitted to the external electronic device in the communication step based on the result of the operation determination. Message information is transmitted to the external electronic device, and when the predetermined program is not running, control is performed to transmit incoming notification information indicating that the message information has been received to the external electronic device. Characteristic information communication method.

Images