JP6766589B2 - Cooperation system, information processing device, cooperation method and cooperation program - Google Patents

Description

The present invention relates to a cooperation system, an information processing device, a cooperation method and a cooperation program, and in particular, a cooperation system including an information processing device that executes processing in cooperation with a portable device carried by a user, the information processing device thereof, and information thereof. Regarding the cooperation method and cooperation program executed by the processing device.

In recent years, there has been known a technique for remotely controlling an image processing device such as an MFP (MultiFaction Peripheral) with a portable device such as a smartphone or a PDA (Personal Digital Assistant) carried by a user.

For example, in Japanese Patent Application Laid-Open No. 2008-123476, the operation of pressing the display surface of the liquid crystal panel is due to the user instructing whether the operation of pressing the display surface of the liquid crystal panel is due to the mobile information terminal being placed on the display surface. If it is determined that it is a mobile information terminal, a communication path is established with the mobile information terminal only while the mobile information terminal is placed on the display surface, and the processing menu screen for the mobile information terminal is displayed. It is stated that it should be done.

However, while the mobile information device terminal is placed on the liquid crystal panel, another process may be executed on the mobile information terminal, for example, by receiving an incoming call from the outside. When the user gives priority to another process on the mobile information terminal, the mobile information terminal may be operated away from the liquid crystal panel. When the mobile information terminal is operated away from the liquid crystal panel, the mobile information terminal may not be able to communicate with the image processing device. In this case, the settings of the mobile information terminal and the image processing device may not match. was there.
Japanese Unexamined Patent Publication No. 2008-123476

The present invention has been made to solve the above-mentioned problems, and one of the objects of the present invention is in the cooperation mode after the communication path established between the information processing device and the portable device is disconnected. It is to provide a cooperation system capable of matching the settings of the information processing device and the portable device.

Another object of the present invention is to provide an information processing device capable of matching the settings with the mobile device in the cooperation mode after the communication path established with the mobile device is disconnected.
Still another object of the present invention is to provide a cooperation method capable of matching the settings with the mobile device in the cooperation mode after the communication path established with the mobile device is disconnected.

Still another object of the present invention is to provide a cooperation program capable of matching the settings with the mobile device in the cooperation mode after the communication path established with the mobile device is disconnected.

In order to achieve the above-mentioned object, according to an aspect of the present invention, the cooperation system is a cooperation system including an information processing device and a portable device carried by a user, and the information processing device displays an image. A response command is received from the mobile device in response to the display means for detecting, the position detecting means for detecting the position where the object touches on the display surface of the display means, and the position where the mobile device touches by the position detecting means. In this case, the device detecting means for detecting the mobile device, the route establishing means for establishing a communication path between the mobile device, and the continuous state for detecting the continuous state based on the state of the portable device or the state of the own device. When a communication path is established between the detection means and the mobile device and the mobile device is detected by the device detection means, the mode is switched from the independent mode that does not cooperate with the mobile device to the cooperation mode that cooperates with the mobile device. , If the mobile device is not detected by the device detection means in the linked mode, the linked mode is continued if the continuous state is detected, and if the continuous state is not detected, the linked mode is switched to the independent mode, and the mobile device is carried in the linked mode. When the communication path established with the device is disconnected, the link mode switching means for switching from the link mode to the independent mode and the link mode are set in the mobile device, and the information processing device and the mobile device are linked. Pre-disconnection setting to acquire the mobile-side setting value used to execute the mobile-side processing defined as the processing to be executed by the mobile device among the cooperative processing that defines a series of multiple processes to be executed. When the communication path established between the value acquisition means and the device detection means is disconnected from the mobile device in the cooperation mode after the mobile device is no longer detected, the processing executed by the information processing device among the cooperation processes. Coordination from the stand-alone mode with the maintenance means that stores the device-side setting value and the pre-disconnection setting value last acquired by the pre-disconnection setting value acquisition means used to execute the device-side processing specified as When switching to the mode, the mobile device setting value set in the mobile device is acquired as the post-connection setting value, and the linkage process to be executed is performed based on the pre-disconnection setting value, the post-connection setting value, and the device side setting value. The mobile device side setting value and the device side setting value for executing the determined cooperation process are provided.

According to this aspect, when the continuous state is detected based on the state of the portable device or the state of the information processing device, and the portable device does not come into contact with the display surface of the display means, the continuous state is detected. Since the linked mode is continued and the continuous mode is switched to the independent mode when the continuous state is not detected, the operation mode can be changed depending on whether or not the continuous state is detected. Since the continuation state is detected based on the state of the portable device or the state of the information processing device, it is possible to easily determine whether or not to continue the cooperation mode. Also, to get the mobile side setting value set in the mobile device with linked mode as before cutting set value, in cooperation mode after the mobile device is no longer in contact with the display surface of the display unit, with the mobile device When the established communication path is disconnected, the device-side setting value and the pre-disconnection setting value are stored in association with the mobile device, and when switching from the independent mode to the linked mode, the mobile-side setting value set in the mobile device. Is acquired as the post-connection setting value, the linkage process to be executed is determined based on the pre-disconnection setting value, the post-connection setting value, and the device side setting value, and the mobile phone setting for executing the determined linkage process. Set the value and the device side setting value. Therefore, in the cooperation mode after the communication path established between the information processing device and the mobile device is disconnected, either before or after the communication path established between the information processing device and the mobile device is disconnected. At that point, the setting can be continued from the state set for each of the information processing device and the portable device. As a result, it is possible to provide a cooperation system capable of matching the settings of the information processing device and the portable device in the cooperation mode after the communication path established between the information processing device and the portable device is disconnected. Can be done.

According to another aspect of the present invention, the cooperation system is a cooperation system including an information processing device and a portable device carried by a user, and the information processing device establishes a communication path between the information processing device and the portable device. A single unit that does not cooperate with the mobile device depending on the establishment of the route establishment means, the continuous state detecting means that detects the continuous state based on the state of the portable device or the state of the own device, and the cooperation start condition corresponding to the portable device. A mobile device with a link mode switching means that switches from a mode to a link mode that links with a mobile device and switches to a stand-alone mode when a predetermined link end condition is satisfied in order to end the link mode in the link mode. It is set to, and is used to execute the mobile-side process defined as the process to be executed by the mobile device among the linked processes that define a series of multiple processes to be executed in cooperation with the information processing device and the mobile device. The pre-disconnection setting value acquisition means for acquiring the mobile-side set value as the pre-disconnection setting value and the cooperation end condition include disconnection of the communication path established with the mobile device, and are established with the mobile device. When the continuation state is detected at the stage where the cooperation mode switching means switches from the cooperation mode to the independent mode according to the disconnection of the communication path, it is defined as the processing executed by the information processing device among the cooperation processing. The maintenance means that stores the device-side setting value and the pre-disconnection setting value last acquired by the device-side setting value acquisition means for executing the device-side processing in association with the mobile device, and the mobile device in a single mode. When switching to the cooperation mode, the setting value on the mobile side set in the mobile device is acquired as the setting value after connection, and the cooperation to be executed is based on the setting value before disconnection, the setting value after connection, and the setting value on the device side. It is provided with a cooperation process determining means for determining a process and setting a mobile phone side setting value and a device side setting value for executing the determined cooperation process.

According to this aspect, the continuous state is detected based on the state of the portable device or the state of the information processing device, and the cooperation mode is changed to the independent mode according to the disconnection of the communication path established with the portable device. If the continuation state is detected at the stage of switching to, the device-side setting value and the pre-disconnection setting value are stored in association with the portable device. Then, when the mode is switched to the cooperation mode, the cooperation process to be executed is determined based on the post-connection setting value, the pre-disconnection setting value, and the device side setting value acquired from the mobile device, and the determined cooperation process is executed. Set the mobile phone side setting value and the device side setting value for this. Therefore, in the cooperation mode after the communication path established between the information processing device and the mobile device is disconnected, either before or after the communication path established between the information processing device and the mobile device is disconnected. At that point, the setting can be continued from the state set for each of the information processing device and the portable device. As a result, it is possible to provide a cooperation system capable of matching the settings of the information processing device and the portable device in the cooperation mode after the communication path established between the information processing device and the portable device is disconnected. Can be done.

Preferably, the information processing device further sets the device-side set value according to the operation received by the device-side reception means in the cooperation mode with the device-side reception means that accepts the operation by the user, and receives the device-side reception in the independent mode. The device side setting means that sets the device independent setting value used to execute the device independent processing different from the device side processing according to the operation received by the means, and the device side processing is linked with the mobile device according to the device side setting value in the cooperation mode. The mobile device is provided with a device-side execution means that executes the device-independent processing according to the device-independent setting value in the independent mode, and the portable device is received by the mobile-side reception means that accepts the operation by the user and the mobile-side reception means. When the mobile phone setting means for setting the mobile phone setting value or the mobile phone independent setting value used for executing the mobile phone independent processing other than the mobile phone processing according to the operation, and the information processing device is in the independent mode or the cooperation mode. However, it is provided with a mobile-side execution means that can execute the mobile-only processing and the information-processing device can execute the mobile-side processing in cooperation with the information-processing device in the cooperation mode.

Preferably, when the pre-disconnection set value and the post-connection set value are the same, the cooperation process determining means determines the cooperation process including the mobile phone side process determined by them and the device side process determined by the device side set value.

According to this aspect, the set values of the information processing device and the portable device can be made the same before and after the communication path established between the information processing device and the portable device is disconnected.

Preferably, when the pre-disconnection set value and the post-connection set value are different, the cooperative process determining means includes a first mobile-side process determined by the pre-disconnection set value and a device-side process determined by the device-side set value. The cooperation process, the second cooperation process including the second mobile phone side process determined by the set value after connection and the device side process determined by the device side set value are determined, and the first cooperation process and the second cooperation process are determined. Which one of them is selected by the user is determined.

According to this aspect, one of the first cooperation process and the second cooperation process selected by the user is determined, so that the user disconnects the communication path established between the information processing device and the mobile device. The setting can be continued from the state set in each of the information processing device and the portable device at any time before or after the information processing.

Preferably, the continuation state detecting means detects the continuation state when the mobile device is executing a predetermined application program.

According to this aspect, when the communication path is disconnected while the portable device is executing the predetermined application program, the information processing device and the portable device are used at any time before or after the communication path is disconnected. The setting can be continued from the state set for each.

Preferably, the predetermined application program is an application program different from the application program for executing the process in cooperation with the information processing apparatus.

Preferably, the continuous state detecting means has elapsed a predetermined time after the mobile device receives the mobile-side set value used for executing the mobile-side process defined as the process to be executed by the mobile device among the linked processes. If not, detect continuation status.

According to this aspect, the continuation state is detected when a predetermined time has not elapsed since the mobile device received the set value on the mobile device side, so that the user can process information in the mobile device after the communication path is disconnected. The settings for processing linked with the device can be continued.

Preferably, the continuous state detecting means detects the continuous state when a predetermined time has not elapsed since the device-side set value was received by the information processing apparatus .

According to this aspect, when the communication path is disconnected within a predetermined time after the device-side set value is received in the information processing apparatus, any time point before or after the communication path is disconnected. The setting can be continued from the state set for each of the information processing device and the portable device.

Preferably, the continuation state detecting means detects the continuation state when a hardware resource defect occurs.

According to this aspect, when the communication path is disconnected during the occurrence of a hardware resource defect, the information processing device and the portable device are set at any time before or after the communication path is disconnected. You can continue the setting from the state.

Preferably, the continuous state detecting means detects the continuous state when the remaining amount of the battery for storing the electric power for driving the portable device is equal to or less than a predetermined value.

According to this aspect, when the mobile device is not driven and the communication path is disconnected, the setting is made from the state set for each of the information processing device and the mobile device at any time before or after the communication path is disconnected. You can continue.

According to still another aspect of the present invention, the information processing device is a portable device by means of a display means for displaying an image, a position detecting means for detecting a position where an object comes into contact with the display surface of the display means, and a position detecting means. A device detection means for detecting a mobile device, a route establishment means for establishing a communication path between the mobile device, and a mobile device when receiving a response command from the mobile device in response to the detection of the contact position. A communication path has been established between the continuous state detecting means for detecting the continuous state and the portable device based on the state of the device or the state of the own device, and the portable device is detected by the device detecting means. In this case, switch from the independent mode that does not cooperate with the mobile device to the cooperation mode that cooperates with the mobile device, and if the mobile device is not detected by the device detection means in the cooperation mode, if the continuation state is detected, the cooperation mode is continued and continued. If the status is not detected, the cooperation mode is switched to the independent mode, and when the communication path established with the mobile device is disconnected in the cooperation mode, the cooperation mode switching means for switching from the cooperation mode to the independent mode and the cooperation mode Is set in the mobile device and executes the mobile-side process defined as the process to be executed by the mobile device among the linked processes that define a series of multiple processes to be executed in cooperation with the own device and the mobile device. Communication established between the pre-disconnection setting value acquisition means that acquires the mobile device set value used for the purpose as the pre-disconnection setting value and the mobile device in the cooperation mode after the mobile device is no longer detected by the device detection means. When the route is disconnected, the device-side setting value and the pre-disconnection setting value acquisition means used to execute the device-side process defined as the process to be executed by the own device among the linked processes is the pre-disconnection setting last acquired by the means. A maintenance means that stores the value in association with the mobile device, and when switching from the independent mode to the linked mode, the set value on the mobile side set in the mobile device is acquired as the set value after connection, and the set value before disconnection and after connection are obtained. Based on the set value and the device side setting value, the cooperation process determining means for determining the cooperation process to be executed and setting the mobile side setting value and the device side setting value for executing the determined cooperation process. Be prepared.

According to this aspect, it is possible to provide an information processing device capable of matching the settings with the mobile device in the cooperation mode after the communication path established with the mobile device is disconnected.

According to still another aspect of the present invention, the information processing device detects a continuation state based on a route establishing means for establishing a communication path with the mobile device and the state of the mobile device or the state of the own device. Depending on the continuation state detection means and the establishment of the cooperation start condition corresponding to the mobile device, it is predetermined to switch from the independent mode that does not cooperate with the mobile device to the cooperation mode that cooperates with the mobile device, and to end the cooperation mode in the cooperation mode. a link mode switching means for switching to a single mode in response to establishment of the obtained coordination termination condition, in cooperation mode, is set to a mobile device, a series of processing in which the self apparatus and the portable device executes in cooperation Of the defined cooperation processing, the pre-disconnection setting value acquisition means for acquiring the mobile-side setting value used to execute the specified mobile-side processing as the processing to be executed by the mobile device as the pre-disconnection setting value, and the cooperation end condition are At the stage where the cooperation mode switching means is switched from the cooperation mode to the independent mode in response to the disconnection of the communication path established with the mobile device, including the disconnection of the communication path established with the mobile device. , When the continuation state is detected, it was finally acquired by the device-side set value and pre-disconnection setting value acquisition means used to execute the device-side process specified as the process to be executed by the own device among the linked processes. When switching between the maintenance means that stores the pre-disconnection setting value in association with the mobile device and the cooperation mode that links with the mobile device in the independent mode, the mobile device setting value set in the mobile device is acquired as the post-connection setting value. , The setting value before disconnection, the setting value after connection, and the setting value on the device side are used to determine the cooperation process to be executed, and the setting value on the mobile phone side and the setting value on the device side for executing the determined cooperation process are set. It is provided with a means for determining cooperative processing.

According to this aspect, it is possible to provide an information processing device capable of matching the settings with the mobile device in the cooperation mode after the communication path established with the mobile device is disconnected.

According to still another aspect of the present invention, the linking method is a linking method executed by an information processing device, in which the information processing device has a display means for displaying an image and an object on the display surface of the display means. A device detection that includes a position detecting means for detecting the contacted position, and detects a portable device when a response command is received from the portable device in response to the position detected by the position detecting means. Communication between the mobile device, the route establishment step of establishing a communication path between the step and the mobile device, the continuous state detection step of detecting the continuous state based on the state of the mobile device or the state of the own device, and the continuous state detection step. If the route is established and the mobile device is detected in the device detection step, the mobile device is switched from the independent mode that does not cooperate with the mobile device to the cooperation mode that cooperates with the mobile device, and the mobile device moves in the device detection step in the cooperation mode. If it is no longer detected, the linked mode is continued if the continuous state is detected, the linked mode is switched to the independent mode if the continuous state is not detected, and the communication path established with the mobile device in the linked mode is established. When disconnected, a link mode switching step that switches from the link mode to the independent mode, and a series of multiple processes that are set in the mobile device in the link mode and executed in cooperation between the information processing device and the mobile device are defined. Among the linked processes, the mobile device in the pre-disconnection setting value acquisition step for acquiring the mobile-side set value used to execute the mobile-side process defined as the process to be executed by the mobile device as the pre-disconnection setting value, and the device detection step. In order to execute the device-side process defined as the process executed by the information processing device among the linked processes when the communication path established with the mobile device is disconnected in the linked mode after the is no longer detected. In the maintenance step of storing the last acquired pre-disconnection setting value in association with the mobile device in the device-side setting value and pre-disconnection setting value acquisition step used for, and when switching from the independent mode to the linked mode, it is set in the mobile device. Acquires the mobile device setting value as the post-connection setting value, determines the cooperation process to be executed based on the pre-disconnection setting value, the post-connection setting value, and the device side setting value, and executes the determined cooperation process. This includes a step of determining a linked process for setting a mobile device side setting value and a device side setting value.

According to this aspect, it is possible to provide a cooperation method capable of matching the settings with the mobile device in the cooperation mode after the communication path established with the mobile device is disconnected.

According to still another aspect of the present invention, the coordinating method is a continuation of detecting a continuation state based on a route establishment step of establishing a communication path with the portable device and the state of the portable device or the state of the own device. Depending on the state detection step and the establishment of the cooperation start condition corresponding to the mobile device, it is predetermined to switch from the independent mode that does not cooperate with the mobile device to the cooperation mode that cooperates with the mobile device, and to end the cooperation mode in the cooperation mode. A series of multiple processes that are set in the mobile device in the link mode and the link mode switching step that switches to the independent mode when the cooperation end condition is satisfied, and that the information processing device and the mobile device execute in cooperation with each other. Of the defined linkage processes, the pre-disconnection setting value acquisition step for acquiring the mobile-side set value used to execute the specified mobile-side process as the process to be executed by the mobile device as the pre-disconnection setting value, and the linkage end condition are At the stage where the cooperation mode is switched to the independent mode in the cooperation mode switching step in response to the disconnection of the communication path established with the mobile device, including the disconnection of the communication path established with the mobile device. , When the continuation state is detected, it is finally acquired in the device side set value and pre-disconnection setting value acquisition step used to execute the device side process defined as the process to be executed by the information processing device among the linked processes. When switching to the maintenance step of storing the pre-disconnection setting value in association with the mobile device and the cooperation mode linked with the mobile device in the independent mode, the mobile device setting value set in the mobile device is acquired as the setting value after connection. Then, based on the pre-disconnection setting value, the post-connection setting value, and the device side setting value, the cooperation process to be executed is determined, and the mobile phone side setting value and the device side setting value for executing the determined cooperation process are determined. Let the information processing device execute the linked process determination step to be set.

According to this aspect, it is possible to provide a cooperation method capable of matching the settings with the mobile device in the cooperation mode after the communication path established with the mobile device is disconnected.

According to still another aspect of the present invention, the linkage program is a linkage program executed by a computer that controls an information processing device, and the information processing device includes a display means for displaying an image and a display surface of the display means. The portable device is provided with a position detecting means for detecting the position where an object is in contact with the inside, and when a response command is received from the portable device in response to the position where the portable device is detected by the position detecting means. A device detection step for detecting, a route establishment step for establishing a communication path between a mobile device, a continuous state detection step for detecting a continuous state based on the state of the portable device or the state of the own device, and a portable device. If a communication path is established between the two and the mobile device is detected in the device detection step, the device detection step is switched from the independent mode that does not cooperate with the mobile device to the cooperation mode that cooperates with the mobile device. If the mobile device is not detected in, the cooperation mode is continued if the continuation state is detected, the cooperation mode is switched to the independent mode if the continuation state is not detected, and the cooperation mode is established with the mobile device. When the communication path is disconnected, a link mode switching step that switches from the link mode to the independent mode, and a series of multiple steps that are set in the mobile device in the link mode and executed in cooperation between the information processing device and the mobile device. Pre-disconnection setting value acquisition step to acquire the mobile-side set value used to execute the mobile-side process specified as the process to be executed by the mobile device among the linked processes that define the process, and device detection When the communication path established with the mobile device is disconnected in the cooperation mode after the mobile device is no longer detected in the step, the device-side processing defined as the processing executed by the information processing device among the cooperation processing. In the maintenance step of storing the last acquired pre-disconnection setting value in the device-side setting value and pre-disconnection setting value acquisition step used to execute the device in association with the mobile device, and when switching from the independent mode to the linked mode, the mobile device is portable. The mobile device setting value set in the device is acquired as the post-connection setting value, and the cooperation process to be executed is determined and determined based on the pre-disconnection setting value, the post-connection setting value, and the device side setting value. The computer is made to execute the cooperation process determination step for setting the mobile device side setting value and the device side setting value for executing the cooperation process.

According to this aspect, it is possible to provide a cooperation program capable of matching the settings with the mobile device in the cooperation mode after the communication path established with the mobile device is disconnected.

According to yet another aspect of the present invention, the linkage program detects a continuation state based on a route establishment step of establishing a communication path with the mobile device and the state of the mobile device or the state of the own device. Depending on the state detection step and the establishment of the cooperation start condition corresponding to the mobile device, it is predetermined to switch from the independent mode not linked with the mobile device to the linked mode linked with the mobile device and end the linked mode in the linked mode. A series of multiple processes that are set in the mobile device in the link mode and the link mode switching step that switches to the independent mode when the cooperation end condition is satisfied, and that the information processing device and the mobile device execute in cooperation with each other. The pre-disconnection setting value acquisition step for acquiring the mobile-side setting value used to execute the mobile-side processing specified as the processing to be executed by the mobile device among the defined cooperation processing as the pre-disconnection setting value, and the cooperation end condition are At the stage where the cooperation mode is switched to the independent mode in the cooperation mode switching step in response to the disconnection of the communication path established with the mobile device, including the disconnection of the communication path established with the mobile device. , When the continuation state is detected, it is finally acquired in the device side set value and pre-disconnection setting value acquisition step used to execute the device side process defined as the process to be executed by the information processing device among the linked processes. When switching to the maintenance step of storing the pre-disconnection setting value in association with the mobile device and the cooperation mode linked with the mobile device in the independent mode, the mobile device setting value set in the mobile device is acquired as the post-connection setting value. Then, based on the pre-disconnection setting value, the post-connection setting value, and the device side setting value, the cooperation process to be executed is determined, and the mobile side setting value and the device side setting value for executing the determined cooperation process are determined. Let the computer that controls the information processing device execute the linked processing decision step to be set.

According to this aspect, it is possible to provide a cooperation program capable of matching the settings with the mobile device in the cooperation mode after the communication path established with the mobile device is disconnected.

It is a figure which shows an example of the whole outline of the cooperation system in embodiment of this invention. It is a block diagram which shows an example of the hardware configuration of the MFP in the 1st Embodiment. It is a block diagram which shows the outline of the hardware composition of the smartphone in 1st Embodiment. It is a block diagram which shows an example of the function of the CPU included in the MFP in the 1st Embodiment. It is a figure which shows an example of the operation screen. It is a figure which shows an example of the continuation condition setting screen. It is a figure which shows an example of the function which the CPU included in the smartphone in 1st Embodiment has. It is a flowchart which shows an example of the flow of cooperation processing in 1st Embodiment. It is a flowchart which shows an example of the flow of device detection processing. It is a flowchart which shows an example of the flow of a reconnection determination process. It is a flowchart which shows an example of the flow of reception control processing. It is a flowchart which shows an example of the flow of a continuation state detection process. It is a flowchart which shows an example of the flow of the mobile side cooperation processing in 1st Embodiment. It is a figure which shows an example of the whole outline of the cooperation system in 2nd Embodiment. It is a block diagram which shows an example of the hardware configuration of the MFP in the 2nd Embodiment. It is a block diagram which shows an example of the function of the CPU included in the MFP in the 2nd Embodiment. It is a figure which shows an example of the function which the CPU included in the smartphone in 2nd Embodiment has. It is a flowchart which shows an example of the flow of cooperation processing in 2nd Embodiment. It is a figure which shows an example of the flow of the continuous state detection processing in 2nd Embodiment. It is a flowchart which shows an example of the flow of the mobile side cooperation processing in 2nd Embodiment.

Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the following description, the same parts are designated by the same reference numerals. Their names and functions are the same. Therefore, detailed explanations about them will not be repeated.

<First Embodiment>
FIG. 1 is a diagram showing an example of an overall outline of a cooperative system according to an embodiment of the present invention. With reference to FIG. 1, the cooperation system 1 includes an MFP (Multifunction Peripheral) 100 and smartphones 200A, 200B, 200C. Here, an example is taken in which three users A, B, and C carry smartphones 200A, 200B, and 200C, respectively, and operate the MFP 100 at the same time.

Here, a case where three users A, B, and C operate the MFP 100 at the same time will be described as an example, but the number of users is not limited, and even if one or more users operate the MFP 100, the number of users is not limited. Good.

The MFP 100 is an example of an information processing device, and includes a display unit 161, a touch panel 165, a document reading unit 130 for reading a document, an image forming unit 140 for forming an image on paper or the like based on data, and an image forming unit 140. Includes a paper feed unit 150 that supplies paper to the machine. The display unit 161 is a display device such as a liquid crystal display (LCD) or an organic ELD (Electro-Luminescence Display). The display unit 161 is provided on the upper surface of the MFP 100 main body. The touch panel 165 is provided on the display unit 161 so as to be superimposed on the upper surface or the lower surface, and detects a position where an object comes into contact with the display surface of the display unit 161. The touch panel 165 is a multi-touch compatible touch panel. Therefore, when an object comes into contact with a plurality of places on the display surface of the display unit 161 at one time, the touch panel 165 can detect a plurality of positions where the object touches. The object here includes smartphones 200A, 200B, and 200C in addition to the user's finger.

The touch panel 165 may be one, or a plurality of touch panels 165 may be combined. When the touch panel 165 is a combination of a plurality of touch panels, for example, the display surface of the display unit 161 may be divided into a plurality of areas, and the plurality of touch panels may be associated with each of the plurality of areas. As the touch panel 165, for example, a resistance film method, a surface acoustic wave method, an infrared method, an electromagnetic induction method, and a capacitance method can be used, and the method is not limited.

Each of the three users A, B and C is located around the MFP 100. The MFP 100 can be used for a conference in which User A, User B, and User C participate. Since each of user A, user B, and user C is located around the MFP 100, the entire display surface of the display unit 161 can be visually recognized. Therefore, if the data prepared for the conference is stored in the MFP 100 in advance, the same data can be displayed to the user A, the user B, and the user C by displaying the data on the display unit 161. You can show them at the same time. Further, the touch panel 165 of the MFP 100 is used as an input device for the user A, the user B, and the user C to operate the MFP 100. For example, when an application program for editing a document is installed in the MFP 100, the touch panel 165 may be used as a keyboard to cause the MFP 100 to create a document.

The smartphones 200A, 200B, and 200C are examples of portable devices, and are carried and used by users A, B, and C, respectively. User A, user B, and user C place the smartphones 200A, 200B, and 200C on the display surface of the display unit 161. Therefore, the smartphones 200A, 200B, and 200C are arranged on the display surface of the display unit 161 near the sides in the directions in which the user A, the user B, and the user C are located. In this case, since the touch panel 165 detects each of the smartphones 200A, 200B, and 200C, the MFP 100 can detect the position of each of the smartphones 200A, 200B, and 200C.

Each of the MFP 100 and the smartphones 200A, 200B, and 200C has a short-range wireless communication function, and can communicate with each other on a one-to-one basis when the other device is within a predetermined range. Further, each of the MFP 100 and the smartphones 200A, 200B, and 200C has a wireless LAN function and can communicate with a wireless base station connected to the network. The wireless base station is a network relay device, communicates with the MFP100, smartphones 200A, 200B, and 200C, and connects the MFP100, smartphones 200A, 200B, and 200C to the network, respectively. Therefore, each of the MFP 100 and the smartphones 200A, 200B, and 200C can communicate with each other via the network by communicating with the wireless base station. The network may also be connected to the Internet. In this case, each of the MFP 100 and the smartphones 200A, 200B, and 200C can communicate with a computer connected to the Internet. The network is, for example, a local area network (LAN), and the connection form may be wired or wireless. The network is not limited to a LAN, and may be a network using a public switched telephone network (Public Switched Telephone Networks). Further, the network may be a wide area network (WAN) such as the Internet.

In the cooperation system 1 in the present embodiment, it is possible to execute the cooperation process in cooperation with any one of the smartphones 200A, 200B, and 200C and the MFP100. For example, the smartphone 200A and the MFP 100 communicate with each other using the short-range communication function or the wireless LAN function, and execute the cooperation process in cooperation with each other. The cooperative process defines a series of a plurality of processes. The series of plurality of processes defined by the cooperative process includes a device-side process executed by the MFP 100 and a mobile-side process executed by the smartphone 200A. For example, when the linkage process in which the mobile phone side process is the data selection process and the device side process is the image forming process is executed by the MFP 100 and the smartphone 200A, the user A who operates the smartphone 200A selects the process. This is a process in which the MFP 100 forms an image of the data stored in the smartphone 200A on paper according to the image forming conditions set by the user A who operates the MFP 100. Further, when the device side process is the process of selecting data and the mobile side process is the process of transmitting data, the cooperation process executed by the MFP 100 and the smartphone 200A is selected by the user A who operates the MFP 100. This is a process in which the smartphone 200A transmits the data stored in the MFP 100 according to the transmission conditions set by the user A who operates the smartphone 200A. The transmission condition is determined, for example, by the user selecting the destination and the transmission method from the address book stored in the smartphone 200A.

As an example of the portable device carried by the user, smartphones 200A, 200B, and 200C will be described as an example, but if the device is portable by the user, it may be a PDA (Personal Digital Assistant) or the like.

FIG. 2 is a block diagram showing an example of the hardware configuration of the MFP in the first embodiment. With reference to FIG. 2, the MFP 100 includes a main circuit 110, a document reading unit 130, an image forming unit 140, a paper feeding unit 150, a display unit 161 and a touch panel 165.

The main circuit 110 is equipped with a CPU 111, a communication interface (I / F) unit 112, a ROM 113, a RAM 114, a hard disk drive (HDD) 115 as a large-capacity storage device, a facsimile unit 116, and a CD-ROM 118. The external storage device 117 and the short-range communication unit 119 are included. The CPU 111 is connected to a document reading unit 130, an image forming unit 140, a paper feeding unit 150, a display unit 161 and a touch panel 165, and controls the entire MFP 100.

The ROM 113 stores a program executed by the CPU 111 or data necessary for executing the program. The RAM 114 is used as a work area when the CPU 111 executes a program. Further, the RAM 114 temporarily stores the reading data (image data) continuously sent from the document reading unit 130.

The communication I / F unit 112 is an interface for connecting the MFP 100 to the network. The CPU 111 communicates with the smartphones 200A, 200B, and 200C via the communication I / F unit 112, and transmits / receives data. Further, the communication I / F unit 112 can communicate with a computer connected to the Internet via a wireless base station and a network.

The short-range communication unit 119 wirelessly communicates with smartphones 200A, 200B, and 200C based on GAP (Generic Access Profile) of the Bluetooth (registered trademark) standard. The short-range communication unit 119 communicates with the smartphone 200A, for example, when the distance between the short-range communication unit 119 and the smartphone 200A is less than the communicable distance. The distance that the short-range communication unit 119 can communicate with is several meters. Further, the short-range communication unit 119 may communicate by the short-range wireless communication method of NFC (Near Field Communication). In this case, the distance that the short-range communication unit 119 can communicate with is several tens of cm.

The facsimile unit 116 is connected to the public switched telephone network (PSTN) and transmits facsimile data to or receives facsimile data from the PSTN. The facsimile unit 116 stores the received facsimile data in the HDD 115 or outputs the received facsimile data to the image forming unit 140. The image forming unit 140 prints the facsimile data received by the facsimile unit 116 on paper. Further, the facsimile unit 116 converts the data stored in the HDD 115 into facsimile data and transmits the data to the facsimile apparatus connected to the PSTN.

A CD-ROM 118 is attached to the external storage device 117. The CPU 111 can access the CD-ROM 118 via the external storage device 117. The CPU 111 loads the program recorded in the CD-ROM 118 mounted on the external storage device 117 into the RAM 114 and executes the program. The medium for storing the program executed by the CPU 111 is not limited to the CD-ROM118, but is an optical disk (MO (Magnetic Optical Disc) / MD (Mini Disc) / DVD (Digital Versaille Disc)), an IC card, an optical card, and the like. It may be a semiconductor memory such as a mask ROM, an EPROM (Erasable Program ROM), or an EEPROM (Electrical EPROM).

Further, the program executed by the CPU 111 is not limited to the program recorded in the CD-ROM 118, and the program stored in the HDD 115 may be loaded into the RAM 114 and executed. In this case, another computer connected to the network may rewrite the program stored in the HDD 115 of the MFP 100, or add a new program and write it. Further, the MFP 100 may download the program from another computer connected to the network and store the program in the HDD 115. The program referred to here includes not only a program that can be directly executed by the CPU 111, but also a source program, a compressed program, an encrypted program, and the like.

Since the basic hardware configurations and functions of the smartphones 200A, 200B, and 200C are the same, the smartphone 200A will be described here as an example.

FIG. 3 is a block diagram showing an outline of the hardware configuration of the smartphone according to the first embodiment. With reference to FIG. 3, the smartphone 200A in the present embodiment is connected to a CPU 201 for controlling the entire smartphone 200A, a camera 202, a flash memory 203 for non-volatilely storing data, and a call unit 205. Wireless communication unit 204, display unit 206 for displaying information, operation unit 207 for receiving user operations, wireless LANI / F208, short-range communication unit 209, GPS reception unit 210, and external storage device 211. ,including.

The display unit 206 is a display device such as a liquid crystal display (LCD) or an organic ELD, and displays an instruction menu for the user, information on acquired image data, and the like. The operation unit 207 includes a main key 207A and a touch panel 207B. When the user instructs the display surface of the display unit 206, the operation unit 207 outputs the position of the display surface detected by the touch panel 207B to the CPU 201. Based on the position detected by the touch panel 207B, the CPU 201 detects the position instructed by the user on the screen displayed on the display unit 206. The CPU 201 accepts various instructions, characters, numbers, and other data input by the user's operation based on the screen displayed on the display unit 206 and the position detected by the touch panel 207B. For example, when displaying a screen including an image of the numeric keypad on the display unit 206, a number corresponding to the key displayed at the position detected by the touch panel 207B is accepted.

The camera 202 includes a lens and a photoelectric conversion element, and images the light collected by the lens on the photoelectric conversion element, and the photoelectric conversion element photoelectrically converts the received light and outputs image data to the CPU 201. The photoelectric conversion element is a CMOS (Complementary Metal Oxide Sensor) sensor, a CCD (Charge Coupled Device) sensor, or the like.

The wireless communication unit 204 wirelessly communicates with a mobile phone base station connected to the telephone communication network. The wireless communication unit 204 connects the smartphone 200A to the telephone communication network and enables a telephone call using the communication unit 205. The wireless communication unit 204 decodes the voice signal obtained by demodulating the wireless signal received from the mobile phone base station and outputs it to the communication unit 205. Further, the wireless communication unit 204 encodes the voice input from the communication unit 205 and transmits it to the mobile phone base station. The telephone unit 205 includes a microphone and a speaker, outputs the voice input from the wireless communication unit 204 from the speaker, and outputs the voice input from the microphone to the wireless communication unit 204. Further, the wireless communication unit 204 is controlled by the CPU 201 to connect the smartphone 200A to the e-mail server to send and receive e-mail.

The wireless LANI / F208 is an interface for communicating with a wireless station connected to the network and connecting the smartphone 200A to the network. By registering the IP (Internet Protocol) address of the MFP 100 in the smartphone 200A, the smartphone 200A can communicate with the MFP 100 and can send and receive data.

The short-range communication unit 209 wirelessly communicates with another device, for example, the MFP 100, based on GAP or the like of the Bluetooth (registered trademark) standard. The short-range communication unit 209 communicates with the MFP 100, for example, when the distance between the short-range communication unit 209 and the MFP 100 is less than or equal to the communicable distance. The distance that the short-range communication unit 209 can communicate with is several meters. Further, the short-range communication unit 209 may communicate by the NFC short-range wireless communication method. In this case, the distance that the short-range communication unit 209 can communicate with is several tens of cm.

The GPS receiving unit 210 receives a signal transmitted from a GPS (Global Positioning System) satellite, and detects the current position based on the received signal. The current position is, for example, latitude and longitude. The GPS receiving unit 210 outputs the detected current position to the CPU 201.

The flash memory 203 stores a program executed by the CPU 201 or data necessary for executing the program. The CPU 201 loads the program recorded in the flash memory 203 into the RAM included in the CPU 201 and executes the program.

The external storage device 211 is removable from the smartphone 200A, and a CD-ROM 211A storing a remote control program can be attached. The CPU 201 can access the CD-ROM 211A via the external storage device 211. The CPU 201 can load the remote control program recorded in the CD-ROM 211A mounted on the external storage device 211 into the RAM included in the CPU 201 and execute the remote control program.

Although the program recorded in the flash memory 203 or the CD-ROM 210A has been described as the program executed by the CPU 201, another computer connected to the network rewrites the program stored in the flash memory 203, or a program. , It may be a new program additionally written. Further, the smartphone 200A may be a program downloaded from another computer connected to the network. The program referred to here includes not only a program that can be directly executed by the CPU 201, but also a source program, a compressed program, an encrypted program, and the like.

The medium for storing the program executed by the CPU 201 is not limited to the CD-ROM211A, but may be a semiconductor memory such as an optical disk (MO / MD / DVD), an IC card, an optical card, a mask ROM, an EPROM, or an EEPROM. Good.

FIG. 4 is a block diagram showing an example of a CPU function included in the MFP according to the first embodiment. The function shown in FIG. 4 is a function formed in the CPU 111 by the CPU 111 included in the MFP 100 executing a cooperation program stored in the ROM 113, the HDD 115, and the CD-ROM 118.

With reference to FIG. 4, the CPU 111 included in the MFP 100 includes a device-side setting unit 31, a device-side execution unit 33, a cooperation mode switching unit 35, a continuation state detection unit 37, a device detection unit 41, and a route establishment unit. 43, a release notification unit 45, a maintenance unit 47, a cooperation processing determination unit 49, a mobile phone side setting value acquisition unit 51, and a change request unit 53 are included.

The device detection unit 41 controls the touch panel 165 and the short-range communication unit 119, and detects when any of the devices of the smartphones 200A, 200B, and 200C is placed on the display surface of the display unit 161. When any device of the smartphone 200A, 200B, or 200C, for example, the smartphone 200A is placed on the display surface of the display unit 161, the touch panel 165 detects the position where the smartphone 200A is placed on the display surface of the display unit 161. To do. Since the area where the smartphone 200A contacts the display surface of the display unit 161 is larger than the area of the user's finger, the upper limit of the area of the user's finger is set in advance as a threshold value, and the touch panel 165 is the area where the touch is detected. When the area is equal to or larger than the threshold value, it is determined that the smartphone 200A is placed, and when the area of the area where the touch panel 165 detects pressing is smaller than the threshold value, the user's instruction by the finger is detected.

The device detection unit 41 controls the short-range communication unit 119 in response to the touch panel 165 detecting the position where the smartphone 200A is placed, and causes the touch panel 165 to transmit a search command for searching for a device existing in the vicinity. When each of the smartphones 200A, 200B, and 200C receives the search command, it returns a response command including device identification information for identifying its own device. As the device identification information, the network address assigned in the network can be used. The network address is, for example, an IP address (Internet Protocol) address or a MAC (Media Access Control) address. When the smartphone 200A is placed on the display surface of the display unit 161, it receives the search command and therefore returns the response command. By receiving the response command returned by the smartphone 200A, the device detection unit 41 detects that the device placed at the position previously detected by the touch panel 165 is the smartphone 200A. When the device detection unit 41 detects the smartphone 200A, the device detection unit 41 registers the smartphone 200A as a cooperation device. Specifically, the device detection unit 41 stores in the RAM 114 the cooperation device information including the device identification information of the smartphone 200A and the position information indicating the position where the smartphone 200A is placed, and switches the cooperation mode. A cooperation instruction is output to the unit 35 and the route establishment unit 43. The cooperation instruction includes device identification information included in the cooperation device information stored in the RAM 114.

When the position specified by the position information paired with the device identification information of the smartphone 200A is not detected by the touch panel 165, the device detection unit 41 determines that the smartphone 200A is away from the display surface of the display unit 161 and determines that the smartphone 200A is away from the display surface. Is deleted from the linked device. Specifically, the device detection unit 41 erases the set of the device identification information and the position information of the smartphone 200A stored in the RAM 114, and sends a departure signal including the device identification information of the smartphone 200A to the cooperation mode switching unit 35. Output.

Here, when the device detection unit 41 controls the short-range communication unit 119 to transmit a search command in response to the touch panel 165 detecting the position where the smartphone 200A is placed, the device detection unit 41 receives a response command from the smartphone 200A. Separately, a response command may be received from the smartphones 200B and 200C. In this case, the device detection unit 41 excludes the response command including the device identification information included in the exclusion device information described later from the processing target from the plurality of response commands. Further, the device detection unit 41 determines the response command whose device identification information included in the response command to be processed is not included in any of the linked device information stored in the RAM 114 as the processing target. When there is one response command determined as the processing target, the device detection unit 41 determines that the device specified by the device identification information included in the response command is placed at a position detected by the touch panel 165.

There may be a plurality of response commands that the device detection unit 41 determines as a processing target. For example, another user B is in the vicinity of the MFP 100 while carrying the smartphone 200B without placing it on the display surface of the display unit 161. In this case, the device detection unit 41 controls the display unit 161 to display an inquiry screen on which a plurality of device identification information included in each of the plurality of response commands can be selected in the vicinity of the position detected by the touch panel 165. .. When the user carrying the smartphone 200A selects the device identification information of the smartphone 200A according to the inquiry screen, the device detection unit 41 determines that the device placed at the position previously detected by the touch panel 165 is the smartphone 200A. The device identification information of the smartphone 200A and the position information indicating the position where the smartphone 200A is placed are stored in the RAM 114, and the device identification information not selected is excluded. It is stored in the RAM 114 as information.

The device detection unit 41 may authenticate the user before storing the cooperation device information in the RAM 114. For example, the authentication information associated with the user identification information of the user who is authorized to use the MFP 100 and the device identification information of the device assigned to the user is stored in the HDD 115 in advance and included in the linked device information. When the authentication information including the device identification information is stored in the HDD 115, the linked device information is stored in the RAM 114. Further, when the device detection unit 41 does not store the authentication information including the device identification information included in the cooperation device information in the HDD 115, the device detection unit 41 does not store the cooperation device information in the RAM 114 and includes the device identification information included in the cooperation device information. Is stored in the RAM 114 as exclusion device information. As a result, only the user registered in advance in the MFP 100 can use the MFP 100.

The route establishment unit 43 controls the short-range communication unit 119 to negotiate with the device specified by the device identification information included in the cooperation instruction to establish the communication path. For example, when the smartphone 200A is placed on the display surface of the display unit 161 by the user A, the device detection unit 41 detects the smartphone 200A, so that the route establishment unit 43 establishes a communication path with the smartphone 200A. When the route establishment unit 43 establishes a communication route with the smartphone 200A, the combination of the device identification information of the smartphone 200A and the route identification information for identifying the communication route is combined with the cooperation mode switching unit 35 and the release notification unit 45. Output to. When the established communication path is disconnected, the route establishment unit 43 outputs a disconnection signal including the disconnected route identification information to the cooperation mode switching unit 35. The case where the communication path is disconnected includes, for example, the case where the smartphone 200A goes out of the communicable range of the short-range communication unit 119, and the case where the smartphone 200A disconnects the communication path. The route establishment unit 43 may control the communication I / F unit 112 to establish a communication route with the smartphone 200A.

When the short-range communication unit 119 communicates by the NFC communication method, the user A may place the smartphone 200A on the display surface of the display unit 161 after bringing the smartphone 200A close to the antenna of the short-range communication unit 119. .. In this case, the device detection unit 41 controls the short-range communication unit 119 and the touch panel 165, and after the short-range communication unit 119 detects the smartphone 200A and establishes the communication path, the smartphone 200A is used on the touch panel 165 within a predetermined time. Detects the position where is placed.

The cooperation mode switching unit 35 switches the operation mode between the independent mode and the cooperation mode. The cooperation mode switching unit 35 switches the operation mode for each smartphone 200A, 200B, 200C. In the first embodiment, since a plurality of users operate the MFP 100 at the same time, the operation mode is switched for each user. The operation mode of the MFP 100 may differ depending on the user. Therefore, the cooperation mode switching unit 35 determines the operation mode corresponding to the device identification information. For example, the cooperation mode switching unit 35 switches the operation mode of the smartphone 200A between a cooperation mode that operates in cooperation with the smartphone 200A and a single mode that operates independently without cooperation with the smartphone 200A. .. The cooperation mode switching unit 35 sends the device identification information and the operation mode signal indicating the operation mode of either the independent mode or the cooperation mode to the device side setting unit 31, the device side execution unit 33, and the continuous state detection unit 37. Output.

The cooperation mode switching unit 35 includes a cooperation setting unit 71 and a release unit 69. The cooperation setting unit 71 switches the operation mode from the independent mode to the cooperative mode, and the release unit 69 switches the operation mode from the cooperative mode to the independent mode. In the cooperation setting unit 71, a cooperation instruction is input from the device detection unit 41, and a set of the same device identification information and route identification information as the device identification information included in the cooperation instruction is input from the route establishment unit 43. , The operation mode corresponding to the device identification information is switched from the independent mode to the linked mode.

When the release signal is input, the release unit 69 switches the operation mode from the cooperation mode to the independent mode unless a continuation signal indicating that the continuation state is input is input from the continuation state detection unit 37 described later. The continuation signal includes device identification information of any of smartphones 200A, 200B, and 200C. When the withdrawal signal is input, the release unit 69 operates corresponding to the device identification information included in the withdrawal signal when the continuation signal including the same device identification information as the device identification information included in the withdrawal signal is not input. Switch the mode from the linked mode to the independent mode. When the release signal is input from the device detection unit 41, the release unit 69 receives the device identification information included in the release signal when a continuation signal including the same device identification information as the device identification information included in the release signal is input. The cooperation mode is maintained without switching the operation mode corresponding to the above from the cooperation mode to the independent mode.

When the release unit 69 maintains the cooperation mode when the withdrawal signal is input from the device detection unit 41, when the short-range communication unit 119 cannot communicate with the smartphone 200A, the operation mode is switched from the cooperation mode to the independent mode. , The maintenance instruction is output to the maintenance unit 47 and the cooperation setting unit 71. Specifically, in the release unit 69, after the disconnection signal is input from the device detection unit 41 and the interlocking mode is maintained, a disconnection signal including the same device identification information as the device identification information included in the release signal is transmitted from the route establishment unit 43. When input, the operation mode corresponding to the device identification information included in the disconnection signal is switched from the cooperation mode to the independent mode, and the maintenance instruction is output to the maintenance unit 47 and the cooperation setting unit 71. The maintenance instruction includes device identification information included in the disconnect signal.

In the release unit 69, a cooperation end instruction may be input from the device side setting value setting unit 63, which will be described later. The details of the cooperation end instruction will be described later. For example, when the user A instructs the end of the cooperation process, the device identification information of the smartphone 200A carried by the user A is included, which is output from the device side setting value setting unit 63. When the cooperation end instruction is input from the device side setting value setting unit 63, the release unit 69 switches the operation mode corresponding to the device identification information included in the cooperation end instruction from the cooperation mode to the independent mode, and also releases the release notification unit 45. Output the end notification instruction to. The end notification instruction includes the device identification information included in the cooperation end instruction.

The release notification unit 45 refers to the set of the device identification information and the route identification information input from the route establishment unit 43 in response to the input of the end notification instruction, and the device identification information included in the end notification instruction. The route identification information to be paired with is specified, and the smartphone 200A is notified of the end of the cooperation process via the identified route identification information. As a result, the user A can operate the MFP 100 to end the cooperation between the MFP 100 and the smartphone 200A, and the smartphone 200A can confirm that the cooperation has been completed.

After the maintenance instruction is input from the release unit 69, the cooperation setting unit 71 determines that the connection is reconnected when the cooperation instruction including the same device identification information as the device identification information included in the maintenance instruction is input from the device detection unit 41. To do. When the cooperation setting unit 71 determines that the connection is reconnected, the device identification information is received from the route establishment unit 43 in response to the same set of device identification information and route identification information as the device identification information included in the cooperation instruction being input from the route establishment unit 43. The operation mode corresponding to is switched from the independent mode to the linked mode, and a return instruction is output to the linked process determination unit 49. The return instruction includes device identification information included in the maintenance instruction.

The device-side execution unit 33 can execute a plurality of types of processing. The plurality of types of processes that can be executed by the device-side execution unit 33 include a document reading process, an image forming process, a data transmission / reception process, a facsimile transmission / reception process, and a data management process. The process that can be executed by the device-side execution unit 33 includes a process that combines at least two of a document reading process, an image forming process, a data transmission / reception process, a facsimile transmission / reception process, and a data management process. The processing that can be executed by the device-side execution unit 33 is not limited to these, and may be less, or may include more types of processing.

The document scanning process is a process of storing the image data obtained by scanning the document with the document scanning unit 130 in the RAM 114. The setting values used to execute the document scanning process are the scanning surface of the document, whether the document is color or monochrome, the scanning resolution, image quality, density, presence / absence of stamp or page printing, and the frame for deleting the periphery of the scanned image. It includes the presence / absence of image processing such as erasing and sharpening, the file format and name of image data stored in the RAM 114, the size of the original, the number of originals, and the type of original. The types of manuscripts include book manuscripts indicating the presence or absence of manuscripts of different sizes and the formation of multiple pages.

The image forming process is a process of forming an image of data on the paper supplied from the paper feeding unit 150 to the image forming unit 140. The setting values used to execute the image formation process are, for example, color and monochrome, paper size, paper type, number of copies, specification of paper tray, presence / absence of post-processing, and the side on which the image is formed (single side). Or both sides), including the orientation of the document. The presence / absence of post-processing includes the presence / absence of sorting, staples, punches, and the like.

The data transmission / reception process is a process of receiving data from a computer connected to the network via the communication I / F unit 112, or a process of receiving data stored in the HDD 115 or the external storage device 117 via the communication I / F unit 112. This is the process of sending data to a computer connected to the network. The settings used to perform the data transmission / reception process include, for example, data resolution, color and monochrome distinction, and file format.

The facsimile transmission / reception process is a process of transmitting an image of facsimile data to the facsimile unit 116, or a process of receiving an image of facsimile data from the outside. The setting values used to execute the facsimile transmission / reception processing include, for example, the setting of the fax machine line, the setting value for specifying the transmission time, the password, and the F code.

The data management process includes a process of storing data in the HDD 115 or the external storage device 117, a process of changing or deleting the data stored in the HDD 115 or the external storage device 117, and a process of storing the data in the HDD 115 or the external storage device 117. This is a process of selecting 1 or more as the processing target. The process of changing data includes a process of editing data and a process of changing the format. The setting values used to execute the data management process are, for example, the folder name when creating a folder in HDD 115, the password set in the folder, the search character string for searching data, the folder type, and the document. Deletion time, etc.

The device side execution unit 33 includes a device independent execution unit 65 that executes processing in the independent mode, and a device side cooperation processing execution unit 67 that executes processing in the cooperation mode. The device independent execution unit 65 and the device-side cooperation processing execution unit 67 can execute a plurality of types of processing that can be executed by the device-side execution unit 33. Hereinafter, the process executed by the device independent execution unit 65 is referred to as a device independent process, and the process executed by the device side cooperation process execution unit 67 is referred to as a device side process.

The device-side setting unit 31 is a setting value used to execute one or more of a plurality of types of processes that can be executed by the device-side execution unit 33 and one or more processes based on an operation input by the user to the touch panel 165. And, set. For example, the user A is located near the position where the smartphone 200A is placed on the display surface of the display unit 161. Therefore, when the touch panel 165 detects the user's operation within a predetermined range from the position where the smartphone 200A is placed on the display surface of the display unit 161, the device-side setting unit 31 performs the detected operation. Decide to operate by A. Further, the device-side setting unit 31 displays the operation screen within a predetermined range from the position where the smartphone 200A is placed on the display surface of the display unit 161 and is based on the position on the operation screen detected by the touch panel 165. To determine the operation of user A. The operation screen includes a screen for selecting one of a plurality of types of processes that can be executed by the device-side execution unit 33, and a screen for setting a setting value used for executing the selected process. Including. Here, a case where the user A inputs an operation to the touch panel 165 will be described as an example.

The device-side setting unit 31 includes a device-only setting value setting unit 61 and a device-side setting value setting unit 63. The device independent setting value setting unit 61 sets the device independent processing executed by the device independent execution unit 65 and the device independent setting value for the device independent execution unit 65 to execute the device independent processing in the single mode. The device independent setting value setting unit 61 outputs the process identification information for identifying the set device independent process, the device independent setting value, and the device identification information of the smartphone 200A to the device independent execution unit 65. When the device independent execution unit 65 detects an operation instructing the user A to execute the device independent process, the device independent execution unit 65 executes the device independent process set by the device independent setting value setting unit 61 according to the device independent setting value.

The device-side setting value setting unit 63 sets the device-side processing executed by the device-side cooperation processing execution unit 67 and the device-side setting value for the device-side cooperation processing execution unit 67 to execute the device-side processing in the cooperation mode. Set. The device-side set value setting unit 63 sets the set of the process identification information for identifying the set device-side process, the device-side set value, and the device identification information of the smartphone 200A into the device-side cooperation process execution unit 67, Output to the maintenance unit 47 and the continuous state detection unit 37. When the device-side cooperation process execution unit 67 detects, for example, an operation instructing the user A to execute the cooperation process, the device-side cooperation process execution unit 67 cooperates with the smartphone 200A to perform the device-side process set by the device-side setting value setting unit 63. Execute according to the side setting value. Specifically, the device-side cooperation processing execution unit 67 executes the device-side processing in synchronization with the mobile-side processing executed by the smartphone 200A. For example, the device-side cooperation processing execution unit 67 acquires the execution state of the mobile-side processing executed by the smartphone 200A from the smartphone 200A and executes the device-side processing. When the device-side processing is executed before the mobile-side processing, the device-side processing is executed after it is confirmed that the smartphone 200A is in a state where the mobile-side processing can be executed. When the device-side processing is executed after the mobile-side processing, the device-side processing is executed after it can be confirmed by the smartphone 200A that the mobile-side processing has been completed.

When the device-side processing is executed by the device-side cooperation processing execution unit 67, the device-side setting value setting unit 63 erases the device-side setting value and outputs a cooperation end instruction to the release unit 69. Further, when the device side setting value setting unit 63 detects, for example, an operation instructing the end of the setting of the cooperation process by the user A, the device side setting value setting unit 63 outputs the cooperation end instruction to the release unit 69. The cooperation end instruction includes device identification information of the smartphone 200A carried by the user A.

FIG. 5 is a diagram showing an example of an operation screen. With reference to FIG. 5, the operation screen 300 is displayed in a part of the display surface of the display unit 161 including the position where the smartphone 200A is placed. The operation screen 300 includes a single area 301 that is valid in the single mode, a set value area 303 that displays a setting screen for setting a set value, and a cooperative area 305 that is valid in the cooperative mode. The dotted line in the figure is attached to distinguish the single area 301, the set value area 303, and the linked area 305, and does not actually exist. In order to distinguish the single area 301, the set value area 303 and the linked area 305, a boundary line may be attached to the operation screen 300, or the background color of the single area 301, the set value area 303 and the linked area 305 may be changed. It may be different.

The single area 301 can accept an operation by the user when the operation mode is the single mode. The single area 301 includes a plurality of buttons for selecting a device independent process. The multiple buttons are, here, a button for selecting the document scanning process and the image forming process in which the characters "copy" are displayed, and a button for selecting the document scanning process in which the characters "scan" are displayed. And a button for selecting data management processing and image formation processing with the characters "print", a button for selecting data transmission / reception processing with the characters "send", and a "box". Includes a button for selecting a data management process in which characters are represented.

The cooperation area 305 can accept operations by the user when the operation mode is the cooperation mode. The cooperation area 305 includes a position where the smartphone 200A is placed, and includes a plurality of buttons for selecting a mobile phone side process around the area where the smartphone 200A is placed. Here, the plurality of buttons are a button for selecting a data transmission / reception process in which the characters "send" are displayed, a button for selecting an image formation process in which the characters "print" are displayed, and a "box". , "Preview," "OCR," and "Edit," each of which includes four buttons for selecting a data management process.

In the setting value area 303, in the case of the single area 301, the setting screen for setting the device independent setting value used for executing the device independent processing selected in the single area 301 is displayed, and in the case of the cooperation mode, the setting value area 303 is displayed. The setting screen for setting the device-side setting value used to execute the device-side process selected in the cooperation area 305 is displayed.

In the stand-alone mode, the user can select the device stand-alone process and set the device stand-alone set value by inputting an operation to the stand-alone area 301 and the set value area 303. Further, in the cooperation mode, the user can select the device side processing and set the device side setting value by inputting an operation to the cooperation area 305 and the setting value area 303, and the smartphone 200A. It is possible to select the processing on the mobile phone side and set the setting value on the mobile phone side by operating.

Returning to FIG. 4, the mobile side setting value acquisition unit 51 controls the short-range communication unit 119, and from the smartphone 200A to the mobile side via the communication path established with the smartphone 200A by the route establishment unit 43. Receive information. The details of the mobile phone side information will be described later, but the process identification information for identifying the mobile phone side process to be executed by the smartphone 200A and the mobile phone side setting used for executing the mobile phone side process are set by the smartphone 200A. Including values. The mobile phone side setting value acquisition unit 51 outputs the device identification information of the smartphone 200A and the mobile phone side information to the maintenance unit 47 and the cooperation processing determination unit 49 in response to receiving the mobile phone side information. The mobile phone side setting value acquisition unit 51 is processed on the mobile phone side from the smartphone 200A after the device detection unit 41 detects the detachment of the display unit 161 of the smartphone 200A from the display surface and the release unit 69 maintains the cooperation mode. Information may be received. In this case, the amount of communication with the smartphone 200A can be reduced as much as possible.

In the maintenance unit 47, a set of the processing identification information, the device side setting value, and the device identification information is input from the device side setting value setting unit 63, and the device identification information and the mobile phone side information are input from the mobile phone side setting value acquisition unit 51. Is entered. The maintenance unit 47 is paired with the processing identification information and the device side set value that are paired with the device identification information included in the maintenance instruction, and the device identification information, in response to the maintenance instruction being input from the release unit 69. The mobile phone side information, which is the mobile phone side information last input from the mobile phone side setting value acquisition unit 51, is stored in the RAM 114 in association with the device identification information.

In response to the return instruction being input from the cooperation setting unit 71, the cooperation processing determination unit 49 carries the same device identification information, processing identification information, and device side setting value set as the device identification information included in the return instruction. The side information is read from the RAM 114, and the read mobile side information is determined as the pre-disconnection information. The cooperation processing determination unit 49 is a device included in the return instruction among the set of the device identification information and the mobile side information input from the mobile side setting value acquisition unit 51 after the return instruction is input from the cooperation setting unit 71. The mobile phone side information that is paired with the identification information is determined as the post-connection information.

The linkage process determination unit 49 determines the linkage process to be executed based on the process identification information read from the RAM 114 in response to the input of the pre-disconnection information, the post-connection information, and the return instruction, and the device-side set value. .. Specifically, when the information before disconnection and the information after connection are the same, the cooperative processing including the mobile phone side processing determined by them and the device side processing determined by the processing identification information and the device side setting value is determined. The cooperation processing determination unit 49 outputs a set of device identification information, processing identification information, and device side setting value to the device side setting value setting unit 63.

When the pre-disconnection information and the post-connection information are different, the cooperation processing determination unit 49 includes a first cooperation including the first mobile side processing determined by the pre-disconnection information, the processing identification information, and the device side processing determined by the device side setting value. The process, the second mobile-side process determined by the post-connection information, and the second cooperative process including the process identification information and the device-side process determined by the device-side set value are determined. The cooperation process determination unit 49 displays a selection screen on the display unit 161 in which either the first cooperation process or the second cooperation process can be selected, and determines which one is selected by the user A. When the cooperation process determination unit 49 determines the first cooperation process, the device identification information and the pre-disconnection information are output to the change request unit 53, and the device identification information and the process identification are output to the device side setting value setting unit 63. When the set of information and the device side setting value is output and the second cooperation process is determined, the device identification information, the processing identification information, and the device side setting value set are output to the device side setting value setting unit 63.

When the set of the device identification information, the process identification information, and the device side setting value is input from the cooperation process determination unit 49, the device side setting value setting unit 63 performs the process identification information and the device in order to continue the setting of the cooperation process. The side setting value is set for the device side processing corresponding to the device identification information. As a result, the user A can continuously set the device-side setting value from the state set before the smartphone 200A leaves the MFP 100 and the communication line is disconnected.

When the combination of the device identification information and the pre-disconnection information is input from the cooperation processing determination unit 49, the change request unit 53 identifies the route that is paired with the device identification information among the communication routes established by the route establishment unit 43. A setting change request including pre-disconnection information is transmitted to the smartphone 200A via the communication path specified by the information. As a result, the user A can operate the smartphone 200A to continuously set the setting value on the mobile phone side from the state set before the smartphone 200A leaves the MFP 100 and the communication line is disconnected. When the second cooperation process is determined by the cooperation process determination unit 49, the change request unit 53 does not send the setting change request. Therefore, the user A operates the smartphone 200A, and the smartphone 200A communicates away from the MFP 100. After the line is disconnected, the setting value on the mobile side can be set continuously from the set state.

The continuation state detection unit 37 receives device identification information and an operation mode signal from the cooperation mode switching unit 35. The operation mode signal indicates either the interlocking mode or the independent mode. The continuous state detection unit 37 includes a device state detection unit 73, a portable state detection unit 77, and a user setting unit 75. If the operation mode signal input from the cooperation mode switching unit 35 includes an operation mode signal indicating the cooperation mode, the device state detection unit 73 detects the continuation state based on the state of the MFP 100. When the state of the MFP 100 is a continuous state, the device state detection unit 73 outputs a continuation signal including the device identification information of the MFP 100 to the cooperation mode switching unit 35.

The device state detection unit 73 includes a device operation detection unit 81 and an error detection unit 83. Each time the device setting value is set by the device side setting value setting unit 63, the device operation detection unit 81 receives the device identification information of the smartphone 200A, 200B, or 200C and the processing identification information from the device side setting value setting unit 63. And the set value on the device side are input. The device operation detection unit 81 identifies the device identification information to be paired with the operation mode signal indicating the cooperation mode based on the pair of the device identification information and the operation mode signal input from the cooperation mode switching unit 35. The device operation detection unit 81 continues to include the specified device identification information while the elapsed time from the last input of the processing identification information and the device setting value to be paired with the specified device identification information is within a predetermined time. The signal is output to the cooperation mode switching unit 35. In other words, the device operation detection unit 81 operates, for example, the user A who operates the smartphone 200A and the MFP 100 sets the device side setting value in the MFP 100 while the user A who operates the smartphone 200A and the MFP 100 is setting the cooperation processing. During that time, a continuation signal is output.

The error detection unit 83 outputs a continuation signal including the device identification information of the MFP 100 to the cooperation mode switching unit 35 while an error occurs in the hardware resource included in the MFP 100. Hardware resources include an image forming unit 140 and a paper feeding unit 150. For example, while the user A who operates the smartphone 200A and the MFP 100 is setting the cooperation processing, an error occurs in the image forming unit 140 and the paper feeding unit 150, and the user A performs the error recovery work. During this time, the error detection unit 83 outputs a continuation signal including the device identification information of the smartphone 200A to the cooperation mode switching unit 35. The image forming unit 140 and the paper feeding unit 150 have consumables, and if the consumables are replaced or replenished, the error is recovered. The consumables include a toner, a photoconductor drum, a developing roller, and a fixing roller in the image forming unit 140. Consumables in the paper feed unit 150 include paper. Further, when an error that the paper is jammed occurs in the paper transport path, the error detection unit 83 can output a continuation signal including the device identification information of the MFP 100 to the cooperation mode switching unit 35 until the jammed paper is removed. .. When the user A, the user B, and the user B are operating the MFP 100, a continuation signal including the device identification information of each of the smartphones 200A, 200B, and 200C is output.

When the user setting unit 75 is set to always be in the continuous state, the user setting unit 75 outputs a continuous signal including the device identification information of the MFP 100 to the cooperation mode switching unit 35. Thereby, for example, while the smartphone 200A and the MFP 100 are linked, the cooperation mode can be continued even if the smartphone 200A is separated from the display surface of the display unit 161 of the MFP 100. When the user A, the user B, and the user B are operating the MFP 100, a continuation signal including the device identification information of each of the smartphones 200A, 200B, and 200C is output.

The portable state detection unit 77 identifies the device identification information in which the operation mode signal indicates the cooperation mode. Here, a case where the device identification information of the smartphone 200A is specified will be described as an example. The mobile state detection unit 77 detects the continuous state based on the state of the smartphone 200A specified by the specified device identification information. When the state of the smartphone 200A is a continuous state, the portable state detection unit 77 outputs a continuous signal including the device identification information of the smartphone 200A to the cooperation mode switching unit 35.

The mobile state detection unit 77 includes an application detection unit 85 and a mobile operation detection unit 87. The application detection unit 85 inquires of the smartphone 200A about the application program being executed in the current state via the communication path specified by the route identification information paired with the device identification information of the smartphone 200A. The current state is a state in which data can be output to the user or a state in which input by the user can be accepted. For example, while the user A who operates the smartphone 200A and the MFP 100 is setting the linkage process, the smartphone 200A cant state a predetermined application program different from the application program for linking with the MFP 100. May be executed with. The predetermined application program includes, but is not limited to, an application program for making a call and an application program for receiving an e-mail. This is because when the smartphone 200A receives a call, the user A may give priority to the call, and when the smartphone 200A receives the e-mail, the user A may give priority to viewing the e-mail. The portable state detection unit 77 outputs a continuation signal including the device identification information of the smartphone 200A to the cooperation mode switching unit 35 while the smartphone 200A is executing a predetermined application program in the current state. As a result, when the user A picks up the smartphone 200A and separates it from the display surface of the display unit 161 of the MFP 100, the cooperation mode can be continued.

The mobile operation detection unit 87 inquires of the smartphone 200A about the operation status via the communication path specified by the route identification information paired with the device identification information of the smartphone 200A. In the smartphone 200A, an application program for linking with the MFP 100 is executed, and a continuous signal including the device identification information of the smartphone 200A is linked mode until a predetermined time elapses after the user A inputs the setting value on the mobile phone side. Output to the switching unit 35. For example, the user A may pick up the smartphone 200A to check the data in order to determine the setting value on the mobile phone side and separate it from the display surface of the display unit 161 of the MFP 100. Even in such a case, the cooperation mode can be continued.

The continuation condition may be set by the user. The continuation condition setting screen for setting the continuation condition is displayed on the display unit 161, and the continuation condition is set according to the operation input by the user according to the continuation condition setting screen. The continuation condition is a condition for enabling at least one of the device operation detection unit 81, the error detection unit 83, the application detection unit 85, the mobile operation detection unit 87, and the user setting unit 75.

FIG. 6 is a diagram showing an example of a continuation condition setting screen. With reference to FIG. 6, the continuation condition setting screen 310 includes an area 311 for setting whether or not to set the continuation condition, and areas 312 to 315 for setting the continuation condition. An item including the characters "automatic continuation of cooperation mode" is arranged on the left side of the area 311, and either "continue" or "do not continue" is set in the area 311. When "continue" is set in the area 311, it is set to set the continuation condition, and the areas 312 to 315 can be set.

The area 312 is an area for setting that a predetermined application program is being executed by the cooperation device, here, the smartphone 200A, as a continuation condition. When the area 312 is instructed and marked by the user, the application program can be specified in the area 312A. In the area 312A, one or more application programs can be specified. In the smartphone 200A, the continuation condition is satisfied while the application program specified in the area 312A is being executed in the current state.

The area 313 is an area for setting that the device-side set value or the mobile-side set value is being set as a continuation condition. When the area 313 is instructed by the user and marked, the continuation condition is satisfied within a predetermined time after the device side setting value is set in the MFP 100, and the mobile side setting value is set in the smartphone 200A. The continuation condition is satisfied within a predetermined time.

The area 314 is an area for setting that the remaining battery level of the cooperation device is equal to or less than the threshold value T as a continuation condition. When the area 314 is instructed by the user and marked, the remaining battery level of the smartphone 200A is equal to or less than the threshold value T, and the continuation condition is satisfied.

Area 314 is set to follow instructions from the user as a continuation condition. When the area 314 is instructed and marked by the user, the MFP 100 displays an inquiry screen asking whether to continue on the display unit 161, and the continuation condition is satisfied when the user instructs to continue. To do.

The user can indicate and mark one or more of the areas 312-314. In other words, when one or more continuation conditions are set, the continuation condition is satisfied if at least one of the one or more continuation conditions is satisfied.

FIG. 7 is a diagram showing an example of a function possessed by the CPU included in the smartphone according to the first embodiment. The function shown in FIG. 7 is a function formed in the CPU 201 by the CPU 201 included in the smartphone 200A executing a mobile-side cooperation program stored in the flash memory 203 and the CD-ROM211A. The mobile-side cooperation program is a part of the cooperation program. Hereinafter, the task in which the CPU 201 executes the mobile phone side cooperation program is referred to as a cooperation task.

With reference to FIG. 7, the CPU 201 includes a communication control unit 250, a mobile phone side setting unit 251, a mobile phone side execution unit 253, a continuation determination unit 255, a set value transmission unit 257, and a change reception unit 259. Including.

The CPU 201 executes a plurality of types of application programs. Here, at least a mobile phone cooperation program, an application program that enables telephone calls, an application program that sends and receives e-mail, and a browsing program for browsing Web pages located on the Internet are installed on the smartphone 200A. The case where it is done will be described as an example. The application program installed on the smartphone 200A is not limited to these. Hereinafter, the task in which the CPU 201 executes the mobile-side cooperation program is referred to as a cooperation task, and the task in which the CPU 201 executes an application program other than the mobile-side cooperation program is referred to as an application task. The application programs other than the mobile-side cooperation program are, here, an application program that enables a telephone call, an application program that sends and receives e-mail, and a browsing program.

The mobile phone side execution unit 253 can execute a plurality of types of processing. A plurality of types of processes that can be executed by the mobile phone side execution unit 253 are determined by an application program installed on the smartphone 200A. The mobile phone side execution unit 253 includes a mobile phone independent execution unit 265 and a mobile phone side cooperation processing execution unit 267.

The mobile phone side setting unit 251 is a setting used to execute one or more of a plurality of types of processes that can be executed by the mobile phone side execution unit 253 and one or more processes based on an operation input by the user to the operation unit 207. Set the value and. The mobile phone side setting unit 251 includes a mobile phone independent setting value setting unit 261 and a mobile phone side setting value setting unit 263. The mobile phone independent setting value setting unit 261 and the mobile phone independent execution unit 265 are application tasks. The mobile side setting value setting unit 263, the mobile side cooperation processing execution unit 267, the continuation determination unit 255, the setting value transmission unit 257, the change reception unit 259, and the communication control unit 250 are cooperation tasks.

The communication control unit 250 controls the short-range communication unit 209 and returns a response command including device identification information of its own device in response to receiving a search command from the MFP 100. Further, the communication control unit 250 controls the short-range communication unit 209 and negotiates with the MFP 100 in response to receiving a connection request from the MFP 100 to establish a communication path. The communication control unit 250 outputs the device identification information of the MFP 100 and the route identification information for identifying the communication route established with the MFP 100 to the set value transmission unit 257 and the change reception unit 259. In the present embodiment, when the user A places the smartphone 200A on the display surface of the display unit 161 of the MFP 100, the MFP 100 sends a connection request to establish a communication path, so that the communication control unit 250 uses the user. When A places the smartphone 200A on the display surface of the display unit 161 of the MFP 100, the communication path is established. The communication control unit 250 disconnects the communication path when the short-range communication unit 209 becomes unable to communicate with the communication path established with the MFP 100, and sets the value transmission unit that the communication path is disconnected. Notify 257 and the change reception department 259. The communication control unit 250 may control the wireless LANI / F208 to establish a communication path with the MFP 100 in response to receiving a connection request from the MFP 100.

The mobile phone independent setting value setting unit 261 sets the mobile phone independent processing executed by the mobile phone independent execution unit 265 and the mobile phone independent setting value for the mobile phone independent execution unit 265 to execute the mobile phone independent execution unit 265 while the application task is in the current state. .. The current state is a state in which an operation by a user input to the operation unit 207 can be accepted, and the non-current state is a state in which an operation by a user input to the operation unit 207 cannot be accepted. The mobile phone independent setting value setting unit 261 outputs the process identification information for identifying the set mobile phone independent process and the mobile phone independent setting value to the mobile phone independent execution unit 265. When the operation unit 207 detects an operation instructing the execution of the mobile phone independent process while the application task is in the current state, the mobile phone independent execution unit 265 sets the mobile phone independent process set by the mobile phone independent setting value setting unit 261. Execute according to the value.

The mobile phone side setting value setting unit 263 is a mobile phone side setting for the mobile phone side cooperation processing execution unit 267 to execute the mobile phone side processing and the mobile phone side processing while the cooperation task is in the current state. Set the value and. The mobile phone side setting value setting unit 263 outputs a set of the processing identification information for identifying the set mobile phone side processing and the mobile phone side setting value to the mobile phone side cooperation processing execution unit 267 and the setting value transmission unit 257. .. When the mobile phone side cooperation processing execution unit 267 is instructed to execute the cooperation processing by the MFP 100, the mobile phone side processing is executed according to the mobile phone side setting value in cooperation with the mobile phone side setting value setting unit 263. .. Specifically, the mobile phone side cooperation processing execution unit 267 executes the mobile phone side processing in synchronization with the MFP 100. For example, the mobile-side cooperation processing execution unit 267 acquires the execution state of the device-side processing executed by the MFP 100 from the MFP 100 and executes the mobile-side processing. When the mobile side processing is executed before the device side processing, the mobile side processing is executed after it is confirmed by the MFP 100 that the device side processing can be executed. When the mobile-side processing is executed after the device-side processing, the mobile-side processing is executed after the MFP 100 can confirm that the device-side processing is completed.

The mobile phone side setting value setting unit 263 is a mobile phone side setting value when the mobile phone side processing is executed by the mobile phone side cooperation processing execution unit 267 or when the operation instructing the end of the setting of the cooperation processing by the user A is detected. Erase.

The set value transmitting unit 257 transmits the set of the processing identification information and the set value on the mobile side to the MFP 100 in response to the input from the set value setting unit 263 on the mobile side. Specifically, the communication route specified by the route identification information input from the communication control unit 250 is specified, the short-range communication unit 209 is controlled, and the MFP 100 is provided with a set of the processing identification information and the mobile phone side setting value. Send. When the communication control unit 250 notifies that the communication path has been disconnected, the set value transmission unit 257 inputs a set of the processing identification information and the mobile side set value from the mobile side set value setting unit 263. Do not send them even if they are.

When the short-range communication unit 209 receives the setting change request from the MFP 100 after the route identification information is input from the communication control unit 250, the change reception unit 259 accepts the setting change request. The setting change request includes pre-disconnection information. The change reception unit 259 outputs the setting change request to the continuation determination unit 255.

The continuation determination unit 255 outputs a setting change instruction to the mobile phone side setting value setting unit 263 in response to the setting change request being input from the change reception unit 259. The setting change instruction includes the pre-disconnection information included in the setting change request. The pre-disconnection information includes the processing identification information set by the device-side set value setting unit 63 and the mobile-side set value before the communication path is disconnected by the short-range communication unit 119.

When the setting change instruction is input from the continuation determination unit 255, the mobile phone side setting value setting unit 263 sets the processing identification information and the mobile phone side setting value set up to that point to the processing identification information included in the setting change instruction. And update with the set value on the mobile side. As a result, the setting of the mobile phone side setting value can be continued from the state in which the processing identification information and the mobile phone side setting value set before the communication path is disconnected by the short-range communication unit 119 are set.

<First modification>
The mobile phone side setting value setting unit 263 may reset the mobile phone side setting value at the stage when the communication path established by the communication control unit 250 with the MFP 100 is disconnected. Resetting the mobile phone setting value includes erasing the mobile phone setting value or updating with the default value.

In this case, in the MFP 100, the cooperation processing determination unit 49 receives the same device identification information, processing identification information, and device side as the device identification information included in the return instruction in response to the return instruction being input from the cooperation setting unit 71. The set of set values and the mobile phone side information are read from the RAM 114, and the read mobile phone side information is set as the pre-disconnection information. The cooperation processing determination unit 49 is a device included in the return instruction among the set of the device identification information and the mobile side information input from the mobile side setting value acquisition unit 51 after the return instruction is input from the cooperation setting unit 71. The mobile phone side information that is paired with the identification information is determined as the post-connection information. Then, the cooperation process determination unit 49 outputs the device identification information and the pre-disconnection information to the change request unit 53 when determining the first cooperation process, and when determining the second cooperation process, the device identification information and the device identification information. The post-connection information is output to the change request unit 53.

The change request unit 53 inputs either a set of device identification information and pre-disconnection information or a set of device identification information and post-connection information from the linkage process determination unit 49. When the set of the device identification information and the pre-disconnection information is input from the cooperation processing determination unit 49, the change request unit 53 transmits a setting change request including the pre-disconnection information to the smartphone 200A, and the device identification information and the post-connection information. When the pair with is input, a setting change request including information after connection is sent to the smartphone 200A. As a result, the user A can operate the smartphone 200A to continuously set the setting value on the mobile phone side from the state set before the smartphone 200A leaves the MFP 100 and the communication line is disconnected.

FIG. 8 is a flowchart showing an example of the flow of the cooperative processing according to the first embodiment. The linkage process is a process executed by the CPU 111 when the CPU 111 included in the MFP 100 executes the linkage program stored in the ROM 113, HDD 115, and CD-ROM 118. With reference to FIG. 8, the CPU 111 determines whether or not the display surface of the display unit 161 is instructed (step S01). Specifically, when the touch panel 165 is controlled to detect the position where the touch panel 165 is in contact with an object, it is detected that the display surface of the display unit 161 is instructed. If the display surface of the display unit 161 is instructed, the process proceeds to step S02, otherwise the process proceeds to step S09.

In the next step S02, it is determined whether or not the area of the designated area of the display surface of the display unit 161 is equal to or larger than a predetermined size. The predetermined size is preferably the upper limit of the area of the user's finger. This is to distinguish between an instruction given by a human finger and an instruction given by placing the smartphone 200A. If the area of the area designated by the display surface of the display unit 161 is equal to or larger than a predetermined size, the process proceeds to step S03, otherwise the process proceeds to step S07.

In step S03, the device detection process is executed, and the process proceeds to step S04. The details of the device detection process will be described later, but it is a process of detecting a device placed on the display surface of the display unit 161. When the device is detected, the detected device is used as a cooperative device and is detected by the touch panel 165. If the device is registered in association with the position and the device is not detected, it is judged as an error. The device detection process is also a process of establishing a communication path with the detected device. The device identification information of the cooperation device and the position identification information indicating the position detected by the touch panel 165 are temporarily stored in the RAM 114.

Here, a case where the user A places the smartphone 200A on the display surface of the display unit 161 will be described as an example. In this case, the smartphone 200A is registered in the cooperation device, and the device identification information of the smartphone 200A and the position identification information indicating the position where the smartphone 200A is placed on the display surface of the display unit 161 are temporarily stored in the RAM 114.

In step S04, it is determined whether or not an error is determined as a result of executing the device detection process. If no error is determined, the process proceeds to step S05, but if an error is determined, the process proceeds to step S09. In step S05, the operation mode is switched to the cooperation mode, and the process proceeds to step S06.

In step S06, the reconnection determination process is executed, and the process proceeds to step S09. The details of the reconnection determination process will be described later, but when the device registered in the cooperation device in step S03, here, the smartphone 200A determines that the connection is reconnection, the cooperation process is performed in the state before the communication path is disconnected. This is the process of recovering the settings.

When the process proceeds to step S07, the user instructs the touch panel 165 with a finger. In step S07, the user who instructed the touch panel 165 is specified. In step S03, when the linked device is detected, the user is specified by using the device identification information and the position information of the linked device. For example, when the smartphone 200A is registered in the cooperation device, the work area of the user A who carries the smartphone 200A is determined within a predetermined range from the position where the smartphone 200A is placed on the display surface of the display unit 161. If the position detected on the touch panel 165 is the work area of the user A, the user who instructed the touch panel 165 is specified as the user A.

In the next step S08, the reception control process is executed, and the process proceeds to step S09. The details of the reception control process will be described later, but it is a process of determining the operation by the user A based on the position detected in step S01 and executing the process determined by the determined operation.

In step S09, it is determined whether or not the mobile phone side information has been received. It is determined whether or not the mobile phone side information is received from the linked device detected by executing the device detection process in step S03. The mobile phone side information includes the processing identification information of the mobile phone side processing set in the cooperation device and the mobile phone side setting value for executing the mobile phone side processing. If the mobile phone information is received, the process proceeds to step S10, otherwise the process proceeds to step S11. In step S11, the mobile phone side information is temporarily stored in the RAM 114 in association with the device identification information of the cooperation device, here the smartphone 200A, and the process proceeds to step S11.

In step S11, it is detected whether or not the cooperation device is separated from the display surface of the display unit 161. When the smartphone 200A is registered in the cooperation device in step S03, the device identification information of the smartphone 200A is associated with the position information indicating the position on the display surface of the display unit 161. When the touch panel 165 does not detect the instruction at the position specified by the position information associated with the smartphone 200A, it is determined that the smartphone 200A is separated from the display surface of the display unit 161. If it is detected that the smartphone 200A, which is the cooperation device, is separated from the display surface of the display unit 161, the process proceeds to step S12, but if not, the process proceeds to step S17.

In step S12, the continuation state detection process is executed, and the process proceeds to step S13. The details of the continuation state detection process will be described later, but it is a process of detecting the continuation state in which the cooperation mode should be continued. In step S13, it is determined whether or not the continuation state is detected. If the continuation state is detected, the process proceeds to step S14, otherwise the process proceeds to step S15. In step S14, the cooperation mode is maintained and the process proceeds to step S17.

In step S15, the operation mode is switched to the independent mode, and the process proceeds to step S16. In step S16, the smartphone 200A detected to be separated from the display surface of the display unit 161 in step S11 is deleted from the cooperation device, and the process proceeds to step S17. The device identification information of the smartphone 200A detected to be separated from the display surface of the display unit 161 is deleted from the cooperation device by erasing from the RAM 114.

In step S17, it is determined whether or not the communication path established with the smartphone 200A, which is a cooperation device, has been disconnected. If the communication path is disconnected, the process proceeds to step S18, otherwise the process returns to step S01. In step S18, it is determined whether or not the operation mode is the cooperation mode. If the operation mode is the cooperation mode, the process proceeds to step S19, otherwise the process proceeds to step S21. In step S19, it is determined whether or not the cooperation mode is maintained after the withdrawal is detected in step S11. For example, in the state where the continuation state is detected with the smartphone 200A, when the smartphone 200A leaves the display surface of the display unit 161 and communication becomes impossible, the cooperation mode is performed after the withdrawal from the smartphone 200A is detected. Is maintained. If the cooperation mode is maintained after the withdrawal is detected, the process proceeds to step S20, otherwise the process proceeds to step S21.

In step S20, the device-side information and the mobile-side information of the cooperation device are stored in the RAM 114 in association with the device identification information of the cooperation device, and the process proceeds to step S21. In step S21, the smartphone 200A determined to have been disconnected in the communication path in step S17 is deleted from the cooperation device, and the process proceeds to step S22. Then, the operation mode is switched to the independent mode (step S22), and the process is returned to step S01.

FIG. 9 is a flowchart showing an example of the flow of the device detection process. The device detection process is a process executed in step S03 of FIG. With reference to FIG. 9, the CPU 111 controls the short-range communication unit 119 to transmit a search command (step S31). One or more of the smartphones 200A, 200B, and 200C existing in the range capable of communicating with the short-range communication unit 119 each returns a response command including the device identification information of the own device in response to receiving the search command. Smartphones 200A, 200B, 200C, in addition to devices placed on the display surface of the display unit 161 and not registered as linked devices, devices and display units not placed on the display surface of the display unit 161. A device placed on the display surface of 161 but already registered in the cooperation device may return a response command. Hereinafter, a device that returns a response command is referred to as a candidate device. Therefore, in the next step S32, the cooperation device and the exclusion device are excluded from the candidate devices. The exclusion device is a device registered as an exclusion device in step S38 described later. The cooperation device is a device registered as a cooperation device in step S41 described later. In the next step S33, it is determined whether or not the candidate device exists. If the candidate device exists, the process proceeds to step S34, but if not, the process proceeds to step S42. In step S42, an error is set and the process is returned to the linked process.

In the next step S34, it is determined whether or not there are a plurality of candidate devices. If there are a plurality of candidate devices, the process proceeds to step S35, but if not, the process proceeds to S38. In step S38, when the process proceeds from step S34, one candidate device is specified, and the process proceeds to step S39.

When the process proceeds to step S35, there are a plurality of candidate devices. In step S35, a candidate selection screen for selecting one of the plurality of candidate devices is displayed on the display unit 161 and the process proceeds to step S36. The position where the candidate selection screen is displayed is near the position detected by the touch panel 165 in step S01 of FIG. In step S36, the standby state is set until one of the plurality of candidate devices is selected (NO in step S36), and if one is selected (YES in step S36), the process proceeds to step S37. In step S37, all of one or more candidate devices that have not been selected from the plurality of candidate devices are registered in the exclusion device, and the process proceeds to step S38.

In step S38, when the process proceeds from step S37, the candidate device selected in step S36 is specified, and the process proceeds to step S39. In step S38, the short-range communication unit 119 is controlled to establish a communication path with the candidate device specified in step S38, and the process proceeds to step S40.

In step S40, the candidate device identified in step S38 is associated with the position detected by the touch panel 165 in step S01 of FIG. 8, and the process proceeds to step S41. In step S41, the candidate device is registered as a linked device, and the process is returned to the linked process. Specifically, the device identification information of the candidate device and the position information indicating the position associated with the candidate device in step S40 are stored in the RAM 114.

FIG. 10 is a flowchart showing an example of the flow of the reconnection determination process. The reconnection determination process is a process executed in step S06 of FIG. In step S03 before the reconnection determination process is executed, the smartphone 200A is detected as a device placed on the display surface of the display unit 161, and a communication path is established with the smartphone 200A. With reference to FIG. 10, the CPU 111 determines whether or not the device side information and the mobile phone side information associated with the device identification information of the smartphone 200A placed on the display surface of the display unit 161 are stored in the RAM 114. Determine (step S51). When step S20 of FIG. 8 is executed, the device side information and the mobile phone side information are stored in the RAM 114 in association with the device identification information of the linked device whose communication path is disconnected. If the device identification information of the device placed on the display surface of the display unit 161 and the device side information and the mobile phone side information associated with the device identification information are stored in the RAM 114, the process proceeds to step S52, but if not, the process is performed. Return to linked processing.

In step S52, the mobile phone side information associated with the device identification information of the device placed on the display surface of the display unit 161 is set as the pre-disconnection information, and the process proceeds to step S53. In step S53, the mobile phone side information is acquired from the smartphone 200A placed on the display surface of the display unit 161. Then, the mobile phone side information acquired in step S53 is set as post-connection information (step S54), and the process proceeds to step S55.

In step S55, it is determined whether or not the pre-disconnection information and the post-connection information are the same. If the pre-disconnection information and the post-connection information are the same, the process proceeds to step S56, otherwise the process proceeds to step S57. In step S56, the device side information associated with the device identification information of the smartphone 200A placed on the display surface of the display unit 161 is set, and the process is returned to the linked process.

In step S57, a process selection screen for selecting either the pre-disconnection information or the post-disconnection information is displayed on the display unit 161, and the process proceeds to step S58. The position where the process selection screen is displayed is near the position detected by the touch panel 165 in step S01 of FIG. In step S58, the standby state is set until either the pre-disconnection information or the post-disconnection information is selected, and when the pre-disconnection information is selected (YES in step S58), the process proceeds to step S59, but the post-disconnection information. Is selected (NO in step S58), the process proceeds to step S56. In step S59, a setting request including a command for setting pre-disconnection information is transmitted to the smartphone 200A placed on the display surface of the display unit 161, and the process proceeds to step S56. In step S56, the device side information associated with the device identification information of the smartphone 200A placed on the display surface of the display unit 161 is set, and the process is returned to the linked process.

FIG. 11 is a flowchart showing an example of the flow of reception control processing. The reception control process is a process executed in step S08 of FIG. The position instructed by the user A is detected by the touch panel 165 before the reception control process is executed. With reference to FIG. 11, the CPU 111 determines the operation based on the position detected by the touch panel 165 (step S61). The position on the operation screen is specified and the operation is determined based on the position detected by the touch panel 165 while the operation screen is displayed on the display unit 161. When the operation screen includes a button to which an operation is assigned and the position in the button is specified, the operation assigned to the button is determined. For example, when the operation screen is a keyboard, when the position in the key is specified, the operation for inputting the alphanumeric character assigned to the key is determined. Further, when the operation screen includes the execution key to which the execution instruction operation instructing the execution of the process is assigned and the position in the execution key is specified, the execution instruction operation is determined.

In the next step S62, the process is branched according to the operation mode. If the operation mode is the cooperative mode, the process proceeds to step S63, and if the operation mode is the independent mode, the process proceeds to step S68.

In step S63, it is determined whether or not the operation determined in step S61 is an execution instruction operation. If it is an execution instruction operation, the process proceeds to step S64, but if not, the process proceeds to step S67. In step S67, the device-side set value is set according to the determined operation, and the process is returned to the linked process. In step S64, the device-side process is executed in cooperation with the smartphone 200A, which is a cooperative device, according to the device-side set value, and the process proceeds to step S65. In step S65, the device-side set value is erased and the process proceeds to step S66. In step S66, the set value on the mobile phone side is deleted and the process is returned to the linked process.

In step S68, it is determined whether or not the operation determined in step S61 is an execution instruction operation. If it is an execution instruction operation, the process proceeds to step S69, but if not, the process proceeds to step S70. In step S70, the device independent setting value is set according to the determined operation, and the process is returned to the linked process. In step S69, the device independent process is executed according to the device independent set value, and the process is returned to the linked process.

FIG. 12 is a flowchart showing an example of the flow of the continuous state detection process. The continuous state detection process is a process executed in step S12 of FIG. With reference to FIG. 12, the CPU 111 determines whether or not the user has set the continuous state (step S81). If the user has set the continuation state, the process proceeds to step S84, otherwise the process proceeds to step S82. In step S82, it is determined whether or not it is within a predetermined time after the set value on the device side is set. If it is within a predetermined time after the device-side set value is set, the process proceeds to step S84, but if not, the process proceeds to step S83. It should be noted that it may be determined whether or not it is within a predetermined time after the operation for the task for executing the linked program is input. The operation for the task of executing the cooperation program includes, for example, an operation of scrolling the screen and an operation of transitioning the screen, in addition to the operation of setting the setting value on the device side.

In step S83, it is determined whether or not an error has occurred in the hardware resource. If an error has occurred in the hardware resource, the process proceeds to step S84, otherwise the process proceeds to step S85. In step S84, the continuation state on the MFP100 side is detected, and the process proceeds to step S85.

In step S85, the mobile state indicating the state of the smartphone 200A is acquired from the smartphone 200A which is a cooperation device. Then, based on the mobile phone state, it is determined whether or not the smartphone 200A, which is a cooperation device, is executing a predetermined application program (step S86). If the predetermined application program is being executed, the process proceeds to step S88, but if not, the process proceeds to step S87. The predetermined application program is a predetermined application program different from the mobile side cooperation program for the smartphone 200A to cooperate with the MFP 100, and is, for example, an application program for a call and an application program for receiving an e-mail. Including. While setting the linkage process with the MFP 100A, the user A may give priority to the call when the smartphone 200A receives a call, and the user A may give priority to the call when the smartphone 200A receives the e-mail. This is because reading e-mail may be prioritized.

In step S87, it is determined whether or not it is within a predetermined time after the set value on the mobile phone side is set. If it is within a predetermined time after the setting value on the mobile phone side is set, the process proceeds to step S88, but if not, the process is returned to the linked process. It should be noted that it may be determined whether or not it is within a predetermined time after the operation for the task for executing the mobile-side cooperation program is input. The operation for the task of executing the mobile phone side cooperation program includes, for example, an operation of scrolling the screen and an operation of transitioning the screen, in addition to the operation of setting the mobile phone side setting value. In step S88, the continuation state on the cooperation device side is detected, and the processing is returned to the cooperation processing.

FIG. 13 is a flowchart showing an example of the flow of the mobile-side cooperation processing according to the first embodiment. The mobile phone side cooperation process is a process executed by the CPU 201 when the CPU 201 included in the smartphone 200A executes the mobile phone side cooperation program stored in the flash memory 203 and the CD-ROM211A. With reference to FIG. 13, it is determined whether or not the short-range communication unit 209 has received the search command. If the search command is received, the process proceeds to step S202, otherwise the process proceeds to step S207. Here, the case where the search command transmitted by the MFP 100 is received will be described as an example.

In step S202, the short-range communication unit 209 is controlled to return a response command. Then, the short-range communication unit 119 determines whether or not the connection request has been received from the MFP 100 that has transmitted the search command received in step S201 (step S203). If the connection request is received, the process proceeds to step S204, otherwise the process proceeds to step S207. In step S204, a communication path is established with the MFP 100 that has transmitted the connection request, and the process proceeds to step S205.

In step S205, it is determined whether or not a setting request has been received from the MFP 100. If the setting request is received, the process proceeds to step S206, otherwise step S206 is skipped and the process proceeds to step S207. In step S206, the mobile phone side setting value included in the setting request is set, and the process proceeds to step S207.

In step S207, it is determined whether or not the operation has been accepted. Based on the position detected by the touch panel 207B while the operation screen is displayed on the display unit 206, the position on the operation screen is specified and the operation is determined. When deciding the operation, it is judged that the operation has been accepted. If the operation is accepted, the process proceeds to step S208, otherwise the process proceeds to step S216. When the operation screen includes a button to which an operation is assigned and the position in the button is specified, the operation assigned to the button is determined. For example, when the operation screen is a keyboard, when the position in the key is specified, the operation for inputting the alphanumeric character assigned to the key is determined. Further, when the operation screen includes the execution key to which the execution instruction operation instructing the execution of the process is assigned and the position in the execution key is specified, the execution instruction operation is determined. Further, when the operation screen includes a switching key for switching a task and a position in the switching key is specified, the task switching operation is determined.

In step S208, if the operation received in step S207 is a task switching operation, the process proceeds to step S209, but if not, the process proceeds to step S210. In step S209, the task is switched and the process is returned to step S201.

In step S210, it is determined whether or not the cooperation task is in the current state. If the linked task is in the current state, the process proceeds to step S211. If not, the process proceeds to step S212. In step S211, the set value on the mobile phone side is set according to the operation received in step S207, and the process proceeds to step S212. In step S212, the processing identification information of the mobile side processing and the mobile side setting value are transmitted to the MFP 100 via the communication path established in step S204, and the processing is returned to step S201.

In step S213, it is determined whether or not the operation received in step S207 is an execution instruction operation. If it is an execution instruction operation, the process proceeds to step S214, but if not, the process proceeds to step S215. In step S214, the device independent process specified by the execution instruction operation is executed according to the device independent set value, and the process is returned to step S201. In step S215, the device independent setting value is set according to the operation received in step S207, and the process returns to step S201.

As described above, in the cooperation system 1 according to the first embodiment, the MFP 100 detects the continuation state based on the state of the smartphone 200A which is the cooperation device or the state of the MFP 100, and the smartphone 200A displays the display unit 161. When the display surface is no longer in contact, the cooperation mode is continued when the continuation state is detected, and the mode is switched to the independent mode when the continuation state is not detected. Therefore, the smartphone 200A contacts the display surface of the display unit 161. When it does not, the operation mode can be changed depending on whether or not the continuation state is detected. Further, since the continuation state is detected based on the state of the portable device or the state of the information processing device, it is possible to easily determine whether or not to continue the cooperation mode. Further, when the smartphone 200A does not come into contact with the display surface of the display unit 161, the MFP 100 continues the cooperation mode when the continuation state is detected. Therefore, the user A displays the smartphone 200A on the display surface of the display unit 161. It is possible to continuously set the device-side setting value that was set before moving away from. Further, when the smartphone 200A does not come into contact with the display surface of the display unit 161 and the continuous state is not detected, the user A switches to the independent mode, so that the user A can easily separate the smartphone 200A from the display surface of the display unit 161. The operation mode of the MFP 100 can be switched by operation. Therefore, when the smartphone 200A does not come into contact with the display surface of the display unit 161, it is possible to appropriately switch whether or not the MFP 100 and the smartphone 200A are linked.

Further, the MFP 100 is a cooperation mode after the smartphone 200A no longer touches the display surface of the display unit 161. When the communication path established with the smartphone 200A is disconnected, the MFP 100 is a set value on the mobile phone side before disconnection. When the set value and the device side setting value are stored in association with the smartphone 200A and then switched from the independent mode to the linked mode, if the device side setting value associated with the smartphone 200A is stored, the device side setting value Resume the settings. As a result, the user A can continuously set the device-side setting value set before the communication path is disconnected in the cooperation mode after the smartphone 200A no longer touches the display surface of the display unit 161. .. Furthermore, when switching from the independent mode to the linked mode, the mobile phone side setting value set in the smartphone 200A is acquired as the post-connection setting value, and based on the pre-disconnection setting value, the post-connection setting value, and the device side setting value, The cooperation process to be executed is determined, and the mobile phone side setting value and the device side setting value for executing the determined cooperation process are set. Therefore, in the cooperation mode after the communication path established with the smartphone 200A is disconnected, the setting is made from the state set for the MFP 100A and the smartphone 200A at any time before or after the communication path is disconnected. You can continue. Therefore, in the cooperation mode after the communication path established between the MFP 100A and the smartphone 200A is disconnected, the settings of the MFP 100A and the smartphone 200A can be matched.

Further, since the MFP 100 detects the continuation state when the smartphone 200A is executing the predetermined application program, the smartphone 200A can execute the predetermined application program in the cooperation mode. In particular, the predetermined application program is an application program different from the mobile-side cooperation program for linking with the MFP 100. Further, when the user A enters the cooperation mode after the communication path is disconnected by executing the predetermined application program on the smartphone 200A, the user A can use the smartphone 200A and the MFP 100 at any time before or after the communication path is disconnected. It can be continuously set from the state set for each.

Further, the MFP 100 detects the continuation state when a predetermined time has not elapsed since the mobile phone side setting value used for executing the mobile phone side processing is received in the smartphone 200A. Therefore, the user A can move the smartphone 200A away from the display surface of the display unit 161 and continue to set the set value on the mobile phone side. Further, when the communication path is disconnected while the mobile phone side setting value is set in the smartphone 200A and then the cooperation mode is set, the user A uses the MFP 100 at any time before or after the communication path is disconnected. And the smartphone 200A can be continuously set from the set state.

Further, since the MFP 100 detects the continuation state when a predetermined time has not elapsed since the device side setting value is received, the user A separates the smartphone 200A from the display surface of the display unit 161 and moves the smartphone 200A away from the display surface of the display unit 161 on the device side. You can continue to set the set value. Further, when the communication path is disconnected while the device side setting value is being set and then the cooperation mode is set, the user A can use the MFP 100 and the smartphone 200A at any time before or after the communication path is disconnected. It can be continuously set from the state set to.

Further, since the MFP 100 detects the continuation state when a problem occurs in the hardware resource, the user A sets the mobile phone side setting value in the smartphone 200A and the device side setting value in the MFP 100 after the problem is solved. You can continue to set. Further, when the communication path is disconnected while the hardware resource has a problem and then the cooperation mode is entered, the user A can use the MFP 100 and the smartphone at any time before or after the communication path is disconnected. It can be continuously set from the state set for each of 200A.

<Second Embodiment>
The difference between the cooperation system 1 in the second embodiment and the cooperation system 1 in the first embodiment will be mainly described.

FIG. 14 is a diagram showing an example of an overall outline of the cooperation system according to the second embodiment. With reference to FIG. 1, the cooperation system 1A in the second embodiment includes an MFP 100A and a smartphone 200A. The MFP 100 in the first embodiment allows a plurality of people to use the MFP 100 at the same time, but the MFP 100A in the second embodiment cannot be used by a plurality of people at the same time, and one person can use the MFP 100. It is said. Here, a case where the user A carrying the smartphone 200A operates the MFP 100A will be described as an example. In the cooperation system 1A according to the second embodiment, the smartphone 200A and the MFP 100A can cooperate with each other to execute the cooperation process. The smartphone 200A and the MFP 100A communicate with each other by using the short-range communication function or the wireless LAN function, and execute the cooperation process in cooperation with each other. The MFP 100A in the second embodiment switches the operation mode to the cooperation mode in which the operation mode is operated in cooperation with the smartphone 200A carried by the user A, triggered by the establishment of the predetermined cooperation start condition.

FIG. 15 is a block diagram showing an example of the hardware configuration of the MFP in the second embodiment. With reference to FIGS. 14 and 15, the difference between the MFP 100A in the second embodiment and the MFP 100 in the first embodiment is that the automatic document transfer device 120 is added and the operation panel 160 is added. It is a point. Since the other configurations of the MFP 100A are the same as those of the MFP 100 in the first embodiment, the description will not be repeated here.

The automatic document transfer device 120 separates one or more documents placed on the document tray by the user and transfers them one by one to the document reading unit 130. Further, when an image is formed on both sides of the original, it has a function of inverting the front and back of the original, transports the original on the surface of the original in a direction that can be read by the original reading unit 130, and then inverts the original. The document is conveyed on the back surface of the document in a direction that can be read by the document reading unit 130.

The operation panel 160 includes a display unit 161A and an operation unit 163. The display unit 161A is a display device for an LCD, an organic ELD, or the like, and is smaller in size than the display unit 161 in the first embodiment. The operation unit 163 includes a hard key unit 167 composed of a plurality of keys, and receives various instructions, characters, numbers, and other data input by the user's operation corresponding to the keys. The touch panel 165 is provided on the display unit 161A so as to be superimposed on the upper surface or the lower surface, and detects a position designated by the user on the display surface of the display unit 161A.

FIG. 16 is a block diagram showing an example of a CPU function included in the MFP according to the second embodiment. The function shown in FIG. 16 is a function formed in the CPU 111 by the CPU 111 included in the MFP 100 executing a cooperation program stored in the ROM 113, the HDD 115, and the CD-ROM 118.

With reference to FIG. 16, the function different from that shown in FIG. 4 is that the cooperation mode switching unit 35, the device detection unit 41, the route establishment unit 43, the maintenance unit 47, and the continuation state detection unit 37 are the cooperation mode switching unit 35A. , The device detection unit 41A, the route establishment unit 43A, the maintenance unit 47A, and the continuation state detection unit 37A, respectively. The continuous state detection unit 37A differs from the continuous state detection unit 37 shown in FIG. 4 in that the portable state detection unit 77 includes the battery remaining amount detection unit 89. Since the other functions are the same as the functions shown in FIG. 4, the description is not repeated here.

The device detection unit 41A controls the short-range communication unit 119 to detect the smartphone 200A. The device detection unit 41A detects the smartphone 200A when the user A brings the smartphone 200A closer to the antenna of the short-range communication unit 119 when the short-range communication unit 119 communicates by the NFC communication method. The device detection unit 41A outputs an establishment instruction to the route establishment unit 43A. The establishment instruction includes device identification information of the smartphone 200A.

The route establishment unit 43A identifies the device to be connected based on the device identification information included in the establishment instruction in response to the input of the establishment instruction from the device detection unit 41A, and controls the communication I / F unit 112. Then, a communication path is established with the specified device, and a cooperation instruction is output to the cooperation mode switching unit 35. Here, since the establishment instruction includes the device identification information of the smartphone 200A, the route establishment unit 43A establishes a communication path with the smartphone 200A and outputs the cooperation instruction to the cooperation mode switching unit 35. The cooperation instruction includes a device that has established a communication path, here, device identification information of the smartphone 200A, and route identification information for identifying the communication path.

When the established communication path is disconnected, the route establishment unit 43A outputs a disconnection signal including the route identification information of the disconnected communication path to the cooperation mode switching unit 35. The case where the communication path is disconnected includes, for example, the case where the smartphone 200A goes out of the communicable range of the communication I / F unit 112, and the case where the smartphone 200A disconnects the communication path.

When the short-range communication unit 119 can communicate at a distance longer than the communicable distance defined by the NFC communication method, the device detection unit 41A causes the short-range communication unit 119 to transmit a search command at predetermined time intervals. In this way, the short-range communication unit 119 detects the device capable of communicating. The route establishment unit 43A may control the short-range communication unit 119 or the communication I / F unit 112 to establish a communication route with the device detected by the device detection unit 41A.

The device detection unit 41A may authenticate the user before outputting the establishment instruction to the route establishment unit 43A. For example, the authentication information associated with the user identification information of the user who is authorized to use the MFP 100 and the device identification information of the device assigned to the user is stored in the HDD 115 in advance, and the device of the detected device. When the authentication information including the identification information is stored in the HDD 115, the establishment instruction is output to the route establishment unit 43A, but if such authentication information is not stored in the HDD 115, the establishment instruction is sent to the route establishment unit 43A. Do not output. Only users pre-registered with the MFP 100 can use the MFP 100.

The cooperation mode switching unit 35A switches the operation mode between the independent mode and the cooperation mode. The cooperation mode switching unit 35A outputs an operation mode signal indicating an operation mode of either the independent mode or the cooperation mode to the device side setting unit 31, the device side execution unit 33, and the continuous state detection unit 37A.

The cooperation mode switching unit 35A includes a cooperation setting unit 71A and a release unit 69A. The cooperation setting unit 71A switches the operation mode from the independent mode to the cooperation mode according to the establishment of the cooperation start condition. Here, the cooperation start condition is that the communication I / F unit 112 establishes a communication path after the short-range communication unit 119 can communicate with the smartphone 200A. The cooperation setting unit 71A switches the operation mode corresponding to the device identification information included in the cooperation instruction from the independent mode to the cooperation mode in response to the input of the cooperation instruction from the route establishment unit 43A.

When the cooperation end condition is satisfied, the release unit 69A switches the operation mode from the cooperation mode to the independent mode. The link termination condition is that the user inputs an operation to terminate the link, or the communication path is disconnected. Further, when the operation mode is switched from the cooperation mode to the independent mode, the release unit 69A outputs the maintenance signal to the maintenance unit 47A if a continuation signal indicating the continuation state is input from the continuation state detection unit 37A. To do. The continuation signal includes device identification information of the smartphone 200A. When the disconnection signal is input, the release unit 69A operates corresponding to the device identification information included in the disconnection signal when the continuation signal including the same device identification information as the device identification information included in the disconnection signal is input. The mode is switched from the cooperation mode to the independent mode, and a maintenance instruction is output to the maintenance unit 47A and the cooperation setting unit 71A. The maintenance instruction includes device identification information included in the disconnect signal.

In the release unit 69A, a cooperation end instruction may be input from the device side setting value setting unit 63, which will be described later. The details of the cooperation end instruction will be described later, but when the user A instructs the end of the cooperation process, it is output from the device side setting value setting unit 63 and includes the device identification information of the smartphone 200A carried by the user A. When the cooperation end instruction is input from the device side setting value setting unit 63, the release unit 69A determines that the cooperation end condition is satisfied, and sets the operation mode corresponding to the device identification information included in the cooperation end instruction from the cooperation mode. While switching to the independent mode, the end notification instruction is output to the release notification unit 45. The end notification instruction includes the device identification information included in the cooperation end instruction.

The cooperation setting unit 71A determines that the connection is reconnected when the maintenance instruction including the same device identification information as the device identification information included in the maintenance instruction is input from the route establishment unit 43A after the maintenance instruction is input from the release unit 69A. To do. When determining reconnection, the cooperation setting unit 71A switches the operation mode corresponding to the device identification information included in the cooperation instruction from the independent mode to the cooperation mode, and outputs a return instruction to the cooperation processing determination unit 49. The return instruction includes device identification information included in the maintenance instruction.

In the maintenance unit 47A, a set of the processing identification information, the device side setting value, and the device identification information is input from the device side setting value setting unit 63, and the device identification information and the mobile phone side information are input from the mobile phone side setting value acquisition unit 51. Is entered. The maintenance unit 47A is paired with the processing identification information and the device side setting value that are paired with the device identification information included in the maintenance instruction, and the device identification information, in response to the maintenance instruction being input from the release unit 69A. The mobile phone side information, which is the mobile phone side information last input from the mobile phone side setting value acquisition unit 51, is stored in the RAM 114 in association with the device identification information.

The battery remaining amount detection unit 89 inquires of the smartphone 200A about the remaining battery level via the communication path specified by the route identification information paired with the device identification information of the smartphone 200A. When the remaining battery level of the smartphone 200A is equal to or less than a predetermined threshold value T, the battery remaining amount detecting unit 89 outputs a continuation signal including the device identification information of the smartphone 200A to the cooperation mode switching unit 35. When the remaining battery level of the smartphone 200A is equal to or less than the threshold value T, the time during which the smartphone 200A can be driven is limited thereafter. Therefore, when the remaining battery level of the smartphone 200A decreases and the smartphone 200A cannot communicate with the MFP 100A, the communication path is cut off, but in the MFP 100A, the remaining battery level of the smartphone 200A is equal to or less than the threshold value T. In this case, since the continuation state is detected, the device side setting value set by the device side setting value setting unit 63 and the mobile phone side setting value set in the smartphone 200A are stored. After that, when the battery of the smartphone 200A is charged and the smartphone 200A and the MFP 100A are linked again, the setting for reproducing the previously set device-side setting value and the mobile-side setting value and executing the linkage process. Can be continued.

FIG. 17 is a diagram showing an example of a function possessed by the CPU included in the smartphone according to the second embodiment. The difference from the function shown in FIG. 7 with reference to FIG. 17 is that the communication control unit 250 has been changed to the communication control unit 250A. Since the other functions are the same as those shown in FIG. 7, the description is not repeated here.

The communication control unit 250A controls the short-range communication unit 209 to detect the MFP 100. When the user A brings the smartphone 200A close to the antenna of the short-range communication unit 119 included in the MFP 100A, the short-range communication unit 209 detects the MFP 100. After the short-range communication unit 209 detects the MFP100, the communication control unit 250A controls the wireless LANI / F208 to establish a communication path with the MFP100A in response to receiving a connection request from the MFP100A. The device identification information of the MFP 100A and the route identification information of the communication path are output to the set value transmission unit 257 and the change reception unit 259.

FIG. 18 is a flowchart showing an example of the flow of the cooperative processing in the second embodiment. The linkage process in the second embodiment is a process executed by the CPU 111 when the CPU 111 included in the MFP 100A executes the linkage program in the second embodiment stored in the ROM 113, HDD 115, and CD-ROM 118. is there. With reference to FIG. 18, the CPU 111 determines whether or not the short-range communication unit 119 communicating according to the NFC standard has detected the device (step S101). If the device is detected, the process proceeds to step S102, otherwise the process proceeds to step S115. In the next step S116, the reception control process shown in FIG. 11 is executed, and the process is returned to step S101.

In step S115, it is determined whether or not the operation has been accepted. When the touch panel 165 detects the position instructed by the user, the operation is detected. If the operation is detected, the process proceeds to step S116, but if not, the process returns to step S101.

In step S102, the device detected by the short-range communication unit 119 is specified, and the process proceeds to step S103. It is identified by receiving device identification information from the device. Here, a case of detecting the smartphone 200A will be described as an example. In step S102, when the device is specified and the user who carries the device is registered in advance, the operation may be accepted. In this case, step S102 or step S115 is executed after step S102 is executed.

In step S103, the communication I / F unit 112 is controlled to establish a communication path with the device specified in step S102, here the smartphone 200A, and the process proceeds to step S104. In step S104, the operation mode is switched to the cooperation mode, and the process proceeds to step S105. In step S105, the reconnection determination process shown in FIG. 10 is executed, and the process proceeds to step S106.

In step S106, it is determined whether or not the mobile phone side information has been received. It is determined whether or not the mobile phone side information is received from the device detected in step S102, here the smartphone 200A. The mobile phone side information includes the processing identification information of the mobile phone side processing set in the smartphone 200A which is a cooperation device and the mobile phone side setting value for executing the mobile phone side processing. If the mobile side information is received, the process proceeds to step S107, but if not, the process proceeds to step S108. In step S107, the mobile phone side information is temporarily stored in the RAM 114 in association with the device identification information of the smartphone 200A which is a cooperation device, and the process proceeds to step S108.

In step S108, the continuation state detection process is executed, and the process proceeds to step S109. The details of the continuation state detection process will be described later, but it is a process of detecting the continuation state in which the cooperation mode should be continued. In step S109, it is determined whether or not the communication path established with the smartphone 200A, which is the cooperation device, has been disconnected. If the communication path is disconnected, the process proceeds to step S110, otherwise the process proceeds to step S113.

In step S110, it is determined whether or not the continuation state is detected in the continuation state detection process executed in step S108. If the continuation state is detected, the process proceeds to step S111, otherwise the process proceeds to step S113.

In step S111, the device-side information and the mobile-side information of the cooperation device are stored in the RAM 114 in association with the device identification information of the smartphone 200A which is the cooperation device, and the process proceeds to step S112. In step S112, the operation mode is switched to the independent mode, and the process proceeds to step S113.

In step S113, it is determined whether or not the operation has been accepted, as in step S115. If the operation is accepted, the process proceeds to step S114, otherwise the process returns to step S109. In step S114, the reception control process shown in FIG. 11 is executed, and the process is returned to step S109.

FIG. 19 is a diagram showing an example of the flow of the continuous state detection process in the second embodiment. With reference to FIG. 19, the difference from the continuous state detection process in the first embodiment shown in FIG. 12 is that step S87A is added. Since the other processes are the same as the processes shown in FIG. 12, the description is not repeated here.

If it is determined in step S87 that the set value on the mobile phone side is not within a predetermined time, the process proceeds to step S87A. In step S87A, it is determined whether or not the remaining amount of the battery built in the smartphone 200A which is the cooperation device is equal to or less than the threshold value T. If the remaining amount of the battery built in the smartphone 200A, which is the cooperation device, is equal to or less than the threshold value T, the process proceeds to step S88, but if not, the process returns to the cooperation process.

FIG. 20 is a flowchart showing an example of the flow of the mobile phone side cooperation processing in the second embodiment. The difference from the mobile-side cooperation processing in the first embodiment shown in FIG. 13 is that steps S201 to S204 are changed to steps S201A to S204A. Since the other processes are the same as the processes shown in FIG. 13, the description will not be repeated here.

With reference to FIG. 20, the CPU 201 determines in step S201A whether or not the short-range communication unit 209 communicating according to the NFC standard has detected the device. If the device is detected, the process proceeds to step S202A, otherwise the process proceeds to step S207. Here, the case of detecting the MFP 100A will be described as an example.

In step S202A, the short-range communication unit 209 is controlled to transmit a response command to the MFP 100A. Then, in the next step S203B, the wireless LANI / F208 is controlled to determine whether or not a connection request has been received from the MFP 100A. If the connection request is received, the process proceeds to step S204A, otherwise the process proceeds to step S207. In step S204A, the wireless LANI / F208 is controlled to establish a communication path with the MFP100A, and the process proceeds to step S205.

<Second modification>
The device detection unit 41A has made the short-range communication unit 119 capable of communicating by a communication method based on the NFC standard detect the smartphone 200A. In the second modification, the smartphone 200A measures the current position of the smartphone 200A by receiving radio waves from GPS satellites. The device detection unit 41A in the second modification acquires the current position from the smartphone 200A, and determines the relative position between the smartphone 200A and the MFP 100A from the acquired current position of the smartphone 200A and the position where the MFP 100A is arranged. decide. Then, the device detection unit 41A detects the smartphone 200A when the smartphone 200A is within a predetermined range from the MFP 100A.

<Third variant>
The device detection unit 41A may detect the smartphone 200A by using human body communication that communicates using the human body as a medium. Specifically, the device detection unit 41A in the third modification detects the smartphone 200A carried by the user A when it becomes possible to communicate with the IC tag (integrated circuit) that can communicate with the human body owned by the user A.

<Fourth modification>
The smartphone 200A may be detected by using the position of the user A managed in the entry / exit management system that manages the entry / exit of the user. In this case, the MFP 100A is installed in a work room managed by an entry / exit management system, and each of the plurality of users carries a unique IC tag.

The entry / exit management system has a memory in which user identification information for identifying the owner of the IC tag is stored, and a tag reading unit for reading the IC tag. When entering the work room, the user brings his / her IC tag close to or in contact with the tag reading unit of the entry / exit management system. The tag reading unit detects the entry of the user by reading the IC tag that is close to or touched, and identifies the user identification information for identifying the owner of the IC tag. Further, when leaving the work room, the user brings his / her IC tag close to or in contact with the tag reading unit of the entry / exit management system. The tag reading unit detects the user's leaving the room by reading the IC tag that is close to or touched.

The device detection unit 41A in the fourth modification acquires the position of the work room and the user identification information of the user who has entered the work room from the entry / exit management system. The device detection unit 41A in the fourth modification acquires the position of the work room and the user identification information of the user who has left the work room from the entry / exit management system. When the device detection unit 41A in the fourth modification identifies a user who has entered the work room where the MFP 100A is arranged, based on the combination of the user's position and the user identification information acquired from the entry / exit management system. , Detects the smartphone carried by the identified user. For example, when the MFP 100A is arranged in the work room A, the smartphone 200A carried by the user A is carried in response to the acquisition of the position of the work room A and the user identification information of the user A from the entry / exit management system. To detect. Since the user identification information for identifying the owner of the IC tag used in the entry / exit management system is used, the user can be identified.

<Fifth variant>
The MFP 100A may be provided with a function for image authentication of the user A existing around the MFP 100A, and the smartphone 200A may be detected using the authentication result. The MFP 100A includes a camera that includes the periphery of the MFP 100A in the angle of view, and when the user A enters the angle of view of the camera, the camera authenticates the user A based on an image that the camera captures and outputs the user A as a subject. When the device detection unit 41A in the fifth modification succeeds in authenticating the user A, the device detection unit 41A detects the smartphone 200A carried by the user A.

<Sixth modification>
The MFP 100A may detect the position of the user existing around the MFP 100A, and the short-range communication unit 119 may detect the device capable of communicating. The MFP100A includes a motion sensor, and the MFP100A detects the position of a user who is in the vicinity. The motion sensor is, for example, an infrared sensor or a pyroelectric sensor. Further, the motion sensor may detect a person by extracting an image of a person from an image captured by the camera.

The device detection unit 41A detects the device to which the short-range communication unit 119 can communicate after the person is detected by the motion sensor. For example, when the user A approaches the MFP 100A, it is detected by the motion sensor. The device detection unit 41A detects the smartphone 200A to which the short-range communication unit 119 can communicate after the person is detected by the motion sensor.

As described above, in the cooperation system 1A in the second embodiment, the MFP 100A detects the continuation state based on the state of the smartphone 200A which is the cooperation device or the state of the MFP 100, and is established with the smartphone 200A. When the continuation state is detected at the stage of switching from the cooperation mode to the independent mode according to the disconnection of the communication path, the pre-disconnection setting value and the device side setting value, which are the mobile side setting values, are associated with the smartphone 200A. And remember. Then, when the mode is switched to the cooperation mode, if the device side setting value associated with the smartphone 200A is stored, the device side setting value setting is restarted, so that the user A sets before the communication path is disconnected. It is possible to continuously set the device-side setting value that has been set. Further, when switching to the cooperation mode, if the device side setting value associated with the smartphone 200A is not stored, the device side setting value is set from the beginning, so that the user A sets before the communication path is disconnected. It is possible to reset the set value on the device side. Therefore, in the MFP 100A, the device-side setting value for the device-side processing linked with the smartphone 200A can be set to an appropriate value. When switching from the independent mode to the linked mode, the linked process to be executed is determined based on the post-connection setting value, the pre-disconnect setting value, and the device side setting value acquired from the smartphone 200A, and the determined linkage is determined. Set the mobile phone side setting value and the device side setting value for executing the process. Therefore, in the cooperation mode after the communication path is disconnected, from the state set in the MFP 100A and the smartphone 200A at any time before or after the communication path established between the MFP 100A and the smartphone 200A is disconnected. The setting can be continued. Therefore, in the cooperation mode after the communication path established between the MFP 100A and the smartphone 200A is disconnected, the settings of the MFP 100A and the smartphone 200A can be matched.

Further, since the MFP 100A detects the continuation state when the smartphone 200A is executing the predetermined application program, the user A executes the predetermined application program on the smartphone 200A and disconnects the communication path. After that, when the cooperation mode is set, it can be continuously set from the state set in each of the smartphone 200A and the MFP 100A at any time before or after the communication path is disconnected. In particular, the predetermined application program is an application program different from the mobile-side cooperation program for linking with the MFP 100A.

Further, the MFP 100A detects the continuation state when a predetermined time has not elapsed since the mobile phone side setting value used for executing the mobile phone side processing is received in the smartphone 200A. Therefore, when the communication path is disconnected while the mobile phone side setting value is set in the smartphone 200A and then the cooperation mode is set, the user A is at any time before or after the communication path is disconnected. It can be continuously set from the state set in each of the MFP 100A and the smartphone 200A.

Further, the MFP 100A detects the continuation state when a predetermined time has not elapsed since the device-side set value used for executing the device-side process was received. Therefore, when the communication path is disconnected while the device side setting value is being set and then the cooperation mode is set, the user A uses the MFP 100A and the smartphone 200A at any time before or after the communication path is disconnected. It can be continuously set from the state set for each.

Further, since the MFP100A detects the continuation state when a problem occurs in the hardware resource, the user A is disconnected from the communication path while the problem occurs in the hardware resource, and then the cooperation mode is used. In this case, it is possible to continuously set from the state set in each of the MFP 100A and the smartphone 200A at any time before or after the communication path is disconnected.

Further, the MFP 100A detects the continuation state when the remaining amount of the battery for storing the electric power for driving the smartphone 200A is equal to or less than a predetermined value. Therefore, when the smartphone 200A does not drive and the communication path is disconnected, When the cooperation mode is set after the battery is charged, the user A can continuously set from the state set in the MFP 100A and the smartphone 200A at any time before or after the communication path is disconnected.

It should be considered that the embodiments disclosed this time are exemplary in all respects and not restrictive. The scope of the present invention is shown by the scope of claims rather than the above description, and is intended to include all modifications within the meaning and scope equivalent to the scope of claims.

1,1A cooperation system, 100,100A MFP, 110 main circuit, 111 CPU, 112 communication I / F section, 113 ROM, 114 RAM, 115 HDD, 116 facsimile section, 117 external storage device, 118 CD-ROM, 119 near Distance communication unit, 120 automatic document transfer device, 130 document reader, 140 image forming unit, 150 paper feed unit, 160 operation panel, 161,161A display unit, 163 operation unit, 165 touch panel, 167 hard key unit, 200A, 200B , 200C smartphone, 201 CPU, 202 camera, 203 flash memory, 204 wireless communication unit, 205 call unit, 206 display unit, 207 operation unit, 207A main key, 207B touch panel, 208 wireless LANI / F, 209 short-range communication unit, 210 GPS receiver, 211 external storage device, 211A CD-ROM, 31 device side setting unit, 33 device side execution unit, 35, 35A cooperation mode switching unit, 37, 37A continuous state detection unit, 41, 41A device detection unit, 43, 43A Route establishment unit, 45 Release notification unit, 47, 47A, 47B maintenance unit, 49 Linkage processing determination unit, 51 Mobile phone side setting value acquisition unit, 53 Change request unit, 61 Device independent setting value setting unit, 63 Device side Setting value setting unit, 65 device independent execution unit, 67 device side cooperation processing execution unit, 69, 69A release unit, 71, 71A cooperation setting unit, 73 device status detection unit, 75 user setting unit, 77 mobile status detection unit, 81 Device operation detection unit, 83 error detection unit, 85 application detection unit, 87 mobile operation detection unit, 89 battery level detection unit, 250, 250A communication control unit, 251 mobile side setting unit, 253 mobile side execution unit, 255 continuation judgment Unit, 257 setting value transmission unit, 259 change reception unit, 261 mobile phone independent setting value setting unit, 263 mobile phone side setting value setting unit, 265 mobile phone independent execution unit, 267 mobile phone side cooperation processing execution unit.

Claims (17)

A collaborative system that includes an information processing device and a portable device carried by a user.
The information processing device
Display means for displaying images and
A position detecting means for detecting a position where an object comes into contact with the display surface of the display means, and
A device detecting means for detecting the portable device when a response command is received from the portable device in response to the position where the portable device is in contact with the position detecting means.
A route establishment means for establishing a communication path with the mobile device, and
A continuous state detecting means for detecting a continuous state based on the state of the portable device or the state of the own device, and
When a communication path is established with the mobile device and the mobile device is detected by the device detection means, the mode changes from a single mode that does not cooperate with the mobile device to a cooperative mode that cooperates with the mobile device. When the portable device is not detected by the device detection means in the cooperation mode, the cooperation mode is continued if the continuation state is detected, and if the continuation state is not detected, the cooperation mode is released from the cooperation mode alone. When the communication path established with the mobile device is disconnected in the cooperation mode by switching to the mode, the cooperation mode switching means for switching from the cooperation mode to the independent mode and the cooperation mode switching means.
In the cooperation mode, it is set as the process to be executed by the portable device among the cooperation processes set to the portable device and defining a series of a plurality of processes to be executed in cooperation with the information processing device and the mobile device. Pre-disconnection setting value acquisition means for acquiring the mobile-side setting value used to execute the performed mobile-side processing as the pre-disconnection setting value, and
When the communication path established with the mobile device is disconnected in the cooperation mode after the portable device is no longer detected by the device detection means, the information processing device executes the cooperation process. A maintenance means for storing the device-side set value used for executing the device-side process defined as the process and the pre-disconnection set value finally acquired by the pre-disconnection setting value acquisition means in association with the portable device.
When switching from the independent mode to the linked mode, the mobile device side setting value set in the mobile device is acquired as the post-connection setting value, and the pre-disconnection setting value, the post-connection setting value, and the device side setting value are acquired. Based on the above, a cooperation system including a cooperation process determining means for determining a cooperation process to be executed and setting a mobile phone side setting value and a device side setting value for executing the determined cooperation process. A collaborative system that includes an information processing device and a portable device carried by a user.
The information processing device
A route establishment means for establishing a communication path with the mobile device, and
A continuous state detecting means for detecting a continuous state based on the state of the portable device or the state of the own device, and
It is predetermined to switch from the independent mode that does not cooperate with the mobile device to the cooperation mode that cooperates with the mobile device and end the cooperation mode in the cooperation mode according to the establishment of the cooperation start condition corresponding to the mobile device. The cooperation mode switching means for switching to the independent mode according to the establishment of the cooperation end condition, and
In the cooperation mode, it is set as the process to be executed by the portable device among the cooperation processes set to the portable device and defining a series of a plurality of processes to be executed in cooperation with the information processing device and the mobile device. Pre-disconnection setting value acquisition means for acquiring the mobile-side setting value used to execute the performed mobile-side processing as the pre-disconnection setting value, and
The cooperation end condition includes disconnection of the communication path established with the mobile device, and the cooperation mode switching means is used in response to the disconnection of the communication path established with the mobile device. When the continuation state is detected at the stage of switching from the cooperative mode to the independent mode, the device side used to execute the device side process defined as the process to be executed by the information processing device among the linked processes. A maintenance means for storing the set value and the pre-disconnection set value finally acquired by the pre-disconnection setting value acquisition means in association with the portable device.
When switching to the cooperation mode linked with the mobile device in the independent mode, the mobile device side setting value set in the mobile device is acquired as the post-connection setting value, and the pre-disconnection setting value, the post-connection setting value and the post-connection setting value are obtained. A cooperation process determining means for determining a cooperation process to be executed based on the device side setting value and setting a mobile phone side setting value and a device side setting value for executing the determined cooperation process is provided. Cooperation system. The information processing device further includes a device-side receiving means for receiving an operation by a user.
In the cooperation mode, the device side setting value is set according to the operation received by the device side reception means, and in the independent mode, the device independent process different from the device side process according to the operation received by the device side reception means. Device-side setting means for setting the device-specific setting value used to execute
A device-side execution means for executing the device-side processing in cooperation with the portable device according to the device-side setting value in the cooperation mode and executing the device-side processing according to the device-only setting value in the single mode. ,
The mobile device includes a mobile reception means that accepts operations by the user and a mobile reception means.
A mobile phone setting means for setting a mobile phone setting value or a mobile phone independent setting value used for executing a mobile phone independent processing other than the mobile phone processing according to an operation received by the mobile phone receiving means.
The mobile phone independent process can be executed regardless of whether the information processing device is in the independent mode or the linked mode, and the information processing device links the mobile phone side process with the information processing device in the linked mode. The cooperation system according to claim 1 or 2, further comprising a portable side execution means that can be executed. When the pre-disconnection set value and the post-connection set value are the same, the cooperation process determining means determines the cooperation process including the portable side process determined by them and the device side process determined by the device side set value. The cooperation system according to any one of claims 1 to 3. When the pre-disconnection set value and the post-connection set value are different, the cooperation process determining means includes a first mobile-side process determined by the pre-disconnection set value and a device-side process determined by the device-side set value. The first cooperation process is determined, and the second cooperation process including the second mobile side process determined by the post-connection set value and the device side process determined by the device side set value is determined. The cooperation system according to any one of claims 1 to 4, which determines one of the second cooperation processes selected by the user. The cooperation system according to any one of claims 1 to 5, wherein the continuous state detecting means detects the continuous state when the portable device is executing a predetermined application program. The cooperation system according to claim 6, wherein the predetermined application program is an application program different from the application program for executing processing in cooperation with the information processing apparatus. A predetermined time has elapsed since the mobile device received the mobile-side set value used for executing the mobile-side process defined as the process to be executed by the mobile device in the mobile device. The cooperation system according to any one of claims 1 to 7, wherein the continuation state is detected when the continuation state is not set. The continuous state detecting means according to any one of claims 1 to 8, wherein the continuous state detecting means detects the continuous state when a predetermined time has not elapsed since the device-side set value was received by the information processing device. Cooperation system. The cooperation system according to any one of claims 1 to 9, wherein the continuous state detecting means detects the continuous state when a defect of a hardware resource occurs. The cooperation system according to any one of claims 1 to 10, wherein the continuous state detecting means detects the continuous state when the remaining amount of the battery for storing electric power for driving the portable device is equal to or less than a predetermined value. .. Display means for displaying images and
A position detecting means for detecting a position where an object comes into contact with the display surface of the display means, and
When the position where the portable device is in contact with the position detecting means receives a response command from said portable device in response to the detected, a device detecting means for detecting the portable device,
A route establishment means for establishing a communication path with the mobile device, and
A continuous state detecting means for detecting a continuous state based on the state of the portable device or the state of the own device, and
When a communication path is established with the mobile device and the mobile device is detected by the device detection means, the mode changes from a single mode that does not cooperate with the mobile device to a cooperative mode that cooperates with the mobile device. When the portable device is not detected by the device detection means in the cooperation mode, the cooperation mode is continued if the continuation state is detected, and if the continuation state is not detected, the cooperation mode is released from the cooperation mode alone. When the communication path established with the mobile device is disconnected in the cooperation mode by switching to the mode, the cooperation mode switching means for switching from the cooperation mode to the independent mode and the cooperation mode switching means.
In the cooperation mode, it is set as the process to be executed by the mobile device among the cooperation processes set to the portable device and defining a series of a plurality of processes to be executed in cooperation with the own device and the mobile device. Pre-disconnection setting value acquisition means for acquiring the mobile-side setting value used to execute mobile-side processing as the pre-disconnection setting value, and
When the communication path established with the mobile device is disconnected in the cooperation mode after the portable device is no longer detected by the device detection means, as a process executed by the own device among the cooperation processes. A maintenance means for storing the device-side set value used for executing the predetermined device-side process and the pre-disconnection set value finally acquired by the pre-disconnection setting value acquisition means in association with the portable device.
When the mode is switched from the independent mode to the linked mode, the mobile device side setting value set in the mobile device is acquired as the post-connection setting value, and the pre-disconnection setting value, the post-connection setting value, and the device side setting value are acquired. An information processing device provided with a cooperation process determining means for determining a cooperation process to be executed and setting a mobile phone side setting value and a device side setting value for executing the determined cooperation process based on the above. A route establishment means for establishing a communication route with a mobile device,
A continuous state detecting means for detecting a continuous state based on the state of the portable device or the state of the own device, and
It is predetermined to switch from the independent mode not linked to the portable device to the linked mode linked to the portable device and to end the linked mode in the linked mode according to the establishment of the cooperation start condition corresponding to the mobile device. The cooperation mode switching means for switching to the independent mode according to the establishment of the cooperation end condition, and
In the cooperation mode, it is set as the process to be executed by the mobile device among the cooperation processes set to the portable device and defining a series of a plurality of processes to be executed in cooperation with the own device and the mobile device. Pre-disconnection setting value acquisition means for acquiring the mobile-side setting value used to execute mobile-side processing as the pre-disconnection setting value, and
The cooperation end condition includes disconnection of the communication path established with the mobile device, and the cooperation mode switching means is used in response to the disconnection of the communication path established with the mobile device. When the continuation state is detected at the stage of switching from the linked mode to the independent mode, the device-side set value used to execute the device-side process defined as the process to be executed by the own device among the linked processes. And a maintenance means for storing the pre-disconnection set value finally acquired by the pre-disconnection setting value acquisition means in association with the portable device.
When switching to the cooperation mode linked with the mobile device in the independent mode, the mobile device side setting value set in the mobile device is acquired as the post-connection setting value, and the pre-disconnection setting value, the post-connection setting value and the post-connection setting value are obtained. A cooperation process determining means for determining a cooperation process to be executed based on the device side setting value and setting a mobile phone side setting value and a device side setting value for executing the determined cooperation process is provided. Information processing device. It is a cooperation method executed by an information processing device.
The information processing device
Display means for displaying images and
A position detecting means for detecting a position where an object comes into contact with the display surface of the display means is provided.
When the position where the portable device is in contact with the position detecting means receives a response command from said portable device in response to being detected, and the device detection step of detecting the portable device,
A route establishment step for establishing a communication path with the mobile device,
A continuation state detection step for detecting a continuation state based on the state of the portable device or the state of the own device, and
When a communication path is established with the mobile device and the mobile device is detected in the device detection step, the mode changes from a single mode that does not cooperate with the mobile device to a cooperative mode that cooperates with the mobile device. When the portable device is not detected in the device detection step in the switching and the cooperation mode, the cooperation mode is continued if the continuation state is detected, and if the continuation state is not detected, the cooperation mode is started alone. When the communication path established with the mobile device is disconnected in the cooperation mode by switching to the mode, the cooperation mode switching step of switching from the cooperation mode to the independent mode and the cooperation mode switching step.
In the cooperation mode, it is set as the process to be executed by the portable device among the cooperation processes set to the portable device and defining a series of a plurality of processes to be executed in cooperation with the information processing device and the mobile device. Pre-disconnection setting value acquisition step to acquire the mobile-side setting value used to execute the performed mobile-side processing as the pre-disconnection setting value, and
When the communication path established with the mobile device is disconnected in the cooperation mode after the portable device is no longer detected in the device detection step, the information processing device executes the cooperation process. A maintenance step of storing the device-side set value used to execute the device-side process defined as the process and the pre-disconnection setting value finally acquired in the pre-disconnection setting value acquisition step in association with the portable device, and
When the mode is switched from the independent mode to the linked mode, the mobile device side setting value set in the mobile device is acquired as the post-connection setting value, and the pre-disconnection setting value, the post-connection setting value, and the device side setting value are acquired. A cooperation method including a cooperation process determination step of determining a cooperation process to be executed and setting a mobile phone side setting value and a device side setting value for executing the determined cooperation process. A route establishment step for establishing a communication route with a mobile device,
A continuation state detection step for detecting a continuation state based on the state of the portable device or the state of the own device, and
It is predetermined to switch from the independent mode not linked to the portable device to the linked mode linked to the portable device and to end the linked mode in the linked mode according to the establishment of the cooperation start condition corresponding to the mobile device. The cooperation mode switching step of switching to the independent mode according to the establishment of the cooperation end condition, and
In the cooperation mode, it is set to the mobile device, and is defined as a process to be executed by the mobile device among a series of a series of processes to be executed in cooperation with the information processing device and the mobile device. The pre-disconnection setting value acquisition step for acquiring the mobile-side setting value used to execute the mobile-side processing as the pre-disconnection setting value, and
The cooperation end condition includes disconnection of the communication path established with the mobile device, and in the cooperation mode switching step in response to the disconnection of the communication path established with the mobile device. When the continuation state is detected at the stage of switching from the cooperative mode to the independent mode, the device side used to execute the device side process defined as the process to be executed by the information processing device among the linked processes. A maintenance step of storing the set value and the pre-disconnection set value finally acquired in the pre-disconnection setting value acquisition step in association with the portable device, and
When switching to the cooperation mode linked with the mobile device in the independent mode, the mobile device side setting value set in the mobile device is acquired as the post-connection setting value, and the pre-disconnection setting value, the post-connection setting value and the post-connection setting value are obtained. The cooperation process determination step of determining the cooperation process to be executed based on the device side setting value, and setting the mobile phone side setting value and the device side setting value for executing the determined cooperation process, is described above. A cooperation method that causes an information processing device to execute. A collaborative program executed by a computer that controls an information processing device.
The information processing device
Display means for displaying images and
A position detecting means for detecting a position where an object comes into contact with the display surface of the display means is provided.
When the position where the portable device is in contact with the position detecting means receives a response command from said portable device in response to being detected, and the device detection step of detecting the portable device,
A route establishment step for establishing a communication path with the mobile device,
A continuation state detection step for detecting a continuation state based on the state of the portable device or the state of the own device, and
When a communication path is established with the mobile device and the mobile device is detected in the device detection step, the mode changes from a single mode that does not cooperate with the mobile device to a cooperative mode that cooperates with the mobile device. When the portable device is not detected in the device detection step in the switching and the cooperation mode, the cooperation mode is continued if the continuation state is detected, and if the continuation state is not detected, the cooperation mode is started alone. When the communication path established with the mobile device is disconnected in the cooperation mode by switching to the mode, the cooperation mode switching step of switching from the cooperation mode to the independent mode and the cooperation mode switching step.
In the cooperation mode, it is set as the process to be executed by the portable device among the cooperation processes set to the portable device and defining a series of a plurality of processes to be executed in cooperation with the information processing device and the mobile device. Pre-disconnection setting value acquisition step to acquire the mobile-side setting value used to execute the performed mobile-side processing as the pre-disconnection setting value, and
When the communication path established with the mobile device is disconnected in the cooperation mode after the portable device is no longer detected in the device detection step, the information processing device executes the cooperation process. A maintenance step of storing the device-side set value used to execute the device-side process defined as the process and the pre-disconnection setting value finally acquired in the pre-disconnection setting value acquisition step in association with the portable device, and
When switching from the independent mode to the linked mode, the mobile device side setting value set in the mobile device is acquired as the post-connection setting value, and the pre-disconnection setting value, the post-connection setting value, and the device side setting value are acquired. Based on the above, the cooperation process for determining the cooperation process to be executed and setting the mobile phone side setting value and the device side setting value for executing the determined cooperation process, and the cooperation process for causing the computer to execute the cooperation process. program. A route establishment step for establishing a communication route with a mobile device,
A continuation state detection step for detecting a continuation state based on the state of the portable device or the state of the own device, and
It is predetermined to switch from the independent mode not linked to the portable device to the linked mode linked to the portable device and to end the linked mode in the linked mode according to the establishment of the cooperation start condition corresponding to the mobile device. The cooperation mode switching step of switching to the independent mode according to the establishment of the cooperation end condition, and
In the cooperation mode, it is set to the mobile device, and is defined as a process to be executed by the mobile device among a series of a series of processes to be executed in cooperation with the information processing device and the mobile device. The pre-disconnection setting value acquisition step for acquiring the mobile-side setting value used to execute the mobile-side processing as the pre-disconnection setting value, and
The cooperation end condition includes disconnection of the communication path established with the mobile device, and in the cooperation mode switching step in response to the disconnection of the communication path established with the mobile device. When the continuation state is detected at the stage of switching from the cooperative mode to the independent mode, the device side used to execute the device side process defined as the process to be executed by the information processing device among the linked processes. A maintenance step of storing the set value and the pre-disconnection set value finally acquired in the pre-disconnection setting value acquisition step in association with the portable device, and
When switching to the cooperation mode linked with the mobile device in the independent mode, the mobile device side setting value set in the mobile device is acquired as the post-connection setting value, and the pre-disconnection setting value, the post-connection setting value and the post-connection setting value are obtained. The cooperation process determination step of determining the cooperation process to be executed based on the device side setting value and setting the mobile phone side setting value and the device side setting value for executing the determined cooperation process is described above. A linked program that is executed by a computer that controls an information processing device.

Images