JP5998657B2 - Device control system, control program, and control method - Google Patents

Description

  The present invention relates to a device control system, a control program, and a control method, and more particularly, to interlock control between a function realized by hardware and an information processing function.

  In recent years, there has been a tendency to digitize information, and image processing apparatuses such as printers and facsimiles used for outputting digitized information and scanners used for digitizing documents have become indispensable devices. Such an image processing apparatus is configured as an MFP (Multi Function Peripheral) that can be used as a printer, a facsimile, a scanner, and a copier by providing an imaging function, an image forming function, a communication function, and the like. Many. There is also known a document management system that stores and uses such digitized documents in a document management server.

  In such a document management system, a macro function for continuously executing a plurality of processes with a small number of operations is used by combining an image processing function by hardware provided in the MFP and an information processing function. As an example of such a macro function, for example, by combining a scanner function and an information processing function, image information generated by scanning is stored in a storage medium accessible via a network, and document accumulation is performed. There is a scan distribution function for improving efficiency (see, for example, Patent Document 1).

  In the conventional macro function, an application program corresponding to the information processing function to be realized is generated and installed in the MFP, and the macro setting that associates the image processing function by hardware and the processing of the application program is registered in advance. It is necessary to keep it. In such a case, in order to expand the information processing function, it is necessary to generate and install an application program corresponding to each MFP. Therefore, the load due to the design and construction of the program and the management burden on the administrator who installs the program in the MFP are large, and it is difficult to expand the functions.

  In addition, since MFPs are often shared by multiple users, when all the functions necessary for each user are installed, it is necessary to install functions that require fewer users, resulting in inefficient use of hardware resources. As a result, the hardware resources of the MFP may be insufficient. Examples of the hardware resources of the MFP include a storage capacity for installing an application program and a user interface for operating the installed application.

  Note that such a problem is not limited to the above-described image processing apparatus such as an MFP, and may be similarly a problem in a system that realizes a macro function that combines a function realized by hardware and an information processing function. . Therefore, the same problem may occur not only in the image processing apparatus but also in all electronic devices.

  The present invention has been made to solve such a problem, and is intended to facilitate the expansion of a macro function that combines the functions of the apparatus and the information processing function, and to improve the use of hardware resources. With the goal.

In order to solve the above-described problem, an aspect of the present invention is an apparatus control system including an electronic apparatus and a portable information processing terminal, in which items of setting values to be set to operate the electronic apparatus are specified. Setting item information acquisition unit that acquires the set item information in the portable information processing terminal, item correspondence information that associates the setting value item in the electronic device with the setting value item in the portable information processing terminal. An operation screen display processing unit that displays an operation screen for operating the electronic device by designating the setting value based on the acquired setting item information on the portable information processing terminal, and In the portable information processing terminal, a setting value designation receiving unit that accepts designation of the setting value in response to an operation on the operation screen, and the item correspondence information The operation control information generating unit that generates the operation control information for controlling the operation of the electronic device by allocating the designated setting value to the setting value item in the electronic device, and the generated operation control information An operation control information transmitting unit for transmitting to the electronic device, an operation control unit for performing operation control according to the operation control information received from the portable information processing terminal in the electronic device, and a plurality of the set values. A preset information acquisition unit that acquires preset information stored in the electronic device and stored in the portable information processing terminal. The operation screen display processing unit refers to the item correspondence information. The operation screen is displayed so that an image for receiving an instruction to cause the electronic device to execute an operation corresponding to the acquired set information is displayed, The slave device is an image processing device including an image processing function, and the set information includes an item for designating a distribution destination of image information processed in the image processing device as one of the setting value items, Setting of an item for designating the delivery destination of the image information when the setting value of the item for designating the delivery destination of the image information is information indicating delivery of the image information to a user who operates the image processing apparatus further characterized by including Mukoto the setting value conversion unit which converts the value to a value that specifies the portable information processing terminal.

Another aspect of the present invention is a control program for controlling the portable information processing terminal in a device control system including an electronic device and a portable information processing terminal, and is set to operate the electronic device. A step of acquiring setting item information in which a setting value item to be specified is specified, and item correspondence information that associates the setting value item in the electronic device with the setting value item in the portable information processing terminal. A step of causing a display device to display an operation screen for operating the electronic device by designating the setting value based on the acquired setting item information; and the setting value according to an operation on the operation screen A step of accepting the designation of the device, and referring to the item correspondence information, and assigning the designated setting value to the setting value item in the electronic device. And generating the operation control information for controlling the operation of the electronic device Te, and transmitting the generated said operation control information to the electronic device, the electronic device the plurality of the set value is specified in advance Obtaining the set information stored in the information processing device used as the portable information processing terminal, and in the displaying step, the item correspondence information is referred to and the obtained set information is obtained. Displaying the operation screen on the display device so that an image for receiving an instruction to cause the electronic device to perform an operation corresponding to information is displayed, and the electronic device is an image processing device including an image processing function; The set information includes, as one of the setting value items, an item for designating a distribution destination of image information processed in the image processing apparatus. When the setting value of the item that specifies the distribution destination of the image information is information indicating the distribution of the image information to the user who operates the image processing apparatus, the item that specifies the distribution destination of the image information The information processing apparatus is further caused to execute a step of converting the set value into a value designating the portable information processing terminal .

According to still another aspect of the present invention, there is provided a device control method including an electronic device and a portable information processing terminal, wherein setting item information specifying a setting value item to be set for operating the electronic device is specified. Is acquired in the portable information processing terminal, and the setting item information acquired by referring to item correspondence information that associates the setting value item in the electronic device with the setting value item in the portable information processing terminal. The operation screen for operating the electronic device is displayed on the portable information processing terminal by designating the setting value, and the portable information processing terminal displays the operation screen according to the operation on the operation screen. Accepting designation of a setting value, referring to the item correspondence information, assigning the designated setting value to a setting value item in the electronic device, Operation control information for controlling the operation of the device is generated, the generated operation control information is transmitted to the electronic device, and the electronic device responds to the operation control information received from the portable information processing terminal. the operation control line Align to obtain the configured information in which a plurality of the set value is stored in the electronic device is designated in advance in the portable information processing terminal, by referring to the item relation information, acquired the The operation screen is displayed on the portable information processing terminal so that an image for accepting an instruction for causing the electronic device to execute an operation corresponding to the set information is displayed, and the electronic device includes an image processing function. The processing apparatus, wherein the set information includes a designation of a distribution destination of image information processed in the image processing apparatus as one of the setting value items. If the setting value of the item that specifies the distribution destination of the image information is information indicating the distribution of the image information to the user who operates the image processing apparatus, the distribution destination of the image information is specified. The set value of the item is converted into a value for designating the portable information processing terminal in the portable information processing terminal .

  According to the present invention, it is possible to facilitate the expansion of the macro function that combines the functions provided in the apparatus and the information processing function and to improve the efficiency of hardware resource utilization.

It is a figure which shows the operation | use form of the image processing system which concerns on embodiment of this invention. It is a block diagram which shows typically the hardware constitutions of the information processing apparatus which concerns on embodiment of this invention. It is a block diagram which shows the function structure of the image processing apparatus which concerns on embodiment of this invention. It is a block diagram which shows the function structure of the mobile apparatus which concerns on embodiment of this invention. It is a block diagram which shows the function structure of the client application which concerns on embodiment of this invention. It is a figure which shows the example of the parameter item information which concerns on embodiment of this invention. It is a figure which shows the example of the item corresponding | compatible information which concerns on embodiment of this invention. It is a figure which shows the example of the setting value information which concerns on embodiment of this invention. 5 is a flowchart illustrating an operation of the mobile device according to the embodiment of the present invention. It is a figure which shows the example of the information of the device classification which concerns on embodiment of this invention. It is a figure which shows the example of the apparatus selection screen which concerns on embodiment of this invention. It is a sequence diagram which shows operation | movement of the system which concerns on embodiment of this invention. It is a figure which shows the example of the macro selection screen which concerns on embodiment of this invention.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. In this embodiment, when using a macro function that links an image processing function installed in an image processing apparatus and an information processing function realized by the information processing apparatus, a mobile device such as a smartphone or a tablet terminal performs image processing. An example of an image processing system that is used as a user interface of the apparatus and that realizes part of an information processing function in a mobile device will be described.

  Generally, mobile devices such as smartphones and tablet terminals are equipped with full-screen touch panels. By using such a mobile device as a user interface of the image processing apparatus, it is possible to operate the macro function with a rich user interface instead of a limited user interface installed in the image processing apparatus.

  Further, when the information processing function is realized on the mobile device side, it is possible to receive information on the image to be processed on the mobile device side through communication between the mobile device and the image processing apparatus. In such a case, the information processing function can be expanded by installing an application program on the mobile device instead of the image processing apparatus side.

  Since it is assumed that the mobile terminal is used as an information processing terminal dedicated to each individual, it becomes possible to select the functions necessary for each individual by installing the necessary applications on each mobile terminal. Resource utilization efficiency can be improved. In addition, the management burden on the MFP administrator can be reduced, and only the application program to be installed on the mobile terminal needs to be developed, so there is no need to develop an application program corresponding to various MFPs. It is also possible to reduce the program development load.

  FIG. 1 is a diagram illustrating an example of an operation mode of the image processing system according to the present embodiment. As shown in FIG. 1, the image processing system according to the present embodiment includes an image processing apparatus 1, a mobile device 2, a PC (Personal Computer) 3, and a projector 4 via a network such as the Internet or a LAN (Local Area Network). Connected and configured.

  The image processing apparatus 1 is an MFP (Multi Function Peripheral) that can be used as a printer, a facsimile, a scanner, and a copier by providing an imaging function, an image forming function, a communication function, and the like. The mobile device 2 is a portable information processing terminal such as a smartphone, a tablet terminal, or a PDA (Personal Digital Assistant).

  The PC 3 is a general information processing apparatus, and can be selected as the final distribution destination of the processed image in the macro function by the image processing system according to the present embodiment. The projector 4 is a projector having a function of projecting an image on a screen. The projector 4 according to the present embodiment has an information processing function for browsing a file, referring to a folder, and the like in addition to a function for performing projection based on an input video signal like a general projector. Furthermore, the projector 4 has a network communication function.

  In other words, the projector 4 according to the present embodiment can be selected as the final distribution destination of the processed image in the macro function by the image processing system according to the present embodiment, and can also be selected from the image processing apparatus 1, the mobile device 2, and the PC 3. It is possible to generate and project a video signal with reference to information stored in.

  Next, a hardware configuration of an information processing apparatus that is each device included in the image processing system according to the present embodiment will be described. FIG. 2 is a block diagram illustrating a hardware configuration of the information processing apparatus according to the present embodiment. As shown in FIG. 2, the information processing apparatus according to the present embodiment includes the same configuration as that of a general server or PC.

  That is, the information processing apparatus according to the present embodiment includes a CPU (Central Processing Unit) 10, a RAM (Random Access Memory) 20, a ROM (Read Only Memory) 30, a HDD (Hard Disk Drive) 40, and an I / F 50. Connected through. Further, an LCD (Liquid Crystal Display) 60 and an operation unit 70 are connected to the I / F 50. In addition, the image processing apparatus 1 includes an engine that performs image formation output and scanning, and the projector 4 includes a projector that emits projection light based on a video signal.

  The CPU 10 is a calculation means and controls the operation of the entire information processing apparatus. The RAM 20 is a volatile storage medium capable of reading and writing information at high speed, and is used as a work area when the CPU 10 processes information. The ROM 30 is a read-only nonvolatile storage medium and stores a program such as firmware. The HDD 40 is a non-volatile storage medium that can read and write information, and stores an OS (Operating System), various control programs, application programs, and the like.

  The I / F 50 connects and controls the bus 80 and various hardware and networks. The LCD 60 is a visual user interface for the user to check the state of the information processing apparatus. The operation unit 70 is a user interface for a user to input information to the information processing apparatus, such as a keyboard, a mouse, various hard buttons, and a touch panel.

  In such a hardware configuration, a program stored in a storage medium such as the ROM 30, the HDD 40, or an optical disk (not shown) is read into the RAM 20, and the software control unit is configured by the CPU 10 performing calculations according to those programs. . A combination of the software control unit configured in this way and hardware constitutes a functional block that realizes the function of each device configuring the image processing system according to the present embodiment.

  Next, functions of the image processing apparatus 1 according to the present embodiment will be described. FIG. 3 is a block diagram showing a functional configuration of the image processing apparatus 1 according to the present embodiment. As shown in FIG. 3, the image processing apparatus 1 according to the present embodiment includes a controller 100, an ADF (Auto Document Feeder) 110, a scanner unit 120, a paper discharge tray 130, a display panel 140, and a paper feed table. 150, a print engine 160, a paper discharge tray 170, a network I / F 180, and a near field communication I / F 190.

  The controller 100 includes a main control unit 101, an engine control unit 102, an input / output control unit 103, an image processing unit 104, and an operation display control unit 105. As shown in FIG. 3, the image processing apparatus 1 according to the present embodiment is configured as a multifunction machine having a scanner unit 120 and a print engine 160. In FIG. 3, the electrical connection is indicated by solid arrows, and the flow of paper is indicated by broken arrows.

  The display panel 140 is an output interface that visually displays the state of the image processing apparatus 1 and is an input when the user directly operates the image processing apparatus 1 or inputs information to the image processing apparatus 1 as a touch panel. It is also an interface (operation unit). The network I / F 180 is an interface for the image processing apparatus 1 to communicate with other devices such as an administrator terminal via the network, and an Ethernet (registered trademark) or a USB interface is used.

  The short-range communication I / F 190 is an interface for the image processing apparatus 1 to communicate with other devices by short-range wireless communication, such as Bluetooth (registered trademark), Wi-Fi (Wireless Fidelity), FeliCa (registered trademark), and the like. The interface is used.

  The controller 100 is configured by a combination of software and hardware. Specifically, a software control unit and an integrated circuit configured by loading a control program such as firmware stored in a non-volatile storage medium such as the ROM 30 or the HDD 40 into the RAM 20 and performing an operation by the CPU 10 according to the program. The controller 100 is configured by hardware such as the above. The controller 100 functions as a control unit that controls the entire image processing apparatus 1.

  The main control unit 101 plays a role of controlling each unit included in the controller 100, and gives a command to each unit of the controller 100. The engine control unit 102 serves as a drive unit that controls or drives the print engine 160, the scanner unit 120, and the like. The input / output control unit 103 inputs signals and commands input to the main control unit 101 via the network I / F 180 and the short-range communication I / F 190. The main control unit 101 also controls the input / output control unit 103 to access other devices via the network I / F 180, the near field communication I / F 190, and the network.

  The image processing unit 104 generates drawing information based on image information to be printed and output under the control of the main control unit 101. The drawing information is information for drawing an image to be formed in the image forming operation by the print engine 160 as an image forming unit. The image processing unit 104 processes image data input from the scanner unit 120 to generate image data. This image data is information stored in the image processing apparatus 1 as a result of the scanner operation or transmitted to other devices via the network I / F 180 or the short-range communication I / F 190.

  In addition, when an application program corresponding to an additional image processing function related to the macro function is installed in the image processing apparatus 1, the function of the image processing unit 104 is expanded according to the installed program. . The operation display control unit 105 displays information on the display panel 140 or notifies the main control unit 101 of information input via the display panel 140.

  When using the image processing apparatus 1, the user performs login processing by inputting login information via the display panel 140. The login information input here is a user ID, a password, or the like. In addition to operating the display panel 140 to input login information, a mode in which information stored in an IC (Integrated Circuit) card is read via NFC (Near Field Communication) is also conceivable. In this case, if a Felica (registered trademark) interface is used as the short-range communication I / F 190, it is possible to input login information by reading an ID card such as an employee ID card through the interface.

  When the image processing apparatus 1 operates as a printer, first, the input / output control unit 103 receives a print job via the network I / F 180. The input / output control unit 103 transfers the received print job to the main control unit 101. When receiving the print job, the main control unit 101 controls the image processing unit 104 to generate drawing information based on document information or image information included in the print job. When drawing information is generated by the image processing unit 104, the engine control unit 102 executes image formation on a sheet conveyed from the paper feed table 150 based on the generated drawing information. As a specific mode of the print engine 160, an image forming mechanism using an ink jet method, an image forming mechanism using an electrophotographic method, or the like can be used. The document on which the image has been formed by the print engine 160 is discharged to the discharge tray 170.

  When the image processing apparatus 1 operates as a scanner, the operation display control unit 105 or input / output control is performed in accordance with a user operation on the display panel 140 or a scan execution instruction input from an external device via the network I / F 180. The unit 103 transfers a scan execution signal to the main control unit 101. The main control unit 101 controls the engine control unit 102 based on the received scan execution signal. The engine control unit 102 drives the ADF 110 and conveys the document to be imaged set on the ADF 110 to the scanner unit 120. Further, the engine control unit 102 drives the scanner unit 120 and images a document conveyed from the ADF 110. If no original is set on the ADF 110 and the original is set directly on the scanner unit 120, the scanner unit 120 images the set original according to the control of the engine control unit 102. That is, the scanner unit 120 operates as an imaging unit.

  In the imaging operation, an imaging element such as a CCD included in the scanner unit 120 optically scans the document, and imaging information based on the optical information is generated. The engine control unit 102 transfers the imaging information generated by the scanner unit 120 to the image processing unit 104. The image processing unit 104 generates image information based on the imaging information received from the engine control unit 102 according to the control of the main control unit 101. Image information generated by the image processing unit 104 is stored in a storage medium attached to the image processing apparatus 1 such as the HDD 40. The image information generated by the image processing unit 104 is stored in the HDD 40 or the like as it is according to a user instruction, or is transmitted to an external device by the input / output control unit 103 via the network I / F 180 and the short-range communication I / F 190. Sent.

  When the image processing apparatus 1 operates as a copying machine, the image processing unit 104 generates drawing information based on the imaging information received by the engine control unit 102 from the scanner unit 120 or the image information generated by the image processing unit 104. To do. Based on the drawing information, the engine control unit 102 drives the print engine 160 as in the case of the printer operation.

  Next, the functional configuration of the mobile device 2 according to the present embodiment will be described with reference to FIG. As shown in FIG. 4, the mobile device 2 according to the present embodiment includes a controller 200, a network I / F 210, and a near field communication I / F 220 in addition to the LCD 60 and the operation unit 70 described in FIG. The controller 200 includes a network control unit 201, an operation control unit 202, a display control unit 203, a near field communication control unit 204, and a client application 230.

  The network I / F 210 is an interface for the mobile device 2 to communicate with other devices via the network, and an interface such as Ethernet (registered trademark) is used. The short-range communication I / F 220 is an interface for the mobile device 2 to communicate with other devices by short-range wireless communication, such as Bluetooth (registered trademark), Wi-Fi (Wireless Fidelity), and FeliCa (registered trademark). An interface is used. The network I / F 210 and the short-range communication I / F 220 are realized by the I / F 50 shown in FIG.

  The controller 200 is configured by a combination of software and hardware. The controller 200 is a control unit that controls the entire mobile device 2. The network control unit 201 acquires information input via the network I / F 210 and transmits information to other devices via the network I / F 210. The near field communication control unit 204 acquires information input via the near field communication I / F 220 and transmits information to other devices via the near field communication I / F 220.

  The operation control unit 202 acquires a signal of the operation content by the user with respect to the operation unit 70 and inputs it to a module that operates in the mobile device 2 such as the client application 204. The display control unit 203 causes the LCD 60 to display the state of the mobile device 2 such as a GUI (Graphical User Interface) of the client application 205.

  The client application 205 is configured by a software program that is installed and operates in the mobile device 2 in order to use the functions of the image processing system according to the present embodiment in the mobile device 2. The client application 205 includes a function for outputting a command for operating the image processing apparatus 1, a function for displaying a GUI (Graphical User Interface) for operating the image processing apparatus 1 on the mobile device 2, and an image incorporated in the macro function. Implement processing functions.

  Next, the functional configuration of the client application 205 according to the present embodiment will be described with reference to FIG. As illustrated in FIG. 5, the client application 230 according to the present embodiment includes an information acquisition unit 231, an item information conversion unit 232, a display information generation unit 233, a GUI display processing unit 234, an item correspondence information storage unit 235, and setting information storage. A unit 236, a setting item conversion unit 237, an operation reception unit 238, and an operation information transmission unit 239.

  The information acquisition unit 231 sends parameter item information (hereinafter referred to as “parameter item information”) to be given to the image processing apparatus 1 in order to operate the image processing apparatus 1 from the image processing apparatus 1 via short-range wireless communication. Get. In order to operate and operate the image processing apparatus 1, it is necessary to provide a parameter value for the operation in addition to the operation command. When the information acquisition unit 231 acquires the parameter item information, the mobile device 2 can recognize the parameter value item to be given to the image processing apparatus 1 in order to operate the image processing apparatus 1. That is, the information acquisition unit 231 functions as a setting item information acquisition unit.

  The parameter item information indicates information on parameter items to be given to the image processing apparatus 1 in order to operate the image processing apparatus 1, and from the mobile device 2 to the image processing apparatus 1 in order to operate the image processing apparatus 1. Indicates the format of information to be entered. Therefore, in the mobile device 2, information for operating the image processing apparatus 1 can be easily set by setting a value corresponding to the operation content by the user as the value of each parameter item according to the format of the parameter item information. Can be generated.

  The parameter item information is information that is the basis of a GUI displayed on the display panel 140 in the image processing apparatus 1, and is information described in a markup language such as XML (extensible Markup Language), for example. By acquiring such information from the image processing apparatus 1 side, the mobile device 2 can also display a screen according to the GUI displayed on the display panel 140 of the image processing apparatus 1.

  FIG. 6 is a diagram showing an example of parameter item information according to the present embodiment. In the parameter item information according to the present embodiment, parameter items to be given to the image processing apparatus 1 in order to operate the image processing apparatus 1 are specified by tags such as “<item A>” and “<item B>”. ing. In addition, options for each item are defined by a tag “<Select>”. In other words, in the image processing apparatus 1, the main control unit 101 displays a GUI on the display panel 140 based on information as illustrated in FIG. 6.

  Further, the information acquisition unit 231 acquires macro function setting value information (hereinafter referred to as “image processing apparatus side setting value information”) set in advance in the image processing apparatus 1. This image processing apparatus side setting value information is information in which setting values in the macro function are registered for each setting item indicated in the parameter item information described above, and is used as set information. Therefore, the information acquisition unit 231 also functions as a set information acquisition unit. Thereby, even when the mobile device 2 is used as a user interface of the image processing apparatus 1, it is possible to use a macro function set in advance in the image processing apparatus 1.

  The item information conversion unit 232 converts various types of information acquired by the information acquisition unit 231 into a format in the mobile device 2 based on information stored in the item correspondence information storage unit 235. As described above, in order to operate the image processing apparatus 1, it is necessary to provide parameter values for the operation. The client application 230 according to the present embodiment also has parameter items to be set in order to operate the image processing apparatus 1 in advance.

  However, the mobile device 2 may be used as a user interface in various types of image processing apparatuses 1, and the names of parameter setting items in the image processing apparatuses 1 of different models may be different. Therefore, the item information conversion unit 232 sets the setting value of each item included in the image processing apparatus side setting value information acquired by the information acquisition unit 231 based on the item correspondence information as illustrated in FIG. Each is assigned to an item, and processing is performed so that the setting value in the mobile device 2 can be confirmed or changed.

  For example, in the case of the parameter item information, tags such as “<item A>” and “<item B>” shown in FIG. 6 are converted into tags such as “<item 1>” and “<item 2>”. Accordingly, the parameter item information is converted into a format recognizable by the client application 230, so that the operation screen of the image processing apparatus 1 can be displayed by the client application 230. In the case of the image processing apparatus side setting value information, the setting values of the respective items included are assigned to the setting items in the mobile device 2.

  Note that item correspondence information as shown in FIG. 7 is generated for each image processing apparatus 1 in which the mobile device 2 may be used as a user interface, and is stored in the item correspondence information storage unit 235. In other words, as the processing corresponding to the initial setting for using the mobile device 2 as the user interface of the image processing apparatus 1 of a certain model, processing for storing the item correspondence information corresponding to the model in the item correspondence information storage unit 235 is executed. Is done. In FIG. 7, “mobile side item” corresponding to “item 4” of “image processing apparatus side item” is blank. This indicates that the image processing apparatus 1 of the model does not require a setting value corresponding to “item 4” or cannot set a setting value corresponding to “item 4”.

  The display information generation unit 233 generates display information for displaying the user interface of the image processing apparatus 1 on the LCD 60 of the mobile device 2 based on the parameter item information converted as described above. Further, the display information generation unit 233 performs processing such as disabling the interface column for setting “item 4” in FIG. 7 based on the item correspondence information described in FIG. Based on the apparatus side set value information, an icon display information generation process for selecting a macro function set by the image processing apparatus side set value information is executed.

  The GUI display processing unit 234 causes the LCD 60 to operate the image processing apparatus 1 by causing the display control unit 203 to control the LCD 60 based on the display information generated by the display information generation unit 233. Display. Also, the GUI display processing unit 234 displays a preset macro function based on the above-described image processing apparatus side setting value information and setting value information stored in the setting value information storage unit 236. As described above, in the client application 230 in the present embodiment, the item information conversion unit 232, the display information generation unit 233, and the GUI display processing unit 234 function as an operation screen display processing unit.

  FIG. 8 is a diagram illustrating an example of setting value information stored in the setting value information storage unit 236. The setting value information is information on macro function setting values as in the above-described image processing apparatus side setting value information, and is information on macro function setting values set in advance in the mobile device 2. As shown in FIG. 7, the set value information is used to operate the image processing apparatus 1 such as “<item 1> Scan to Me”, “<item 2> scan”, “<item 3> A4”, and the like. This is information stored in association with a tag indicating the set item and information of the set value.

  Further, the image processing device side setting value information has the same configuration as that in FIG. 8, but as described above, in the image processing device side setting value information, each “image processing device side item” shown in FIG. Items are described and setting values are registered. The set value information shown in FIG. 7 is generated for each macro function that has been set and registered in advance, and is stored in the set value information 236.

  The operation reception unit 237 receives an operation on the operation screen for the image processing apparatus 1 displayed by the GUI display processing unit 234 based on information input from the operation control unit 202. And the operation reception part 237 performs the process corresponding to the received operation. The operation information received by the operation receiving unit 237 includes specification of setting values for each of the parameter items described above. That is, the operation reception unit 237 functions as a setting value designation reception unit.

  The setting item conversion unit 238 converts the setting value information on the mobile side as shown in FIG. 7 into setting value information corresponding to the image processing apparatus 1 based on the item correspondence information shown in FIG. The setting item conversion unit 238 converts the setting items included in the setting value information shown in FIG. 8 into “image processing apparatus side items” based on the item correspondence information shown in FIG. Information is acquired, and setting value information in a format corresponding to the image processing apparatus 1 is generated. That is, the setting item conversion unit 238 functions as an operation control information generation unit that generates operation control information for controlling the operation of the image processing apparatus 1.

  If the macro function designated by the operation is a macro function preset in the image processing apparatus 1, that is, a macro function designated by the setting value information on the image processing apparatus side, the same conversion process as described above is performed. The image processing apparatus side setting value information acquired by the information acquisition unit 231 may be acquired as it is.

  The operation information transmission unit 239 transmits necessary information to the image processing device 1 via short-range wireless communication in response to an operation on the operation screen of the image processing device 1 received by the operation reception unit 237. For example, when the operation reception unit 237 acquires the converted set value information from the setting item conversion unit 238, the operation reception unit 237 inputs the converted set value information to the operation information transmission unit 239 together with a macro function execution instruction. In this case, the operation information transmission unit 239 controls the near field communication control unit 204 to cause the image processing apparatus 1 to transmit a macro function execution command via the near field communication I / F 220. As a result, a macro function execution command and a macro function parameter setting value to be executed are transmitted from the mobile device 2 to the image processing apparatus 1. That is, the operation information transmission unit 239 functions as an operation control information transmission unit.

  Next, the operation when the mobile device 2 is used as the user interface of the image processing apparatus 1 in the system according to the present embodiment will be described. FIG. 9 is a flowchart showing the operation of the mobile device 2 until an operation screen for operating the image processing apparatus 1 is displayed on the LCD 60 of the mobile device 2. As shown in FIG. 8, first, the client application 230 searches for a device capable of communication by short-range wireless communication (S901).

  In step S <b> 901, the client application 230 controls the near field communication control unit 204 to transmit a polling signal to the near field communication I / F 220 and receives a response signal corresponding to the polling signal to perform device search. . Upon receiving the response signal to the polling signal, the client application 230 controls the short-range communication control unit 204 to establish communication so that information can be exchanged with the responding device through short-range wireless communication. (S903).

  When the short-range wireless communication is established with the device, the client application 230 acquires an IP (Internet Protocol) address from the device that has established the communication (S903). When acquiring the IP address, the client application 230 controls the network control unit 201 to acquire device type information of each device by inquiring about the device type via the network (S904). That is, in S904, the client application 230 functions as a device type information acquisition unit.

  FIG. 10 is a diagram illustrating an example of device type information acquired in step S904. As shown in FIG. 10, the device type information includes information of “<device type>”, “<IP address>”, and “<device name>”. The information “<device type>” is information indicating the type of device as the name indicates, “image processing device” for the image processing device 1, “PC” for the PC 3, and “PC” for the projector 4. Information such as “Projector”.

  “<IP address>” is information indicating an IP address as the name suggests, and in S904, for example, information indicating to which device a response to an inquiry is used. “<Device name>” is information indicating the name of each device on the network as the name indicates, and is information indicating the model number of the model.

  In FIG. 9, the case where the process of S904 is performed after obtaining the IP address in S903 is described as an example. This is because acquiring the IP address facilitates the processing of S904 by acquiring MIB (Management Information Base) information using SNMP (Simple Network Management Protocol). In addition, the function of the client application 230 and the function corresponding to the client application 230 in each device such as the image processing apparatus 1, the PC 3, the projector 4, and the like are created, so that the information of FIG. 10 is acquired through short-range wireless communication. It is also possible to do.

  When the device type information of each device is acquired, the client application 230 refers to the information of each “<device type>”, and can be a device that can be an operation target or a device that can be an image distribution destination. The information “<device name>” and “<IP address>” is stored in the storage medium in the mobile device 2 (S905). That is, in S905, the client application 230 functions as an operable device determination unit and a distributable device determination unit.

  In step S905, “<device name>” and “<IP address>” registered as devices that can be image distribution destinations are displayed on the operation screen displayed on the mobile device 2 in FIG. It is used as an option in an interface for selecting a parameter as indicated by “specified value”. Therefore, the acquired “<device name>” is registered as an option item subsequent to “<Select>” for “<item H> distribution destination specified value” shown in FIG. In S905, “<device name>” and “<IP address>” registered as devices that can be operated are used as options when selecting an image processing apparatus to be operated in subsequent processing.

  As described above, in the image processing system according to the present embodiment, based on the device type information acquired by the client application 230 via the network, the delivery destination options when the image is distributed via the network are automatically selected. Generate. Therefore, when setting the macro function parameters, the user does not need to confirm and input the IP address or the like when setting the image distribution destination, and the convenience of the user can be improved.

  When the processing of S905 is completed, the client application 230 displays on the LCD 60 a selection screen for selecting the image processing apparatus 1 to be operated, that is, the image processing apparatus 1 to be displayed on the mobile device 2. The display control unit 203 is controlled to display (S906). Accordingly, a screen as shown in FIG. 11 is displayed on the LCD 60 of the mobile device 2, and the user can select a target device for displaying the operation screen.

  Next, the operation after the device to be operated is selected on the screen as shown in FIG. 11 will be described with reference to FIG. As illustrated in FIG. 12, when the client application 230 of the mobile device 2 receives selection of the image processing apparatus 1 to be operated by an operation on the screen illustrated in FIG. 11 (S1201), the information acquisition unit 231 is selected. The parameter item information and the image processing apparatus side set value information described above are acquired via the short-range wireless communication established with the image processing apparatus 1 (S1202).

  When the information acquisition unit 231 acquires the various types of information described above, the item information conversion unit 232 converts the setting values of each item included in the image processing device side setting value information based on the item correspondence information described in FIG. The item information is converted by assigning it to the setting item in the device 2 (S1203). Then, the display information generation unit 233 generates display information for displaying the user interface of the image processing apparatus 1 on the LCD 60 of the mobile device 2 based on the item correspondence information and the converted image processing apparatus side setting value information ( In step S1204, the GUI display processing unit 234 controls the display control unit 203 based on the generated display information, thereby performing display control of the operation screen on the LCD 60 (S1205).

  FIGS. 13A and 13B are diagrams showing the difference between the operation screen displayed on the LCD 60 of the mobile device 2 in S1205 and the operation screen of the image processing apparatus 1. FIG. FIG. 13A is a diagram showing an operation screen displayed on the LCD 60 of the mobile device 2 in S1205. In the example of FIG. 13A, three macro functions “Scan to Me”, “Scan to Projector”, and “Scan to Server” are displayed in a selectable manner. Among these, for example, “Scan to Me” is the macro function based on the setting value information on the image processing apparatus side described above, and “Scan to Projector” and “Scan to Server” are stored in the setting value information storage unit 236 in the mobile device 2. This is a macro function based on stored setting value information.

  FIG. 13B is a diagram illustrating an operation screen for selecting a macro function displayed on the image processing apparatus 1. As described above, since “Scan to ME” is the macro function displayed by the setting value information on the image processing apparatus side, the macro function selection displayed on the image processing apparatus 1 is displayed as shown in FIG. It is also displayed on the operation screen. As described above, in the present embodiment, the mobile device 2 acquires the setting value information on the image processing device side from the image processing device 1, and converts items based on the item correspondence information stored in the item correspondence information storage unit 235. As a result, even when the mobile device 2 is used as a user interface of the image processing apparatus 1, it is possible to use a macro function set in advance in the image processing apparatus 1.

  Thus, the operation screen of the image processing apparatus 1 is displayed on the mobile device 2, so that the user can operate the image processing apparatus 1 on the operation screen displayed on the LCD 60 of the mobile device 2 and give a command. It becomes. When the user operates the operation screen displayed on the mobile device 2 and the operation reception unit 237 receives an operation via the operation control unit 202 (S1206), the operation reception unit 237 and the setting item conversion unit as described above. The operation information is generated by the processing of 238, and the operation information is transmitted by the operation information transmission unit 239 via the short-range wireless communication (S1207).

  The operation information transmitted in S1207 includes information on parameters to be specified when executing the operation, in addition to the operation command specified by the operation by the user. Here, a case will be described as an example where a scan distribution function is executed in which scanning is performed in the image processing apparatus 1 and predetermined processing is performed on the scan result and stored in the mobile device 2.

  In the image processing apparatus 1, the input / output control unit 103 receives the operation information via the short-range communication I / F 190, and the input / output control unit 103 transfers the operation information to the main control unit 101. When the main control unit 101 acquires the operation information related to the execution of the scan distribution function from the input / output control unit 103, the main control unit 101 executes the scan by controlling the engine control unit 102 according to the command and parameters included in the operation information (S1208). . That is, the main control unit 101 functions as an operation control unit that controls the operation of the apparatus based on the operation control information received from the mobile device 2 in the image processing apparatus 1.

  When the information of the imaging result obtained by imaging the document by scanning is obtained, the main control unit 101 controls the image processing unit 104 to execute image processing on the information of the imaging result and control the input / output control unit 103. Thus, the image information generated by the image processing is transmitted to the mobile device 2 via the short-range communication I / F 190 (S1209).

  In the mobile device 2, the short-range communication control unit 204 receives image information via the short-range communication I / F 220, and the short-range communication control unit 204 transfers the information to the client application 230. Upon acquiring the image information, the client application 230 executes the image processing according to the set parameters when the image processing by the application program installed in the mobile device 2 is specified in the operation received in S1206 ( After that, the data is stored in a storage medium included in the mobile device 2 (S1211).

  As described above, in the image processing system according to the present embodiment, by displaying the GUI for operating the image processing apparatus 1 on the mobile device 2, it is possible to operate the image processing apparatus 1 with a rich user interface. It becomes. In addition, the mobile device 2 is used as a user interface of the image processing apparatus 1, and an information processing function incorporated in the macro function is realized by an application program installed in the mobile device 2. There is no need to expand functions, and the management burden on the image processing apparatus 1 can be reduced.

  Even when the same function is expanded, when the function of the image processing apparatus 1 is expanded, it is necessary to develop an application program corresponding to each image processing apparatus 1 of a different model. Becomes higher. On the other hand, it is only necessary to develop an application program for the mobile device 2 in which the use of hardware and software is relatively uniform by realizing the application program installed in the mobile device 2. It is possible to reduce the program development load.

  In addition, since each user installs only the application program corresponding to the function he / she uses in his / her mobile device 2, the number of programs installed in the shared image processing apparatus 1 is reduced, and the use of hardware resources is improved. Can be achieved. In other words, the image processing system according to the present embodiment makes it possible to easily expand the macro function that combines the functions provided in the image processing apparatus and the information processing function, and to improve the use efficiency of hardware resources.

  In addition, when various types of image processing apparatuses 1 are to be operated, the format of operation commands for operating each image processing apparatus 1 and the contents of parameters to be given differ for each image processing apparatus 1. On the other hand, in the system according to the present embodiment, parameter item information indicating the content of parameters to be given to each image processing apparatus 1 and the format of operation information to be input is acquired from the image processing apparatus 1 to be operated. Therefore, the mobile device 2 side can easily recognize the format of the operation command for operating each image processing apparatus 1 and the content of the parameter to be given.

  In addition, when various types of image processing apparatuses 1 are to be operated, it is conceivable that the definition of parameter values in the respective image processing apparatuses 1 is different even for corresponding parameter items. On the other hand, in the system according to the present embodiment, item correspondence information as shown in FIG. 7 is stored in advance on the mobile device 2 side. It is possible to perform conversion corresponding to the parameter value to be input to the apparatus 1.

  The parameter item information is information described in a markup language that is a source for displaying the GUI of the operation screen in the image processing apparatus 1, and the parameter item information is mobile based on the item correspondence information described above. Since conversion to the definition of the parameter item in the device 2 is performed, it is possible to realize GUI display on the mobile device 2 by a simple process.

  In the example of FIG. 12, an example in which image information generated by scanning and image processing in the image processing apparatus 1 is distributed from the image processing apparatus 1 to the mobile device 2 via short-range wireless communication will be described. did. On the other hand, in a general scan distribution function, network distribution based on TCP / IP protocol is used instead of short-range wireless communication.

  Accordingly, when using short-range wireless communication as in the example of FIG. 12, parameters for specifying a policy method for specifying the short-range communication control unit 204 instead of the network control unit 201 are set. The mobile device 2 is designated as a parameter of “<item H> delivery destination designation value” as shown in FIG.

  In addition, as described above, the mobile device 2 in the image processing system according to the present embodiment acquires information indicating the type of the device connected via the network in S904 of FIG. The selectable device is displayed as one of the delivery destination options on the operation screen displayed on the mobile device 2. Here, the determination as to whether or not the distribution destination can be selected is a determination in the mobile device 2 and does not indicate that direct distribution from the image processing apparatus 1 is possible.

  Accordingly, when a device that is determined to be selectable as a delivery destination based on the device type information acquired in S904, such as the projector 2, is designated as “<item H> delivery destination designation value”, the mobile device 2 As a delivery destination to be notified to the image processing apparatus 1, delivery to the mobile device 2 by short-range wireless communication is designated as in the example of FIG. In addition, the mobile device 2 delivers to the projector 4 via the network, thereby realizing delivery according to the user's designation.

  In addition, as a macro function registered in the image processing apparatus 1, a function called “Scan to Me” that distributes an image to a device set as its own terminal may be registered. In this case, in the image processing apparatus 1, “<item H> distribution destination designation value” in the “Scan to Me” macro function is automatically set according to the user authenticated by the login process.

  On the other hand, when the mobile device 2 is used as the user interface of the image processing apparatus 1, the mobile device 2 is selected as the “Scan to Me” distribution destination because of the characteristics of the device called the mobile device. preferable. Accordingly, when the client application 230 acquires the setting value information of the macro function corresponding to “Scan to Me” when acquiring the setting value information of the image processing apparatus from the image processing apparatus 1, the distribution destination thereof Is preferably rewritten to delivery to the mobile device 2 by short-range wireless communication as shown in the example of FIG.

  For example, when the item information conversion unit 232 converts the setting value of each parameter item, such processing is referred to as “Scan to Me” with reference to “<Item A> Setting Value Name Value” shown in FIG. This can be realized by determining whether or not a value is set. Further, in the case of “<item H> distribution destination designation value” shown in FIG. 6, when an identifier that designates a distribution destination corresponding to the logged-in user is registered, the item information conversion unit 232 displays the identifier. It can also be realized by detecting the identifier. That is, the item information conversion unit 232 functions as a set value conversion unit.

  In addition, “Scan to Me” in the present embodiment is distribution to the mobile device 2. Therefore, when the item information conversion unit 232 detects that the value “Scan to Me” is set in the setting value information on the image processing apparatus side as described above, the item information conversion unit 232 converts the value to “Scan to Mobile”. May be. Accordingly, as shown in FIG. 13C, the display on the macro selection screen in the mobile device 2 is changed from “Scan to Me” to “Scan to Mobile”. Thereby, the display of the operation screen can be easily understood by the user, and the convenience for the user can be improved.

  In the above embodiment, the item information conversion unit 232 converts the parameter item information as shown in FIG. 6 based on the item correspondence information as shown in FIG. The case where display information is generated based on converted parameter item information has been described as an example. On the other hand, instead of converting the parameter item information, when the display information generating unit 233 generates the display information, the table information may be generated based on the parameter item information while referring to the item correspondence information. good.

  Further, the parameter item information acquired from the image processing apparatus 1 to be operated is not limited to the information described in the markup language as shown in FIG. 6, but at least specified as shown in FIG. Any information including information indicating a parameter item to be displayed, information on options to be displayed on the operation screen, and the like may be used. When the client application 230 of the mobile device 2 acquires such information, an operation to be performed by determining a correspondence relationship with the parameter items defined in the client application 230 based on the item correspondence information illustrated in FIG. Screen display information can be generated.

  In any case, the format for defining parameter items used in various image forming apparatuses is an identifier such as “<item A>”, “<item 1>”, or “<set name value>”. Even if the name designation information is different, the item correspondence information as shown in FIG. 7 is registered in the client application 230 in advance, so that the parameter item definition in the client application 230 is defined. Display information for displaying the GUI of the operation screen can be generated based on the above.

  Further, in the above-described embodiment, the case where information exchanged when the mobile device 2 functions as the user interface of the image processing apparatus 1 is exchanged via short-range wireless communication has been described as an example. In addition, communication via a wireless LAN (Local Area Network) by the network I / F 210 may be used, or wired communication such as USB (Universal Serial Bus) may be used, and the same effects as described above can be obtained.

In the above-described embodiment, the image processing system having the image processing apparatus 1 as an operation target has been described as an example. It can be similarly applied as a control system. As a result, it is possible to facilitate the expansion of the macro function that combines the functions provided in the apparatus and the information processing function, and to improve the efficiency of hardware resource utilization.
Image processing apparatus 1 and

1 Image processing device 2 Client terminal 3 PC
4 Projector 10 CPU
20 RAM
30 ROM
40 HDD
50 I / F
60 LCD
70 Operation Unit 80 Bus 100 Controller 101 Main Control Unit 102 Engine Control Unit 103 Input / Output Control Unit 104 Image Processing Unit 105 Operation Display Control Unit 110 ADF
120 Scanner unit 130 Paper discharge tray 140 Display panel 150 Paper feed table 160 Print engine 170 Paper discharge tray 180 Network I / F
190 Short range communication I / F
200 Controller 201 Network Control Unit 202 Operation Control Unit 203 Display Control Unit 204 Near Field Communication Control Unit 210 Network I / F
220 Short range communication I / F
230 Client application 231 Information acquisition unit 232 Item information conversion unit 233 Display information generation unit 234 GUI display processing unit 235 Item correspondence information 236 Setting value information 237 Operation reception unit 238 Setting item conversion unit 239 Operation information transmission unit

JP 2002-77177 A

Claims (5)

A device control system including an electronic device and a portable information processing terminal,
A setting item information acquisition unit that acquires setting item information in which an item of a setting value to be set for operating the electronic device is specified in the portable information processing terminal;
Referencing item correspondence information for associating the setting value item in the electronic device with the setting value item in the portable information processing terminal, and specifying the setting value based on the acquired setting item information An operation screen display processing unit for displaying an operation screen for operating the electronic device by the portable information processing terminal,
In the portable information processing terminal, a setting value designation accepting unit that accepts designation of the setting value in response to an operation on the operation screen;
An operation control information generating unit that refers to the item correspondence information and generates operation control information for controlling the operation of the electronic device by assigning the designated setting value to an item of the setting value in the electronic device;
An operation control information transmitter for transmitting the generated operation control information to the electronic device;
In the electronic device, an operation control unit that performs operation control according to the operation control information received from the portable information processing terminal ;
A set information acquisition unit for acquiring, in the portable information processing terminal, set information stored in the electronic device in which a plurality of the set values are specified in advance,
The operation screen display processing unit refers to the item correspondence information, and displays the operation screen so that an image for receiving an instruction for causing the electronic device to execute an operation corresponding to the acquired set information is displayed. Display
The electronic device is an image processing apparatus including an image processing function,
The set information includes, as one of the setting value items, an item for designating a distribution destination of image information processed in the image processing apparatus,
Setting of an item for designating the delivery destination of the image information when the setting value of the item for designating the delivery destination of the image information is information indicating delivery of the image information to a user who operates the image processing apparatus equipment control system according to claim further including Mukoto the setting value conversion unit which converts the value to a value that specifies the portable information processing terminal. In the portable information processing terminal, a device type information acquisition unit that acquires device type information indicating the type of each device from communicable devices;
An operable device determination unit that determines a device that can be operated via the portable information processing terminal based on the acquired device type information;
The device control system according to claim 1, wherein the setting item information acquisition unit acquires the setting item information from a device that is determined to be operable. The electronic device is an image processing apparatus including an image processing function,
As one of the setting value items, an item for designating a distribution destination of image information processed in the image processing apparatus,
A distributable device determination unit that determines a device that can be designated as a distribution destination of the image information processed in the image processing device based on the acquired device type information;
The operation screen display processing unit displays the operation screen so that a device that can be designated as a delivery destination is displayed as an option of an item that designates a delivery destination of image information. 2. The device control system according to 2. A control program for controlling the portable information processing terminal in a device control system including an electronic device and a portable information processing terminal,
Obtaining setting item information in which items of setting values to be set to operate the electronic device are specified;
Referencing item correspondence information for associating the setting value item in the electronic device with the setting value item in the portable information processing terminal, and specifying the setting value based on the acquired setting item information Displaying an operation screen for operating the electronic device on a display device by:
Receiving the setting value according to an operation on the operation screen;
Referring to the item correspondence information, and generating operation control information for controlling the operation of the electronic device by allocating the designated setting value to an item of the setting value in the electronic device;
Transmitting the generated operation control information to the electronic device ;
A plurality of setting values designated in advance and acquiring set information stored in the electronic device are executed by an information processing device used as the portable information processing terminal;
In the displaying step, the operation screen is displayed so that an image for receiving an instruction for causing the electronic device to execute an operation corresponding to the acquired set information is referred to the item correspondence information. Display on the device,
The electronic device is an image processing apparatus including an image processing function,
The set information includes, as one of the setting value items, an item for designating a distribution destination of image information processed in the image processing apparatus,
Setting of an item for designating the delivery destination of the image information when the setting value of the item for designating the delivery destination of the image information is information indicating delivery of the image information to a user who operates the image processing apparatus A control program that causes the information processing apparatus to further execute a step of converting a value into a value that specifies the portable information processing terminal . A device control method including an electronic device and a portable information processing terminal,
Obtaining the setting item information in which the item of the setting value to be set to operate the electronic device is specified in the portable information processing terminal;
Referencing item correspondence information for associating the setting value item in the electronic device with the setting value item in the portable information processing terminal, and specifying the setting value based on the acquired setting item information An operation screen for operating the electronic device is displayed on the portable information processing terminal.
In the portable information processing terminal, the specification of the setting value is accepted according to an operation on the operation screen,
Referring to the item correspondence information, generating the operation control information for controlling the operation of the electronic device by assigning the designated setting value to the setting value item in the electronic device,
The generated operation control information is transmitted to the electronic device,
In the electronic device, the row Align the operation control according to the operation control information received from the portable information processing terminal,
A plurality of set values are designated in advance and set information stored in the electronic device is acquired in the portable information processing terminal,
The operation screen is displayed on the portable information processing terminal so as to display an image for receiving an instruction for causing the electronic device to execute an operation corresponding to the acquired set information with reference to the item correspondence information. Let
The electronic device is an image processing apparatus including an image processing function,
The set information includes, as one of the setting value items, an item for designating a distribution destination of image information processed in the image processing apparatus,
Setting of an item for designating the delivery destination of the image information when the setting value of the item for designating the delivery destination of the image information is information indicating delivery of the image information to a user who operates the image processing apparatus A device control method comprising: converting a value into a value specifying the portable information processing terminal in the portable information processing terminal .

Images