JP2021103476A - Information processing system, information processing device, evaluation method, and program - Google Patents

Abstract

To provide an information processing system capable of evaluating an image even without an image formation device, and the like.SOLUTION: An information processing system 100 enables communication between a terminal device 30 and an information processing device 50. The information processing device comprises an evaluation unit 55 which evaluates an image generated by a printer simulator according to a request from the terminal device, and a first communication unit 58 which transmits contents of evaluation results by the evaluation unit to the terminal device. The terminal device comprises a second communication unit 31 which receives the evaluation results, and a display control unit 32 which displays the evaluation results received by the second communication unit.SELECTED DRAWING: Figure 1

Description

The present invention relates to an information processing system, an information processing device, an evaluation method, and a program.

You may want to determine if two images are the same. For example, in fields such as commercial printing where high-quality printed matter is required, the user may evaluate whether printed matter of the same image quality can be obtained even if the printer driver is changed due to version upgrade or the like. Further, a PDL module (Printer Description Language) that performs rendering is operating on the image forming apparatus side such as a printer, but this PDL module may also be appropriately modified and upgraded. In this case as well, the user may evaluate whether or not a printed matter having the same image quality can be obtained.

Conventionally, the work related to such evaluation has been performed visually, but a technique for automating has been devised (see, for example, Patent Document 1). In Patent Document 1, a print job and set values are sent from the host computer to the image forming apparatus to be evaluated, and the image forming apparatus side creates image data based on the print job and set values and sends the image data to the host computer. It is described that the host computer evaluates the image forming apparatus to be evaluated by comparing the image data created by the stored previous version of the printer with the image data created by the image forming apparatus to be evaluated. ..

However, in the conventional technique, there is a problem that an image forming apparatus is required to create an image for evaluation on the image forming apparatus side.

In view of the above problems, an object of the present invention is to provide an information processing system or the like capable of evaluating an image without an image forming apparatus.

In view of the above problems, the present invention is an information processing system capable of communicating between a terminal device and an information processing device, wherein the information processing device is an image generated by a printer simulator in response to a request from the terminal device. It has an evaluation unit for evaluating the above and a first communication unit for transmitting the content of the evaluation result by the evaluation unit to the terminal device.
The terminal device is characterized by having a second communication unit that receives the evaluation result and a display control unit that displays the evaluation result received by the second communication unit.

It is possible to provide an information processing system or the like capable of evaluating an image without an image forming apparatus.

It is a figure explaining the outline of the processing of an information processing system. It is a block diagram of an example of an information processing system which performs an identity determination. This is an example of a hardware configuration diagram of a terminal device or an information processing device. This is an example of a functional block diagram for explaining the functions of the information processing device and the terminal device by dividing them into blocks. It is a figure which shows the configuration example of the virtual machine built in the information processing apparatus. It is a figure explaining the flow of processing performed by an information processing apparatus. This is an example of a sequence diagram for explaining the overall processing or operation performed by the information processing system. It is a figure which shows an example of the setting screen which a terminal device displays. It is a figure which shows an example of the initial value information which registered the initial value displayed on the setting screen 300. It is a figure explaining another example of a setting screen. It is a figure which shows an example of the pull-down menu displayed in the evaluation ID column. This is an example of a flowchart for explaining a process in which an information processing device performs an identity determination. This is an example of a diagram illustrating a method of generating difference information by the evaluation unit. It is a figure explaining the detection method of the difference which is continuous more than the size recognizable by the human eye. It is a figure explaining the detection method of the difference which exists more than the ratio recognizable by the human eye in a certain area. It is a figure explaining the generation method of the difference information. It is a figure which shows an example of the difference information of two images. It is a figure explaining the method of detecting the arrangement pattern from the arrangement of the difference. It is a figure which shows an example of the difference information of two images which the arrangement of a difference is not detected, and two images. It is a figure which shows an example of the difference information of two images which detected the arrangement of the difference, and the difference information of two images. It is a figure which shows an example of the evaluation result screen displayed by a terminal device. It is a figure which shows an example of the detailed evaluation result screen. It is a figure which shows an example of the judgment result for each page of the evaluation result. It is a figure which shows the description example of the XML file which has the details of a difference.

Hereinafter, as an example of the embodiment for carrying out the present invention, the information processing apparatus and the evaluation method performed by the information processing apparatus will be described with reference to the drawings.

<Outline of operation>
In the present embodiment, the information processing device that receives the request from the terminal device that can communicate via the network executes the printer simulator to create an image for printing processing that has been conventionally created by the image forming device. As a result, the information processing apparatus can compare two images for printing processing without an actual image forming apparatus.

FIG. 1 is a diagram illustrating an outline of processing of the information processing system 100.
(1) On the setting screen displayed by the terminal device 30, the user inputs the setting related to the image identity determination and presses the start button. As a result, the settings related to the identity determination are transmitted to the information processing device 50. By determining the identity of the images, the information processing device 50 can evaluate the influence of, for example, the modification of the printer driver, the printer simulator, the OS, or the like.
(2) When the information processing device 50 installs the printer driver set to be evaluated by the user and the printing application calls the printer driver for the evaluation file (file that is the source of image generation), the printer driver calls PDL (Printer). Create a print file described in Description Language). The OS, printer simulator, and the like can also be evaluated by being set by the user. In addition, printing conditions and evaluation files may affect the image quality.
(3) Normally, this print file is transmitted to the image forming apparatus, and the PDL module operating in the image forming apparatus renders and prints it on paper. However, in the present embodiment, information processing is performed without transmitting to the image forming apparatus. The printer simulator (PDL module) started in the device 50 performs the rendering process. Therefore, an image for printing processing is created in the information processing apparatus 50.
(4) The information processing device 50 stores the created image for printing processing in the storage unit. The stored image for printing processing is compared with the image for printing processing of the comparison source created in the same manner, and an evaluation result is generated.

As described above, since the information processing apparatus 50 of the present embodiment does not use the image forming apparatus for evaluating the influence of the difference in the printer driver, the PDL module, or the OS on the image, the configuration of the information processing system 100 is simplified. The evaluation cost can be reduced.

<Terminology>
The printer simulator is software that reproduces the image processing performed by the image forming apparatus on the information processing apparatus. In the present embodiment, the printer simulator has at least a PDL module and has a function of rendering.

Image evaluation refers to inspecting whether an image meets a predetermined quality. For example, it includes comparing with the image of the comparison source, and estimating the degree of difference if there is a difference in the comparison. Therefore, as an example of evaluation, there is an identity determination of two images. It should be noted that the evaluation does not necessarily require two images, and there is also a method of scanning the image generated by the printer simulator with a scanner and evaluating the pixel arrangement. In this case, there is a method in which the printer simulator prints an image with a fixed pattern having different pixel densities and compares the number of pixels in a certain area and the way they are scattered with a threshold value.

The evaluation result may include information about the quality of the image and may include, for example, the degree of difference.

The same judgment method includes a completely identical judgment method that determines that the difference is not mechanically the same if there is a difference of a predetermined value or more, and an ambiguous same judgment method that determines whether or not there is a difference that cannot be recognized by the human eye. There is. The same may be referred to as similar and dissimilar may be referred to as dissimilar.

The arrangement of differences refers to a bias of differences that is organized to some extent. It may be a set difference.

<Configuration example>
FIG. 2 is a configuration diagram of an example of an information processing system 100 that performs identity determination. In the present embodiment, the system configuration in which the information processing device 50 corresponding to the client-server type server determines the identity of the two images will be described. However, the terminal device 30 may perform the identity determination by itself.

In the information processing system 100, the terminal device 30 and the information processing device 50 can communicate with each other via the network N. The information processing device 50, also called a server or a server device, is a device that mainly performs information processing on a network, and is a device that responds to information and processing results in response to a request received via the network.

The information processing device 50 may exist on the Internet or on-premises. In any form, the information processing system 100 may be called a cloud system. A cloud system is a system in which resources on a network are used without being aware of specific hardware resources.

The information processing device 50 is described as a so-called Web server in the screen information (HTML, XML, script language, CSS (cascading style sheet), etc. of the portal screen that accepts processing, and is mainly analyzed and displayed by the browser software. Information) is generated and provided to the terminal device 30. A Web browser is operating in the terminal device 30, which receives screen information and displays a Web page. One of the Web pages has an interface that accepts the setting of the identity judgment of two images, and the user specifies one or more from the OS, the printer driver, the PDL module, etc. and informs the process of the identity judgment. Request to the processing device 50.

The web page may be provided by a web application. A Web application refers to software or a mechanism thereof that operates by coordinating a program in a programming language (for example, JavaScript (registered trademark)) that operates on a browser and a program on the Web server side and is executed on the browser. A web page can be dynamically changed by a web application.

On the other hand, the terminal device 30 receives screen information from the information processing device 50, displays it on a Web browser, and accepts operations from the user including settings related to the identity determination of the two images. The Web browser operating on the terminal device 30 transmits the setting related to the identity determination to the information processing device 50 and requests the process of the identity determination.

The terminal device 30 may be any device that operates software such as a Web browser such as a PC (Personal Computer), a tablet terminal, a PDA, or a smartphone. An electronic blackboard, a video conference terminal, or the like can also be a terminal device 30. Note that application software dedicated to the information processing system 100 may operate on the terminal device 30 instead of the Web browser. The evaluation result obtained by the identity determination can be displayed by the terminal device 30, and may be transmitted by the information processing device 50 by e-mail or stored on the network.

<Hardware configuration example>
FIG. 3 is a hardware configuration diagram of the terminal device 30 or the information processing device 50. Here, the hardware configuration of the information processing device 50 will be described.

As shown in FIG. 3, the information processing apparatus 50 is constructed by a computer, and as shown in FIG. 3, the CPU 501, ROM 502, RAM 503, HD 504, HDD (Hard Disk Drive) controller 505, It is equipped with a display 506, an external device connection I / F (Interface) 508, a network I / F 509, a bus line 510, a keyboard 511, a pointing device 512, a DVD-RW (Digital Versatile Disk Rewritable) drive 514, and a media I / F 516. ..

Of these, the CPU 501 controls the operation of the entire information processing device 50. The ROM 502 stores a program used to drive the CPU 501 such as an IPL. The RAM 503 is used as a work area of the CPU 501. The HD504 stores various data such as programs. The HDD controller 505 controls reading or writing of various data to the HD 504 according to the control of the CPU 501. The display 506 displays various information such as cursors, menus, windows, characters, or images. The external device connection I / F 508 is an interface for connecting various external devices. The external device in this case is, for example, a USB (Universal Serial Bus) memory, a printer, or the like. The network I / F 509 is an interface for performing data communication using a communication network. The bus line 510 is an address bus, a data bus, or the like for electrically connecting each component such as the CPU 501 shown in FIG.

Further, the keyboard 511 is a kind of input means including a plurality of keys for inputting characters, numerical values, various instructions and the like. The pointing device 512 is a kind of input means for selecting and executing various instructions, selecting a processing target, moving a cursor, and the like. The DVD-RW drive 514 controls reading or writing of various data to the DVD-RW 513 as an example of the removable recording medium. In addition, it is not limited to DVD-RW, and may be DVD-R or the like. The media I / F 516 controls reading or writing (storage) of data to a recording medium 515 such as a flash memory.

<About functions>
FIG. 4 is an example of a functional block diagram for explaining the functions of the information processing device 50 and the terminal device 30 by dividing them into blocks.

<< Information processing device >>
The information processing device 50 includes a control unit 51, a printing application 52, a printer driver 53, a printer simulator 54, an evaluation unit 55, a screen information generation unit 56, a management unit 57, and a first communication unit 58. Each of these functional units included in the information processing device 50 is a function realized by operating any of the components shown in FIG. 3 by an instruction from the CPU 501 according to a program developed from the HD 504 to the RAM 503. Or a means.

The first communication unit 58 communicates with the terminal device 30 and transmits / receives various information. For example, the setting related to the identity determination is received from the terminal device 30, and the evaluation result is transmitted.

The management unit 57 controls the entire process related to the identity determination. For example, the processing flow is managed based on the settings related to the identity determination received from the user, and the necessary functions of the printing application 52 or less are called. A control tool such as Jenkins is known as the control unit 51. Further, RPA (Robotic Process Automation) may be used. RPA is a concept in which a software-type robot in a personal computer acts on behalf of and automates desk work (mainly routine work).

The printing application 52 is application software that runs on the OS installed in the information processing device 50. That is, it is an application that can at least open the evaluation file and calls the printer driver 53 to start printing. The printing application 52 may be software that calls the printer driver 53, and includes, for example, word processing software, Web browser software, illustration software, paint software, and the like. Further, the number of printing applications 52 may be two or more. In the case of a plurality of cases, the information processing apparatus 50 performs the identity determination with different evaluation files.

The printer driver 53 is software that runs on the OS installed in the information processing device 50. The printer driver 53 is essentially software that acts as an intermediary between a computer and an image forming apparatus so that the user can easily use the image forming apparatus. The printer driver 53 has a function of displaying a user interface screen that accepts print settings (also referred to as print conditions) and a function of generating print data described in PDL. PDL includes, for example, PostScript (registered trademark) and PCL (Printer Control Language). In addition, there are various types depending on the manufacturer of the image forming apparatus. In the image forming apparatus, a PDL module corresponding to each PDL is operating.

The printer simulator 54 is software that operates on an OS installed in the information processing device 50. The printer simulator 54 performs the rendering performed by the image forming apparatus. Rendering may be referred to as RIP (Raster Image Processer) or drawing process. Further, the rendering software may be referred to as a PDL module or a drawing processing unit. The printer simulator 54 has one or more of these PDL modules. The printer simulator 54 may exist on a network that can be accessed by the information processing device 50, in addition to the information processing device 50.

The PDL module performs color matching processing and screening processing to generate an image for printing processing for each of the C, M, Y, and K colors used by the image forming apparatus for printing. The color matching process is a process of converting the input color (or monochrome) print data at an optimum conversion ratio for printing with the four color toners C, M, Y, and K of the image forming apparatus. The print data input from the print application 52 may be expressed in the RGB color space or the CMYK color space, but when the general print application 52 is used, the RGB color space is used. Has been adopted. The printer simulator 54 converts the print data in the RGB color space into a device-independent color space by color matching processing, and then converts it into a device color space suitable for the characteristics of the image forming apparatus to convert it into a CMYK color space. A known conversion formula may be used for the conversion formula from RGB to C, M, Y, K, or a conversion formula optimized for the image forming apparatus may be used.

The screening process is a pseudo-gradation expression method such as the dither method, which uses the optical illusion to express the difference in shading by changing the size and density of halftone dots. This is a process of converting an image for print processing that can be printed. In the image for printing processing, 1 (ON: draw) or 0 (OFF: not draw) is set for each dot corresponding to the pixel drawn as a point by the laser or ink.

The evaluation unit 55 is an application module that operates on the information processing device 50. The evaluation unit 55 compares the two images for printing processing of interest and evaluates whether or not they can be regarded as the same. It also generates difference information between the two images. For example, the difference information is generated by comparing whether or not there are the same pixels (CMYK) for each pixel position determined by the image resolution.

The screen information generation unit 56 generates screen information of the screen displayed by the terminal device 30 as a Web server. In the present embodiment, the screen information of the setting screen that accepts the setting related to the identity determination is mainly generated.

When the identity determination is performed, the management unit 57 assigns an evaluation ID and manages it in association with the evaluation results of the two images for printing processing. In addition, the evaluation result is sent to the user's e-mail address, or sent to the user using the chat system.

Further, the information processing device 50 has a storage unit 59 constructed by at least one of the HD 504 and the RAM 503 shown in FIG. The storage unit 59 stores an image for printing processing, difference information, an evaluation result, and the like.

<< Terminal equipment >>
The terminal device 30 has a second communication unit 31, a display control unit 32, and an operation reception unit 33. Each of these functional units included in the terminal device 30 is operated by an instruction from the CPU 501 according to a program for the terminal device 30 developed from the HD 504 on the RAM 503 by any of the components shown in FIG. It is a function realized by this. This program is supposed to be, for example, a Web browser.

The second communication unit 31 included in the terminal device 30 transmits and receives various information to and from the information processing device 50. For example, various Web pages are requested by HTTP communication, and various operation contents for the Web pages are transmitted to the information processing device 50.

The display control unit 32 analyzes various screen information received from the information processing device 50 and displays it on the display 506. The display control unit 32 displays the difference information of the two images as the evaluation result. The operation reception unit 33 receives various operations on the Web page (screen) displayed by the terminal device 30.

<About virtual machines>
In the present embodiment, the information processing device 50 efficiently evaluates the image for printing processing by generating the image for printing processing on the virtual machine. Various factors such as the OS, the printer driver 53, the PDL module, the printing conditions, and the evaluation file affect the image for printing processing, but at least for the OS, it takes time for the user to replace the OS. On the other hand, if a virtual machine is used, the information processing device 50 can install an arbitrary guest OS while keeping the host OS operating in the information processing device 50 as it is. Further, since it is possible to build a plurality of virtual machines on the host OS, it is possible to reduce the labor of the work related to the installation of the guest OS for the evaluation on the same OS.

FIG. 5 is a diagram showing a configuration example of virtual machines 61A and 61B constructed in the information processing device 50. The virtual machines 61A and 61B are independently operating information processing devices constructed in one information processing device 50 using virtualization technology. The physical machine 65 of FIG. 5 corresponds to the original hardware configuration of the information processing apparatus 50 shown in FIG. The host OS 64 is an OS that directly operates on the information processing device 50. Virtualization software 63 runs on the host OS 64. Virtualization technology is used in the virtualization software 63, which is software that emulates hardware for virtual machines 61A and 61B. For example, VMware (registered trademark), Microsoft Virtual PC (registered trademark), etc.

The guest OS 62 is a general OS, and in the present embodiment, it is one of the factors that affect the image for printing processing. Since the virtualization software 63 is merely seen as an information processing device when viewed from the guest OS 62, the virtual machines 61A and 61B operate independently of the host OS 64 and other virtual machines. Therefore, the same printing application 52 and printer driver 53 can be used as usual.

Although the virtual machine shown in the figure is called a host type, a hypervisor type virtual machine may be used.

<Overall processing flow>
Next, the overall flow of processing performed by the information processing apparatus 50 will be described with reference to FIG. FIG. 6 is a diagram illustrating a flow of processing performed by the information processing apparatus 50. As shown in FIG. 6, the information processing apparatus 50 generates an image for print processing of the comparison source and an image for print processing of the comparison target, respectively. It should be noted that not all the processes shown in FIG. 6 are necessarily performed by one identity determination. For example, if an image for comparison or a print process to be compared is generated, it is not necessary to generate the image, and if the printer driver 53 is already installed, installation is unnecessary.

S1: The user sets the identity determination on the setting screen described later displayed on the terminal device 30, and causes the information processing device 50 to transmit to the terminal device 30. The information processing device 50 accepts the start of the identity determination.

S2: When the storage unit 59 already has an image for printing processing that matches the OS, printer driver 53, PDL module (printer simulator), print conditions, and evaluation file specified by the user as the evaluation source on the setting screen. Is skipped from S2 to S6.

S3: The control unit 51 first starts the OS (guest OS) designated as the evaluation source on the virtual machine. If it has already been started, it does not have to be started.

S4: The control unit 51 installs the printer driver 53 designated as the evaluation source in the guest OS. If it is already installed, no installation is required.

S5: The control unit 51 starts the print application 52 corresponding to the evaluation file, and the print application 52 generates the print data of the evaluation file specified by the specified print conditions. Print data (* .prn, * .ps) is stored in the storage unit 59. If the evaluation file is in a format such as a prn file.ps file or a PDF file that the printing application 52 does not need to print, the print data is not generated and is copied to the storage unit 59 as it is. Further, even if the evaluation file is an image file such as png or jpeg, it is saved as it is in the storage unit 59 for print data.

S6: The control unit 51 starts the printer simulator 54, and the printer simulator 54 uses the designated PDL module to perform drawing processing on the print data created in step S5 to generate an image for printing processing. The generated image for printing processing is stored in the storage unit 59 as an image for printing processing of the comparison source. The image for printing processing is created in png format, for example, but it can be created in other formats such as Jpeg and Tiff by modifying the initial setting file described later by the user.

In the following steps S7 to S10, the information processing apparatus 50 generates an image for printing processing to be compared.

S7 to S10: In the processing of steps S7 to S10, one or more of the comparison target OS, printer driver 53, PDL module, printing conditions, and evaluation file are changed with respect to the comparison source processing, but each step The content of the processing of is the same as that of the comparison source.

S11: The evaluation unit 55 creates an evaluation result by comparing the evaluation source and the image for printing processing of the evaluation target.

S12: The management unit 57 stores the evaluation result in the designated storage unit 59. The saved evaluation result and the image for printing processing (either the comparison source or the comparison target) may be referred to by the information processing apparatus 50 as the image for printing processing of the evaluation source or the comparison target at the next evaluation. It is possible.

S13: The management unit 57 notifies, for example, an e-mail address that the identity determination has been completed and the evaluation result. A URL in which the evaluation result is stored is described in the e-mail address, and the user can operate the terminal device 30 to display the evaluation result. The management unit 57 may directly transmit the evaluation result to the terminal device 30. Even if each process fails, it is advisable to state that fact and send it by e-mail or the like.

In FIG. 6, the generation of the image for printing processing of the comparison source and the generation of the image for printing processing of the comparison target are executed in order, but both may be executed in parallel. This will save you time.

<About overall processing or operation>
FIG. 7 is an example of a sequence diagram illustrating an overall process or operation performed by the information processing system 100.

S21: When the user operates the terminal device 30 to connect to the information processing device 50 and inputs an operation for displaying the setting screen for identity determination, the terminal device 30 outputs the screen information of the setting screen to the information processing device. Request 50. The first communication unit 58 of the information processing device 50 receives this request, the screen information generation unit 56 generates the screen information of the setting screen, and the first communication unit 58 of the information processing device 50 outputs the screen information of the setting screen to the terminal. It is transmitted to the device 30.

S22: The second communication unit 31 of the terminal device 30 receives the screen information of the setting screen, and the display control unit 32 displays the setting screen on the display 506. An example of the setting screen is shown in FIG. When the user inputs the setting related to the identity determination on the setting screen, the operation reception unit 33 accepts the operation.

S23: When the user presses the start button on the setting screen, the operation reception unit 33 accepts the operation reception unit 33, and the second communication unit 31 specifies the setting related to the identity determination and transmits the identity determination request to the information processing device 50.

S24: The first communication unit 58 of the information processing device 50 receives the identity determination request, and the control unit 51 starts the identity determination in the flow described with reference to FIG. The details of the processing of the information processing apparatus 50 will be described with reference to FIG.

S25: During the identity determination, the first communication unit 58 of the information processing device 50 transmits the status to the terminal device 30 in response to a request from the terminal device 30 or by push communication. The status is, for example, progress information indicating to which step of the process of FIG. 6 the process is completed. This allows the user to know how far the process is progressing.

S26: When the evaluation unit 55 of the information processing device 50 completes the evaluation, the first communication unit 58 transmits the evaluation result to the terminal device 30.

S27: The second communication unit 31 of the terminal device 30 receives the evaluation result, and the display control unit 32 displays the evaluation result on the display 506. An example of the evaluation result is shown in FIG. 21 and the like.

<Setting screen>
FIG. 8 is a diagram showing an example of the setting screen 300 displayed by the terminal device 30. The initial value displayed on the setting screen 300 before the user's operation is held by the control unit 51. FIG. 9 shows an example of initial value information in which the initial value displayed on the setting screen 300 is registered. For example, the initial value information shown in FIG. 9 is stored in a file called "c: /setting.ini".
"#Image Comparison Tool Default Setting": The title of this file.
"Image Format": An image format (file format) for printing processing.
"Output Folder": The address to which the image for printing is sent.
"Work Folder": A folder for temporarily storing print data or evaluation files.
"Comparison": Set whether the comparison method is an exact match or an ambiguous match.
"E-mail": The e-mail address to which the evaluation result is sent.

When the control unit 51 transmits the initial value information of FIG. 9 to the screen information generation unit 56, the screen information generation unit 56 can generate the setting screen 300 in which the initial value is set.

It will be described back to FIG. The setting screen 300 has a comparison source column 301, a comparison target column 305, and other setting columns 316. The items of the comparison source column 301 and the comparison target column 305 are the same.
-OS 302, 306 ... The guest OS is set.
-PrinterDriver303,307 ... The type and version of the printer driver 53 are set.
-PDL304, 308 ... The type and version of the PDL module (drawing processing unit) are set. When the PDL module is set, the printer simulator is also set.

In the comparison source column 301 of FIG. 8, "64-bit version Windwos10 (registered trademark)" is used for OS302, a package of "C: / Driver / x64 / postscript_1.00" is used for PrinterDriver303, and the printer simulator 54 is used. It is set that the operating PDL304 (PDL module) uses "C: / PDL / Postscript_1.00". In the comparison target column 305, "32bit version Windwos10 (registered trademark)" is used for OS306, "C: / Driver / x64 / postscript_1.00" package is used for PrinterDriver307, and the printer simulator 54 used for printing is used. It is set that the operating PDL308 uses "C: /PDL/Postscript_1.00".

Subsequently, other items of the setting column 316 will be described.
-Evaluation column File column 309 ... A column in which the file name of the evaluation file used for image evaluation is set. The user can also set multiple evaluation files. Further, a printing application 52 such as a prn file or a PDF file is not required, and a file that can be directly transmitted to the image forming apparatus can be set. You can also directly specify image data such as png, jpeg, tiff, and bmp.
-Comparison method column 310 ... A column in which a comparison method is set. The evaluation unit 55 either determines whether or not all the pixels in the evaluation source and the image for printing processing to be evaluated completely match, or "ambiguity determination" that allows a certain difference. Compare with. The strictness of comparison may be set numerically instead of two steps. The initial value of the comparison method column 310 is set to "Comparison" of the initial value information.
-Result save destination column 311 ... This is a column in which the save destination of the evaluation result is set. The evaluation result may be in a format such as a csv file, a text file, or an XML file. Not only the evaluation result, but also the image for printing processing of the comparison source and the comparison target, and the difference information of the two images are saved.
-Printing condition column 312 ... This is a column in which a setting file for which printing conditions for the printer driver 53 are specified is set. For example, the printing conditions that affect the image quality include the designation of aggregate printing and the designation of color management.
-Notification destination column 313 ... For example, the e-mail address of the notification destination of the evaluation result is set. It can also be used in the event of a failure. You may set multiple e-mail addresses. You may also set up an account for the user's chat system. As a result, the information processing device 50 can transmit the evaluation result in the chat system.

Looking at the comparison source column 301 and the comparison target column 305 in FIG. 8, since there is only a difference between the OSs of 64 bits and 32 bits, the information processing device 50 can compare whether or not there is a difference between the OSs. The PDL module can be evaluated by making the OS and the printer driver 53 the same in the comparison source column 301 and the comparison target column 305 and changing the PDL module. Further, the printer driver 53 can be evaluated by making the OS and the PDL module the same in the comparison source column 301 and the comparison target column 305 and changing the printer driver 53.

As described above, the user can input the settings related to the identity determination, but the processing start time and the like may be set in addition to the described conditions. Further, in FIG. 8, the OS, the printer driver 53, and the PDL module are mentioned as factors that affect the image for printing processing, but other extensions such as changing the printing application 52 to be used are also considered. Be done. Further, although not shown in FIG. 8, the priority (high, medium, low) may be set on the setting screen 300. The priority is information that the information processing apparatus 50 determines which identity determination request is preferentially processed when many identity determination requests are accumulated in the information processing apparatus 50.

When the user presses the start button 314, the identity determination request is transmitted to the information processing device 50. When the cancel button 315 is pressed, the setting related to the identity determination is canceled, and the setting screen 300 returns to, for example, the portal screen.

<< Another example of the setting screen >>
FIG. 10 is a diagram illustrating another example of the setting screen. In the description of FIG. 10, the difference from FIG. 8 will be mainly described. In the setting screen 320 of FIG. 10, the comparison source column 321 is different from that of FIG. In the present embodiment, any image for printing processing generated by the combination of the OS, the printer driver 53, and the PDL module, which the user has determined to match, can be the image of the comparison source from the next time onward. Therefore, in the comparison source column 321, the OS, the printer driver 53, and the PDL module set on the setting screens 300 and 320 in the past are often set as comparison targets. Therefore, in the comparison source field 321 of the setting screen 320 of FIG. 10, the user can easily select the OS, the printer driver 53, and the PDL module that have been set in the past by the identity determination.

The setting screen 320 of FIG. 10 has an evaluation ID column 322 and a setting content column 323. The evaluation ID column 322 can display a pull-down menu, and the pull-down menu displays a list of evaluation IDs. The evaluation ID is identification information that identifies a series of processes for determining the identity, and is given by the information processing device 50. The information processing device 50 can specify the information set on the setting screens 300 and 320 by the evaluation ID.

The user can set the comparison source OS, the printer driver 53, and the PDL module by selecting the evaluation ID given in the past identity determination. In the setting content field 323, the comparison source OS, the printer driver 53, and the PDL module selected by the user are displayed. In the setting content field 323, the OS, the printer driver, and the printer simulator in which the comparison source image determined to be the same in the past is generated are displayed. Therefore, when an image having the same combination of the OS, the printer driver, and the printer simulator has already been generated, the control unit 51 does not generate the image, but uses the already generated image for comparison.

FIG. 11 is an example of the pull-down menu 330 displayed in the evaluation ID column 322. The pull-down menu 330 displays a list of past evaluation results. The pull-down menu 330 has items of selection button 331, evaluation ID 332, date 333, OS 334, CPU 335, Driver 336, Ver 337, PDL 338, and Ver 339. The selection button 331 is a button for the user to select the evaluation ID. The evaluation ID 332 is as described above, the date 333 specifies the evaluation date, the OS 334 and the CPU 335 specify the OS, the Driver 336 and Ver 337 indicate the printer driver 53, and the PDL 338 and Ver 339 indicate the PDL module.

The screen information generation unit 56 of the information processing device 50 pulls down the evaluation ID attached to the OS, the printer driver 53, and the PDL module used to generate the image confirmed to be the same as the comparison source by the user. Generate screen information of the setting screen by including it in the display target. As a result, the user can set the comparison source field 321 by selecting the past settings related to the OS, the printer driver 53, and the PDL module. Whether or not the user has confirmed that the comparison source is the same is determined based on the setting of the result correction button 612 on the evaluation result screen (FIG. 21) described later.

<Details of identity determination processing>
Next, the details of the identity determination process performed by the information processing apparatus 50 will be described with reference to FIG. FIG. 12 is an example of a flowchart for explaining a process in which the information processing apparatus 50 performs the identity determination. The process of FIG. 12 starts when the information processing device 50 receives the identity determination request.

The first communication unit 58 of the information processing device 50 receives the setting related to the identity determination (S101). The control unit 51 assigns an evaluation ID.

Next, the control unit 51 determines whether or not there is an image for printing processing of the comparison source (S102). The information set in the comparison source fields 301 and 321 is attached as metadata to the image for printing processing. That is, the comparison source OS, the printer driver 53, and the PDL module are recorded. Therefore, the control unit 51 compares the setting of the comparison source included in the identity determination request with the metadata of the image for print processing stored in the storage unit 59, so that there is an image for print processing of the comparison source. Whether or not it can be determined. The metadata is data that describes the meaning of the data. In other words, metadata is data that has information about some data. It is called meta (upper) data because it is about the data, not the data itself.

If the determination in step S102 is No, the control unit 51 starts the OS specified in the comparison source setting (S103). By booting the OS, the virtual machine 61A or 61B starts up.

Next, the printer driver 53 is installed in the OS started by the control unit 51 (S104). If the printer driver 53 is already installed in the OS, installation is not necessary. At the time of installation, the storage unit 59 is specified as the print destination. That is, the information processing device 50 defaults to "save the print data as a file". As a result, the print data is not transmitted to the image forming apparatus through the port such as COM1.

Next, the control unit 51 activates the printing application 52 (S105). The print application 52 to be started is an application that can open the evaluation file. For example, it is judged by the extension of the evaluation file.

Next, the printing application 52 prints the evaluation file, so that the printer driver 53 is called, and the printer driver 53 generates print data of the evaluation file under the printing conditions included in the identity determination request (S106). The print data is stored in the storage unit 59 set in step S104 in association with the evaluation ID.

Next, the control unit 51 activates the printer simulator 54 designated by the identity determination request (S107). The PDL module is included in the identity determination request, but when the PDL module is specified, the printer simulator 54 can be specified.

Next, the PDL module performs rendering (drawing processing) using the print data stored in the storage unit 59 based on the evaluation ID, and the result is associated with the evaluation ID as an image for printing processing and stored in the storage unit. It is stored in 59 (S108).

Now that the evaluation source image for print processing has been created, the control unit 51 determines whether or not there is an image for print processing to be compared (S109). The judgment method may be the same as that of the comparison source.

If there is no image for print processing to be compared, the process returns to step S103, and the information processing apparatus 50 generates an image for print processing to be compared.

When there is an image for print processing to be compared, the evaluation unit 55 compares the image for print processing of the comparison source with the image for print processing to be compared (S110). Details of the comparison will be described with reference to FIGS. 13 to 20.

Next, the management unit 57 associates the evaluation result with the evaluation ID and stores it in the storage unit 59 (S111). In addition, the management unit 57 notifies the evaluation result to the e-mail address or the like specified in the identity determination request (S112).

<Comparison of images>
In the present embodiment, the identity determination of at least one of two criteria, which is completely identical and ambiguously identical, is performed. Exactly the same is a method of determining whether or not there is a difference for each pixel, and ambiguous identity is a method of determining whether or not there is a difference when viewed by the human eye.

First, an example of a completely identical comparison method will be described with reference to FIG. FIG. 13 is a diagram illustrating a method of generating difference information by the evaluation unit 55. In FIG. 13, a part of the two images to be compared is enlarged and displayed. The evaluation unit 55 divides the image into two images for each pixel position determined according to the image resolution (for example, in the case of an image having a resolution of 1980 × 1280, the vertical is equally divided into 1980 and the horizontal is equally divided into 1280). Determine if there is a difference. In FIG. 13, the intersection of the mesh is the pixel position.

If there are pixels of the same color at the same pixel position in the two images, it is determined that there is no difference, and if there are no pixels of the same color, it is determined that there is a difference. The evaluation unit 55 sets a flag at the pixel position where there is a difference. When the difference information is represented by an image, a point is displayed at the pixel position where the flag is present. For example, prepare a table for the number of pixel positions and record "presence / absence of flag".

Alternatively, a value according to the magnitude of the difference may be used as the difference information. For example, suppose that there is the following difference between a certain pixel position of one image data and the other image data.
A. With C With K With B. With C With Y With C. C Yes Nothing D. With C With M In this case, it is considered that the difference is larger in the order of A <B <C <D. Therefore, the evaluation unit 55 sets a larger value in the above table in the order of A <B <C <D.

Further, the evaluation unit 55 may merge each pixel of each image with another pixel to calculate the feature amount, and then compare the features. For example, the pixels around the pixel position are weighted with a Gaussian filter or the like, and the difference between the weighted values is recorded in the table, or if there is a difference larger than the threshold value, the fact that there is a difference (flag) is recorded in the table. ..

<Outline of identity judgment>
Even if there seems to be a large difference in the determination for each pixel as in the exact same determination method, such a minute difference is difficult for the human eye to notice. Therefore, the identity determination is performed on the basis of ambiguous identity. As a result, a judgment result close to that of a human can be obtained.

In the case of ambiguity and identity, when each pixel determined to be recognizable by the human eye in the difference information of the two images is arranged so as to be recognizable by the human eye, it is regarded as a visible difference (not the same). Examples of the arrangement of differences that can be recognized by the human eye include the following.
(i) Pixels judged to be differences are continuous to a size that can be recognized by the human eye.
(ii) There are more pixels in a certain area that are judged to be differences than can be recognized by the human eye.
(iii) Pixels judged to be differences exist in the specified arrangement pattern.

In the following, each method of recognizing the arrangement of differences will be described.

(i) Pixels judged to be differences are continuous beyond the size recognizable by the human eye.
Will be described.

The evaluation unit 55 scans the pixel positions in order to detect continuous differences.

FIG. 14 is a diagram illustrating a method of detecting a difference having a size that is recognizable by the human eye or more and is continuous. In FIG. 14A, the pixel positions are scanned in the lateral direction. As a result, if there is a size difference 130 that can be continuously recognized by the human eye in the lateral direction, it can be detected.

In FIG. 14B, the pixel positions are scanned in the vertical direction. As a result, if there is a difference 131 having a size that can be continuously recognized by the human eye in the vertical direction, it can be detected.

In FIG. 14, the arrangement of rectangular differences is detected in each of the vertical and horizontal scans. The evaluation unit 55 detects the length of the difference that is continuous vertically or horizontally. It is also preferable to scan in an oblique direction.

Then, the evaluation unit 55 compares the length of the continuous difference with the predetermined length (threshold value), and records that fact at the pixel position of the continuous difference longer than the predetermined length. For example, a table for the number of pixel positions is prepared, and "difference" is recorded at all the pixel positions of the difference that are continuous longer than a predetermined length. The evaluation unit 55 determines that they are the same when they are equal to or less than the threshold value.

As a result, the display control unit 32 of the terminal device 30 can emphasize and display these pixels, and the user can recognize the arrangement of the differences at a glance.

In this embodiment, the predetermined length (threshold value) can be made constant regardless of the image.

continue,
(ii) There are more pixels in a certain area that are judged to be differences than can be recognized by the human eye.
Will be described. In this case, the evaluation unit 55 sequentially moves the windows surrounding the pixel positions in the difference information, and determines whether or not there is a difference larger than the ratio recognizable by the human eye in the windows. The size of this window corresponds to a certain area.

FIG. 15 is a diagram illustrating a method of detecting a difference that exists in a certain region at a rate that can be recognized by the human eye or more. Although FIG. 15 shows a window 140 having 4 × 4 pixels, the size of the window 140 is an example. The window 140 moves the pixel position in the center of the window 140 one pixel at a time from the upper left corner to the right, and when it reaches the right end, it goes down by one pixel and returns to the left end. Such movement is repeated until the pixel position at the center reaches the lower right corner.

A pixel position of 5 × 5 = 25 is included in the window 140 of 4 × 4 pixels. The evaluation unit 55 counts how many pixel positions in the window are determined to be different. In FIG. 15, for convenience of explanation, it is determined that there is a difference at the 10 pixel positions.

The evaluation unit 55 determines whether or not "10/25> a predetermined ratio" is satisfied, and if so, records that fact in all the pixel positions in the window in the table for the number of pixel positions. Keep it. As a result, the display control unit 32 of the information processing device 50 can emphasize and display the pixels, and the user can recognize the arrangement of the differences at a glance. The evaluation unit 55 determines that they are the same when they are equal to or less than the threshold value.

In this embodiment, this predetermined ratio (threshold value) can be made constant regardless of the image.

continue,
(iii) Pixels judged to be differences exist in the specified arrangement pattern.
Will be described. In this case, the evaluation unit 55 holds the designated arrangement pattern. The evaluation unit 55 performs pattern matching on the difference information with an arrangement pattern, and determines whether or not there is an arrangement of differences that matches the arrangement pattern.

FIG. 16 is a diagram illustrating a method of generating difference information. FIG. 16A shows an example of the image of the comparison source, and FIG. 16B shows an example of the image to be compared. Although FIG. 16 shows a comparison source and a comparison target that are clearly different for the sake of explanation, in reality, it may be difficult to understand the difference just by looking at the image of the comparison source.

FIG. 17A shows the difference information of the two images of FIG. 16, and FIG. 17B is an enlarged view of the difference information. Further, FIG. 17C shows an arrangement pattern 150. The arrangement pattern 150 is pre-generated as a difference pattern that is easily perceived by the human eye. The arrangement pattern 150 in FIG. 17C is an example, and may be band-shaped, circular, geometric pattern obtained, or the like.

When the difference as shown in the enlarged view of FIG. 17B matches the arrangement pattern 150, if the evaluation unit 55 determines that there is a difference, two images that humans perceive as having a difference can be detected.

FIG. 18 is a diagram illustrating a method of detecting an arrangement pattern from the arrangement 160 of the difference. In FIG. 18, for the sake of explanation, the arrangement 160 of the difference of the same pattern as the arrangement pattern 150 is shown. The evaluation unit 55 moves the arrangement pattern 150 one pixel at a time from the upper left corner of the difference information 151 to the right, and when it reaches the right end, it goes down by one pixel and returns to the left end. This movement is repeated until the lower right corner is reached.

The evaluation unit 55 determines whether or not a difference is recorded in the difference information at the same position as the pixel of the arrangement pattern 150, and when the difference is recorded at the positions of all the pixels, the arrangement pattern 150 is recorded. It is determined that it is detected from the difference information 151. Alternatively, when a difference is recorded at the positions of a certain number or more (a certain percentage or more) of pixels, it is determined that the arrangement pattern 150 is detected from the difference information 151.

In FIG. 18, there is a difference arrangement 160 that matches the arrangement pattern 150 at the lower right of the difference information 151, and the evaluation unit 55 can detect the difference arrangement 160.

The evaluation unit 55 records that fact at the pixel positions that match the arrangement pattern 150 in the table for the number of pixel positions. As a result, the display control unit 32 of the information processing device 50 can emphasize and display the pixels, and the user can recognize the arrangement of the differences at a glance.

<Display example of difference arrangement>
A case where the arrangement of the difference is detected and a case where the difference arrangement is not detected will be compared and described with reference to FIGS. 19 and 20.

First, FIG. 19 shows two images in which the arrangement of the difference is not detected and the difference information of the two images. FIG. 19A is an image of a comparison source, FIG. 19B is an image to be compared, and FIG. 19C is difference information. Although FIG. 19 is an image of CMYK, the same can be applied to RGB.

When viewed by humans, no difference is observed between the images of FIGS. 19 (a) and 19 (b). However, as shown in the difference information of FIG. 19C, it can be seen that there is a difference such as noise as a whole. When the exact same is adopted, this noise is detected as the difference between the two images, and the information processing apparatus 50 determines that the two images are not the same.

When ambiguity is adopted, it is determined that the images of FIGS. 19A and 19B are the same because the information processing apparatus 50 does not recognize the arrangement of the differences in the difference information.

FIG. 20 shows the two images in which the arrangement of the differences was detected and the difference information of the two images. FIG. 20A is a comparison source image, FIG. 20B is a comparison target image in which a white rectangle 170 is added to the comparison source image, and FIG. 20C is difference information. Although FIG. 20 is an image of CMYK, the same can be applied to RGB.

When viewed by humans, there is a clear difference between the images of FIGS. 20 (a) and 20 (b). In the difference information of FIG. 20C, a rectangular difference arrangement 171 is detected at the same pixel position as the white rectangle 170 of the image to be compared. In FIG. 20, the difference arrangement 171 is black and white due to drawing, but on the display 506, it is emphasized in, for example, red, so that it is displayed in a mode different from the noise as shown in FIG. 19 (c). Therefore, the user can determine at a glance whether or not there is a difference arrangement.

In the present embodiment, since the information processing device 50 recognizes the arrangement of the differences in the difference information, it is determined that the images of FIGS. 20A and 20B are not the same.

<Display example of evaluation result>
FIG. 21 is an example of the evaluation result screen 600 displayed by the terminal device 30. The evaluation result screen 600 has an evaluation file selection field 601, an evaluation file display field 602, and a page designation field 603. The evaluation file selection field 601 is a field in which the user selects the number of the evaluation files used for the identity determination to be opened. FIG. 21 shows that the first of the two evaluation files is selected.

The evaluation file display field 602 is a field indicating the file name of the currently selected evaluation file. The page designation field 603 is a field in which the user selects the page number of the image of the currently selected evaluation file to be displayed.

Further, the evaluation result screen 600 has a comparison source image column 604, a comparison target image column 605, and a difference information column 606. In the comparison source image field 604, an image for printing processing of the comparison source of the page specified in the page designation field 603 among the evaluation files selected in the evaluation file selection field 601 is displayed.

In the comparison target image field 605, among the evaluation files selected in the evaluation file selection field 601 and the page specified in the page designation field 603, an image for printing processing to be compared is displayed.

In the difference information column 606, the difference information between the image for printing processing of the comparison source and the image for printing processing to be compared is displayed. In the difference information column 606, the portion where there is a difference between the comparison source and the comparison target is displayed in an emphasized color such as red. Colors may be changed, such as displaying subtle differences that are not exactly the same in black and displaying ambiguous and non-identical differences in red.

Images may be displayed for each CMYK in the comparison source image column 604, the comparison target image column 605, and the difference information column 606.

The difference information column 606 in FIG. 21 is not only completely the same and ambiguous and the same, and the color may be changed according to the type of the object described in the evaluation file. For example, the screen information generation unit 56 changes the color according to an object such as a character, a figure (illustration), or a photograph. Characters are hiragana, alphabets, numbers, etc., figures are mainly color-coded objects in areas separated by straight lines and curves, and photographs are objects represented by clogged dots. The screen information generation unit 56 performs an FFT (Fast Fourier transform) on the image for printing processing of the comparison source or the comparison target, and classifies the objects for each pixel of the image for printing processing according to the obtained frequency. For example, characters are classified in the high frequency region, illustrations in the low frequency region, photographs in the middle, and so on. By doing so, the difference information can be emphasized for each object, so that it becomes easy for the user to understand which object the printer driver, printer simulator, OS, or the like has a great influence on.

Further, the evaluation result screen 600 has three enlargement buttons 607, 608, 609, a detail button 611, three result correction buttons 612, and an end button 616. The three enlargement buttons 607, 608, and 609 are buttons for printing processing of the comparison source, printing processing of the comparison target, or enlarged display of the difference information, respectively, and when the user presses the buttons, respectively. The image is enlarged and displayed in a separate window.

The detail button 611 is a button for the terminal device 30 to display the detailed evaluation result. FIG. 22 shows an example of the detailed evaluation result screen.

The three result correction buttons 612 are a match button 613, a mismatch button 614, or a hold button 615, respectively. The three result correction buttons 612 are buttons for the user to correct the same or non-identical determination results. In the example of FIG. 21, the determination results are inconsistent, but the determination result can be changed to match by the user pressing the match button 613. Further, the hold button 615 can be put on hold because it cannot be determined. The mismatch button 614 is a button for changing the determination result to a mismatch by pressing the mismatch button 614, although the determination result is a match. Since the current determination results are inconsistent, the inconsistency button 614 is grayed out and cannot be selected by the user.

When the user corrects the determination result, the corrected determination result is transmitted to the information processing device 50, and the evaluation unit 55 adjusts the accuracy of the determination. For example, the magnitude of the difference between the comparison source image and the comparison target image (for example, the details of the difference in FIG. 22) is reflected in the threshold value of the same or non-identical determination. The end button 616 is a button for closing the evaluation result screen 600.

FIG. 22 is a diagram showing an example of the detailed evaluation result screen 620. The detailed evaluation result screen 620 displays the details of the evaluation result. The content 621 includes an evaluation date, an evaluation start time, an evaluation executor, an evaluation file, comparison source data (file name of the generated comparison source image for print processing), and comparison target data (generated comparison target print processing). (File name of image for), difference data (file name of difference information), result file, judgment result, and details of difference.

The comparison source data (file name of the image for printing processing of the comparison source) includes the file name to be evaluated (J9.doc), the comparison source (org), and the page number (1). The same applies to the comparison target data and the difference data.

In addition, the result file describes the judgment results for each page of all evaluation files. The contents of "Resut_201909112200.csv", which is the result file of FIG. 22, are shown in FIG.

The details of the difference show numerically the difference information acquired by the methods described with reference to FIGS. 8 to 18. As shown in the figure, it has the number of difference points, the area, the screen occupancy rate, the coordinates (x coordinate, y coordinate), and the degree of ambiguity determination. The number of difference points is the number of areas when the pixels judged to be different are continuous, the number of areas is the number of pixels, the screen occupancy rate is the number of areas / total pixels, and the coordinates are the upper left of the difference points. The coordinates. The ambiguity determination degree may be input by a human being, or may be set based on a table in which the details of the difference and the ambiguity determination degree are associated (the AI may have learned the user's input). The details of the difference may differ between an exact match and an ambiguous match.

The copy button 622 is a button for the terminal device 30 to copy the contents of the detailed evaluation result to the clipboard. The end button 623 is a button for closing the detailed evaluation result screen 620.

The content shown in FIG. 22 is only an example, and the details of the evaluation result created by the evaluation unit 55 can be displayed as needed.

<< Judgment result by page >>
FIG. 23 shows an example of the contents of the result file. As described above, the result file shows the judgment result for each page of each evaluation file. One line in FIG. 23 is the judgment result of one page of the evaluation file. Since J9.doc has 5 pages and J11.ppt has 8 pages, there are a total of 13 lines of judgment results. One line is separated by a comma, and from the left, "date, time, performer, evaluation file, page, image for print processing of evaluation source, image for print processing to be evaluated, difference information, judgment of exact match" Result, judgment result of ambiguous match "is shown.

According to Figure 23, J9.doc began evaluation at 22:00 on September 11, 2019, with the first page not being an exact match and an ambiguous match, the second page being an exact match, and the third page being. It is judged that there is no exact match and there is an ambiguous match, the 4th page is an exact match, and the 5th page is a mismatch. Evaluation of J11.ppt started at 22:15, and it was judged that the 3rd and 6th pages were ambiguous matches, the 7th page was inconsistent, and the other pages were exact matches. Further, although not specified in FIG. 23, the image for printing processing created by the identity determination is described as a result file.

The details of the difference shown in FIG. 22 are also saved for each evaluation file. The save destination is the folder specified on the setting screens 300 and 320, and the file is saved with a file name having a unique name. For example, the evaluation result of "C: /Sample/J9.doc" is saved as "C: /Output/J9.doc.log.xml".

FIG. 24 shows a description example of an XML file having the details of the difference. <Page> ~ </ page> show the details of the difference per page. Tags of <evaluation date>, <start time>, <comparison source data>, <comparison target data>, <difference data>, <result file>, <judgment result>, and <difference details> for each page. Has. Further, the <details of difference> tag has <number of difference points>, <area>, <screen occupancy rate>, <x coordinate>, <y coordinate>, and <ambiguity determination degree>.

Although it is described in the XML format in this example, it may be divided into a file name and a page, and any format may be used as long as the items can be expanded. When the result correction button is edited on the evaluation result screen of FIG. 21, the management unit 57 corrects the <determination result> tag of the difference details in FIG. 24.

<Reflected in the evaluation result of the result correction by the user>
Although it has been explained on the evaluation result screen 600 that the user can correct the determination result, it is preferable that the information processing device 50 can reflect the correction in the determination criterion of the identity determination. The evaluation unit 55 compares the number of difference points, the area, the screen occupancy rate, and the coordinates (x-coordinate and y-coordinate) with the threshold value to determine whether they match or do not match. Therefore, for example, when the user corrects the determination result as “mismatch” → “match”, the details of the difference are reflected in the threshold value. It is assumed that this threshold value is for determining a mismatch when there is even one item having a larger difference.

For example, when the user corrects "mismatch" → "match" with the number of difference points: 1, area: 125, screen occupancy rate: 6, x coordinate: 3820, y coordinate: 951, the evaluation unit 55 increases the threshold value. .. For example, when the threshold value of the number of difference points, the area, and the screen occupancy rate exceeds the threshold value, the evaluation unit 55 sets the threshold value of the number of difference points to 2, the area threshold value to 130, and the screen occupancy rate threshold value to 7. And. The threshold may be minimized and increased. On the contrary, when the user corrects the determination result as "match" → "mismatch", the threshold value of the corresponding item is reduced.

By doing so, the determination by the user and the determination by the evaluation unit 55 can be gradually brought closer to each other.

Further, when a sufficient number of combinations of the details of the difference and the judgment result by the human being who matches or does not match are prepared for machine learning, it is advisable to construct a learning model by a neural network (deep learning) or the like. In this case, the number of difference points, area, screen occupancy, x-coordinate, and y-coordinate are input, and the weight between the nodes of the neural network is learned by using the match or mismatch as a teacher signal. When the learning is completed, the learning model can output a match or a mismatch close to the human judgment result with respect to the details of the difference input to the learning model.

Machine learning is a technology for making a computer acquire learning ability like a human being, and the computer autonomously generates algorithms necessary for data identification etc. from learning data that is taken in in advance, and uses this for new data. A technology that applies and makes predictions. The learning method for machine learning may be any of supervised learning, unsupervised learning, semi-supervised learning, intensive learning, and deep learning, and may be a learning method that combines these learning methods. Machine learning It doesn't matter how you learn for.

Further, machine learning methods include perceptron, deep learning, support vector machine, logistic regression, naive Bayes, decision tree, random forest, and the like, and are not limited to the methods described in the present embodiment.

<Main effect>
As described above, since the information processing system of the present embodiment does not use the image forming apparatus for evaluating the influence of the difference in the printer driver, the PDL module, or the OS on the image, the configuration of the information processing system 100 is simplified. , Evaluation cost can be reduced.

<Other application examples>
Although the best mode for carrying out the present invention has been described above with reference to examples, the present invention is not limited to these examples, and various modifications are made without departing from the gist of the present invention. And substitutions can be made.

For example, the configuration example shown in FIG. 4 is divided according to the main functions in order to facilitate understanding of the processing by the information processing apparatus 50. The present invention is not limited by the method of dividing the processing unit or the name. The processing of the information processing apparatus 50 can be divided into more processing units according to the processing content. It is also possible to divide one processing unit so as to include more processing.

In addition to the information processing device 50, the printer simulator may be included in a server device that communicates with the information processing device 50.

The group of devices described in this embodiment is merely one of a plurality of computing environments for implementing the embodiments disclosed herein. In certain embodiments, the information processing device 50 includes a plurality of computing devices, such as a server cluster. The plurality of computing devices are configured to communicate with each other over any type of communication link, including networks, shared memory, and the like, and perform the processes disclosed herein. Similarly, the terminal device 30 may include a plurality of computing devices configured to communicate with each other.

Each function of the embodiment described above can be realized by one or more processing circuits. Here, the "processing circuit" in the present specification is a processor programmed to execute each function by software such as a processor implemented by an electronic circuit, or a processor designed to execute each function described above. It shall include devices such as ASIC (Application Specific Integrated Circuit), DSP (Digital Signal Processor), FPGA (Field Programmable Gate Array) and conventional circuit modules.

30 Terminal device 50 Information processing device 100 Information processing system

Japanese Unexamined Patent Publication No. 2008-33472

Claims (19)

An information processing system in which a terminal device and an information processing device can communicate with each other.
The information processing device
An evaluation unit that evaluates an image generated by a printer simulator in response to a request from the terminal device, and an evaluation unit.
It has a first communication unit that transmits the contents of the evaluation result by the evaluation unit to the terminal device.
The terminal device is
The second communication unit that receives the evaluation result and
A display control unit that displays the evaluation result received by the second communication unit, and
An information processing system characterized by having. The information processing device generates two images with the printer simulator, and the information processing device generates two images.
The evaluation unit compares the two images and compares them.
The information processing system according to claim 1, wherein the display control unit of the terminal device displays the difference information of the two images as the evaluation result. The information processing system according to claim 2, wherein the information processing device uses the same OS and a printer driver to generate the two images with different printer simulators. The second aspect of claim 2, wherein the information processing apparatus generates print data with two printer drivers different from the same OS, and generates the two images from the two print data using the same printer simulator. Information processing system. The information according to claim 2, wherein the information processing apparatus generates print data with the same printer driver as a different OS, and generates the two images from the two print data using the same printer simulator. Processing system. The information processing apparatus is characterized in that, when an image having the same combination of OS, printer driver and printer simulator has already been generated, the already generated image is used for comparison without generating the image. Item 2. The information processing system according to any one of Items 2 to 5. An image having the same combination of the OS, the printer driver, and the printer simulator is characterized in that it is generated by the OS, the printer driver, and the printer simulator in which the image determined to be the same by comparison of the two images is generated. The information processing system according to claim 6. The information processing system according to any one of claims 3 to 7, wherein the information processing apparatus executes the OS in a virtual machine and executes a printer driver and a printer simulator on the OS of the virtual machine. .. The evaluation unit determines whether the two images are the same or non-identical based on a predetermined criterion, and determines whether the two images are the same or non-identical.
The first communication unit transmits to the terminal device whether the two images are the same or non-identical as the evaluation result.
The second communication unit of the terminal device receives whether the two images are the same or non-identical, and receives.
The display control unit displays two images that are the same or non-identical.
The information processing system according to any one of claims 2 to 8, further comprising an operation receiving unit that accepts modifications from the same to non-identical or non-identical to identical by the user. The second communication unit of the terminal device transmits the content of the modification of the modification from the same to the non-identical or the modification from the non-identical to the same to the information processing apparatus.
The first communication unit of the information processing device receives the content of the modification and receives the content of the modification.
The information processing system according to claim 9, wherein the evaluation unit changes the predetermined standard according to the content of the modification. The evaluation unit detects whether the two images are the same or non-identical, and detects the number of differences, the area, the screen occupancy, the x-coordinate of the difference, and the y-coordinate of the difference as the details of the difference.
The first communication unit transmits the details of the difference to the terminal device, and the first communication unit transmits the details of the difference to the terminal device.
The information processing system according to any one of claims 2 to 10, wherein the display control unit of the terminal device displays the details of the difference. The first communication unit transmits the two images generated by the printer simulator to the terminal device.
The information processing system according to any one of claims 2 to 11, wherein the display control unit of the terminal device displays the two images. The display control unit of the terminal device displays the setting screen based on the screen information received from the information processing device.
The setting screen is
Claims 3 to 12 include items that accept settings of the comparison source OS, printer driver, and printer simulator, and items that accept settings of the comparison target OS, printer driver, and printer simulator. The information processing system according to any one of the items. The information processing system according to claim 13, wherein the setting screen includes an item that accepts settings of one or more evaluation files used for generating an image. The setting screen accepts the settings of the comparison source OS, the printer driver, and the printer simulator by the identification information of a series of processes of the identity determination that has been determined in the past that the comparison source and the comparison target are the same. The information processing system according to claim 13 or 14. The setting screen has an item of exact match or ambiguous match as a method of comparing the two images.
The second communication unit of the terminal device transmits the comparison method specified by the exact match or the ambiguous match to the information processing apparatus.
When the ambiguous match is specified, the evaluation unit of the information processing apparatus
When the predetermined difference arrangement recognized from the difference information of the two images is larger than the threshold value, it is determined that the two images are not the same, and when it is equal to or less than the threshold value, it is determined that they are the same. The information processing system according to any one of claims 13 to 15, which is characterized. An information processing device that can communicate with a terminal device
An evaluation unit that evaluates an image generated by a printer simulator in response to a request from the terminal device, and an evaluation unit.
An information processing device including a first communication unit that transmits the content of an evaluation result by the evaluation unit to the terminal device. This is an evaluation method performed by an information processing system that can communicate between the terminal device and the information processing device.
The information processing device
A step in which the evaluation unit evaluates an image generated by the printer simulator in response to a request from the terminal device.
The first communication unit has a step of transmitting the content of the evaluation result by the evaluation unit to the terminal device.
The terminal device is
The step in which the second communication unit receives the evaluation result,
A step in which the display control unit displays the evaluation result received by the second communication unit, and
An evaluation method characterized by having. An information processing device that can communicate with the terminal device,
An evaluation unit that evaluates an image generated by a printer simulator in response to a request from the terminal device, and an evaluation unit.
A program for functioning as a first communication unit that transmits the contents of the evaluation result by the evaluation unit to the terminal device.

Images