JP5334124B2 - Information processing apparatus, control method thereof, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To easily perform the parameter setting of a module for performing specific image processing in the case of creating a program for performing image processing, and to register a created program as a module available in the case of creating another program. <P>SOLUTION: In the case of creating an application program for performing image processing, a picture for making it possible to recognize an image processing result with each processing item included in the application program is prepared. In the case of performing the application program, the result of the image processing performed with each processing item when the application program is performed is displayed on the picture. Also, it is possible to register the created program as a custom module, and to perform efficient program creation by creating another application program by using the custom module. <P>COPYRIGHT: (C)2011,JPO&amp;INPIT

Description

The present invention relates to an information processing apparatus for processing image, the control method, and a program, particularly an information processing apparatus for creating a program for performing image processing, a control method, and a program.

  2. Description of the Related Art Conventionally, for example, an image processing apparatus that performs image processing of image data to be inspected with a camera with a certain logic (processing flow) for the purpose of positioning a substrate or a component in a chip mounter or inspecting a finished product. Widely used.

  As such an image processing apparatus, for example, a general-purpose type image processing apparatus equipped with a predetermined image processing logic, or a dedicated user that can construct a logic that meets the user's needs. There are types of image processing devices.

  Here, the general-purpose type image processing apparatus does not require the construction of a new image processing logic, so it does not require the user's labor when introducing it into an actual manufacturing process, etc., but the logic completely satisfies the user's needs. There are few. On the other hand, a dedicated type image processing apparatus can construct image processing logic that completely satisfies the user's needs. For this reason, it is necessary to develop the image processing logic each time, so a great amount of development effort is required. The development period and the cost were high.

  Therefore, conventionally, for example, a technique for improving the efficiency of logic development as shown in Patent Document 1 below has been proposed. Specifically, in Patent Document 1, a plurality of image processing modules are registered in advance in a computer that develops logic, the developer selects a module that meets the needs of the user, and is necessary for the selected module. By setting parameters and creating source code after creating source code, logic development is made more efficient.

JP 2003-296112 A

  Here, when constructing logic in the above-described dedicated type image processing apparatus, usually, a plurality of modules for performing specific image processing are prepared, and logic is constructed by combining these modules. In this case, even if the image processing logic (processing flow) obtains an ideal result for a certain image data, there are various types of images to be processed. May not be obtained. Therefore, usually, the parameters of each module included in the constructed logic are changed, the order of modules is changed, and new modules are added, and the logic is adjusted by repeating trial and error. There is a need to do. In addition, when a branch process based on the determination process result is included or when an iterative process is included, it is necessary to adjust parameters such as a threshold for determination and the number of repetitions.

  However, when such a module adjustment is performed, in the technique of the above-described Patent Document 1, it is necessary to perform an operation of selecting a module from the beginning and setting a parameter every time the adjustment is performed. There is a problem that a large work must be done.

  In addition, in the constructed logic, which module of the combined modules is to be changed by changing parameters and order, or by adding a new module, that is, the module to be adjusted Need to be identified.

  However, in the technique of Patent Document 1 described above, in the constructed logic, the processing result of the module in the middle of the processing flow is unknown and only the final processing result is known, so in order to specify the module to be adjusted, After all, there is a problem that the developer has to perform a heavy work.

  In particular, when branching or iterative processing is included, it is necessary to determine whether to adjust parameters such as the threshold and the number of iterations for branching judgment, or to adjust the parameters and order of preceding and following processing. Become. However, in the technique of Patent Document 1 described above, since only the final processing result is known, after all, adjustment by trial and error is necessary, or it is necessary to create a special program for adjustment. There was a problem that the developer had to perform a heavy work.

  Furthermore, even when the parallel processing includes the parallel processing in which a plurality of processes are separately performed after the branch processing and the next processing is performed using each processing result, the parameter of the parallel branch processing module should be adjusted, Although it is necessary to determine whether to adjust the processing itself, there is a similar problem.

  In order to efficiently develop logic, it is desirable to register logic created by combining a plurality of modules as a new module so that other logic can be created.

The present invention has been made in view of such problems, as well as support the description of the source code to create a process item can be added to the application program can utilize the source code as processing item Another object of the present invention is to provide a mechanism that can realize creation support of a program for performing image processing by constructing efficient image processing logic.

An information processing apparatus according to the present invention is an information processing apparatus that generates an application program for causing a computer to perform image processing, and implements a plurality of process items that can be added to the application program and processes related to the process items Storage means for associating and storing source code used for generating a program for performing , accepting designation of a processing item to be added to the application program from a selection screen for displaying the plurality of processing items, and the selection screen Accepting means for displaying the input screen for the user to describe the source code, including the basic part of the source code, and receiving the description of the source code including debugging information for debugging according to the instruction from the user in And the processing item in the receiving means The application program using a setting unit that sets a display area for displaying image data of an image processing result by the processing item according to a specified reception, and a source code corresponding to the processing item received by the receiving unit And generating means for generating a processing item by removing the debug information from the source code whose description has been received by the receiving means, and registration for registering the application program generated by the generating means in the storage means And display control means for displaying result image data as a result of performing processing relating to the processing item on the processing target image in the display area set by the setting means when executing the application program registered by the registration means. , wherein the registration means, processing generated by the generating means As the item is possible to specify the reception of the selection screen by said reception means, characterized in that it additionally registered in the storage means a process item to which the generated as addable process item to the application program.

A method for controlling an information processing apparatus according to the present invention includes a plurality of process items that can be added to an application program for causing a computer to perform image processing, and a source used to generate a program for realizing processing related to the process item An information processing apparatus control method that includes a storage unit that stores a code in association with each other, wherein the reception unit of the information processing apparatus displays the plurality of process items from a selection screen that displays the plurality of process items. Accepts the designation of process items to be added to the application program, and displays the input screen for the user to describe the source code, including the basic part of the source code, in accordance with instructions from the user on the selection screen, and debugs description of the source code, including the debug information for the A setting step of setting a display area in which image data of an image processing result by the processing item is displayed in response to the reception of the designation of the processing item in the reception step. Step, and the generation unit of the information processing apparatus generates the application program using the source code corresponding to the processing item received in the receiving step, and from the source code that receives the description in the receiving step, A generation step of generating a processing item by removing the debug information, a registration step of registering the application program generated in the generation step by the registration unit of the information processing device, The display control means registers the application registered in the registration step. During the execution of the Deployment program, and a display control step of displaying the resulting image data of the result of the process according to the process item in the display area set in said setting step for the processing target image, the registration step, The generated process item is additionally registered in the storage unit as a process item that can be added to the application program so that the process item generated in the generating step can be specified on the selection screen in the receiving step. It is characterized by doing.

The program of the present invention associates a plurality of process items that can be added to an application program for causing a computer to perform image processing, and source code used to generate a program for realizing the processing related to the process item. A storage means for storing the information processing apparatus, and a computer-readable program for causing the computer to execute a control method of the information processing apparatus for generating the application program, wherein the information processing apparatus includes the plurality of processing items . The specification of the processing item to be added to the application program is accepted from the selection screen to be displayed, and the input screen for the user to describe the source code is displayed based on the instruction from the user on the selection screen. Including and displaying A receiving means for receiving a description of a source code, including debugging information for grayed, depending on the reception of the specified the process item in the reception unit, a display area for displaying the image data of the image processing result by the processing item Generating the application program using the setting means for setting the source code and the source code corresponding to the processing item received by the receiving means, and removing the debug information from the source code receiving the description by the receiving means Generating means for generating a processing item , registration means for registering the application program generated by the generating means in the storage means, and the processing item for the processing target image when executing the application program registered by the registration means The result image data of the result of the processing related to To function as a display control means for displaying on the display area set by the setting means, said registration means so that the process item generated by the generating means is possible to specify the reception of the selection screen by said reception means, The generated process item is additionally registered in the storage unit as a process item that can be added to the application program.

According to the present invention, it will support the description of the source code to create an additional possible process item in the application program, which can utilize the source code as processing item, the efficient image processing logic constructs It is possible to provide a mechanism to realize.

1 is a schematic diagram illustrating an example of a schematic configuration of an image processing system according to an embodiment of the present invention. It is a schematic diagram which shows an example of the hardware constitutions inside the information processing apparatus 110 shown in FIG. It is a schematic diagram which shows an example of the hardware constitutions of the image input controller 115f shown in FIG. It is a schematic diagram which shows an example of a function structure of the information processing apparatus 110 shown in FIG. FIG. 5 is a schematic diagram illustrating an example of a module / source code master table 411 illustrated in FIG. 4. FIG. 5 is a schematic diagram illustrating an example of a processing flow / input / output parameter table 412 illustrated in FIG. 4. It is a schematic diagram which shows an example of the process sequence of the control method by the information processing apparatus 110 shown in FIG. It is a schematic diagram which shows an example of the main menu of an image processing system construction screen. FIG. 5 is a schematic diagram illustrating an example of a processing flow main table 418 illustrated in FIG. 4. It is a schematic diagram which shows an example of the process sequence of the control method by the information processing apparatus 110 shown in FIG. It is a schematic diagram which shows an example of an image processing flow construction screen. 11 is a flowchart illustrating an example of a detailed processing procedure of “new addition processing” of a module in step S207 of FIG. 11 is a flowchart illustrating an example of a detailed processing procedure of “modification processing” of a module in step S209 in FIG. It is a schematic diagram which shows an example of a parameter edit screen. 11 is a flowchart illustrating an example of a detailed processing procedure of a “move process” of a module in step S211 of FIG. 11 is a flowchart showing an example of a detailed processing procedure of “insertion processing” of a module in step S213 in FIG. 11 is a flowchart illustrating an example of a detailed processing procedure of “deletion processing” of a module in step S215 in FIG. 11 is a flowchart illustrating an example of a detailed processing procedure of “execution processing” of a module in step S217 of FIG. 12 is a flowchart illustrating an example of a detailed processing procedure of “save processing” of a module in step S219 of FIG. It is a schematic diagram which shows an example of a conditional expression input screen. As shown in FIG. 5 is a schematic diagram illustrating an example of a conditional expression table 416. FIG. It is a flowchart which shows an example of the process sequence containing a branch process. An example of the processing result image comparison window with the last set value is shown. An example of the window which displays the progress image in the iterative process is shown. It is a flowchart which shows an example of the detailed process sequence of a "parallel branch process." It is a flowchart which shows an example of the detailed process sequence of the "apparatus adjustment" process of FIG.7 S111. 12 is a flowchart illustrating an example of a detailed processing procedure of “image storage” processing. An example of the window of “apparatus adjustment” processing is shown. It is a schematic diagram which shows an example of a node process flag table. It is a schematic diagram which shows an example of the process sequence of the control method of the 2nd Example by the information processing apparatus 110 shown in FIG. 32 is a flowchart illustrating an example of a detailed processing procedure of “custom module creation processing” in step S221 of FIG. 30. 32 is a flowchart illustrating an example of a detailed processing procedure of an execution process in step S1205 of FIG. 31. An example of a custom module creation screen window is shown. FIG. 5 is a schematic diagram illustrating an example of a system information table 419 illustrated in FIG. 4. 8 is a flowchart showing an example of a detailed processing procedure of “online inspection” processing in step S109 of FIG. It is a schematic diagram which shows an example of the process sequence of the control method of the 3rd Example by the information processing apparatus 110 shown in FIG. It is a schematic diagram which shows an example of the layout screen used by a screen creation process. It is a flowchart which shows an example of a screen creation process. FIG. 39 is a flowchart showing details of new button addition processing in step S3805 of FIG. 38. FIG. It is a flowchart which shows the detail of the new screen addition process of step S3807 of FIG. FIG. 39 is a flowchart showing details of new box addition processing in step S3809 of FIG. 38. FIG. FIG. 39 is a flowchart showing details of the change / move process in step S3811 of FIG. 38. FIG. It is a flowchart which shows the detail of the preservation | save process of step S3813 of FIG. It is a schematic diagram which shows an example of a screen layout table. It is a schematic diagram which shows an example of a button control table. It is a schematic diagram which shows an example of a screen control table. It is a schematic diagram which shows an example of a box control table.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. FIG. 1 is a schematic diagram illustrating an example of a schematic configuration of an image processing system 100 according to an embodiment of the present invention. As shown in FIG. 1, the image processing system 100 includes an information processing device 110, an input device 120, a display device 130, a camera 140, a lighting device controller 150, a lighting device 160, an external device controller 170, and an inspection. It has a stage 180 on which an object 181 is placed.

  The information processing apparatus 110 is an apparatus that comprehensively controls operations in the image processing system 100. Here, in the present embodiment, an example in which the information processing apparatus 110 is applied as an apparatus that supports development of an image processing application program that operates on an image processing apparatus introduced into an actual manufacturing process will be described. However, the present invention is not limited to this. For example, the present invention includes a form applied as an image processing apparatus introduced into an actual manufacturing process.

  The information processing apparatus 110 is configured to be able to communicate with a camera 140 that captures an image of the inspection target 181 via a predetermined cable or the like. Further, the information processing apparatus 110 is configured to be able to communicate with an illumination apparatus controller 150 that controls the illumination apparatus 160 via a predetermined cable or the like. The information processing apparatus 110 is configured to be able to communicate with an external device controller 170 such as a programmable controller (PCL) that controls the stage 180 via a predetermined cable or the like. Furthermore, the information processing device 110 is configured to be able to communicate with the input device 120 and the display device 130 via a predetermined cable or the like. In other words, the information processing apparatus 110 controls the input device 120, the display device 130, the camera 140, the lighting device controller 150, and the external device controller 170 connected via a predetermined cable or the like, so that the image processing system 100 includes the information processing device 110. Control the overall operation.

  The input device 120 is operated by the user when the user inputs various instructions to the information processing apparatus 110, for example, and the input instruction is sent to the information processing apparatus 110 according to the input instruction operation from the user. In contrast, it is input. The input device 120 is composed of, for example, a keyboard (KB) and a pointing device.

  The display device 130 displays various images and various information on the display screen according to the control of the information processing device 110.

  The camera 140 performs imaging (imaging) of the inspection object 181 placed on the stage 180 according to the control of the information processing apparatus 110, and the image data obtained by the imaging is processed via a predetermined cable or the like. Send to.

  The lighting device controller 150 controls the lighting of the lighting device 160 according to the control of the information processing device 110. Based on the control of the lighting device controller 150, the lighting device 160 performs switching of lighting on / off of the lighting of the inspection target 181 and adjustment of brightness according to the inspection content of the inspection target 181.

  The external device controller 170 controls the stage 180 according to the control of the information processing apparatus 110. The stage 180 moves the placed inspection object 181 to a target position and carries in or out the inspection object 181 based on the control of the external device controller 170. The above is an example of the configuration of the image processing system.

  Next, the hardware configuration of the information processing apparatus 110 will be described. FIG. 2 is a schematic diagram illustrating an example of a hardware configuration of the information processing apparatus 110 illustrated in FIG. In FIG. 2, in addition to the internal configuration of the information processing apparatus 110, various apparatuses connected to the information processing apparatus 110 are also described.

As illustrated in FIG. 2, the information processing apparatus 110 includes a CPU 111, a RAM 112, a ROM 113, a system bus 114, various controllers 115 (115 a to 115 g), and an external memory 116. As various controllers 115, an input controller 115a, a video controller 115b, a memory controller 115c, communication I / F controllers 115d, 115e, and 115g, and an image input controller 115f are configured. The CPU 111 controls each device connected to the system bus 114 based on a program or the like stored in the ROM 113 or the external memory 116 so as to comprehensively control the operation in the information processing apparatus 110. The RAM 112 functions as a main memory and work area for the CPU 111. The CPU 111 implements various operations in the information processing apparatus 110 by loading a necessary program or the like into the RAM 112 and executing the program when executing the processing. The ROM 113 has a BIOS (Basic Input) which is a control program of the CPU 111.
/ Output System) is stored.

  The system bus 114 connects the CPU 111, RAM 112, ROM 113, input controller 115a, video controller 115b, memory controller 115c, communication I / F controllers 115d and 115e, 115g, and image input controller 115f so that they can communicate with each other.

  The input controller 115a controls input from the input device 120 including a keyboard (KB) and a pointing device. The video controller 115b controls display on the display device 130 which is a display device. The memory controller 115 c controls access to the external memory 116. Here, the external memory 116 is composed of, for example, a hard disk (HD) or a flexible disk (FD), and stores a boot program, various application programs, editing files, various data, various information, and the like. In addition, the external memory 116 is an operating system (hereinafter referred to as “OS”), a program for causing the CPU 111 to execute various processes described later, and various types used when performing processes according to the control of the programs. A table, various inspection result information, and the like are also stored.

  The communication I / F controller 115d controls communication with the external device controller 170. Further, the communication I / F controller 115e controls communication with the lighting device controller 150. The image input controller 115 f is configured to be able to receive image data from the camera 140 by communicating with the camera 140. Here, the image input controller 115f may be equipped with hardware capable of performing arithmetic processing on the controller. In the present embodiment, the description is based on the assumption that image data is input from the camera 140, but an image file may be read and input. Further, the communication I / F controller 115g is connected to a network such as a local area network (LAN) 190, and controls communication with various devices connected to the network.

  Next, the hardware configuration of the image input controller 115f will be described with reference to FIG. As shown in FIG. 3, the image input controller 115 f includes a CPU (arithmetic chip) 301, a memory controller 302, an input controller 303, and an on-board memory 304.

  A CPU (arithmetic chip) 301 executes various image processing described later. The memory controller 302 controls the input / output of various data to the on-board memory 304 according to the control of the CPU (arithmetic chip) 301. An input controller 303 controls input of image data from the camera 140. The on-board memory 304 functions as a main memory of the CPU (arithmetic chip) 301. The above is the description of the hardware configuration of the image input controller 115f.

  Next, an example of a functional configuration of the information processing apparatus 110 will be described. FIG. 4 is a schematic diagram illustrating an example of a functional configuration of the information processing apparatus 110 illustrated in FIG.

  As shown in FIG. 4, the information processing apparatus 110 includes a table storage unit 410, a flow creation unit 420, a source code conversion unit 430, a compilation unit 440, a (verification) execution unit 450, a data storage unit 460, and a data input Each functional configuration of the output unit 470 is configured. The table storage unit 410 stores a module / source code master table 411, a processing flow / input / output parameter table 412, a source code table 413, an object code table 414, and a project file table 415. In addition, a conditional expression table 416, a node processing flag table 417, a processing flow main table 418, and a system information table 418 are also stored.

  Here, in the present embodiment, the table storage unit 410 of FIG. 4 is configured in the external memory 116 shown in FIG. 2, for example (including the case where it is configured once in the RAM 112 and then in the external memory 116). . Also, the flow creation unit 420, source code conversion unit 430, compilation unit 440, (verification) execution unit 450, data storage unit 460, and data input / output unit 470 of FIG. And a program stored in the external memory 116.

  The module / source code master table 411 stored in the table storage unit 410 of FIG. 4 will be described with reference to FIG. FIG. 5 is a schematic diagram showing an example of the configuration of the module / source code master table 411.

  As shown in FIG. 5, in the module / source code master table 411, for each index 501, a processing item 502 related to image processing, a source code 503 corresponding to each processing item, and the processing item are realized. An initial value 504 and a processing entity 505 for the module for doing so are associated. This source code is used when the source code conversion unit 430 converts a module to be processed into a source code.

  Next, the processing flow / input / output parameter table 412 stored in the table storage unit 410 of FIG. 4 will be described with reference to FIG. FIG. 6 is a schematic diagram showing an example of the configuration of the processing flow / input / output parameter table 412 shown in FIG. As shown in FIG. 6, the processing flow / input / output parameter table 412 includes, for each index 601, a module 603 relating to image processing, an order 602 of each module 603, and a flow registration name 604 of each module 603. The input parameter 605 and the output parameter 606 in each module 603 are associated with each other. An input parameter 605 indicates an image buffer, a storage area, or the like in which various data used by each module is stored. An output parameter 606 indicates a storage area for storing a result image buffer when each module is executed, a threshold value used for various processes, and the like. A next step 607 indicates an index 601 of a step to be processed next. The next step 607 may have a plurality of indexes. The branch reference 608 indicates a conditional expression table for designating which step is to be processed next by each condition (node) when the “iterative processing” module and the “conditional branch processing” module are set in the module 603. . Further, the processing main body 609 is an item indicating whether the processing is performed in each module by the CPU 111 or the CPU (arithmetic chip) 301 of the image input controller 115f.

  The index (Index) 601 in the processing flow / input / output parameter table 412 shown in FIG. 6 and the index (Index) in the module / source code master table 411 shown in FIG. In this case, each table may be created. In the processing flow / input / output parameter table T600, 2 and 3 of the index (Index) 601 are examples of iterative processing, and 2 to 4 of the index (Index) 601 of the processing flow / input / output parameter table T601 are examples of conditional branch processing. is there.

  The source code table 413 converts all the modules 603 stored in the processing flow / input / output parameter table 412 into source codes using the module / source code master table 411 and registers them. The source code in the module or a part of the modules is stored.

  The object code table 414 stores object code that is an executable module obtained by converting the source code stored in the source code table 413 by the compiling unit 440. The project file table 415 stores initial setting parameters relating to image processing, processing flow sequences, source codes, input / output parameters, and the like. In addition, the conditional expression table 416 stores a conditional expression or the like when the “conditional branch processing” module is set, and the node processing flag table 417 stores the conditional expression when the “parallel branch processing” module is set. Stores the node name and the like.

  Next, the flow creation unit 420, the source code conversion unit 430, the compilation unit 440, the execution unit 450, the data storage unit 460, and the data input / output unit 470 of FIG. 4 will be described.

  The flow creation unit 420 creates a processing flow / input / output parameter table 412 for managing the processing sequence of modules included in the module / source code master table 411, and a processing flow drawing area (1102 in FIG. 11 described later). It has a function to draw a module in

  The source code conversion unit 430 collates the processing data of each module stored in the processing flow / input / output parameter table 412 created by the flow creation unit 420 with the module / source code master table 411 to source each module. It has a function of converting into code and storing it in the source code table 413.

  The table modules shown in FIGS. 5 and 6 include not only processing for images but also processing for external devices including pre-processing for acquiring images and post-processing for outputting processing results. But of course. For example, a control command for setting the imaging conditions of the camera 140, a control command for the lighting device controller 150 for controlling the lighting device 160, or a control command for the external device controller 170 for controlling movement of the stage, etc. A control command such as transmitting data to a PC connected on the LAN may be performed.

  The compiling unit 440 has a function of generating executable object code from the source code stored in the source code table 413 and storing the generated object code in the object code table 414.

  There are two types of compilation performed by the compiling unit 440: debug compilation and release compilation. Here, in this embodiment, during the process flow creation, debugging / compilation that enables step execution at the source code level is performed, and release / compilation that generates a file that can be used online is performed when data is saved. Do. At this time, both the debug compilation and the release compilation refer to the source code generated by the same conversion method.

  The (verification) execution unit 450 executes the object code stored in the object code table 414 created by the compiling unit 440, results image display area (1103 in FIG. 11 described later), processing flow / input / output parameter table 412 is updated.

  For example, the data storage unit 460 outputs the source code table 413, the object code table 414, and the project file table 415 in the RAM 112 to the external memory 116, and performs data storage processing.

  The data input / output unit 470 has a function of managing input / output parameters used in each module.

Next, a processing procedure of image processing application program creation processing executed by the information processing apparatus 110 will be described. FIG. 7 is a flowchart illustrating an example of a processing procedure of an image processing program creation process by the information processing apparatus 110 illustrated in FIG. A program for causing the CPU 111 to execute this process is stored in the external memory 116. When an execution request for this process is received from the input device 120, the CPU 111 loads the program into the RAM 112 and depends on the loaded program. This process is executed according to the control.

  First, in step S101 of FIG. 7, the CPU 111 of the information processing apparatus 110 refers to the startup project name 3402 of the system setting table T3400 shown in FIG. 34 and identifies the startup mode. Here, in the startup project 3402, an existing project name or “NULL” is set.

  Subsequently, when the process proceeds to step S102, it is determined whether or not the activation mode specified in step S101 is startup. If an existing project name is set in the startup project name 3402 of the system setting table, the CPU 111 determines that the startup is in progress. If the CPU 111 determines in step S102 that the startup mode is startup (S102 / YES), the process proceeds to the “online inspection” process in step S109. On the other hand, if the CPU 111 determines that it is not startup (S102 / NO), the process proceeds to step S103.

  In step S <b> 103, the CPU 111 of the information processing apparatus 110 performs a process of displaying a main menu for performing image processing system development and system settings on the display device 130 based on an input instruction from the input device 120, for example. The main menu is as shown in FIG.

  FIG. 8 is a schematic diagram showing an example of the main menu 800 of the image processing system development screen. The main menu 800 of the image processing system development screen shown in FIG. 8 is created with a “project construction” menu 801 and a “project construction” menu 801 for creating a new logic (processing flow) or editing a created processing flow. “Online inspection” menu 802 for executing the processed flow in the online inspection mode, “Device adjustment” menu 803 for performing adjustment when an image is captured by the camera 140 in the image processing system 100, and “Online inspection” menu 802 “System setting” menu 804 for designating a project to be read in, “Exit” menu 805 for ending the main menu, “Read project name” menu to be specified when editing a project that has been created in “Project construction” menu 801 8 6 is provided.

  Returning to the description of FIG. When the main menu display process in step S103 is completed, the CPU 111 advances the process to step S104. Then, the CPU 111 of the information processing apparatus 110 determines whether or not there is an input instruction from the input device 120 for each menu item on the main menu 800 of the image processing system development screen displayed in step S103.

  As a result of the determination in step S104, when it is determined that there is no input instruction for each menu item of the main menu 800 from the input device 120 (step S104 / NO), the input device 120 continues until there is an input instruction in step S104. On the other hand, if it is determined that there is an input instruction from the input device 120 as a result of the determination in step 102 (step S104 / YES), the process proceeds to step S105.

  In step S <b> 105, the CPU 111 of the information processing apparatus 110 performs a process for determining the selected process content based on an input instruction from the input apparatus 120. In this example, the processing contents determined in step S105 are “project construction processing”, “online inspection processing”, “apparatus adjustment screen display”, “system setting screen display”, “end processing”, and “read”. “Project name input”. Note that the processing content given here is an example, and other menu items can be added to the main menu, and the other processing content corresponding to the menu item can be determined in step S105.

  Subsequently, in step S106, the CPU 111 of the information processing apparatus 110 determines whether or not the processing content determined in step S105 is “project construction processing”. As a result of the determination in step S106, if it is determined that the processing content determined in step S105 is “project construction processing” (step S106 / YES), the process proceeds to step S107.

  In step S107, the CPU 111 of the information processing apparatus 110 performs “project construction processing”. Details of the “project construction process” will be described later with reference to FIG. When the process of step S107 is completed, the process returns to step S104 and waits until the next input instruction is received from the input device 120.

  On the other hand, as a result of the determination in step S106, if it is determined that the processing content determined in step S106 is not “project construction processing” (step S106 / NO), the process proceeds to step S108.

  In step S108, the CPU 111 of the information processing apparatus 110 determines whether or not the processing content determined in step S105 is “online inspection processing”.

  As a result of the determination in step S108, when it is determined that the processing content determined in step S105 is “online inspection processing” (step S108 / YES), the CPU 111 advances the processing to step S109.

  In step S109, the CPU 111 of the information processing apparatus 110 performs an “online inspection process” process. Details of the “online inspection process” will be described later with reference to FIG. When the process of step S109 ends, the process returns to step S104 and waits until the next input instruction is received from the input device 120.

  On the other hand, as a result of the determination in step S108, when it is determined that the processing content determined in step S106 is not “online inspection processing” (step S108 / NO), the CPU 111 advances the processing to step S110.

  In step S110, the CPU 111 of the information processing apparatus 110 determines whether the processing content determined in step S105 is “apparatus adjustment processing”.

  As a result of the determination in step S110, when it is determined that the processing content determined in step S105 is “device adjustment processing” (step S110 / YES), the CPU 111 advances the processing to step S111.

  In step S <b> 111, the CPU 111 of the information processing apparatus 110 performs “apparatus adjustment processing”. Details of this “apparatus adjustment processing” will be described later with reference to FIG. When the process of step S111 is completed, the process returns to step S104 and waits until the next input instruction is received from the input device 120.

  On the other hand, as a result of the determination in step S110, if it is determined that the processing content determined in step S105 is not “apparatus adjustment screen display processing” (step S110 / NO), the CPU 111 advances the processing to step S112.

  In step S112, the CPU 111 of the information processing apparatus 110 determines whether or not the processing content determined in step S105 is “system setting processing”.

  As a result of the determination in step S112, if it is determined that the processing content determined in step S105 is “system setting processing” (step S112 / YES), the CPU 111 advances the processing to step S113.

  In step S113, the CPU 111 of the information processing apparatus 110 performs “system setting processing”. When the process of step S113 is completed, the process returns to step S104, and waits for a next input instruction from the input device 120.

  On the other hand, as a result of the determination in step S112, if it is determined that the processing content determined in step S105 is not “system setting processing” (step S112 / NO), the CPU 111 advances the processing to step S114.

  In step S114, the CPU 111 of the information processing apparatus 110 determines whether or not the processing content determined in step S105 is “end processing”.

  As a result of the determination in step S114, when it is determined that the processing content determined in step S105 is “end processing” (step S114 / YES), the processing by this program is ended.

  On the other hand, as a result of the determination in step S114, if it is determined that the processing content determined in step S106 is not “end processing” (step S114 / NO), the process proceeds to step S104, and the input device 120 performs the next process. Wait for input instructions.

  Next, the details of the “project construction process” in step S107 of FIG. 7 will be described with reference to FIG. FIG. 10 is a flowchart illustrating an example of a process procedure of “project construction process” performed by the CPU 111 of the information processing apparatus 110. A program for causing the CPU 111 to execute this process is stored in the external memory 116. When an execution request for this process is received from the input device 120, the CPU 111 loads the program into the RAM 112 and depends on the loaded program. This process is executed according to the control.

  First, in step S <b> 201, the CPU 111 of the information processing apparatus 110 displays an image processing project development screen 1100 for developing the image processing system shown in FIG. 11 based on an input instruction from the input apparatus 120, for example. Process to be displayed.

  FIG. 11 is a schematic diagram illustrating an example of the image processing project development screen 1100. An image processing project development screen 1100 shown in FIG. 11 includes a tool box 1101 that displays available processing units (that is, modules related to image processing such as “camera capture”), and an execution order of image processing (that is, , The execution order of each module) in a flowchart, a processing flow drawing area 1102, a result image display area 1103 for displaying a result image executed in each image processing (that is, processing of each module), a toolbar 1107, an image A close button (not shown) that is operated when the development of the processing program is finished is also provided. Further, the image processing project development screen 1100 shown in FIG. 11 includes parameters used in each step (that is, each module) of the flowchart of the processing flow drawing area 1102 when, for example, a new module is registered or a parameter is edited. A parameter editing screen 1104 for setting the image and a result image display area 1103 for displaying the result image executed by setting the parameter are displayed. The example of the project construction screen in FIG. 11 also includes a module that controls the flow by branch processing. Here, the result image display area 1103 is a result image of each module in the flow drawing area 1102. This may be a preview image or a reduced image. In the case of conditional branch processing, an image of a node (branch) that satisfies the condition is displayed, and a blackout image is displayed because processing is not performed for a node that does not satisfy the condition. At this time, if the results of all processing flows do not fit in the result image display area 1103, the display area may be changed using horizontal and vertical scroll bars. The above is an example of the configuration of the image processing project development screen.

  Returning to the description of FIG. When the process of step S201 ends, the CPU 111 advances the process to step S202. In step S202, the CPU 111 of the information processing apparatus 110 determines whether to newly develop an image processing program using the image processing project development screen 1100 displayed in step S201, based on an input instruction from the input device 120. to decide.

  As a result of the determination in step S202, when a new image processing program is not developed, that is, when editing an already created image processing flow (step S202 / NO), the process proceeds to step S203.

  In step S 203, the CPU 111 of the information processing apparatus 110 reads the project file table 415 stored in the external memory 116 and stores it in the RAM 112.

  After the process of step S203 is completed, or when it is determined in step S202 that a new image processing program is to be developed (step S202 / YES), the CPU 111 advances the process to step S204.

  In step S204, the CPU 111 of the information processing apparatus 110 determines whether there is an input instruction from the input apparatus 120 (specifically, an input instruction for the image processing project development screen 1100 displayed in step S201).

  As a result of the determination in step S204, if it is determined that an input instruction from the input device 120 is not received (step S204 / NO), the process waits in step S204 until there is an input instruction from the input device 120. On the other hand, as a result of the determination in step S204, if it is determined that an input instruction from the input device 120 has been received (input is present) (step S204 / YES), the process proceeds to step S205.

  In step S205, the CPU 111 of the information processing apparatus 110 performs a process for determining the selected process content based on the input instruction received from the input apparatus 120. In this example, the processing contents determined in step S205 are “new addition processing”, “change processing”, “move processing”, “insertion processing”, “deletion processing”, “overall execution processing”, “save” Processing. It should be noted that the processing content given here is an example, and it is of course possible to determine other processing content in step S205.

  Here, in the determination process of step S205, the CPU 111 determines each process described above by making the following inputs on the image processing project development screen 1100 shown in FIG. 11, for example.

  First, when any process item (module) is selected from the tool box 1101 shown in FIG. 11 and dragged and dropped to the end of the process flow sequence in the process flow drawing area 1102, the CPU 111 of the information processing apparatus 110 It is determined that the event is a “new addition process” of the module. Further, when a module already registered in the processing flow drawing area 1102 is double-clicked, or a certain module is specified to display a pop-up menu (not shown), and a parameter change menu item is selected (click instruction), The CPU 111 of the information processing apparatus 110 determines that the event is a “change process” event of the module parameter. When a module already registered in the processing flow drawing area 1102 is dragged and dropped between other modules, the CPU 111 of the information processing apparatus 110 determines that the event is a “movement process” of the module. When a module is selected from the toolbox 1101 shown in FIG. 11 and dragged and dropped between modules already registered in the processing flow drawing area 1102, the CPU 111 of the information processing apparatus 110 performs “insertion processing of module”. It is determined that the event is. Also, a module already registered in the processing flow drawing area 1102 is selected, and the delete key is pressed, or a certain module is specified to display a pop-up menu (not shown), and the delete menu item is selected (click instruction). Then, the CPU 111 of the information processing apparatus 110 determines that the event is a “deletion process” of the module. When “execution” of the menu bar 1106 or the tool bar 1107 is selected, the CPU 111 of the information processing apparatus 110 determines that the event is the “overall execution process” event of the process flow set in the process flow drawing area 1102. . When “save” on the toolbar 1107 is selected, the CPU 111 of the information processing apparatus 110 determines that the event is a “save process” event of the process flow set in the process flow drawing area 1102.

  In this embodiment, the processing content is determined in this way. However, this is an example. For example, the toolbar 1107 is provided with a function such as an icon corresponding to the processing content such as “add new”. The present invention is not limited to the above-described form.

  Subsequently, in step S <b> 206, the CPU 111 of the information processing apparatus 110 determines whether the processing content determined in step S <b> 205 is a “new addition process” of the module. If it is determined in step S206 that the processing content determined in step S205 is “new addition processing” of the module (step S206 / YES), the CPU 111 advances the processing to step S207.

  In step S207, the CPU 111 of the information processing apparatus 110 performs a “new addition process” for the selected module. Details of the new addition process in step S207 will be described later with reference to FIG. When the process of step S207 ends, the process returns to step S204, and waits for a next input instruction from the input device 120.

  On the other hand, if it is determined that the determination processing in step S206 and the processing content determined in step S205 are not the “new addition processing” of the module (step S206 / NO), the CPU 111 advances the processing to step S208.

  In step S208, the CPU 111 of the information processing apparatus 110 determines whether or not the processing content determined in step S205 is a “parameter change processing” of the module. If it is determined in the determination process of step S208 that the processing content determined in step S205 is a “parameter change process” for the module parameter (YES in step S208), the process proceeds to step S209.

  In step S209, the CPU 111 of the information processing apparatus 110 performs “change processing” for the parameter of the selected module. Details of the change processing in step S209 will be described later with reference to FIG. When the process of step S209 is completed, the process returns to step S204, and waits for a next input instruction from the input device 120.

  On the other hand, if it is determined in step S208 that the processing content determined in step S205 is not a “parameter change processing” for the module parameter (step S208 / NO), the CPU 111 proceeds to step S210. In step S210, the CPU 111 of the information processing apparatus 110 determines whether or not the processing content determined in step S205 is a “movement process” of the module.

  If it is determined in step S210 that the processing content determined in step S205 is a “movement process” of the module (step S210 / YES), the process proceeds to step S211.

  In step S <b> 211, the CPU 111 of the information processing apparatus 110 performs “move processing” for the selected module. Details of the movement process in step S211 will be described later with reference to FIG. When the process of step S211 is completed, the process returns to step S204, and waits for a next input instruction from the input device 120.

  On the other hand, if it is determined in step S210 that the processing content determined in step S205 is not the “movement processing” of the module (step S210 / NO), the process proceeds to step S212. In step S212, the CPU 111 of the information processing apparatus 110 determines whether the processing content determined in step S205 is “insertion processing” of the module.

  If it is determined in step S212 that the processing content determined in step S205 is “insertion processing” of the module (step S212 / YES), the process proceeds to step S213.

  In step S213, the CPU 111 of the information processing apparatus 110 performs an “insertion process” for the selected module. Details of the insertion processing in step S213 will be described later with reference to FIG. When the process of step S213 is completed, the process returns to step S204, and waits for a next input instruction from the input device 120.

  On the other hand, when it is determined in step S212 that the processing content determined in step S205 is not the “insertion processing” of the module (step S212 / NO), the CPU 111 advances the processing to step S214.

  In step S214, the CPU 111 of the information processing apparatus 110 determines whether the processing content determined in step S205 is a “deletion process” of the module. If it is determined in step S214 that the processing content determined in step S205 is the “deletion processing” of the module (step S214 / YES), the process proceeds to step S215.

  In step S215, the CPU 111 of the information processing apparatus 110 performs “deletion processing” for the selected module. Details of the deletion process in step S215 will be described later with reference to FIG. When the process of step S215 is completed, the process returns to step S204, and waits for a next input instruction from the operation input device 120.

  On the other hand, if it is determined in step S214 that the processing content determined in step S205 is not the “insertion processing” of the module (step S214 / NO), the CPU 111 advances the processing to step S216.

  In step S216, the CPU 111 of the information processing apparatus 110 determines whether the processing content determined in step S205 is “execution processing” of the processing flow. If it is determined in step S216 that the processing content determined in step S205 is “execution processing” of the processing flow (step S216 / YES), the CPU 111 advances the processing to step S217.

  In step S <b> 217, the CPU 111 of the information processing apparatus 110 performs “execution processing” of the processing flow set in the processing flow drawing area 1102. Details of the execution process of step S217 will be described later with reference to FIG. When the process of step S217 is completed, the process returns to step S204, and waits for a next input instruction from the input device 120.

  On the other hand, if it is determined in step S216 that the processing content determined in step S205 is not “execution processing” in the processing flow (step S216 / NO), the CPU 111 advances the processing to step S218.

  In step S218, the CPU 111 of the information processing apparatus 110 determines whether the processing content determined in step S205 is “save processing” in the processing flow. If it is determined in step S218 that the processing content determined in step S205 is “save processing” in the processing flow (YES in step S218), the CPU 111 advances the processing to step S219.

  In step S 219, the CPU 111 of the information processing apparatus 110 performs “save processing” for the contents set on the image processing project development screen 1100. Then, when the process of step S219 ends, the image processing project development screen 1100 ends.

  On the other hand, if it is determined in step S218 that the processing content determined in step S205 is not “save processing” in the processing flow (step S218 / NO), the process returns to step S204 and input from the operation input device 120. Wait for instructions.

  Next, details of the “new addition process” of the module will be described with reference to FIG. FIG. 12 is a flowchart showing details of the “new addition process” of the module in step S207 of FIG. A program for causing the CPU 111 to execute this process is stored in the external memory 116. When an execution request for this process is received from the input device 120, the CPU 111 loads the program into the RAM 112 and depends on the loaded program. This process is executed according to the control.

  First, in the process of step S301 in FIG. 12, the CPU 111 of the information processing apparatus 110 specifies the selected process on the toolbar 1107 of the image processing project development screen 1100 in FIG. Here, in the present invention, it is assumed that the “input mode” and the “processing mode” can be determined.

  In step 302, the CPU 111 determines whether the mode specified in step S301 is “input mode” or “processing mode”. When the image processing is performed by the CPU 301 of the image input controller 115f, the “input mode” is determined. When the CPU 111 of the information processing apparatus 110 is performed, the “processing mode” is determined. As a result of the determination processing in step S302, when it is determined that the processing content specified in step S301 is “input mode” (step S302 / YES), the CPU 111 advances the processing to step S303.

  In step S <b> 303, the CPU 111 reads the input mode module stored in the external memory 116 into the source code master table 411 a of the RAM 112. After the process is completed, the process proceeds to step S405.

  On the other hand, when it is determined in the determination process of step S302 that the processing content specified in step S301 is “processing mode” (step S302 / NO), the CPU 111 advances the process to step S304.

  In step S <b> 304, the CPU 111 reads the processing mode module stored in the external memory 116 into the source code master table 411 b of the RAM 112. After the process is completed, the process proceeds to step S405.

  After step S303 or step S304 is completed, in step S305, the CPU 111 of the information processing apparatus 110 reads the source code master table 411a (input mode module) or the source code master table 411b (processing mode) read into the RAM 112. Module) is displayed on the display device 130 as a selectable module menu.

  Thereafter, in step S306, the CPU 111 of the information processing apparatus 110 specifies the module selected in step S305. In the process of step S307, it is determined whether the module specified in step S306 is an iterative process or a conditional branch process module. In this determination process, the CPU 111 makes a determination of YES if the module identified in step S306 is a module of repetitive processing or conditional branch processing, and makes a determination of NO if the module is any other module. .

  If it is determined in step S307 that the module is not an iterative / conditional branch processing module (NO in step S307), the process proceeds to step S308, and the CPU 111 (for example, the flow creation unit 420) of the information processing apparatus 110 performs step S306. The information obtained by the process is added to the process flow / input / output parameter table 412 as one record.

  Here, a case where a record relating to the “binarization” module is added to the processing flow / input / output parameter table 412 shown in FIG. 6 will be described.

  In this case, “1” is set as the index 601, and when no other processing is set, “1” is set as the order 602 and “binarization” is set as the module 603. Is done. In addition, a value (for example, “UI00001”) designated by the user is set as the flow registration name 604. Further, for example, information (address, etc.) of “image buffer B” that is the storage destination of the result image is set as the output parameter 606. Here, the “binarization” processing is the first module in the processing flow. Naturally, since the image capturing processing has been executed before that, the input parameter 605 includes image buffer information (address, etc.). “Image buffer A” is set. The “binarization” processing module performs binarization processing on the image data input to the image buffer A set as an input parameter, and stores the result in the image buffer B set as an output parameter. . At that time, a value used as a threshold value is output to the threshold value in order to determine whether to perform white pixel or black pixel when binarization is performed.

  Returning to the description of FIG. When the processing of step S308 ends, the CPU 111 advances the processing to step S309, and based on the value specified in advance in the processing subject field 505 of the module / source code master table 411, the CPU 111 determines whether the processing subject is a CPU. Whether the image input controller is a CPU (arithmetic chip) 301 or not is determined.

  If the CPU 111 determines YES in the determination processing in step S309 (processing is performed by the CPU of the image input controller), the processing subject field of the record indicating the processing in the processing flow / input / output parameter table (FIG. 6) displays “ “0” is set (step S310). On the other hand, if it is determined as NO in step S309 (processed by the CPU of the information processing apparatus), “1” is set (step S311). At this time, if the processing mode determined in step S301 is “input mode”, the processing subject is the CPU (arithmetic chip) 301 of the image input controller 115f, so that “0” is displayed in the processing subject field. In the “processing mode”, since the processing subject is the CPU 111 of the information processing apparatus 110 that executes the program, “1” is set. Of course, this processing mode may be set based on the user's designation.

  After the process of step S310 or step S311 is completed, the CPU 111 advances the process to step S312 and determines whether or not the module specified in step S306 is an “event set” process.

  If it is determined in step S312 that the “event set” process (YES), the process proceeds to step S313, whereas if NO, the process proceeds to step S314.

In step S313, the CPU 111 sets event information issued in the event set process in the event reference field 610 of the record indicating the process in the process flow / input / output parameter table T600. As for event information, a value input on a reference event information input screen (not shown) is acquired as event information, and a value of a node processing flag table described below is set in this event reference field 610. FIG. 25 shows an example of a detailed procedure of event processing (parallel branch processing), and FIG. 29 shows an example of a board processing flag table.

  FIG. 25 describes the details of the processing procedure when executing parallel processing. Here, step S1102a and step S1102b show an example in the case where the “code recognition” process and the “defect inspection” process are performed by a parallel branch process.

  In step S1101, preprocessing for allocating the result of the previous step in which the parallel branch module is registered (inserted) to the next step of each node, creation of a node processing flag table, and the like are performed. FIG. 29 is an example of the node processing flag table T2900.

  Returning to step S1101, a node processing flag table T2900 is newly created on the RAM 112. Add code for the number of nodes to be processed in parallel. Thereafter, “NODEx” is registered in the node name of each index (Index) 2901 and “0” is registered in the end flag. In addition, the node processing flag table T2900 is set to the branch reference of the processing flow / input / output parameter table in which one record is registered (inserted) as the parallel branch processing. As an example of a value registered in the end flag, completion is set to “1” and incomplete is set to “0”.

  In step S1102a, a processing module (code recognition processing in this case) registered in the processing flow / input / output parameter table is executed. Subsequently, in step S1103a, the CPU 111 of the information processing apparatus 110 sets the end flag of the node processing flag table T2900 on the RAM 112 to “1”.

  Similarly, simultaneously with the start of step S1102a, the node (branch) 2 sequentially executes the processing from step S1102b (defect inspection processing) to S1103b, and updates the end flag in the node processing flag table T2900. When there are three or more nodes (branches), the same procedure is performed.

  Next, in step S1104, the CPU 111 of the information processing apparatus 110 checks the end flag in the node processing flag table T2900, and performs a determination process to determine whether all the nodes have been processed.

  As a result of the determination in step S1104, when the processing content determined in step S1105 is “complete” (step S1105 / YES), the parallel branch processing is terminated and the processing flow is returned to the step. On the other hand, when it is not “completed” (step S1105 / NO), the process returns to step S1104 and waits for all of the executing nodes to be completed. That is, the processing of each node is synchronized by this processing, and the subsequent processing timing can be made uniform. The above is the execution procedure of the parallel branch processing.

  In step S314, the CPU 111 of the information processing apparatus 110 determines whether or not the module identified in step S306 is “event waiting” processing. If it is determined that the “event waiting” process (YES) in the determination process in step S314, the CPU 111 advances the process to step S315. On the other hand, if NO is determined, the process proceeds to step S318.

  In step S315, event information issued in the event set process set in step S313 is set in the event reference field 610 of the record indicating the process in the process flow / input / output parameter table T600. As for event information, the CPU 111 acquires the value input in the standby event input field on the standby event information input screen (not shown) as event information, and sets the value (table name, etc.) set in step S313 as the event information. Will do.

  In step S316, it is determined whether or not the associated processing flow (logic) has already been displayed. If it is determined in step S316 that the image has already been displayed, the CPU 111 proceeds to step 318. On the other hand, if it is determined that it is not displayed yet, the process proceeds to step S317, and the related process flow is displayed on the screen. If the event set process that issues an event that is set to wait is not set in any other process flow (that is, there is no process flow / input / output parameter table indicating the process of the flow), The related process flow is not displayed.

  If NO is determined in step S316 or after the process of step S317 is completed, the CPU 111 advances the process to step S318, and the CPU 111 (for example, the flow creation unit 420) of the information processing apparatus 110 processes the module identified in step S306. In addition to the drawing area 1102, drawing (display) is performed. In the present embodiment, the process related to the process flow / input / output parameter table 412 in step S308 may be performed after the process of the process flow drawing area 1102 in step S318.

  Thereafter, in step S319, it is determined whether the module identified in step S306 is a module for parallel branch processing. If it is determined that it is not a parallel branch process (NO in step S319), the process proceeds to step S320.

  In step S320, the CPU 111 (for example, the source code conversion unit 430) of the information processing apparatus 110 converts the module added to the processing flow drawing area 1102 in step S317 into source code using the module / source code master table 411. The source code obtained by the conversion is stored in the source code table 413. At this time, the CPU 111 (for example, the source code conversion unit 430) of the information processing apparatus 110 performs correction such as reflecting parameters on the source code read from the module / source code master table 411, and the obtained source code Is stored in the source code table 413.

  If it is determined in step S307 that the module identified in step S306 is “repetition / branch processing”, the CPU 111 advances the processing to step S321 to perform “branch processing module registration” processing. Details of the “branch processing module registration” processing will be described with reference to FIG.

  When step S321 ends, the process proceeds to step S322, and the CPU 111 (for example, the flow creation unit 420) of the information processing apparatus 110 adds the module identified in step S306 to the processing flow drawing area 1102 and draws (displays) it. The above is the detailed description of the “new addition process” of the module in step S207 of FIG.

  Next, a conditional expression table T2100 for registering detailed processing conditions in “branch processing” and “iterative processing” will be described with reference to FIG.

  FIG. 21 shows an example of the conditional expression table T2100. An index 2101, a conditional expression 2104, a threshold value 1 (2105) and a threshold value 2 (2106), and the next step 2107 are registered. The conditional expression table T2100 creates one table for one “branch processing” module and one “repetition processing” module.

The feature quantity 2103 registers the feature quantity used when comparing the results, for example, the number of matching detections and the number of particles for particle analysis. In addition, the conditional expression column 2104 includes Greator.
/ GreaterOrEqual
/ Equal / LessOrEqual / Less / InRange / OutRange and the like, the threshold 1 column 2105 and the threshold 2 column 2106 register values to be compared with the feature amount. In the next step column 2107, the next step (index of processing flow / input / output parameter table (Index) 1801) is set for each condition. When there are a plurality of conditions, the number of rows in the conditional expression table T2100 is added to cope with it.

  Next, the details of the “branch processing module registration” process in step S321 of FIG. 12 will be described with reference to FIG. FIG. 22 is a flowchart showing details of the branch processing module registration processing in step S321 of FIG. A program for causing the CPU 111 to execute this process is stored in the external memory 116. When an execution request for this process is received from the input device 120, the CPU 111 loads the program into the RAM 112 and depends on the loaded program. This process is executed according to the control.

  First, in step S1001, the CPU 111 selects the feature quantities that can be selected based on the index 1 601 and 2 of the processing flow / input / output parameter table T600 and the output parameter 1806 for the module to be registered. Get the type. The acquired feature amount type is stored in the RAM 112.

  In step S1002, a conditional expression input screen is displayed. FIG. 20 is an example of a conditional expression input screen, which includes a feature quantity list box for specifying a feature quantity, and a conditional expression and a threshold value input box for setting conditions for determination. The feature amount list box displays a list of selectable feature amounts for subsequent determination processing.

  In step S1003, it is determined whether or not a value is input from the input device 120 for a predetermined item on the conditional expression input screen. In step S1003, when there is no input from the input device 120 (step S1003 / NO), it waits for input. On the other hand, if there is an input from the input device 120 in step S903 (step S1003 / YES), the process proceeds to step S1004.

  In step S1004, the CPU 111 of the information processing apparatus 110 determines whether or not the value input in step S1003 is valid. The items to be determined here are the lower limit value of the conditional expression input screen set in advance for each module, and the numerical value or character string input as the upper limit value.

  In step S1005, it is determined whether or not the value specified in step S1004 is correct. As a result of the determination in step S1005, when it is determined that the value is not correct (step S1005 / NO), the process waits for input from the input device 120. On the other hand, if it is determined that the value is correct (step S1005 / YES), the process proceeds to step S1006.

  In step S <b> 1006, the CPU 111 (for example, the flow creation unit 420) of the information processing apparatus 110 determines whether or not to register the parameter edited on the conditional expression input screen 2000 based on an input instruction from the input device 120. Specifically, here, when the setting button of the conditional expression input screen shown in FIG. 20 is selected, it is determined that the parameter edited on the conditional expression input screen is registered, and the conditional expression input screen shown in FIG. When the cancel button or the like is selected, it is determined that the parameter edited on the conditional expression input screen is not registered.

  In step S1007, the CPU 111 of the information processing layer apparatus 110 newly creates a conditional expression table T2100 on the RAM 112.

  In step S1008, a record is added to the conditional expression table T2100 created in step S1007. The above is the detailed description of the branch processing module registration in step S321 in FIG.

  Here, a process performed by the CPU 111 when actually creating data shown in T600 and T601 in FIG. 6 will be described. As a specific processing flow, after “image capture” processing (not shown), the processing of “binarization” → “morphology (repeated three times)” is performed by the image input controller 115f, and then information processing is performed. “Positioning” is performed by the CPU 111 of the apparatus 110, and “rotation” is performed when the result of “positioning” satisfies the condition, and “mirror inversion” is performed when the result is NG. Thereafter, “median” processing is performed, “code recognition” processing is performed thereafter, and the result is “I / O output”. Here, the processing flow / input / output parameter table for “input mode” is represented by T600, and the processing flow / input / output parameter table for “processing mode” is represented by T601.

  First, a process of newly adding a “binarization” processing module is performed (step S207 in FIG. 10), and is registered as a process for causing the image input controller 115f to perform the binarization process prior to the selection of the processing module. Therefore, in order to select a module in the input mode, the developer instructs the CPU 111 to input the “input mode” to the CPU 111 by instructing the CPU 111 to click “input” in FIG. It will be.

  When the input instruction is accepted, the CPU 111 determines in the mode determination process in step S301 of FIG. 12 that the input mode is selected, and the process proceeds to step S303 to read out the module in the input mode from the module / source code master table 411. (Processing in step S303 in FIG. 12), the read modules are set in the tool box 1101 that displays available processing units (modules) (processing in step S305 in FIG. 12).

  After that, the developer uses the input device 120 to input an instruction to drag and drop the binarized module menu among the module menu items set in the tool box 1101 to the processing flow drawing area 1102. . The CPU 111 detects the process and identifies the module that is the target of drag and drop (module identification in step S306). In this case, the binarization module is specified as a newly added module.

  Here, although not shown in the flowcharts of FIGS. 10 and 12, a process flow main table 418 is created when a new project is developed. An example of the configuration is shown in FIG.

  FIG. 9 is a diagram showing an example of the configuration of the processing flow main table 418 stored in the table storage unit 410 of FIG. As shown in the figure, the processing flow main table 418 includes, as data items, an Index 901, an order 902, a camera number 903, and a processing flow / input / output parameter table 904.

  Index 901 is identification information for uniquely identifying a record. An order 902 indicates the order in which the process indicated by the record managed in the process flow main table is executed. The camera number 903 indicates a camera number for identifying a camera that is an image processing target in the created processing flow. In the process flow / input / output parameter table name 904, the table number of the process flow / input / output parameter table in which the process corresponding to the record is registered is registered.

  In this creation example, a series of processes (records with an index of 1) executed by the image input controller 115f and a series of processes (records with an index number of 2) executed by the CPU 111 of the information processing apparatus 110 are registered. Thus, T600 in FIG. 6 (image processing flow executed by the image input controller 115f created in the present creation example) and T601 in FIG. 6 are registered in the processing flow / input / output parameter table name, respectively. .

  In step S306, the CPU 111 of the information processing apparatus 110 identifies the module selected in step S305 as a “binarization” module, and then determines whether the identified module is a module for repetitive processing or conditional branch processing. Judge. Since it is a “binarization” module this time, it is determined NO and the process proceeds to step S308.

  In step S308, the CPU 111 of the information processing apparatus 110 (for example, the flow creation unit 420) performs processing for adding the information obtained in step S306 as one record to the processing flow / input / output parameter table 412. In this case, a record whose index 601 of T600 in FIG. 6 is 1 is added. At that time, designation of input parameters and output parameters is accepted, and the information is also registered.

  Thereafter, the event set determination process (step S312), the event standby determination process (step S313), etc. of FIG. 12 are performed. However, since each setting is not performed, it is determined NO in the determination process, and step S320 is performed. Thus, the source code conversion is performed, and the new addition process of the binarization process ends.

  Subsequently, in this creation example, the “morphology” module is registered, but since it is almost the same as the new registration process for binarization, the description is omitted.

  Thereafter, in order to repeatedly execute the newly registered “morphology” process three times, the iterative process is set.

First, a process for newly registering an “iterative process” module for performing the “morphology” process three times as a process flow according to the procedure of FIG. 12 will be described. Since the process up to step S306 is almost the same as the process for newly adding a binarized module already described, a description thereof will be omitted.

  In step S307, the CPU 111 determines that the module identified in step S306 is an “iterative process” module (YES in step S307). If the CPU 111 determines that the module is “iteration process”, the process proceeds to step S321 and uses FIG. The registration processing of the iteration / branch processing module already described above is performed.

By performing the iterative branching process shown in FIG. 22, a record in which the index of T600 in FIG. 6 is 3 is created. Here, the next step of the record is 2, NULL. I want you to pay attention to. Here, when the repetition condition is satisfied, the morphology process of the index number 2 shown in the next step 607 is performed. When the repetition condition is no longer satisfied, the next step is performed. However, in this case, since NULL is set as the next step, the process managed in this table is terminated. Here, when the next step 607 is set to 1 and NULL, this means that if the repetition condition is satisfied, the binarization process that is the process of Index1 that is the next step is performed. When such a setting is made, after iterative processing, if the iterative conditions are satisfied, binarization processing is performed, and then morphology processing is performed. After that, iterative determination processing is performed, and if the repetition condition is satisfied, a program based on a logic (processing flow) of performing binarization processing again is created.

  In step S1001, selectable feature quantities are specified based on 1 and 2 of the index (Index) 601 in the processing flow / input / output parameter table T600, and the output parameter 1806 for the module to be registered. That is, in this case, since only the “counter” of the iterative process is used, the “counter” is stored in the RAM 112 as a selectable feature amount.

  In step S1002, the conditional expression input screen 2000 is displayed. Since “counter” is stored as a selectable feature amount in the RAM 112, only “counter” − “count number” is displayed in the feature amount list 2001 of FIG.

  In step S903, in this example, “number of counters”, “<” as a conditional expression, and “3” as an upper limit value are input.

In subsequent step S1007, the CPU 111 of the information processing apparatus 110 newly creates the conditional expression table T2100 on the RAM 112. As shown in FIG. 21, the index (Index) 2101 is set to “1”, one record is added, and the setting value when the condition is satisfied is written. That is, “UI00003-Count” that is the count number of the iterative process is registered in the feature quantity 2103, “Less” is registered in the conditional expression 2104, and “3” is registered in the threshold 1105 2105. Since “Less” is set in the conditional expression 2104, “NULL” is set in the threshold 2106. In the next step 2107, the first processing module for performing the iterative processing is designated. Here, an index (Index) 601 of the processing flow / input / output parameter table T600 indicating the “morphology” module of “UI00002” is designated. A certain “2” is registered.

Further, the index (Index) 2101 of the conditional expression table T2100 is set to “2”, one record is added, and “UI00003-Count” is set as the feature quantity 2103, and the conditional expression 2104 is “Else”. In the next step, the step to be executed next after finishing the iterative process is set, but since the next step is not yet registered at this stage, the next step 2107 is temporarily registered as “NULL”. It will be. Then, T2100 is set in the branch reference 608 of the record whose index 601 of T600 in FIG. This completes registration of the iterative process.

  Subsequently, in this example, “positioning” processing is registered, but since the subsequent processing creates logic (processing flow) for creating a program for causing the CPU 111 of the information processing apparatus 110 to perform. The “processing mode” is selected as the operation mode.

  Similar to the above-described procedure, the “positioning” module is registered. However, since the mode specified in step S301 in FIG. 12 is the “processing mode”, step S302 / NO is performed, and the process proceeds to step S304. Here, since “processing mode” is selected for the first time, a new processing flow / input / output parameter table T601 is created, “1” in the index 611, “1” in the order 612, and “positioning” in the module 613. “UP00001” is set in the flow registration name 614, and “image buffer D” which is the final image in the processing flow / input / output parameter table T600 of “input mode” is set in the input parameter image buffer. At the same time, the CPU 111 of the information processing apparatus 110 sets the index (index) 901 to “2”, the order 902 to “2”, and the process flow / input / output parameter table name to “T601” in the processing flow main table T900. Add a record.

  Next, the processing procedure of the control method performed by the information processing apparatus 110 when the “conditional branch processing” module is included will be described. Specifically, using the result of the previous positioning process, if the condition is satisfied (YES), the “rotation correction” process is performed. If the condition is not satisfied (NO), the “mirror” process is performed. A case will be described as an example. In step S306, the selected module is specified.

  In the determination process of step S307, since the module identified in step S306 is the “conditional branch process”, the CPU 111 determines YES, and performs the “conditional branch process” module registration process in step S321. Since the registration processing of the “conditional branch processing” module is almost the same as the registration processing of the “iterative processing” module, detailed description thereof is omitted. Note that a conditional expression table created as a result of the “conditional branching process” is shown at T2110 in FIG.

In step S1001, based on the output parameter 606 of the processing flow / input / output parameter table T600, feature quantities that can be selected up to the current step are specified. Here, the CPU 111 of the information processing apparatus 110 refers to the output parameter 606. In this example, the selectable feature amount includes a binarization threshold “UI00001-Thresh” and an iterative process time “UI00003-Count”. The number of positioning is “UP00001-Count”.

In step S1002, the conditional expression input screen 2000 is displayed based on the feature amount specified in step S1001, and input is accepted. In this creation example, the feature amount 2113 is input as the number of positionings “U00004-Count” in the previous step, the conditional expression 2114 is “==”, and the threshold value 2114 is “1”.

  In step S907, the CPU 111 of the information processing apparatus 110 newly creates the conditional expression table T2110 on the RAM 112.

  In step S908, a record is added to the conditional expression table T2110 created in step S907. At this time, first, an index 2111 is set to “1”, one code is added, and a setting value when the condition is satisfied is written. “UP00001-Count”, which is the number of positioning processes, is registered in the feature amount 2113, “Equal” is registered in the conditional expression 2114, and “1” is registered in the threshold 1115. Since “Less” is set in the conditional expression 2114, “NULL” is set in the threshold 2116. In the next step 2117, the processing module of the branch destination when the “conditional branch processing” is performed is designated, but since the next step is not yet registered, it is temporarily set to “NULL”.

  Furthermore, an index (Index) 2101 is set to “2” in the conditional expression table T2110, one record is added, “UP00001-Count” is set as the feature quantity 2113, and “Else” is set as the conditional expression 1914. Similarly, in the next step, the step to be executed next after the “conditional branch process” is set, but since the next step is not yet registered at this stage, the next step 1917 is temporarily set to “ "NULL". Also, T2110 is set in the branch reference 608 of the record whose index 601 of T601 in FIG.

  Next, a process for additionally registering the process of the node in the conditional branch after the “conditional branch” module will be described. Here, when the number of positioning is “1”, rotation correction is performed, and when it is not “1”, mirror conversion is performed, and the “rotation correction” processing module and the “mirror conversion” processing module are respectively set. Perform additional registration with the node.

  After that, since it corresponds to the registration of the module following the conditional branch module, “3” is registered in the next step when the condition is satisfied in the conditional expression table T2110, that is, the next step 2117 in which the index (Index) 2111 is “1”. To do. On the other hand, if the condition is not satisfied, that is, “4” is registered in the next step 2117 in which the index 2111 is “2”. In addition, “3, 4” is registered in the next step 1807 in which the index (Index) 611 of the processing flow / input / output parameter table T601 is “2”.

Here, in the processing flow / input / output parameter table T601, the image buffer of the input parameter 1805 of “3” “rotation correction” of the index (Index) 611 and “mirror conversion” of “4” is the index. The pointer of the image buffer of the output parameter 616 of “conditional branch processing” of “Index” 601 “2” is used. That is, “1” of the index (Index) 601 which is the previous step of “conditional branch processing”
The positioning output image 617 is used.

The processing after step S319 is the same as that described above with reference to FIG. However, the source conversion processing in step S321 is performed by converting the modules of “conditional branch processing”, “rotation processing”, and “mirror processing” into the source code using the module / source code master table 411, and the source obtained by the conversion. The code is stored in the source code table 413 and updated. Also, the source code of the source code table 413 is debugged and compiled, and this is stored in the object code table 414 and updated. This completes registration of the “conditional branch processing” module and creation of the program.

Subsequently, “median” processing and “code recognition” processing are performed, and finally “I / O output” processing is registered. However, since new addition processing is performed in accordance with the procedure described in FIG. Omitted. The above is an example of creating the processing flow / input / output parameter table shown in FIG.

  Next, with reference to FIG. 13, the detailed process of the change process shown in step S209 of FIG. 10 will be described. FIG. 13 is a flowchart illustrating an example of a detailed procedure of the “change process” in step S209 of FIG. A program for causing the CPU 111 to execute this process is stored in the external memory 116. When an execution request for this process is received from the input device 120, the CPU 111 loads the program into the RAM 112 and depends on the loaded program. This process is executed according to the control.

  In step S401 in FIG. 13, the CPU 111 of the information processing apparatus 110 performs processing for specifying a module that has already been registered as a processing flow. The developer (user) performs designation input of a module to be processed by giving a click instruction to the module displayed in the processing flow drawing area 1102 in the image processing project development screen 1100 shown in FIG. Therefore, the CPU 111 specifies the module according to the designation input.

In step S <b> 402, the CPU 111 of the information processing apparatus 110 displays a parameter editing screen for the module specified in step S <b> 401 on the CRT 130.
FIG. 14 shows an example of the parameter editing screen. A parameter editing screen 1400 shown in FIG. 14 includes a toolbar 1401 for reading and saving an image file and an image processing setting file, an image processing parameter setting area 1402, a result image display area 1403, and input parameter settings. A setting menu 1404 for determining whether or not to perform is provided.

  FIG. 14 shows an example of a screen for setting parameters relating to the spatial filter. Here, an item 1402a for setting a kernel type (Gaussian, Sobel, etc.) used for the spatial filter and a developer (user) can freely set. A custom kernel setting button 1402b that can be used and an item 1402c for setting a processing area are provided. Further, when the value of the result image display area 1403 is changed in the parameter setting area 1402, the result image is updated at any time and the processing result can be confirmed.

  Thereafter, the process proceeds to step S403, and it is determined whether or not any parameter has been changed on the parameter editing screen displayed in step S402. If it is determined in step S403 that the parameter has not been changed (step S403 / NO), the change process is terminated. On the other hand, if it is determined in step S403 that there is a change (step S403 / YES), the CPU 111 advances the process to step S404.

  In step S404, the CPU 111 identifies the changed parameter. In step S405, the process is executed based on the parameter changed in step S404.

  Thereafter, the process proceeds to step S406, and the CPU 111 of the information processing apparatus 110 determines whether or not to enable the parameter setting changed in step S404. That is, the input of the setting menu 1404 in FIG. 14 is determined. If the CPU 111 determines that it is valid (S406 / YES), the process proceeds to step S407. On the other hand, if it is determined not to be valid (S406 / NO), the change process is terminated.

  In step S <b> 407, the CPU 111 updates the processing flow / input / output parameter table and stores it in the RAM 112.

  Subsequently, in step S <b> 408, the CPU 111 converts the information into the source code based on the information in the processing flow / input / output parameter table, and stores it in the source code table 413. Thus, the change process ends.

When the change process is performed, in all the modules, the image comparison window is displayed by double-clicking the result image of each module in the result image display area or selecting from the context menu. FIG. 23 shows an image comparison window of the processing result image with the previous parameter and the current processing result image when the parameter is changed.

  Next, with reference to FIG. 15, the detailed process of the movement process of step S211 of FIG. 11 is demonstrated. FIG. 15 is a flowchart illustrating an example of a detailed processing procedure of the “move process” of the module in step S211 of FIG. The order of processing flow is changed by the movement processing of this module. A program for causing the CPU 111 to execute this process is stored in the external memory 116. When an execution request for this process is received from the input device 120, the CPU 111 loads the program into the RAM 112 and depends on the loaded program. This process is executed according to the control.

  In step S501, the CPU 111 (for example, the flow creation unit 420) of the information processing apparatus 110 identifies a module that has been selected as an input in step S204 in FIG. In step S502, the CPU 111 of the information processing apparatus 110 specifies the position of the module dragged in step S204.

  In step S503, it is determined whether or not the position specified in step S502 is correct. If the position is correct (S503 / YES), the process proceeds to step 504. If the position is not correct (S503 / NO), the process returns to step S502 and continues until the correct position is specified.

  Subsequently, in step S504, the CPU 111 (for example, the flow creation unit 420) of the information processing apparatus 110 identifies the module identified in step S501 for the processing flow drawn (displayed) in the processing flow drawing area 1102, in step S502. It moves between the identified modules, and performs processing to redraw (redisplay) the processing flow drawing area 1102.

  In step S505, the CPU 111 (for example, the flow creation unit 420) changes the process flow / input / output parameter table 412 in accordance with the module movement process specified in step S501. Here, a specific example is not shown, but first, in accordance with the order of modules in the processing flow of the processing flow drawing area 1102 redrawn in step S504, the order 602 of the processing flow / input / output parameter table 412 (and the flow registration name) 604 may be changed). Next, in accordance with the module order in the process flow of the process flow drawing area 1102 redrawn in step S504, the module input parameters 605 and output parameters 606 are changed according to the change in the order. For example, the input parameter 605 of the module to be moved stores information on the image buffer of the output parameter 606 in the immediately preceding module. At this time, the output parameter 606 of the module to be moved may not be changed. However, the input parameter 605 in the next-order module stores image buffer information of the output parameter 606 of the module to be moved.

  Subsequently, in step S505, the CPU 111 (for example, the source code conversion unit 430) uses the module / source code master table 411 for modules after the module whose order 602 has been changed in the processing flow / input / output parameter table 412. The source code is converted into source code, and the source code obtained by the conversion is stored in the source code table 413 and updated. At this time, the CPU 111 (for example, the source code conversion unit 430) erases the source code corresponding to the module whose order has been changed in the source code table 413, converts the source code into the source code again, and then converts the source code into the source code. The table 413 is updated.

  When the process in step S506 is completed, when the operation input device 120 instructs to end the “move process”, the process of the flowchart in FIG. 15 is ended, and the “move process” is continued from the input device 120. Is instructed, the process returns to step S501, and the processing after step S501 is performed again. As described above, the “move process” of the module in step S211 of FIG. 11 is performed. The above is the detailed description of the movement process.

  Next, with reference to FIG. 16, the detailed procedure of the insertion process shown in step S213 of FIG. 11 will be described. FIG. 16 is a flowchart showing an example of a detailed processing procedure of the “insertion processing” of the module in step S213 in FIG. A program for causing the CPU 111 to execute this process is stored in the external memory 116. When an execution request for this process is received from the input device 120, the CPU 111 loads the program into the RAM 112 and depends on the loaded program. This process is executed according to the control.

  First, in step S601 in FIG. 16, the CPU 111 (for example, the flow creation unit 420) of the information processing apparatus 110 specifies an insertion destination into which a processing module is dropped and a module is newly inserted in the input in step S204.

  Subsequently, in step S602, the CPU 111 (for example, the flow creation unit 420) of the information processing apparatus 110 performs processing for specifying the module selected in the input in step S204. In the present embodiment, the processing order of the insertion destination specifying process in step S601 and the module specifying process in step S602 may be reversed.

  In step S602, the CPU 111 identifies the position of the module dropped in step S204. In step S603, it is determined whether the position specified in step S602 is correct. If it is determined that the position is correct (S603 / YES), the process proceeds to step 604. On the other hand, if it is determined that it is not correct (S603 / NO), the process returns to step S602 and continues until the correct position is specified.

  Subsequently, in step S604, the CPU 111 (for example, the flow creation unit 420) determines the module identified in step S601 for the process flow rendered (displayed) in the process flow rendering area 1102 as the module identified in step S602. The processing flow drawing area 1102 is redrawn (redisplayed).

  In step S605, the CPU 111 (for example, the flow creation unit 420) also performs processing for changing the processing flow / input / output parameter table 412 in accordance with the movement processing of the module specified in step S601. Here, although a specific example is not shown, first, the CPU 111 (for example, the flow creation unit 420) of the information processing apparatus 110 stores the information obtained in the module / source code master table 411 in the processing flow / input / output parameter table 412. While performing processing to add as one record, information in the processing flow / input / output parameter table 412 is changed and updated based on the information of the insertion destination specified in step S602.

  Subsequently, in step S606, the CPU 111 (for example, the source code conversion unit 430) of the information processing apparatus 110 performs module / source code master for modules after the module whose order 602 has been changed in the processing flow / input / output parameter table 412. Using the table 411, the source code is converted, and the source code obtained by the conversion is stored in the source code table 413 and updated. At this time, the CPU 111 (for example, the source code conversion unit 430) erases the source code corresponding to the module whose order has been changed in the source code table 413, converts the source code into the source code again, and then converts the source code into the source code. The table 413 is updated.

  When the process of step S606 is completed, when the input device 120 instructs the end of the “insertion process”, the process ends. When the input device 120 instructs to continue the “insertion process”, the process returns to step S601, and the processes after step S601 are performed again. The above is the description of the insertion processing in step S213 in FIG.

Next, a detailed procedure of the deletion process in step S215 in FIG. 11 will be described with reference to FIG. FIG. 17 is a flowchart illustrating an example of a detailed processing procedure of the “deleting process” of the module in step S215 of FIG. A program for causing the CPU 111 to execute this process is stored in the external memory 116. When an execution request for this process is received from the input device 120, the CPU 111 loads the program into the RAM 112 and depends on the loaded program. This process is executed according to the control.

  First, in step S701, the CPU 111 (for example, the flow creation unit 420) of the information processing apparatus 110 performs processing for specifying the module selected in the input in step S204.

  Subsequently, in step S <b> 702, the CPU 111 (for example, the flow creation unit 420) also performs processing for changing the processing flow / input / output parameter table 412 in accordance with the deletion processing of the module specified in step S <b> 701. Here, although a specific example is not shown, first, the CPU 111 (for example, the flow creation unit 420) of the information processing apparatus 110 displays items related to the registered modules identified in step S701 in the processing flow / input / output parameter table 412. While deleting as one record, the information in the processing flow / input / output parameter table 412 is changed and updated based on the information of the insertion destination specified in step S602.

  Subsequently, in step S704, the CPU 111 (for example, the source code conversion unit 430) uses the module / source code master table 411 for modules after the module whose order 602 is changed in the processing flow / input / output parameter table 412. The source code is converted into source code, and the source code obtained by the conversion is stored in the source code table 413 and updated. At this time, the CPU 111 (for example, the source code conversion unit 430) of the information processing apparatus 110 once deletes the source code corresponding to the module whose order has been changed in the source code table 413, and converts it again into the source code. To update the source code table 413. The above is the detailed description of the “deletion process” of the module in step S215 in FIG.

Next, with reference to FIG. 18, the detailed procedure of the execution process of step S217 of FIG. 11 will be described. FIG. 18 is a flowchart illustrating an example of a detailed processing procedure of the “execution processing” of the module in step S217 of FIG. A program for causing the CPU 111 to execute this process is stored in the external memory 116. When an execution request for this process is received from the input device 120, the CPU 111 loads the program into the RAM 112 and depends on the loaded program. This process is executed according to the control.

  First, in step S801, the CPU 111 (for example, the compile conversion unit 440) performs debugging and compilation on the source code stored in the source code table 413 by the source code conversion process in the final step of each process, and the object code Store in table 414.

  In step S802, the CPU 111 executes the object code stored in the object code table 414. Thereafter, the process proceeds to step S803, and the result of each module executed in step S802 is drawn in the result drawing area 1103. At this time, if the processing flow includes an iterative process, by double-clicking the iterative process module or selecting a result display from the menu, the elapsed image window at each number of times is shown as an example in FIG. Is displayed. The above is the detailed description of the execution process.

Next, with reference to FIG. 19, the detailed procedure of the storage process in step S219 of FIG. 11 will be described. FIG. 19 is a flowchart showing an example of a detailed processing procedure of the “save processing” of the module in step S219 of FIG. A program for causing the CPU 111 to execute this process is stored in the external memory 116. When an execution request for this process is received from the input device 120, the CPU 111 loads the program into the RAM 112 and depends on the loaded program. This process is executed according to the control.

  First, in step 901, the CPU 111 (for example, the source code conversion unit 430) removes debug information from a series of processing flows registered in the processing flow / input / output parameter table 412 and converts them into source code. Store in table 413. Here, when converting to the source code, not only the information of the processing flow / input / output parameter table 412 but also a format including a dialog resource used in the online inspection screen is stored in the source code table 413.

  Subsequently, in step S902, the CPU 111 (for example, the compile conversion unit 440) releases and compiles the source code stored in the source code table 413 in step S902, and stores it in the object code table 414.

  Thereafter, in step S903, the CPU 111 of the information processing apparatus 110 (for example, the data storage unit 460) stores the processing flow / input / output parameter table 412 stored in the RAM 112 and the source code table 413 converted in step S901. As a code file, the object code table 414 is saved as an executable binary file such as EXE or DLL. In the present invention, the resources and processing codes for the online inspection screen are included and stored in the external memory 160 as a project file that can be used by a commercially available compiler. In other words, by executing the project saving process, it is possible to change online screen resources and add processes by using a commercially available compiler. The above is the detailed description of the storage process.

  FIG. 28 is a diagram illustrating an example of the device adjustment screen. In the figure, an image acquired from the camera 140 is displayed in an image display area 2801. In addition, an option selection 2802 can select an operation to be performed at the time of device adjustment. In the image storage setting 2803, parameters required when the “image storage” process is selected in the option selection 2802 can be designated. In the history image display area 2804, an image acquired by the capturing process immediately before the image displayed in the image display area 2801 is displayed. The display order of the latest image is displayed on the left side, but it may be reversed.

  Next, with reference to FIG. 26, a detailed procedure of the device adjustment process in step S109 of FIG. 7 will be described. FIG. 26 is a flowchart illustrating an example of a detailed processing procedure of the “device adjustment” of the module in step S109 of FIG. A program for causing the CPU 111 to execute this process is stored in the external memory 116. When an execution request for this process is received from the input device 120, the CPU 111 loads the program into the RAM 112 and depends on the loaded program. This process is executed according to the control.

  First, in step S1401, the CPU 111 identifies a camera that performs camera capture. In step S1402, the CPU 111 acquires a single image from the camera specified in step S1401, and proceeds to step S1403.

In step S1403, it is determined whether or not there is an input from the input device 120. If it is determined in step S1403 that there is no input (S1403 / NO), the process returns to step S1402 to capture an image. On the other hand, if it is determined that there is an operation from the input device 120 (S1403 / YES), the process proceeds to step S1404.

  In step S1404, an input from the input device 120 is specified. In the present invention, “histogram display”, “profile display”, “X / Y projection display”, “focus display”, “statistics display”, and “image storage” can be selected. There may be items.

  In step S1405, the CPU 111 determines whether the content specified in step S1404 is “histogram display”. If it is determined in step S1405 that the display is not “histogram display” (S1405 / NO), the process proceeds to step S1407. On the other hand, if it is determined that the display is “histogram display” (S1405 / YES), the process proceeds to step S1406, and the histogram of the image acquired in step S1402 is displayed.

  In step S1407, the CPU 111 of the information processing apparatus 110 determines whether or not the content specified in step S1404 is “profile display”. If it is determined in step S1407 that the CPU 111 is not “profile display” (S1407 / NO), the process proceeds to step S1409. On the other hand, if it is determined that “profile display” is selected (S1407 / YES), the process proceeds to step S1408, and the profile of the image acquired in step S1402 is displayed.

  In step S1409, the CPU 111 of the information processing apparatus 110 determines whether or not the content specified in step S1404 is “X / Y projection display”. If it is determined that the display is not “X / Y projection display” (S1409 / NO), the process proceeds to step S1411. On the other hand, if it is determined that the display is “X / Y projection display” (S1409 / YES), the process proceeds to step S1410, and the X / Y projection of the image acquired in step S1402 is displayed.

  In step S1411, the CPU 111 of the information processing apparatus 110 determines whether the content specified in step S1404 is “focus display”. If it is determined in step S1411 that the display is not “focus display” (S1411 / NO), the process proceeds to step S1413. On the other hand, if it is determined that the display is “focus display” (S1411 / YES), the process proceeds to step S1412, and the focus of the image acquired in step S1402 is displayed.

  In step S1413, the CPU 111 of the information processing apparatus 110 determines whether or not the content specified in step S1404 is “statistic display”. If the CPU 111 determines in the determination process of step S1413 that it is not “statistic display” (S1413 / NO), the process proceeds to step S1415. On the other hand, if it is determined that the display is “statistic display” (S1413 / YES), the process proceeds to step S1414, and the statistics of the image acquired in step S1402 are displayed.

  In step S1415, the CPU 111 of the information processing apparatus 110 determines whether the content specified in step S1404 is “image storage processing”. If it is determined in step S1415 that it is not “image saving processing” (S1415 / NO), the process proceeds to step S1417. On the other hand, if it is determined that the process is “image storage processing” (S1415 / YES), the process proceeds to processing step S1416 to perform image storage processing. Details of this processing will be described later with reference to FIG.

  In step S1417, the CPU 111 of the information processing apparatus 110 determines whether or not the content specified in step S1404 is “camera setting processing”. If the CPU 111 determines in the determination process of step S1417 that the camera setting process is not “NO” (S1417 / NO), the process proceeds to step S1419. On the other hand, if it is determined that it is “camera setting processing” (S1417 / YES), the process proceeds to step S1418. Here, for example, in the “camera setting process”, the CPU 111 of the information processing apparatus 110 displays on the display device 130 a window in which the camera exposure time, trigger mode, gain, and the like can be set.

  In step S1419, the CPU 111 of the information processing apparatus 110 determines whether or not the content specified in step S1404 is “lighting setting processing”. If the CPU 111 determines in the determination process in step S1419 that the “lighting setting process” is not performed (S1419 / NO), the process proceeds to step S1421. On the other hand, if it is determined that it is “lighting setting processing” (S1419 / YES), the process proceeds to step S1420. In the “lighting setting process” in step S1420, the CPU 111 of the information processing apparatus 110 displays a window in which the brightness of the lighting, the lighting time, the delay, and the like can be set on the display device 130.

  In step S1421, the CPU 111 of the information processing apparatus 110 determines whether the content specified in step S1404 is “stop processing”. If the CPU 111 determines in the determination processing in step S1421 that it is not “stop processing” (S1421 / NO), the process returns to step S1412, and image capture is performed. On the other hand, when it is determined that the process is the “stop process” (S1421 / YES), this process ends. The above is the description of the device adjustment screen display process in step S111 of FIG.

  Next, with reference to FIG. 27, the detailed procedure of the image storing process in step S1416 in FIG. 26 will be described. FIG. 27 is a flowchart showing an example of a detailed processing procedure of the “image saving process” of the module in step S1415 of FIG. A program for causing the CPU 111 to execute this process is stored in the external memory 116. When an execution request for this process is received from the input device 120, the CPU 111 loads the program into the RAM 112 and depends on the loaded program. This process is executed according to the control.

  First, in step S1501, the CPU 111 of the information processing apparatus 110 acquires each parameter specified in the image storage setting 2803 of the device adjustment screen 2800 illustrated in FIG. Here, in this example, capture control (time, number), capture interval (time, number), storage location, and image format can be specified.

  In step S1502, the CPU 111 of the information processing apparatus 110 acquires one image from the camera 140 through the image input controller 115f and stores it on the RAM 112.

  In step S1503, the image data acquired in step S1502, that is, on the RAM 112, is stored in the external memory 116 in the image format acquired in step S1501.

  In step S1504, the CPU 111 of the information processing apparatus 110 waits for the time acquired in step S1501 or the number of sheets.

  In step S1505, the CPU 111 of the information processing apparatus 110 determines whether the input from the input apparatus 120 is a stop process. If the CPU 111 determines in the determination process of step S1505 that the process is a stop process (S1505 / YES), this process ends. On the other hand, if it is determined that the process is not a stop process (S1505 / NO), the process returns to step 1502 and is executed from image acquisition. Here, the item that can be determined in step S1505 may be the input from the operation input device 120, or the acquired number of images and the capture time specified by the image storage setting 2805 in FIG. The above is the detailed description of the image storage processing in step S1416 of FIG.

<Second embodiment>
The second embodiment of the present invention will be described below. In this embodiment, the user can add processing modules to be registered in the processing flow by incorporating their own logic. At this time, the user creates a module by describing the source code. In the present invention, debugging information such as breakpoints can be placed in the source code to assist in development. .

  FIG. 30 is a flowchart illustrating an example of a detailed procedure for project construction in the second embodiment. Note that the same step numbers as those in FIG. 10 are assigned to steps for performing the same processing as the project construction processing (FIG. 10) in the first embodiment, and detailed description of the processing is omitted. The difference from the first embodiment is a portion surrounded by a dotted line.

  In step S220 of FIG. 30, it is determined whether or not the process specified in step S205 of FIG. 10 is a “custom module creation” process. Here, an event input from the operation input device 120 of the information processing apparatus 110 is indicated by a method such as a context menu 3301 on the module display screen 3300 in this example. In addition, as an event to be determined here, functions such as “modify” and “delete” may be provided in addition to “add”.

  Here, FIG. 33 shows an example of the custom module creation window 3310. The custom module creation window 3310 shown in this example includes a source code description area 3311 for describing source code, an area 3312 for setting a breakpoint, and a variable display area 3313.

  Returning to the description of FIG. When the CPU 111 determines in the determination process of step S220 that the process specified in step S205 is “custom module creation” (YES in step S220), the process proceeds to step S221. On the other hand, when the determined result is not “custom module creation” processing (step S220 / NO), the process proceeds to step S219.

  In step S221, the CPU 111 performs a “custom module creation” process. FIG. 31 shows an example of a detailed procedure of the “custom module creation” process.

  FIG. 31 shows details of the custom module creation processing in step S221 of FIG. A program for causing the CPU 111 to execute this process is stored in the external memory 116. When an execution request for this process is received from the input device 120, the CPU 111 loads the program into the RAM 112 and depends on the loaded program. This process is executed according to the control.

  First, in step S1201, the CPU 111 (for example, the source code conversion unit 430) of the information processing apparatus 110 reads and reads the basic source code of the “custom module” process prepared in advance in the module / source code master table 411. The source code is stored in the source code table 413.

  In step S1202, the basic source code of the “custom module” process read in the source code table 413 in step S1201 is displayed in the source code description area 3311 shown as an example in FIG. In this step, the user will add logic as needed.

  Subsequently, in step S1203, the CPU 111 of the information processing apparatus 110 analyzes the input source code. Here, a new processing flow / input / output parameter table is temporarily created, and information (image buffer or the like) to be passed to the custom module, that is, result information of the previous step before adding the custom module is set in the input parameter 605. Further, result information (image buffer or the like) of the custom module to be created, that is, information to be passed to the next step of the custom step is set in the output parameter 606. Furthermore, the CPU 111 of the information processing apparatus 110 updates the source code table 413 with the added code and stores it in the RAM 112.

  In step S1204, the CPU 111 (compile unit 440) of the information processing apparatus 110 compiles the source code analyzed in step S1203, and temporarily stores the object code on the RAM 112.

  In step S1205, the object code stored on the RAM 112 in step S1204 is executed. Details of the execution procedure will be described later with reference to FIG.

  In step S1206, the CPU 111 of the information processing apparatus 110 displays the result executed in step S1205 in the result drawing area 1103.

  In step S1207, it is determined whether to register the custom module created in steps S1201 to S1206.

  If it is determined in step S1207 that the CPU 111 does not register (step S1207 / NO), the “custom module creation” process is terminated. On the other hand, if the CPU 111 determines in the determination process in step S1207 (step S1207 / YES), the process proceeds to step S1208. In step S1208, debug information is removed from the source code table 413 stored in the RAM 112 in step S1203, and release and compilation are performed.

Subsequently, when proceeding to step S1209, one record is added to the information of each field of the processing flow / input / output parameter table temporarily created in step S1203 to the processing flow / input / output parameter table in which the processing flow is already registered. To migrate the settings.

  In step S1210, the CPU 111 of the information processing apparatus 110 additionally sets the custom module created in the previous step in the tool box 1101 on the project construction screen 1100. The above is a detailed description of creating a custom module. As a result, a newly created custom module can be selected by the above-described new addition processing like a module prepared from the beginning.

  Next, details of the execution process of step S1205 of FIG. 31 will be described with reference to FIG. FIG. 32 is a flowchart illustrating an example of details of the processing procedure of the execution processing in step S1205 of FIG. A program for causing the CPU 111 to execute this process is stored in the external memory 116. When an execution request for this process is received from the input device 120, the CPU 111 loads the program into the RAM 112 and depends on the loaded program. This process is executed according to the control.

  In step S1301, the execution mode is determined. Here, the execution mode includes a mode with debugging (with a breakpoint) or a mode without a breakpoint, but there may be other modes such as step execution.

  In step S1302, the CPU 111 determines whether debug information is included in the mode determined in step S1301. If the CPU 111 determines in step S1302 that the execution is without debugging (step S1302 / NO), the process proceeds to step S1308 to execute the process. On the other hand, if it is determined in step S1302 that there is debugging (step S1302 / YES), the process proceeds to step S1303.

  In step S1303, the CPU 111 determines whether or not there is a breakpoint in the source code analyzed in step S1203 of FIG. In the determination process, when the CPU 111 determines that there is no break point (step S1303 / NO), the process proceeds to step S1308, and the process is executed. On the other hand, if it is determined that there is a break point (step S1303 / YES), the process proceeds to step S1304.

  In step S1304, the CPU 111 of the information processing apparatus 110 executes processing up to a line where a breakpoint is set in the source code. At the same time, in step S1305, the source code of the line executed in step S1304 is displayed.

  In step S1305, the CPU 111 of the information processing apparatus 110 displays the progress of variables and the like as necessary. In step S1306, the CPU 111 determines whether to continue debug execution. As a result of the determination in step S1306, when it is determined to continue (step S1306 / YES), the process returns to step S1303. On the other hand, if it is determined not to continue (NO in step S1306), the process proceeds to step S1308 to execute the process.

In step S1308, processing according to the created custom module is executed. The above is the detailed description of the execution process of step S1205 of FIG.

  Next, with reference to FIG. 35, details of the system setting screen display processing in step S113 of FIG. 7 will be described. FIG. 35 is a flowchart showing an example of a detailed processing procedure of the system setting screen display processing in step S113 of FIG. A program for causing the CPU 111 to execute this process is stored in the external memory 116. When an execution request for this process is received from the input device 120, the CPU 111 loads the program into the RAM 112 and depends on the loaded program. This process is executed according to the control. The “online inspection” process can be started not only by the main menu but also by directly executing the executable file.

  When the process of step S113 in FIG. 7 is called, the CPU 111 of the information processing apparatus 110 displays a system setting screen 3500. Although no example is given here, in this window, as shown in the system information table T3400 shown in FIG. 34, a “startup project name” field 3402 for setting a project to be started when the online inspection program is executed, data communication information “Data communication” field 3403 for setting image information, “File transfer” field 3403 for setting information for transferring image data to the outside of information processing apparatus 110, and “Camera table” field 3404 for setting camera information include items that can be set. It is out. An example of the camera table T3410 referred to in the “camera table” field 3404 is indicated by a camera table T3410 in FIG. The camera table T3410 includes a “device name” field 3412, a “property field” 3413 for designating a camera setting file, an “origin setting” field 3414 for setting an origin, and a “correction information” 3415 field for setting calibration information. It is out.

FIG. 34 shows an example of the system information table 419 shown in FIG.

  First, in step S1601, the CPU 111 of the information processing apparatus 110 specifies whether the “online inspection” process has been executed from the main menu or directly.

  Next, in step S1602, it is determined whether the mode specified in step S1601 is from the main menu. If the result of determination in step S1602 is from the main menu (S1602 / YES), the process proceeds to step S1603, while if not from the main menu (S1602 / NO), the process proceeds to step S1604.

  In step S1603, a screen for inputting a project name read from the external memory 160 is displayed.

  In step S1604, the CPU 111 of the information processing apparatus 110 acquires the project name set in the startup project name 3402 of the system information table T3400.

  Subsequently, in step S1605, the CPU 111 of the information processing apparatus 110 reads the data communication 3403, the file transfer 3404, and the camera table 3405 from the system information table T3400 to the RAM 112.

  Finally, in step S1606, the CPU 111 of the information processing apparatus 110 displays an online inspection screen on the CRT 130 based on the system information read into the RAM 112 in step S1605.

<Third embodiment>
The third embodiment of the present invention will be described below. In this embodiment, when the processing flow is constructed and executed by online inspection, the user can edit it as a unique screen layout.

  FIG. 36 is a flowchart illustrating an example of a detailed procedure for project construction in the third embodiment. Note that the same step numbers as those in FIG. 10 are assigned to steps for performing the same processing as the project construction processing (FIG. 10) in the first embodiment, and detailed description of the processing is omitted.

  In step S222 in FIG. 36, it is determined whether or not the process specified in step S205 in FIG. 10 is a “layout edit” process. As a result of the determination in step S222, when the process specified in step S205 is the “layout edit” process (step S222 / YES), the process proceeds to step S223. On the other hand, if the determined result is not the “layout editing” process (step S222 / NO), the process proceeds to step S219.

  In step S223, "layout editing" processing is performed. FIG. 38 shows an example of a detailed procedure of the “layout editing” process.

Next, the details of the layout editing process in step S223 of FIG. 36 will be described with reference to FIG. In this process, a screen creation process for executing the programs created in the first and second embodiments is performed. FIG. 38 is a flowchart illustrating an example of detailed processing of screen creation processing. A program for causing the CPU 111 to execute this processing is stored in the external memory 116, and when the CPU performs this processing, the CPU 111 loads the program into the RAM 112 and performs this processing according to the control of the program. Become.

  First, the CPU 111 displays the layout screen shown in FIG. 37 on the CRT 130 via the video controller 115b (step S3801). Details of the layout screen will be described with reference to FIG.

  Next, it is determined whether a control input instruction has been received (has an input?) Based on an operation by the user via the operation input device on the screen of FIG. 37 (step S3802). If it is determined that an input instruction has been accepted (step S3802 / YES), the processing content of the input instruction is determined (step S3803).

  If it is determined in step S3803 that the input content is a new button addition process (YES in step S3804), the process advances to step S3805 to perform a new button addition process. Details of the new button addition processing will be described with reference to FIG.

  If it is determined in step S3804 that the input content is a new screen addition process (YES in step S3806), the process advances to step S3807 to perform a new screen addition process. Details of the new screen addition processing will be described with reference to FIG.

  If it is determined in step S3804 that the input content is a new box addition process (YES in step S3808), the process advances to step S3809 to perform a new box addition process. Details of the new box addition processing will be described with reference to FIG.

  If it is determined in step S3804 that the input content is a change / movement process (YES in step S3810), the process proceeds to step S3811 to perform the change / movement process. Details of the change / move process will be described with reference to FIG.

  If it is determined in step S3804 that the input content is a storage process (YES in step S3812), the process advances to step S3813 to perform the storage process. Details of the storage process will be described with reference to FIG.

  The above processing is repeated until it is determined in step S3814 that a development end instruction has been received. The above is a rough description of the screen creation process.

  Next, an example of a layout screen displayed on the display device 130 in step S3801 of FIG. 38 will be described with reference to FIG. The layout screen 3700 includes a tool box 3701 that displays available processing controls (that is, controls related to the configuration of the online GUI such as a text box that displays numerical results) and a screen configuration (that is, text boxes, buttons, and the like). A design area 3702 to be displayed, a property display area 3703 to display properties related to each control, and the like are provided.

  The developer (user) arranges the processing control displayed in the tool box 3701 in a desired position by dragging and dropping it in the design area, and then changes the size of the processing control or displays the properties. A screen can be created by changing the properties displayed in the column. The above is the description of the layout screen 3700.

  Next, with reference to FIG. 30, the new button addition processing in step S3805 of FIG. 38 will be described. First, when receiving an instruction to add a new button, the CPU 111 determines whether a screen layout table for arranging the button has already been created (step S3901). If it is determined as a result of the determination process in step S3901 that a table has not yet been created (NO with table) (step S3902 / NO), a screen layout table is created. An example of the screen layout table will be described with reference to FIG.

  FIG. 44 is a schematic diagram illustrating an example of a screen layout table. In the screen layout table 4400 of FIG. 44, an Index 4401, a control type 4402, a design registration name 4403, and a property table 4404 are set.

  The type of each control set on the screen is registered in the control type 4402, the ID of the control is registered in the design registration name, and the ID of the property table that manages the details of the control is registered in the property table 4404. become. The above is the description of the screen layout table.

  Returning to the description of FIG. Thereafter, the type of the added button control is specified (step S3904). As the types of button controls, “single inspection”, “continuous inspection”, “inspection stop”, “inspection setting”, “end”, and the like are prepared.

  Thereafter, a record for registering the details of the added button control is added to the button control table (FIG. 45) showing the details of the button control (step S3905), and the basic properties of the button are read from the external memory 116. The record is set (step S3906). Then, the property read out in step S3906 is displayed in the property display area 3703 of FIG. 46, and the added control is drawn in the design area 3702. The above is the details of the new button addition processing in step S3805 of FIG.

  An example of the button control table will be described with reference to FIG. In the button control table T4500 shown in FIG. 45, Index (4501), basic property (4502), execution content (4503), custom 1 (4504), custom 2 (4505),... Are set.

  The Index (4501) includes the index information of the control, the basic property (4502) includes the basic property information of the button control, and the execution content (4503) includes the execution content to be executed when the button is instructed to be pressed. However, in the custom 1 (4504), custom 2 (4505)..., Information such as button control position information, button size, and shape is registered. The above is the description of the button control table of FIG.

  Next, with reference to FIG. 40, details of the new screen addition processing in step S3807 of FIG. 38 will be described. This process is substantially the same as the new button addition process described with reference to FIG.

  First, when receiving an instruction for a new screen addition process for displaying an image processing result, the CPU 111 determines whether a screen layout table for arranging a screen for displaying the result of the process has already been created (step S4001). ). If it is determined as a result of the determination process in step S4001 that a table has not yet been created (NO with table) (step S4002 / NO), a screen layout table is created (step S4003).

Thereafter, data to be displayed on the added screen is set (step S4004). The data to be set here is, for example, the processing result in the processing flow executed by the screen control set for the screen. Specifically, the input in the processing flow / input / output parameter table indicating the processing flow A variable set as a parameter or output parameter is specified.

  Thereafter, a record for registering the details of the added button control is added to the screen control table (FIG. 46) showing the details of the screen control (step S4005), and the basic properties of the screen are read from the external memory 116. The record is set (step S4006). The property read in step S4006 is displayed in the property display area 3703 of FIG. 46, and the added control is drawn in the design area 3702. The above is the details of the new screen addition process in step S3807 of FIG.

  An example of the screen control table will be described with reference to FIG. In the screen control table T4600, Index (4601), basic property (4602), resource (4603), custom 1 (4604), custom 2 (4605), etc. are set.

  Index (4601) includes Index information of the control, Basic Property (4602) includes basic property information of the screen control, and Resource includes a variable that holds data displayed on the screen as Custom 1 (4604). ), Custom 2 (4605)..., Information such as screen control position information, screen control size, and the like is registered. The above is the description of the screen control table of FIG.

  Next, with reference to FIG. 41, the details of the new box addition processing in step S3809 in FIG. 38 will be described. This process is substantially the same as the new button addition process described with reference to FIG.

  First, when receiving an instruction for a new box addition process for displaying an image processing result, the CPU 111 determines whether a screen layout table for arranging a box for displaying the result of the process has already been created (step S4101). ). If it is determined as a result of the determination process in step S4101 that a table has not yet been created (NO with table) (step S4102 / NO), a screen layout table is created (step S4103).

Thereafter, data to be displayed on the added screen is set (step S4104). The data to be set here is, for example, the processing result in the processing flow executed by the button control set on the screen, and specifically, the input in the processing flow / input / output parameter table indicating the processing flow A variable set as a parameter or output parameter is specified.

  Thereafter, a record for registering the details of the added box control is added to the box control table (FIG. 47) showing the details of the box control (step S4105), and the basic properties of the screen are read from the external memory 116. The record is set (step S4106). Then, the property read in step S4106 is displayed in the property display area 3703 of FIG. 46, and the added control is drawn in the design area 3702. The above is the details of the new box addition process in step S3809 of FIG.

  An example of the box control table will be described with reference to FIG. In the box control table 4700, Index (4701), basic property (4702), display variable (4703), custom 1 (4704), custom 2 (4705), etc. are set.

  Index (4701) includes index information of the control, basic property (4702) includes basic property information of the screen control, and display variable (4703) includes a variable that holds data displayed on the screen. Custom 1 (4704), custom 2 (4705)... Register information such as box control position information, box control size, and the like. The above is the description of the screen control table of FIG.

  Next, with reference to FIG. 42, the details of the change / move process shown in step S3811 of FIG. 38 will be described. When the CPU 111 receives a change or movement instruction, the CPU 111 first specifies a control to be changed (step S4201). Thereafter, a record of the control to be changed is acquired from the control table that manages the details of the type control that has received the change request (step S4202).

  And the change process according to the change content received from the user with respect to the record acquired by step S4202 is performed (step S4203). For example, in the case of movement of a control, a change process for information indicating the coordinate value of the control is performed.

  Then, the changed property information is displayed in the property display area 3703 in FIG. 37, and the redrawing process of the changed control is performed. The above is the details of the change / move process in step S3811 of FIG.

  With reference to FIG. 43, the details of the storage processing in step S3813 in FIG. 38 will be described. First, in accordance with a source program stored in the external memory 116, the CPU 111 executes a set process in accordance with an event generated by an operation instruction or the like on the screen created by the processes in FIGS. A source program is created (step S4301). Then, the source program is stored in the external memory 116 (step S4302). When performing this process, it is of course possible to actually execute the compile process and link process of the source program, and then perform the debug process.

  The present invention can be implemented as a system, apparatus, method, program, storage medium, or the like, and can be applied to a system including a plurality of devices. You may apply to the apparatus which consists of one apparatus.

  Note that the present invention includes a software program that implements the functions of the above-described embodiments directly or remotely from a system or apparatus. The present invention also includes a case where the system or the computer of the apparatus is achieved by reading and executing the supplied program code.

  Accordingly, since the functions of the present invention are implemented by computer, the program code installed in the computer also implements the present invention. In other words, the present invention includes a computer program itself for realizing the functional processing of the present invention.

  In that case, as long as it has the function of a program, it may be in the form of object code, a program executed by an interpreter, script data supplied to the OS, and the like.

  Examples of the recording medium for supplying the program include a flexible disk, hard disk, optical disk, magneto-optical disk, MO, CD-ROM, CD-R, and CD-RW. There are also magnetic tape, nonvolatile memory card, ROM, DVD (DVD-ROM, DVD-R) and the like.

  As another program supply method, a browser on a client computer is used to connect to an Internet home page. The computer program itself of the present invention or a compressed file including an automatic installation function can be downloaded from the homepage by downloading it to a recording medium such as a hard disk.

  It can also be realized by dividing the program code constituting the program of the present invention into a plurality of files and downloading each file from a different homepage. That is, a WWW server that allows a plurality of users to download a program file for realizing the functional processing of the present invention on a computer is also included in the present invention.

  In addition, the program of the present invention is encrypted, stored in a storage medium such as a CD-ROM, distributed to users, and key information for decryption is downloaded from a homepage via the Internet to users who have cleared predetermined conditions. Let me. It is also possible to execute the encrypted program by using the downloaded key information and install the program on a computer.

  Further, the functions of the above-described embodiments are realized by the computer executing the read program. In addition, based on the instructions of the program, an OS or the like running on the computer performs part or all of the actual processing, and the functions of the above-described embodiments can also be realized by the processing.

  Further, the program read from the recording medium is written in a memory provided in a function expansion board inserted into the computer or a function expansion unit connected to the computer. Thereafter, the CPU of the function expansion board or function expansion unit performs part or all of the actual processing based on the instructions of the program, and the functions of the above-described embodiments are realized by the processing.

  The above-described embodiments are merely examples of implementation in carrying out the present invention, and the technical scope of the present invention should not be construed as being limited thereto. That is, the present invention can be implemented in various forms without departing from the technical idea or the main features thereof.

100 image processing system 110 information processing apparatus)
120 Input Device 130 Display Device 140 Camera 150 Illumination Device Controller 160 Illumination Device 170 External Device Controller 180 Stage 181 Inspection Object 190 LAN (Local Area Network)
111 CPU
112 RAM
113 ROM
114 System bus 115a Input controller 115b Video controller 115c Memory controller 115d, 115e, 115g Communication I / F controller 115f Image input controller 116 External memory

Claims (10)

An information processing apparatus for generating an application program for causing a computer to perform image processing,
Storage means for storing a plurality of process items that can be added to the application program and source code used for generating a program for realizing the process related to the process item in association with each other;
The specification of a process item to be added to the application program is received from the selection screen for displaying the plurality of process items, and an input screen for the user to describe the source code is displayed according to an instruction from the user on the selection screen. Receiving means for displaying the source code including the debugging information for debugging, including the basic part of
A setting unit that sets a display area for displaying image data of an image processing result by the processing item in response to the reception of the designation of the processing item by the receiving unit;
The application program is generated using the source code corresponding to the processing item received by the receiving unit, and the processing item is generated by removing the debug information from the source code whose description is received by the receiving unit Generating means for
Registration means for registering the application program generated by the generating means in the storage means;
Display control means for displaying the result image data as a result of performing the processing related to the processing item on the processing target image in the display area set by the setting means when executing the application program registered by the registration means;
With
Said registration means so that the process item generated by the generating means is possible to specify the reception of the selection screen by said receiving means, said processing items in which the generated as addable process item to the application program An information processing apparatus that is additionally registered in a storage unit. The accepting unit accepts designation of a process item to be added to a process flow indicating a flow of a series of processes of the application program from a selection screen displaying the plurality of process items,
The registration unit additionally registers the process item generated by the generation unit in the storage unit so that the reception unit can receive an additional designation for the processing flow. The information processing apparatus according to 1. Said registration means, during reception of the specified the process item in said receiving means, said processing items generated by the generating means, so that it is possible to specify the reception of the selection screen by said receiving means, said The information processing apparatus according to claim 1 , wherein the generated processing item is additionally registered in the storage unit. A first display area serving as the selection screen for displaying a menu item for accepting designation of a process item; and a second display area for displaying display information indicating the process and execution order of the process item accepted by the accepting means. A display means for displaying screen information;
The accepting means accepts a designation of a process item to be added to the application program by accepting a drag and drop process to the second area for the menu item displayed in the first display area. The information processing apparatus according to any one of claims 1 to 3. The information processing apparatus according to claim 4, wherein the display unit displays screen information further including a third display area that is the input screen in which the source code can be described.   The information processing apparatus according to claim 4, wherein the display unit displays a processing flow indicating processing performed by the processing item received by the receiving unit in the second display area.   The information according to any one of claims 1 to 6, wherein the accepting unit deletes a process item added to the application program and changes an execution order of the process items added to the application program. Processing equipment.   The information processing apparatus according to claim 1, further comprising a creation unit that creates screen information used to instruct execution of a program generated by the generation unit. Storage means for storing a plurality of process items that can be added to an application program for causing a computer to perform image processing and source code used for generating a program for realizing processing related to the process items in association with each other A method for controlling the information processing apparatus for generating the application program,
The accepting means of the information processing apparatus accepts designation of a process item to be added to the application program from a selection screen that displays the plurality of process items, and a user describes source code according to an instruction from the user on the selection screen An input screen for displaying the source code including the basic part of the source code, and receiving a description of the source code including debug information for debugging ,
A setting step in which the setting unit of the information processing apparatus sets a display area for displaying image data of an image processing result by the processing item in response to receiving the designation of the processing item in the receiving step;
The generation unit of the information processing apparatus generates the application program using the source code corresponding to the processing item received in the receiving step, and the debug information from the source code whose description is received in the receiving step. Generating a process item by removing
A registration step in which the registration unit of the information processing apparatus registers the application program generated in the generation step in the storage unit;
The display area in which the display control unit of the information processing apparatus sets the result image data obtained as a result of performing the processing related to the processing item on the processing target image when the application program registered in the registration step is executed. Display control steps to be displayed on,
With
The registration step, so that the process item generated in the generation step is possible to specify the reception of the selection screen in the accepting step, the processing item which the generated as addable process item to the application program A method for controlling an information processing apparatus, wherein the information is additionally registered in a storage unit. Storage means for storing a plurality of process items that can be added to an application program for causing a computer to perform image processing and source code used for generating a program for realizing processing related to the process items in association with each other A computer-readable program for causing a computer to execute the control method of the information processing apparatus that generates the application program,
The information processing apparatus;
The specification of a process item to be added to the application program is received from the selection screen for displaying the plurality of process items, and an input screen for the user to describe the source code is displayed according to an instruction from the user on the selection screen. Receiving means for displaying the source code including the debugging information for debugging, including the basic part of
A setting unit that sets a display area for displaying image data of an image processing result by the processing item in response to the reception of the designation of the processing item by the receiving unit;
The application program is generated using the source code corresponding to the processing item received by the receiving unit, and the processing item is generated by removing the debug information from the source code whose description is received by the receiving unit Generating means for
Registration means for registering the application program generated by the generating means in the storage means;
When executing the application program registered by the registration means, function as display control means for displaying the result image data as a result of performing the processing related to the processing item on the processing target image in the display area set by the setting means,
Said registration means so that the process item generated by the generating means is possible to specify the reception of the selection screen by said receiving means, said processing items in which the generated as addable process item to the application program A program readable and executable by a computer, additionally registered in a storage means.

Images