JP2020064519A - Information processing device, display control method, and program - Google Patents

Abstract

To provide an information processing device, a display control method, and a program capable of easily displaying, on an operation screen, hierarchical display of commands and/or display of condition setting.SOLUTION: An information processing device 1 includes a display control unit 104 configured to display a list of robot operations in a first area of a display device 3 and arrange and display, in a second area of the display device 3, in the execution order of the information processing device, a set of a robot operation and a command whose input is received by a command input unit 101. When there is an input of hierarchy designation and/or condition designation for the set of the robot operation and the command displayed in the second area via an input device 2, the display control unit changes a display mode of the set of the robot operation and the command displayed in the second area.SELECTED DRAWING: Figure 1

Description

  The present invention relates to an information processing device, a display control method and a program for executing so-called RPA (Robotic Process Automation).

  Software called RPA software that causes an information processing device to execute commands that can be executed by an information processing device such as a computer in a predetermined execution order is known (see Non-Patent Document 1, for example).

"RPA solution Windows operating robot" WinActor "| NTT data", [online], [Search on October 10, 2018], Internet <URL: http://www.nttdata.com/jp/ja/lineup/winactor /index.html>

  The conventional RPA software has a function of displaying an operation screen in which commands are arranged in the order of execution on a display device connected to the information processing device. However, there has been nothing that hierarchically displays the execution procedure of command execution or visually displays whether or not a condition is set.

  Therefore, it is an object of the present invention to provide an information processing apparatus, a display control method, and a program capable of easily displaying a hierarchical display of commands and / or a display of condition setting on an operation screen.

  In order to achieve the above-mentioned object, an information processing apparatus of the present invention has a command input that accepts a robot operation indicating a type of command executed by the information processing apparatus and a command input that is a specific execution content of the robot operation. Section, a scenario creating section for creating scenario data in which a set of robot operations and commands received by the command input section are arranged in the order of execution of the information processing apparatus, and a list of robot operations for the first area of the display apparatus. And a display control unit configured to display the robot operation and the set of commands received by the command input unit in the execution order of the information processing device in the second area of the display device. , The display control unit is configured to display a hierarchy instruction of a set of robot movements and commands displayed in the second area via the input device. And / or when there is input conditions specified, it is characterized by changing the set of display mode of robot operation and commands displayed in the second region.

  In the information processing apparatus of the present invention configured as described above, the display control unit inputs the hierarchical designation and / or the conditional designation of the robot operation and the set of commands displayed in the second area through the input device. If there is, the display mode of the set of robot motions and commands displayed in the second area is changed.

  By doing so, it is possible to easily display the hierarchical display of commands and / or the display of condition setting on the operation screen.

It is a functional block diagram which shows schematic structure of the information processing apparatus which is embodiment of this invention. It is a figure which shows the content of the scenario data of the information processing apparatus which is embodiment. It is a figure which shows the content of the robot operation | movement list data of the information processing apparatus which is embodiment. 7 is a flowchart for explaining an example of the operation of the information processing apparatus that is the embodiment. It is a figure which shows an example of the operation screen displayed by the information processing apparatus which is embodiment. It is a figure which shows the other example of the operation screen displayed by the information processing apparatus which is embodiment. It is a figure which shows another example of the operation screen displayed by the information processing apparatus which is embodiment. It is a figure which shows another example of the operation screen displayed by the information processing apparatus which is embodiment. It is a figure which shows another example of the operation screen displayed by the information processing apparatus which is embodiment. It is a figure which shows another example of the operation screen displayed by the information processing apparatus which is embodiment.

  Embodiments of the present invention will be described below with reference to the drawings. FIG. 1 is a functional block diagram showing a schematic configuration of an information processing apparatus that is an embodiment of the present invention.

  The information processing device 1 according to the present embodiment is a device capable of information processing, such as a personal computer, a server, a smartphone, a tablet terminal, or the like. The information processing device 1 includes a control unit 100, a storage unit 110, a communication unit 120, an input I / F (interface) 130, and an output I / F 140.

  The control unit 100 controls the entire information processing device 1. The control unit 100 has a CPU, a programmable logic device such as an FPGA, and an arithmetic element represented by an integrated circuit such as an ASIC.

  An operating system 111 and scenario software 113 are stored in the storage unit 110 of the information processing device 1, and the operating system 111 is executed by the control unit 100 when the information processing device 1 is started, and the operating system 111 is executed. Then, when the scenario software 113 is executed by the operator of the information processing device 1 instructing the execution of the scenario software 113, the information processing device 1 has a functional configuration as shown in FIG. . Of course, the scenario software 113 may be set to be automatically executed after the operating system 111 is activated.

  The control unit 100 includes a command input unit 101, a scenario creation unit 102, a scenario execution unit 103, and a display control unit 104.

  The command input unit 101 receives a robot operation indicating a type of command executed by the operating system 111 and the application software 112 of the information processing apparatus 1 and a command input that is a specific execution content of this robot operation. More specifically, the command input unit 101 receives, via the input I / F 130, the input of the robot operation and the command input by the operator of the information processing device 1 via the input device 2.

  The scenario creating unit 102 creates scenario data 114 in which a set of robot actions and commands received by the command input unit 101 are arranged in the order of execution of the information processing apparatus 1. The scenario data 114 created by the scenario creating unit 102 is stored in the storage unit 110. Details of the scenario data 114 will be described later.

  The scenario execution unit 103 causes the information processing apparatus 1 to execute the commands arranged in the execution order based on the scenario data 114 created by the scenario creation unit 102. Here, if the command is a command executable by the operating system 111, the scenario execution unit 103 causes the operating system 111 to execute the command, and if the command is a command executable by the application software 112, the scenario execution is executed. The unit 103 causes the application software 112 to execute this command.

  The display control unit 104 sends a display control signal for causing the display device 3 to display a predetermined display screen. Specifically, the display control unit 104 causes the list of robot operations to be displayed in the first area of the display device 3 connected to the information processing device 1 via the output I / F 140, and causes the command input unit 101 to display the list. The robot operation and the set of commands for which the input is accepted are arranged and displayed in the second area of the display device 3 in the order of execution of the information processing device 1.

  Further, the display control unit 104 is displayed in the second area when the input of the robot operation and the hierarchy specification and / or the condition specification of the set of commands displayed in the second area via the input device 2. The display mode of the set of the robot motion and the command being performed is changed.

  Preferably, the display control unit 104 receives the robot operation displayed in the second area and the hierarchy designation of the command set via the input device 2, and the robot operation displayed in the second area. And change the hierarchical display of a set of commands.

  Alternatively, the display control unit 104 receives the robot operation displayed in the second area and the input of the condition specification of the set of commands through the input device 2, and the robot operation displayed in the second area is displayed. The condition display of the command set is changed.

  The storage unit 110 has a storage medium such as a large-capacity storage medium such as a hard disk drive or a semiconductor storage medium such as ROM or RAM. The storage unit 110 temporarily or non-temporarily stores various data used in various operations in the control unit 100.

  The storage unit 110 also stores an operating system 111, application software 112, scenario software 113, scenario data 114, and robot operation list data 115.

  The operating system 111 is software that controls the overall operation of the information processing apparatus 1 and controls input / output to / from the information processing apparatus 1. The application software 112 is software that gives the information processing apparatus 1 a specific function and performs a specific operation. Examples of the application software 112 include word processing software and spreadsheet software.

  The operating system 111 and the application software 112 operate based on the operation input by the operator of the information processing apparatus 1 via the input device 2. However, in the information processing apparatus 1 of the present embodiment, the operating system 111 and the application software 112 are used. All of 112 also operate based on a command input by the operator of the information processing device 1 via the input device 2 and a command instructed to be executed by the scenario execution unit 103.

  As described above, the scenario software 113 is software that, when executed by the information processing device 1, causes the information processing device 1 to have the functional configuration shown in FIG. The scenario data 114 is a set of robot movements and commands arranged in the order of execution of the information processing apparatus 1, and is created by the scenario creating unit 102. The robot movement list data 115 is data in which robot movements indicating the types of commands executed by the operating system 111 and the application software 112 of the information processing apparatus 1 are stored as a list (for example, in a table format). Details of the robot operation list data 115 will also be described later.

  The communication unit 120 includes a communication control function of a CPU and a chipset, a LAN chip, and the like, and communicates with the LAN 4 and other devices on the WAN (not shown) such as the Internet connected to the LAN 4. To control.

  The input device 2 is, for example, a keyboard, a mouse, etc., and sends an operation input signal to the information processing device 1 based on an operation input from an operator of the information processing device 1. The input I / F 130 includes an interface function of a CPU and a chipset, an interface chip, and the like, and sends an operation input signal from the input device 2 to the control unit 100.

  The display device 3 is, for example, a liquid crystal display or the like, and displays a predetermined display screen based on a display control signal from the display control unit 104. The output I / F 140 includes an interface function of a CPU and a chipset, an interface chip, and the like, and outputs a display control signal from the display control unit 104 to the display device.

  Specific operations of the respective units constituting the information processing apparatus 1 shown in FIG. 1 will be described in detail later.

  Next, the contents of the scenario data 114 stored in the storage unit 110 will be described with reference to FIG.

  As shown in FIG. 2, the scenario data 114 has a plurality (n (n: natural number) of scenario data # 1 to #n 114a in the illustrated example. The scenario data # 1 to #n 114a include scenario name data 114b for identifying the scenario data # 1 to #n 114a, and a plurality of commands (commands shown in the figure) included in the scenario data # 1 to #n 114a. Has n (n: natural number)) command data # 1 to #n 114c. In the illustrated example, each scenario data # 1 to #n 114a has n command data # 1 to #n 114c for simplification, but each scenario data # 1 to #n 114a is It may have a different number of command data 114c.

  The command data # 1 to #n 114c includes command name data 114d indicating which robot operation each command data 114c corresponds to, and command memo data that can describe an outline of a command executed by command execution data 114f described later. 114e and command execution data 114f in which a command, which is the specific execution content of the robot operation specified by the command name data 114d, is described. The command described in the command execution data 114f is a command that can be interpreted by the operating system 111 and / or the application software 112 and can be executed by these.

  In each of the scenario data # 1 to #n 114a, the command data # 1 to #n 114c are arranged in the order of execution of the information processing device 1. Therefore, when the scenario execution unit 103 selects and executes specific scenario data # 1 to #n 114a, the command data # 1 to #n 114c in the selected scenario data # 1 to #n 114a are arranged in the arranged order. (That is, in ascending order from # 1).

  Next, the contents of the robot operation list data 115 stored in the storage unit 110 will be described with reference to FIG.

  The robot motion list data 115 includes a robot motion column 115a indicating the contents of the robot motion, a branch column 115b indicating whether or not a branch can be designated for this robot motion, and a hierarchy column 115c indicating whether or not a hierarchy can be designated for this robot motion. Have.

  As an example, you can not specify branch or layer specification for robot operation to start application (application), but you can only specify branch for robot operation to confirm scenario continuation, you can only specify layer for robot operation to receive mail, and The robot operation that confirms the existence of a file in a specific directory (file path) can be specified as a branch or a hierarchy.

  The control unit 100 of the information processing apparatus 1 according to the present embodiment has a mail client function and can receive a mail that has arrived at the mail address described by the scenario data 114 (command data 114c).

  The robot operation list data 115 shown in FIG. 3 is merely an example, and the number and contents of data are not limited to those shown in the figure.

  Next, an example of the operation of the information processing device 1 according to the present embodiment will be described with reference to the flowchart of FIG. 4 and FIGS.

  FIG. 4 is a flow chart for explaining the operation of the information processing device 1. The operation shown in the flowchart of FIG. 4 is started when the operator of the information processing apparatus 1 instructs the scenario software 113 to be activated and the scenario software 113 is activated.

  A screen displayed on the display screen of the display device 3 when the scenario software 113 is activated is shown in FIG. The screen is generated by the display control unit 104 of the control unit 100 of the information processing device 1 and sent to the display device 3.

  In the screen shown in FIG. 5, an area 200 in which the scenario name data 114b of each scenario data # 1 to #n 114a of the scenario data 114 stored in the storage unit 110 is displayed, and a new scenario creation instruction The scenario creation button 201 is displayed. In the flowchart of FIG. 4, the procedure when the new scenario creation button 201 is input, that is, the new scenario data # 1 to #n 114a is created will be described.

  In step S1, the operator waits for an operation input to the new scenario creation button 201 displayed on the display device 3 via the input device 2. Then, if there is an operation input of the new scenario creation button 201 (YES in step S1), the program proceeds to step S2, and the display control unit 104 causes the display device 3 to display a scenario name input screen (not shown). When there is an operation input of the scenario name via the input device 2, the command input unit 101 of the control unit 100 accepts this operation input. The accepted scenario name is stored in the storage unit 110 as part of the scenario data 114 by the scenario creating unit 102 as scenario name data 114b.

  FIG. 6 is a diagram showing an example of a scenario edit mode screen displayed on the display screen of the display device 3 after the scenario name input operation in step S2. The screen shown in FIG. 6 is generated by the display control unit 104 and sent to the display device 3.

  In the screen shown in FIG. 6, a first area 210 in which a list of robot movements is displayed and a set of robot movements and commands input by a command input unit 101, which will be described later, are displayed from top to bottom in the order of execution of the information processing apparatus 1. And a second region 211 arranged in the. The display of the robot motion list displayed in the first area 210 is generated by the display control unit 104 with reference to the robot motion list data 115. Further, the display of the robot operation and the set of commands displayed in the second area 211 is similarly generated by the display control unit 104.

  The screen shown in FIG. 6 shows a state in which a plurality of sets of robot motions and commands have already been input by the command input unit 101. Therefore, in the state where step S2 ends and step S3 is executed, nothing is displayed in the second area 211.

  In step S <b> 3, the operator of the information processing apparatus 1 waits for selection input of any robot operation from the list of robot operations displayed in the first area 210 via the input device 2. Then, when the selection input is made (YES in step S3), the program proceeds to step S4, and the display control unit 104 causes the display device 3 to display the command detail setting screen.

  An example of the command detail setting screen displayed on the display device 3 is shown in FIGS.

  The command detail setting screen 220 shown in FIG. 7 is a screen for inputting details of a command corresponding to the robot operation “application> start”. The command detailed setting screen 220 shown in FIG. 7 includes an application software designation screen 221 for designating the application software 112 to be started up, and a memo input screen 222 for inputting command memo data 114e showing concrete execution contents of this command. Have.

  The operator of the information processing device 1 inputs a character string or the like on the command detail setting screen 220 via the input device 2. In the example shown in FIG. 7, the operator inputs “excel (registered trademark)” on the application software designation screen 221 and “excel start” on the memo input screen 222.

  Next, the command detail setting screen 230 shown in FIG. 8 is a screen for inputting the details of the command corresponding to the robot operation “File> Open> Fixed file name”. The command detail setting screen 230 shown in FIG. 8 includes a file location designation screen 231 for designating a location of a file to be opened (by the application software 112 associated with the file), in other words, a directory (file path), and a specific command It has a memo input screen 232 for inputting command memo data 114e indicating execution contents.

  Next, the command detail setting screen 240 shown in FIG. 9 is a screen for inputting details of a command corresponding to the robot operation “flow> branch (numerical value)”. The command detail setting screen 240 shown in FIG. 9 includes a data ID setting screen 241 for setting an ID for specifying data that is a branch condition, a size setting screen 242 for setting a magnitude relationship with a numerical value that is a branch condition, It has a numerical value input screen 243 for inputting a numerical value to be compared, and a memo input screen 244 for inputting command memo data 114e showing specific execution contents of this command.

  The command detail setting screen 250 shown in FIG. 10 is a screen for inputting the details of the command corresponding to the robot operation “window> store front window”. The command detail setting screen 250 shown in FIG. 10 is a window reference ID setting screen 251 for setting an ID for storing the screen displayed first on the display screen of the display device 3, and a command indicating specific execution contents of this command. It has a memo input screen 252 for inputting memo data 114e.

  In step S5, the process waits until a command or the like is input using the command detail setting screen displayed in step S4. Then, when a command or the like is input (YES in step S5), the program proceeds to step S6, and the command input unit 101 is the robot operation input in steps S4 and S5 and the specific execution content of the robot operation. The command input and the command memo data 114e are respectively accepted. Next, the scenario creating unit 102 updates the scenario data 114 using the robot operation and the set of commands accepted by the command input unit 101, and further the command memo data 114e.

  Further, the display control unit 104, based on the robot operation received by the command input unit 101, the command input that is the specific execution content of the robot operation, and the command memo data 114e, the second area 211 of the display screen of the display device 3. Display contents are updated (see FIG. 6).

  At this time, the display control unit 104 refers to the robot operation list data 115 for the robot operation accepted by the command input unit 101, and determines whether or not branch designation is possible for the accepted robot operation. Then, when it is determined that the branch designation is possible, the condition display is added to the display content of the second area 211.

  As an example, in FIG. 6, the robot operation R1 in which the command memo data 114e is “when the number of orders is 10 or more” is branch-designated. Therefore, the display control unit 104 does not satisfy the conditions of the robot action R1 and the robot action R2 that branches when the condition of the robot action R1 is satisfied (displayed as “True” in the diagram) (“False” in the diagram). (Displayed), the robot action R3 that branches is displayed separately in a visually recognizable state.

  Next, in step S7, the operator of the information processing device 1 waits for an operation input to the second area 211 of the display screen of the display device 3 via the input device 2. An example of the operation input referred to here is an operation input for instructing to change the hierarchy for the robot motion displayed in the second area 211, and more specifically, the robot motion is displayed in the horizontal direction in FIG. This is an operation input for instructing a hierarchy change by dragging to.

  In step S8, the display control unit 104 refers to the robot movement list data 115 for the robot movement for which the operation input has been made, and determines whether the received robot movement can be hierarchically designated. When it is determined that the hierarchy can be designated, the display content of the second area 211 is updated and the hierarchy is displayed (or changed).

  As an example, in FIG. 6, the robot motion R4 in which the command memo data 114e is “move” is shifted to the right in the figure from the robot motion R5 in which the command memo data 114e is “repeat for each order”. It is displayed. Hierarchical display is performed by shifting the display of the robot motion in the left-right direction by a predetermined distance.

  After that, the program returns to step S3 and repeats the operations of steps S3 to S8.

  In the information processing device 1 according to the present embodiment configured as described above, the display control unit 104 causes the input device 2 to specify the hierarchy of the set of robot motions and commands displayed in the second area 211. And / or when a condition designation is input, the display mode of the set of robot motions and commands displayed in the second area 211 is changed.

  By doing so, it is possible to easily display the hierarchical display of commands and / or the display of condition setting on the operation screen.

  Although the embodiment of the present invention has been described in detail with reference to the drawings, the specific configuration is not limited to this embodiment and the example, and a design change is made to the extent not departing from the gist of the present invention. Are included in the present invention.

  As an example, the display mode on the display screen of the display device 3 by the display control unit 104 is not limited to the illustrated example, and various modifications are possible.

  In the above-described embodiment, the program for operating the information processing apparatus 1 is stored in the storage unit 110 and provided, but the program is stored by using an optical disk drive, a USB interface, or the like (not shown). It is also possible to connect an optical disc, a USB flash memory device, a memory card, etc., and read the program from the DVD or the like into the information processing device 1 to operate it. Alternatively, the program may be stored in an external server on the WAN, and the program may be read into the information processing device 1 via the communication unit 120 and operated. Furthermore, in each of the above-described embodiments, the information processing device 1 is configured by a plurality of hardware elements, but it is also possible for a CPU or the like to realize some operations of these hardware elements by the operation of a program. .

1 information processing device 2 input device 3 display device 100 control unit 101 command input unit 102 scenario creation unit 103 scenario execution unit 104 display control unit 110 storage unit 114 scenario data 115 robot motion list data 210 first area 211 second area

Claims (7)

A robot operation indicating a type of command executed by the information processing apparatus, and a command input unit that receives an input of the command that is a specific execution content of the robot operation,
A scenario creation unit that creates scenario data in which the robot operation and the command set received by the command input unit are arranged in the order of execution of the information processing apparatus;
The robot operation list is displayed in the first area of the display device, and the set of the robot operation and the command received by the command input unit is processed in the second area of the display device. A display control unit arranged and displayed in the order of execution of the device,
The display control unit displays the robot operation and the command set displayed in the second area via the input device when the hierarchy specification and / or the condition specification is input to the second area. An information processing apparatus, characterized in that a display mode of a set of the robot operation and the command being performed is changed.   The display control unit displays the robot operation displayed in the second area and the hierarchy designation of the command set input via the input device, and the display area is displayed in the second area. The information processing apparatus according to claim 1, wherein the hierarchical display of the robot motion and the command set is changed.   The display control unit displays the robot operation displayed in the second area and the condition designation of the set of commands through the input device, and the condition is displayed in the second area. The information processing apparatus according to claim 1, wherein the condition display of the robot operation and the set of the commands is changed.   The information processing apparatus according to any one of claims 1 to 3, further comprising a storage unit that stores data defining the robot operation and the scenario data.   The information processing apparatus according to any one of claims 1 to 4, further comprising a scenario execution unit that causes the information processing apparatus to execute the commands arranged in an execution order based on the scenario data. The robot operation indicating the type of command executed by the information processing device, and the input of the command that is the specific execution content of the robot operation, respectively,
Creating a scenario data in which the set of the robot operation and the command for which the input is accepted is arranged in the order of execution of the information processing device,
A list of the robot motions is displayed in a first area of the display device, and the set of the robot motions and the commands received as inputs are arranged in the second area of the display device in the order of execution of the information processing device. To display
Further, when there is an input of the layer designation and / or the condition designation of the robot operation and the command set displayed in the second area via an input device, the display in the second area is performed. A display control method by an information processing apparatus, characterized in that a display mode of a robot motion and a set of the command is changed. A program executed by a computer,
This program, when executed by the computer,
A robot operation that indicates the type of command executed by the computer, and a command input unit that receives an input of the command that is the specific execution content of the robot operation,
A scenario creation unit that creates scenario data in which the robot operation and the command set, the input of which is received by the command input unit, are arranged in the order of execution of the computer;
The robot operation list is displayed in the first area of the display device, and the set of the robot operation and the command received by the command input unit are stored in the second area of the display device. If the robot operation and the command set displayed in the second area are input via the input device, the hierarchical specification and / or the condition specification are input via the input device. A program that functions as a display control unit that changes a display mode of the robot motion and the command set displayed in the area.