JP2012178094A - Test execution device and test execution method and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To accurately continue a test to a test object system in a test environment in the case of performing a test by transmitting input data to the test object system in an actual environment to the test object system in the test environment.SOLUTION: This test execution device is configured to determine which of a normal time sequence and an error time sequence is pertinent to a sequence under progress in a test object system 201 in an actual environment 200, determine which of the normal time sequence and the error time sequence is pertinent to a sequence under progress in a test object system 301 in a test environment 300, and select input data to be transmitted to the test object system 301 on the basis of the determination result about the test object system 201 and the determination result about the test object system 301. Thus, it is possible to transmit appropriate input data in accordance with the state of the test object system 301, and accurately continue the test of the test object system 301.

Description

  The present invention relates to a technique for testing the operation of an IT (Information Technology) system.

As a test method for the IT system, for example, there is a technique disclosed in Patent Document 1.
In Patent Document 1, input data and output data between a test target system and other systems are collected on a network in a real environment, and the input data is input from a test tool to a computer in a test environment, and an output result that is a response to the input data. Is compared with the output data to perform a higher quality test.

JP 2007-145156 A

The conventional testing method using a test tool using data collected from a real environment is based on the premise that the test target system in the real environment and the test environment are in the same state and operate normally.
For this reason, when an error or the like occurs in the actual environment or the test environment and a transition is made to an abnormal sequence, there is a problem that subsequent tests cannot be continued.
Specifically, if the sequence is abnormal in the real environment and normal in the test environment, even if input data of the abnormal sequence collected from the real environment is sent to the test target system in the test environment, the test environment Since this is a normal sequence, even if this input data is received by the test target system in the test environment, it may not be processed.
In addition, if the sequence is normal in the real environment and abnormal in the test environment, even if input data of the normal sequence collected from the real environment is sent to the test target system in the test environment, Since it is a sequence, it may not be processed even if it is received by the test target system in the test environment.
In any case, it is considered that the subsequent test cannot be continued or the accuracy of the test is lowered even if it is continued.

  The main object of the present invention is to solve the above-described problems, and when the test is performed by transmitting the input data to the system in the real environment to the system in the test environment, the test for the system in the test environment is accurate. The main purpose is to realize a structure that can be continued well.

The test execution apparatus according to the present invention includes:
A test of the second data processing system using the input data and the output data in the first data processing system in parallel with the operation of the first data processing system in which proper processing is confirmed to be performed. A test execution device for performing
An input / output sequence of input data and output data during normal operation of the first data processing system is shown as a normal sequence, and an input / output sequence of input data and output data when an error occurs in the first data processing system A sequence information storage unit for storing sequence information indicated as an error time sequence;
A first communication unit that receives input data input to the first data processing system as first system input data and receives output data output from the first data processing system as first system output data When,
Of the first system input data received by the first communication unit, the first system input data designated as a transmission target is transmitted as second system input data to the second data processing system, and the second system input A second communication unit for receiving a response to the data as second system output data;
Based on the first system input data, the first system output data, and the sequence information, it is determined whether the input / output sequence in progress in the first data processing system is a normal sequence or an error sequence In addition, based on the second system input data, the second system output data, and the sequence information, the input / output sequence in progress in the second data processing system is either a normal sequence or an error sequence. The second data processing system transmits the second system input data to the second data processing system based on the determination result for the first data processing system and the determination result for the second data processing system. 1 It has an input data specification part that specifies system input data. The features.

  According to the present invention, it is determined whether the input / output sequence in progress in the first data processing system that is confirmed to perform proper processing is a normal sequence or an error sequence, It is determined whether the input / output sequence in progress in the second data processing system that is performing the test is a normal sequence or an error sequence, and the determination result for the first data processing system and the second In order to designate input data to be transmitted to the second data processing system based on the determination result for the data processing system, appropriate input data can be transmitted according to the state of the second data processing system, The test of the second data processing system can be continued with high accuracy.

FIG. 3 is a diagram illustrating an example of a system configuration according to the first embodiment. The figure which shows the example of the communication sequence file which the sequence reading part concerning Embodiment 1 reads. FIG. 6 is a diagram showing an example of real environment management information stored in a real environment sequence storage buffer according to the first embodiment. FIG. 6 is a diagram showing an example of test environment management information stored in a test environment sequence storage buffer according to the first embodiment. FIG. 5 is a diagram illustrating an operation example of an input data determination unit according to the first embodiment. FIG. 5 is a diagram illustrating an operation example of an input data determination unit according to the first embodiment. FIG. 5 is a diagram illustrating an operation example of an input data determination unit according to the first embodiment. FIG. 5 is a diagram illustrating an operation example of an input data determination unit according to the first embodiment. FIG. 5 is a diagram illustrating an operation example of an input data determination unit according to the first embodiment. FIG. 5 is a diagram illustrating an operation example of an input data determination unit according to the first embodiment. FIG. 5 is a diagram illustrating an operation example of an input data determination unit according to the first embodiment. FIG. 4 is a flowchart showing an operation example of a real environment sequence storage unit according to the first embodiment. FIG. 4 is a flowchart showing an operation example of a test environment sequence storage unit according to the first embodiment. FIG. 3 is a flowchart showing an operation example of an input data determination unit according to the first embodiment. FIG. 3 is a flowchart showing an operation example of an input data determination unit according to the first embodiment. FIG. 3 is a diagram illustrating a hardware configuration example of a test execution apparatus according to the first embodiment.

Embodiment 1 FIG.
FIG. 1 shows a system configuration example according to the present embodiment.
The system according to the present embodiment includes a test execution apparatus 100, a real environment 200, and a test environment 300.

The real environment 200 includes a test target system 201, a switch 202, and other IT systems 203.
The test target system 201 has been confirmed to perform proper processing, and is an example of a first data processing system.
The test target system 201 performs predetermined data processing on the input data from the other IT system 203 and outputs output data that is a response to the input data to the other IT system 203.
Transmission / reception of input data and output data between the test target system 201 and the other IT system 203 is performed via a switch 202 which is a network device.
The switch 202 is set to transmit a copy of input data and a copy of output data to the test execution apparatus 100.
The other IT system 203 includes a plurality of communication destination devices that communicate with the test target system 201.
As the communication destination device, for example, there are a plurality of client devices operated by a user using the test target system 201.

The test environment 300 is operating in parallel with the real environment.
The test environment 300 includes a test target system 301 and a switch 302.
The test target system 301 has the same specifications as the test target system 201 in the real environment 200, and the same operation as that of the test target system 201 is expected. The test is performed by 100.
The test target system 301 is an example of a second data processing system.
The switch 302 is a network device that relays communication between the test execution device 100 and the test target system 301.
The switch 302 transfers input data from the test execution apparatus 100 to the test target system 301 and transfers output data from the test target system 301 to the test execution apparatus 100.

The test execution apparatus 100 performs the test of the test target system 301 using the input data and output data in the test target system 201 in parallel with the operation of the test target system 201 in the real environment 200.
More specifically, the test execution apparatus 100 collects input data and output data in the test target system 201 in the real environment 200 and transmits the input data to the test target system 301 in the test environment 300.
Then, output data that is a response of the test target system 301 in the test environment 300 is received, and whether the received output data matches the output data collected from the test target system 201 in the real environment 200 is checked. Check whether the operation of the system 301 is proper.
As described above, the test execution device 100 emulates a plurality of client devices included in the other IT system 203, transmits input data from the plurality of client devices to the test target system 301, and a plurality of clients. It is confirmed whether the response (output data) from the test target system 301 to the input data from the apparatus is correct.

In addition, the test execution apparatus 100 manages the sequence of the real environment 200 using the input / output data collected in the real environment 200 based on the read communication sequence information regarding the test target system. The sequence of the test environment 300 is managed using the input data transmitted to and the received output data.
The test execution apparatus 100 confirms the sequence of the managed real environment 200 and the test environment 300 with respect to the input data collected in the real environment 200 or the output data received from the test environment 300, and then to the test environment 300. Determine the input data to be sent.
In this way, when an abnormal sequence occurs in the real environment 200 or the test environment 300, the optimum input data can be transmitted to the test target system 301 in the test environment 300. Even if the system under test in the test environment 300 is out of synchronization, the test can be continued by recovering this and synchronizing it.

  Next, the internal configuration of the test execution apparatus 100 will be described.

The data collection unit 101 collects network data (input data and output data) flowing through the network from the switch 202 on the network in the real environment 200 and notifies the data analysis unit 102 of the collected data.
The data collection unit 101 corresponds to a first communication unit.
Further, the process performed by the data collection unit 101 corresponds to the first communication step.

  The data analysis unit 102 analyzes the network data collected by the data collection unit 101, uses the network data destined for the test target system 201 as input data, and the network data whose source is the test target system 201 Is output as output data to the data management unit 103, and other network data is discarded.

The data management unit 103 notifies the actual environment sequence storage unit 105 of the input data and output data analyzed by the data analysis unit 102.
The data management unit 103 notifies the test environment sequence storage unit 106 of the input data notified to the data transmission / reception unit 104 and the output data received by the data transmission / reception unit 104 from the test target system 301 in the test environment 300.
In addition, the data management unit 103 collates the output data analyzed by the data analysis unit 102 with the output data received by the data transmission / reception unit 104.
The collated result is output as a test result by, for example, outputting it to a test result log.

The data transmission / reception unit 104 transmits the input data notified from the data management unit 103 to the test target system 301 in the test environment 300.
Further, the data transmission / reception unit 104 receives output data from the test target system 301 in the test environment 300.
The data transmission / reception unit 104 corresponds to a second communication unit.
Moreover, the process implemented by the data transmission / reception part 104 is equivalent to a 2nd communication step.

The sequence reading unit 108 reads the communication sequence file and stores it in the read sequence storage buffer 112.
The sequence reading unit 108 reads, for example, the communication sequence file shown in FIG.
FIG. 2A shows information indicating an input / output sequence of input data and output data during normal operation of the test target system 201.
FIG. 2B shows information indicating an input / output sequence of input data and output data when an error occurs in the test target system 201.

The real environment sequence storage unit 105 compares the input data and output data collected from the real environment 200 notified from the data management unit 103 with the communication sequence file (FIG. 2) read by the sequence reading unit 108. The type of collected data (whether it is input data or output data), the data type of the data (what kind of processing is the data), the sequence in progress in the test target system 201, the state of the test target system 201 (normal) Or abnormal)).
In addition, the real environment sequence storage unit 105 generates real environment management information indicating the determination result, and stores the real environment management information in the real environment sequence storage buffer 110.
An example of real environment management information stored in the real environment sequence storage buffer 110 is shown in FIG.
As shown in each of FIGS. 3A to 3D, the real environment sequence storage unit 105 includes input data and real data in the real environment management information for each communication destination device (user) communicating with the test target system 201. The output data is grouped, and the sequence and state in progress in the test target system 201 are managed for each communication destination device (user).
The real environment sequence storage unit 105 notifies the input data determination unit 109 of the input data collected from the real environment 200 notified from the data management unit 103.

The test environment sequence storage unit 106 receives the input data transmitted to the test target system 301 in the test environment 300 notified from the data management unit 103, the received output data, and the communication sequence file (see FIG. 2), the type of each data (whether it is input data or output data), the data type of each data (what kind of processing is the data), the sequence in progress in the test target system 301, the test target The state of the system 301 (normal or abnormal) is determined.
In addition, the test environment sequence storage unit 106 generates test environment management information indicating the determination result, and stores the test environment management information in the test environment sequence storage buffer 111.
An example of test environment management information stored in the test environment sequence storage buffer 111 is shown in FIG.
The test execution apparatus 100 advances the process for each communication destination apparatus (client apparatus or the like) that is emulating and performs the test of the test target system 301.
For this reason, as shown in each of FIGS. 4A to 4D, the test environment sequence storage unit 106 communicates with the test target system 201, that is, the communication destination device (user), that is, the test target system 301. The input data and output data are grouped in the test environment management information for each communication destination device (user) emulating, and the test target system 301 progresses for each communication destination device (user) emulated. Manage the sequence and state inside.
Further, the test environment sequence storage unit 106 notifies the input data determination unit 109 of the output data received from the test target system 301 in the test environment 300 notified from the data management unit 103.

The input data determination unit 109 receives the input data notified from the real environment sequence storage unit 105, the output data notified from the test environment sequence storage unit 106, the contents of the real environment management information in the real environment sequence storage buffer 110, the test environment The next input data to the test target system 301 of the test environment 300 is determined from the content of the test environment management information in the sequence storage buffer 111.
Since the operation of the input data determination unit 109 is complicated, details of the operation of the input data determination unit 109 will be described later.

  The input data generation unit 107 generates input data to be transmitted to the test target system 301 in the test environment 300 from the input data notified from the input data determination unit 109 or the input data information and output data.

A combination of the real environment sequence storage unit 105, the test environment sequence storage unit 106, the input data generation unit 107, and the input data determination unit 109 corresponds to the input data designation unit.
Further, the processing performed by the real environment sequence storage unit 105, the test environment sequence storage unit 106, the input data generation unit 107, and the input data determination unit 109 corresponds to an input data designation step.

The read sequence storage buffer 112 is a buffer for storing the communication sequence file read by the sequence reading unit 108.
The read sequence storage buffer 112 corresponds to a sequence information storage unit.
Further, the processing executed by the read sequence storage buffer 112 corresponds to a sequence information storage step.

  The real environment sequence storage buffer 110 is a buffer for storing the real environment management information generated by the real environment sequence storage unit 105.

  The test environment sequence storage buffer 111 is a buffer for storing the test environment management information generated by the test environment sequence storage unit 106.

  The input data storage buffer 113 is a buffer for storing normal sequence input data that has not been transmitted to the test target system 301 in the test environment 300.

  Next, the operation of the test execution apparatus 100 according to the present embodiment will be described.

  First, before the start of the test, the sequence reading unit 108 reads a communication sequence file and stores the read communication sequence file in the read sequence storage buffer 112.

Thereafter, the data collection unit 101 collects network data (input data and output data) flowing through the network from the switch 202 on the network in the real environment 200 and outputs it to the data analysis unit 102.
The data analysis unit 102 analyzes the network data collected by the data collection unit 101, uses the network data destined for the test target system 201 as input data, and the network data whose source is the test target system 201 Is output to the data management unit 103 as output data, and other network data is discarded.

The data management unit 103 outputs the input data and output data analyzed by the data analysis unit 102 to the real environment sequence storage unit 105.
Further, when input data to the test target system 301 of the test environment 300 is input from the input data generation unit 107, the data management unit 103 outputs the input data to the data transmission / reception unit 104.
Further, the data management unit 103 outputs the input data output to the data transmission / reception unit 104 to the test environment sequence storage unit 106.
Further, when output data from the test target system 301 in the test environment 300 is input from the data transmission / reception unit 104, the output data is output to the test environment sequence storage unit 106.
In addition, the data management unit 103 collates the output data of the test target system 301 input from the data transmission / reception unit 104 with the output data of the test target system 201 input from the data analysis unit 102.
The collated result is output as a test result by, for example, outputting it to a test result log.

Next, the operation of the real environment sequence storage unit 105 will be described.
The real environment sequence storage unit 105 performs the operation shown in the flowchart of FIG.

When the input data or output data of the real environment 200 is input from the data management unit 103 (YES in S101), the real environment sequence storage unit 105 has already generated a communication sequence file (FIG. 2) in the read sequence storage buffer 112. The type of data input from the data management unit 103 (input data or output data) based on the actual environment management information (FIG. 3), and the data type of the data (what kind of processing is the data) Then, the sequence in progress in the test target system 201 and the state (normal or abnormal) of the test target system 201 are discriminated (S102).
Then, a new record of real environment management information reflecting the determined data type, sequence, state, etc. is generated and stored in the real environment sequence storage buffer 110 (S103).
Thereafter, if the data input from the data management unit 103 is input data (YES in S104), the real environment sequence storage unit 105 outputs the input data to the input data determination unit 109 (S105).

12, specifically, the real environment sequence storage unit 105 uses the user ID, the IP address, the port number, and the like, for example, as a communication destination client or system of the test target system 201. For each identified client or system, the type, data type, sequence, and status are determined based on the already generated real environment management information (FIG. 3) and the communication sequence file (FIG. 2).
For example, assume that the real environment management information (user001) is in the situation shown in FIG. 3A (the situation where the record with serial number 5 is the latest record).
The contents of the record with serial number 5 in FIG. 3A match the contents of the record with serial number 3 in the communication sequence file (FIG. 2A).
For this reason, the real environment sequence storage unit 105 receives the data from the real environment 200 input from the data management unit 103 for the user 001 from the record of serial number 4 in the communication sequence file (FIG. 2A). It can be predicted that the data type is “Reservation change result answer”.
Then, when data is input from the data management unit 103, if the data is in accordance with the record of the serial number 4 of the communication sequence file (FIG. 2A), the test target system 201 is operating normally. The real environment sequence storage unit 105 generates the type “output”, the data type “reservation change result answer”, the sequence “reservation change sequence”, and the state “normal” as the record of the serial number 5 in FIG. Save in the environment sequence save buffer 110.
On the other hand, if the data input from the data management unit 103 does not follow the record with the serial number 4 in the communication sequence file (FIG. 2A), the input data is analyzed, the data type of the data is determined, and the transmission source The abnormal sequence corresponding to the destination and data type is extracted.
Thereafter, a record of real environment management information indicating the contents of the extracted abnormal sequence is generated and stored in the real environment sequence storage buffer 110.
In this case, the test target system 201 is in a state of being changed from a normal state to an abnormal state, but the same operation is performed when the test target system 201 is recovered from the abnormal state.

Next, the operation of the test environment sequence storage unit 106 will be described.
The test environment sequence storage unit 106 performs the operation shown in the flowchart of FIG.

When the output data from the test target system 301 is input from the data management unit 103 (YES in S201), the test environment sequence storage unit 106 is already generated with the communication sequence file (FIG. 2) in the read sequence storage buffer 112. Based on the current test environment management information (FIG. 4), the data type of the output data (what kind of processing is the data), the sequence in progress in the test target system 301, and the state of the test target system 301 (normal) Or abnormal) is determined (S202).
Then, a new record of the test environment management information reflecting the determined data type, sequence, state, etc. is generated and stored in the test environment sequence storage buffer 111 (S203).
Thereafter, the test environment sequence storage unit 106 outputs the output data input from the data management unit 103 to the input data determination unit 109 (S204).
Since the processing of S202 and S203 in the test environment sequence storage unit 106 is the same as the processing of S102 and S103 in the real environment sequence storage unit 105, detailed description thereof is omitted.

Next, the operation of the input data determination unit 109 will be described.
The input data determination unit 109 performs the operations shown in the flowcharts of FIGS.
The following operation is performed individually for each communication destination device of the test target system 201 (each communication destination device emulating the test target system 301).

When the input data is input from the real environment sequence storage unit 105 (YES in S301), the input data determination unit 109 receives the real environment management information in the real environment sequence storage buffer 110 and the test environment management information in the test environment sequence storage buffer 111. Referring to the status of the real environment 200 and the test environment 300 (S302).
Then, the following processing is performed according to the state of the real environment 200 and the test environment 300.

When the system state is normal in both the real environment 200 and the test environment 300 (YES in S303), the input data determination unit 109 outputs the input data input from the real environment sequence storage unit 105 to the input data generation unit 107. (S304).
Then, the input data generation unit 107 passes the input data acquired from the input data determination unit 109 to the data management unit 103.
An operation example of the input data determination unit 109 in this case is shown in FIG.

If the system state is normal in the real environment 200 and the test environment 300 is abnormal (NO in S303, YES in S305), the input data determination unit 109 stores the input data in the input data storage buffer 113 ( S306).
An operation example of the input data determination unit 109 in this case is shown in FIG.

If the system state is abnormal in the real environment 200 (NO in S303, NO in S305), the input data determination unit 109 discards the input data (S307).
An operation example of the input data determination unit 109 in this case is shown in FIG.

Further, when the input data determination unit 109 inputs output data from the test environment sequence storage unit 106 (NO in S301, YES in S308), the test data management unit 109 refers to the test environment management information in the test environment sequence storage buffer 111, and determines the test environment. The state of 300 is checked (S309).
Then, the following processing is performed according to the state of the test environment 300.

When the state of the test target system 301 in the test environment 300 is normal (YES in S310), a sequence related to this output data is acquired from the read sequence storage buffer 112, and input data that matches the next input data candidate is acquired. Therefore, the input data storage buffer 113 is accessed (S311).
Here, when there is no input data that matches the next input data candidate in the input data storage buffer 113 (NO in S312), the input data from the real environment 200 has not been received. The output data is discarded (S313).
An operation example of the input data determination unit 109 in this case is shown in FIG.

On the other hand, if there is input data that matches the next input data candidate in the input data storage buffer 113 (YES in S312), the input data determination unit 109 acquires the input data from the input data storage buffer 113 and acquires the acquired input. Data is output to the input data generation unit 107 (S314).
Then, the input data generation unit 107 passes the input data acquired from the input data determination unit 109 to the data management unit 103.
An operation example of the input data determination unit 109 in this case is shown in FIG.

If the state of the test target system 301 in the test environment 300 is abnormal (NO in S310), the input data determination unit 109 acquires a sequence related to the output data from the read sequence storage buffer 112, and the next sequence in the acquired sequence. It is confirmed whether or not there is input data (S315).
When the next input data exists in the acquired sequence (YES in S315), the input data determination unit 109 notifies the input data generation unit 107 of information on the next input data.
Then, the input data generation unit 107 generates the next input data according to the information about the next input data notified from the input data determination unit 109, and passes the generated input data to the data management unit 103.
Since the input data generated here is fixed data, the input data generation unit 107 can generate the next input data in accordance with the information notified from the input data determination unit 109.
An operation example of the input data determination unit 109 in this case is shown in FIG.

On the other hand, if this sequence is completed with this output data and there is no next input data (NO in S315), the input data determination unit 109 reads the latest normal sequence before this output from the test environment sequence storage buffer 111. If the data type is input, the input data is acquired and output to the input data generation unit 107 (S317).
Then, the input data generation unit 107 passes the input data acquired from the input data determination unit 109 to the data management unit 103.
An operation example of the input data determination unit 109 in this case is shown in FIG.

  As described above, in this embodiment, in a test method for reproducing input data collected from a real environment in a test environment, even if an abnormal sequence occurs in the real environment or the test environment, the test execution device can cope with this. As a result, the test can be continued even when the test could not be performed until now or when the test accuracy was lowered due to the occurrence of an abnormal sequence, so that the test efficiency and accuracy can be improved.

As described above, in the present embodiment,
A test execution apparatus for testing a test environment operating in parallel with the real environment with the same configuration as the real environment composed of a plurality of IT systems including the test target system,
Collecting input data to the test target system in the real environment and output data from the test target system in the real environment on a network connecting the test target system in the real environment and other IT systems Data collection means;
Input data and output data collected in the real environment by the data collection means, input data to be transmitted to the test target system in the test environment by data transmission / reception means described later, and output received from the test target system in the test environment Data management means for managing data and collating output data collected in the real environment with output data received from the test environment;
Data transmitting and receiving means for transmitting input data notified from the data management means to the test target system of the test environment and receiving output data from the test target system of the test environment;
A sequence reading means for reading a communication sequence file in which all communication sequences of the test target system in the real environment are described and storing them in a reading sequence storage buffer;
A real environment sequence storage buffer that indicates the communication sequence and system status of the test target system in the real environment based on the input data and output data collected from the real environment by the data collection means notified from the data management means And the communication sequence of the test target system in the test environment based on the input data transmitted to the test target system in the test environment and the output data received from the test environment by the data transmitting / receiving means A sequence storage means for storing the state in the test environment sequence storage buffer;
Referring to the input data collected from the real environment or the output data received from the test environment, the read sequence storage buffer, the real environment sequence storage buffer, the test environment sequence storage buffer, and the input data storage buffer, Input data determination means for determining the input data to be transmitted to the test target system in the test environment and storing the input data collected from the real environment not transmitted this time in the input data storage buffer;
A test execution apparatus having data generation means for generating input data determined by the input data determination means based on input data collected from the actual environment and output data received from the test environment has been described.

Finally, a hardware configuration example of the test execution apparatus 100 shown in the present embodiment will be described.
FIG. 16 is a diagram illustrating an example of hardware resources of the test execution apparatus 100 illustrated in the present embodiment.
Note that the configuration of FIG. 16 is merely an example of the hardware configuration of the test execution apparatus 100, and the hardware configuration of the test execution apparatus 100 is not limited to the configuration illustrated in FIG. Also good.

In FIG. 16, the test execution apparatus 100 includes a CPU 911 (also referred to as a central processing unit, a central processing unit, a processing unit, a processing unit, a microprocessor, a microcomputer, and a processor) that executes a program.
The CPU 911 is connected to, for example, a ROM (Read Only Memory) 913, a RAM (Random Access Memory) 914, a communication board 915, a display device 901, a keyboard 902, a mouse 903, and a magnetic disk device 920 via a bus 912. Control hardware devices.
Further, the CPU 911 may be connected to an FDD 904 (Flexible Disk Drive), a compact disk device 905 (CDD), a printer device 906, and a scanner device 907. Further, instead of the magnetic disk device 920, a storage device such as an SSD (Solid State Drive), an optical disk device, or a memory card (registered trademark) read / write device may be used.
The RAM 914 is an example of a volatile memory. The storage media of the ROM 913, the FDD 904, the CDD 905, and the magnetic disk device 920 are an example of a nonvolatile memory. These are examples of the storage device.
The “˜buffer” described in the present embodiment is realized by the RAM 914, the magnetic disk device 920, and the like.
A communication board 915, a keyboard 902, a mouse 903, a scanner device 907, an FDD 904, and the like are examples of input devices.
The communication board 915, the display device 901, the printer device 906, and the like are examples of output devices.

The communication board 915 is connected to the network.
For example, the communication board 915 is connected to a LAN (local area network), the Internet, a WAN (wide area network), a SAN (storage area network), and the like.

The magnetic disk device 920 stores an operating system 921 (OS), a window system 922, a program group 923, and a file group 924.
The programs in the program group 923 are executed by the CPU 911 using the operating system 921 and the window system 922.

The RAM 914 temporarily stores at least part of the operating system 921 program and application programs to be executed by the CPU 911.
The RAM 914 stores various data necessary for processing by the CPU 911.

The ROM 913 stores a BIOS (Basic Input Output System) program, and the magnetic disk device 920 stores a boot program.
When the test execution apparatus 100 is activated, the BIOS program in the ROM 913 and the boot program in the magnetic disk device 920 are executed, and the operating system 921 is activated by the BIOS program and the boot program.

  The program group 923 stores programs that execute the functions described as “˜unit” and “˜means” in the description of the present embodiment. The program is read and executed by the CPU 911.

In the description of this embodiment, the file group 924 includes “determination of”, “determination of”, “determination of”, “designation of”, “acquisition of”, “comparison of”, As “notification of”, “identification of”, “update of”, “setting of”, “registration of”, “selection of”, “input of”, “output of”, etc. Information, data, signal values, variable values, and parameters indicating the results of the processing described are stored as items of “˜file” and “˜database”.
The “˜file” and “˜database” are stored in a recording medium such as a disk or a memory.
Information, data, signal values, variable values, and parameters stored in a storage medium such as a disk or memory are read out to the main memory or cache memory by the CPU 911 via a read / write circuit.
The read information, data, signal value, variable value, and parameter are used for CPU operations such as extraction, search, reference, comparison, calculation, calculation, processing, editing, output, printing, and display.
Information, data, signal values, variable values, and parameters are stored in the main memory, registers, cache memory, and buffers during the CPU operations of extraction, search, reference, comparison, calculation, processing, editing, output, printing, and display. It is temporarily stored in a memory or the like.
In addition, the arrows in the flowchart described in this embodiment mainly indicate input / output of data and signals.
Data and signal values are recorded on a recording medium such as a memory of the RAM 914, a flexible disk of the FDD 904, a compact disk of the CDD 905, a magnetic disk of the magnetic disk device 920, other optical disks, a mini disk, and a DVD.
Data and signals are transmitted online via a bus 912, signal lines, cables, or other transmission media.

In the description of the present embodiment, what is described as “to part” and “to means” may be “to circuit”, “to device”, and “to device”. It may be “step”, “˜procedure”, “˜processing”.
That is, the “test execution method” according to the present invention can be realized by the steps, procedures, and processes shown in the flowchart described in the present embodiment.
In addition, what is described as “˜unit” and “˜means” may be realized by firmware stored in the ROM 913.
Alternatively, it may be implemented only by software, or only by hardware such as elements, devices, substrates, and wirings, by a combination of software and hardware, or by a combination of firmware.
Firmware and software are stored as programs in a recording medium such as a magnetic disk, a flexible disk, an optical disk, a compact disk, a mini disk, and a DVD.
The program is read by the CPU 911 and executed by the CPU 911.
That is, the program causes the computer to function as “to part” and “to means” in the present embodiment. Alternatively, the procedures and methods of “˜unit” and “˜means” of the present embodiment are executed by a computer.

As described above, the test execution apparatus 100 shown in this embodiment includes a CPU as a processing device, a memory as a storage device, a magnetic disk, etc., a keyboard as an input device, a mouse, a communication board, etc., a display device as an output device, a communication board, etc. It is a computer provided with.
As described above, the functions indicated as “˜unit” and “˜means” are realized by using these processing devices, storage devices, input devices, and output devices.

  100 test execution device, 101 data collection unit, 102 data analysis unit, 103 data management unit, 104 data transmission / reception unit, 105 real environment sequence storage unit, 106 test environment sequence storage unit, 107 input data generation unit, 108 sequence reading unit, 109 Input data determination unit, 110 Real environment sequence storage buffer, 111 Test environment sequence storage buffer, 113 Input data storage buffer, 112 Read sequence storage buffer, 200 Real environment, 201 Test target system, 202 Switch, 203 Other IT system, 300 test environment, 301 system under test, 302 switch.

Claims (8)

A test of the second data processing system using the input data and the output data in the first data processing system in parallel with the operation of the first data processing system in which proper processing is confirmed to be performed. A test execution device for performing
An input / output sequence of input data and output data during normal operation of the first data processing system is shown as a normal sequence, and an input / output sequence of input data and output data when an error occurs in the first data processing system A sequence information storage unit for storing sequence information indicated as an error time sequence;
A first communication unit that receives input data input to the first data processing system as first system input data and receives output data output from the first data processing system as first system output data When,
Of the first system input data received by the first communication unit, the first system input data designated as a transmission target is transmitted as second system input data to the second data processing system, and the second system input A second communication unit for receiving a response to the data as second system output data;
Based on the first system input data, the first system output data, and the sequence information, it is determined whether the input / output sequence in progress in the first data processing system is a normal sequence or an error sequence In addition, based on the second system input data, the second system output data, and the sequence information, the input / output sequence in progress in the second data processing system is either a normal sequence or an error sequence. The second data processing system transmits the second system input data to the second data processing system based on the determination result for the first data processing system and the determination result for the second data processing system. 1 It has an input data specification part that specifies system input data. Test execution device according to claim. The test execution device further includes:
An input data storage buffer for storing first system input data;
The input data designating unit is
An input / output sequence progressing in the first data processing system and an input / output sequence progressing in the second data processing system when the first system input data is received by the first communication unit; If both are normal sequence, the first system input data received by the first communication unit is designated as a transmission target to the second data processing system,
When the first system input data is received by the first communication unit, the input / output sequence proceeding in the first data processing system is a normal sequence, and proceeds in the second data processing system. When the input / output sequence is an error sequence, the first system input data received by the first communication unit is stored in the input data storage buffer;
Received by the first communication unit when the first system input data is received by the first communication unit and the input / output sequence in progress in the first data processing system is an error sequence. The test execution apparatus according to claim 1, wherein the first system input data is discarded. The input data designating unit is
Received by the second communication unit when the second system output data is received by the second communication unit and the input / output sequence in progress in the second data processing system is a normal sequence. The first system input data following the first system output data corresponding to the second system output data is identified based on the normal sequence, and the corresponding first system input data is stored in the input data storage buffer. Determine whether or not
When the corresponding first system input data is stored in the input data storage buffer, the first system input data stored in the input data storage buffer is designated as a transmission target to the second data processing system. And
Received by the second communication unit when the second system output data is received by the second communication unit and the input / output sequence in progress in the second data processing system is an error sequence. Determining whether or not the first system input data subsequent to the first system output data corresponding to the second system output data is included in the error sequence;
When the corresponding first system input data is included in the error sequence, the corresponding first system input data is generated, and the generated first system input data is set as a transmission target to the second data processing system. Specify
When the corresponding first system input data is not included in the error sequence, the second communication unit in the normal sequence before the input / output sequence in the second data processing system becomes the error sequence. If the last processed data is the second system input data, the corresponding second system input data is acquired, and the acquired second system input data is designated as a transmission target to the second data processing system. The test execution device according to claim 2. The sequence information storage unit
Stores sequence information indicating multiple types of normal sequence and multiple types of error sequence,
The input data designating unit is
It is determined whether the input / output sequence in progress in the first data processing system is one of a plurality of types of normal sequence or a plurality of types of error sequence, and progresses in the second data processing system The test execution apparatus according to claim 1, wherein the input / output sequence being determined is one of a plurality of normal sequences and a plurality of error sequences. The test execution device includes:
In parallel with the operation of the first data processing system that communicates input data and output data with a plurality of communication destination devices and advances the processing for each communication destination device, the plurality of communication destination devices are emulated, A test execution device for causing the data processing system to proceed with the process for each emulated communication destination device and performing a test of the second data processing system;
The input data designating unit is
For each communication destination device, group the first system input data, the first system output data, the second system input data, and the second system output data,
Based on the grouped first system input data and first system output data and the sequence information, the input / output sequence in progress in the first data processing system is a normal sequence and an error sequence for each communication destination device. In addition, based on the grouped second system input data, second system output data, and the sequence information, each communication destination device is proceeding with the second data processing system. Determine whether the output sequence is a normal sequence or an error sequence,
Based on the determination result for the first data processing system and the determination result for the second data processing system, each communication destination device transmits the second system input data to the second data processing system. The test execution device according to claim 1, wherein the first system input data is designated. The input data designating unit is
When the first system input data is received by the first communication unit and when the first system output data is received, the input / output sequence proceeding in the first data processing system is normal. Determine whether it is a sequence or an error sequence,
When the second system output data is received by the second communication unit, it is determined whether the input / output sequence in progress in the second data processing system is a normal sequence or an error sequence The test execution device according to any one of claims 1 to 5, wherein In parallel with the operation of the first data processing system in which proper processing is confirmed to be performed by the computer, the second data processing is performed using the input data and the output data in the first data processing system. A test execution method for performing a test of a system,
In the computer, an input / output sequence of input data and output data during normal operation of the first data processing system is shown as a normal sequence, and input data and output data when an error occurs in the first data processing system A sequence information storage step for storing sequence information in which the input / output sequence of the error sequence is indicated as an error sequence
The computer receives input data input to the first data processing system as first system input data, and receives output data output from the first data processing system as first system output data. 1 communication step;
The computer transmits first system input data designated as a transmission target among the first system input data received in the first communication step to the second data processing system as second system input data, A second communication step of receiving a response to second system input data as second system output data;
Based on the first system input data, the first system output data, and the sequence information, the computer inputs / outputs the sequence that is proceeding in the first data processing system in either a normal sequence or an error sequence. And determining whether or not the input / output sequence in progress in the second data processing system is a normal sequence and an error sequence based on the second system input data, the second system output data, and the sequence information. And the second data processing system as the second system input data based on the determination result for the first data processing system and the determination result for the second data processing system. Input data that specifies the first system input data to be sent to Test implementation method characterized by having a designation step. A test of the second data processing system using the input data and the output data in the first data processing system in parallel with the operation of the first data processing system in which proper processing is confirmed to be performed. On the computer that implements
An input / output sequence of input data and output data during normal operation of the first data processing system is shown as a normal sequence, and an input / output sequence of input data and output data when an error occurs in the first data processing system A sequence information storage step for storing sequence information indicated as a sequence at the time of error,
A first communication step of receiving input data input to the first data processing system as first system input data and receiving output data output from the first data processing system as first system output data When,
The first system input data designated as the transmission target among the first system input data received by the first communication step is transmitted as the second system input data to the second data processing system, and the second system input A second communication step of receiving a response to the data as second system output data;
Based on the first system input data, the first system output data, and the sequence information, it is determined whether the input / output sequence in progress in the first data processing system is a normal sequence or an error sequence In addition, based on the second system input data, the second system output data, and the sequence information, the input / output sequence in progress in the second data processing system is either a normal sequence or an error sequence. The second data processing system transmits the second system input data to the second data processing system based on the determination result for the first data processing system and the determination result for the second data processing system. 1 Input data specification step for specifying system input data Program characterized thereby.

Images