JP2006059108A - Support system for development test of information system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a support system for development test of information system capable of easily detecting a failure on software configuration and easily performing development verification of software. <P>SOLUTION: This system comprises a development test support database having model systems developed in the past, and test programs and test evaluation data corresponding thereto; a system template having a sample software group used in a system model; a test controller combining software of a test object with sample software to construct a system of a test object, and generating a test program based on proven test programs; and an evaluation verification system generating comparison data of the execution result of a system of a new test object with the test evaluation data of the system model. According to this, the failure on software configuration of the system of the test object can be easily detected. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to an information system development test support system that supports the development test of an information system in the Web 3-level hierarchy and improves its efficiency.

  It is positioned between the front end (client) such as a Web browser used by the user and the back end such as a database management system, and has a function of accepting a request from the user and bridging the processing of a business system such as a database. There is a Web three-tier system provided with an application server, which is easy to change, update, and enhance the system, has high flexibility, and is widely used in business systems and the like.

  In addition, as a conventional information system development test support system in the Web 3-level hierarchy, there is a system in which a test command is simultaneously sent from a plurality of clients to an application object to be tested and its execution response time is measured (for example, Patent Document 1). reference). When the execution response time is abnormally long and unusable, a bottleneck analysis can be performed to improve the execution response time.

JP2003-271418A (5th page, FIG. 1)

  However, the prior art has the following problems. If the cause of the abnormally long execution response time is due to server performance or network performance, the cause is relatively easy to find. However, if the previous cause is caused by a defect in the software configuration, much effort is required to analyze the cause. In particular, in the case where each layer has various software structures, such as a Web three-layer software system, and each software is componentized, it takes time to analyze the cause.

  In general, a test command for measuring the execution response time is generated in various forms according to the configuration of the software based on the experience and intuition of the person who performs the analysis. Then, the person who performs the analysis proceeds with the analysis by trial and error while looking at the result, and extracts problems. As described above, the conventional analysis method depends on the experience and intuition of the person performing the analysis and needs to be performed by trial and error.

  Further, in software development that can achieve extremely high performance, the software configuration and some software functions often include technology specific to the developer. However, the contents of the software are difficult to understand except for the person who developed it, and when other developers try to realize the same function, the previous know-how is not utilized and development of different contents is to be performed. May cause performance problems.

  The present invention has been made to solve the above-described problems, and it is an object of the present invention to obtain an information system development test support system that can easily detect software configuration defects and can easily perform software development verification. Objective.

  An information system development test support system according to the present invention is an information system development for supporting system development of software applied to a Web three-tier system including a Web server and an application server located between a client terminal and a database server. A test support system, which is a system model in which software functions and usage patterns of servers suitable for the software functions are associated, a test program for evaluating the performance of software corresponding to the system model, and test evaluation of the test program for the system model The development test support database in which data is stored, the system template in which a sample software program including system model sample programs and sample data is stored, and an inspection input based on operation input. A sample program and sample data corresponding to the system model that matches the test target software are extracted from the system template based on the function to extract the system model that matches the software of the development test support database and the operation input. A function to generate the test target system by incorporating the test target software into the data, and a test program corresponding to the system model is extracted from the development test support database based on the operation input, and the extracted test program is edited. When evaluating a test target system using a test program based on a function for generating a new test program suitable for the test target system and an operation input, a Web server, an application A function for generating a verification module for monitoring the response time and input / output operation of each of the software executed by the application server and the database server, and the system to be tested and verification for the Web server, application server, and database server A test controller having a function for mounting a module and a function for mounting a generated new test program on each client terminal, and a new test program is executed on each client terminal, so that a verification module of each server An evaluation verification system that receives collected data as execution results, extracts test evaluation data corresponding to a system model that matches the software under test from the development test support database, and generates comparison data between the execution results and test evaluation data. It is equipped with

  According to the present invention, the construction of a test target system for evaluating the performance of the test target software by utilizing the software, test program, and test evaluation data that have a proven record in the system model that matches the test target software; By generating the test program, it is possible to obtain an information system development test support system that can easily detect defects in the software configuration and can easily perform software development verification.

  DESCRIPTION OF EXEMPLARY EMBODIMENTS Hereinafter, preferred embodiments of an information system development test support system of the invention will be described with reference to the drawings.

Embodiment 1 FIG.
FIG. 1 is an overall configuration diagram including an information system development test support system according to Embodiment 1 of the present invention. The development test support system 10 and the development system 20 are connected to each other via a network 30.

  The development test support system 10 supports a software development test, and includes a development test support database 11, a system template 12, a test controller 13, an evaluation verification system 14, and a plurality of client terminals 15.

  The development system 20 includes three types of servers: a Web server 21, an application server 22, and a database server 23. Each server is equipped with a verification module 24 that can perform performance evaluation of the software together with the software to be executed.

  The development test support database 11 is a database in which system model data is accumulated. This system model associates a software function to be realized with a usage form of each server suitable for the software function. The Web three-tier system in the first embodiment includes a client, a Web server, an application server, and a database server, and the realized functions are configured by a combination of various software configurations.

  Here, in order to efficiently realize the software function of the development system, it is important to determine which server should be assigned various software as its usage form, and is stored in the development test support database 11. The most suitable system model is selected based on past experience.

  As a specific example of the system model, for example, the database server 23 extracts necessary data from a large amount of data, performs data processing on the data extracted by the application server 22, and provides necessary information to the client terminal. A model of business application software consisting of multiple programs.

  Further, the development test support database 11 stores a test program necessary for system test verification of the system model, and test verification data when the test verification is performed using this test program in association with the system model.

  The system template 12 stores standard sample software groups used in the system models corresponding to various system models developed in the past, and includes sample programs and sample data. As an example of this standard sample software group, a program that is installed on the database server 23 and extracts necessary data from a large amount of data, and installed on the application server 22 and performs data processing on the extracted data, and the client Examples include programs that provide information necessary for the terminal, and data used for evaluation of these programs.

  The sample software is software for realizing a part of the functions executed in the system model, and does not necessarily correspond one-to-one with the system model, but is a sample program or sample commonly used in a plurality of system models. It can be data.

  The test controller 13 constitutes a test target system including a test target program, edits and generates a test program suitable for the system, and assigns a necessary program to each server.

  Specifically, the test controller 13 extracts from the development test support database 11 a system model selected by the user as a system model that matches the software function and usage form of the program to be tested, and this extracted system model The sample software used in the above is taken out from the system template 12.

  Further, the test controller 13 embeds a test target program in a part of the extracted sample software based on the user's operation to configure a test target system. That is, a test target system corresponding to the Web three-tier system is configured by incorporating test target software to be verified as part of sample software that already has test / verification data and has a track record.

  Each program included in the system configured as described above is divided into a client terminal 15 on the development test support system 10, a Web server 21 on the development system 20, an application server 22, and a database server 23. .

  The test controller 13 extracts a test program corresponding to the previously extracted system model from the development test support database 11, and based on the operation of the user, the test target system including the test target program while referring to the test program Create a new test program for The created new test program is sent to each client terminal 15.

  Furthermore, the test controller 13 creates a verification module 24 for monitoring the response time and input / output operation at each server when a new test program is executed based on the user's operation. Send.

  By following these procedures, the test target system for the test target program currently being developed, and the test program for verifying the system, sample software that has already been proven, and verification of the sample software It can be created based on the test program used for.

  The evaluation verification system 14 evaluates a system to be tested. The evaluation verification system 14 receives the execution result of the new test program for the test target system from the verification module 24 of each server. Further, the evaluation verification system 14 extracts test evaluation data associated with the previously extracted system model from the development test support database 11 as performance data. And the evaluation verification system 14 compares the execution result of a new test program, and performance data, produces | generates comparison data, and evaluates the system used as the test object.

  The plurality of client terminals 15 receive a test program from the test controller 13 and execute a test of a system to be tested. By generating the test program from each client terminal 15 a plurality of times at the same time, it is possible to perform a performance test in consideration of the load state.

  Next, each server on the development system 20 side will be described. The Web server 21 has a function of executing a program in response to a request from the client terminal 15 or executing transaction processing in cooperation with the application server 22 and the database server 23, and the execution result is transmitted via the network 30. Server that transmits to the client terminal 15.

  The application server 22 has a program execution environment, a connection function to the database server 23, a transaction management function that links a plurality of processes, and the like, and is a server that controls the flow of business processes.

  The database server 23 is a server that manages data shared by a plurality of application software or users.

  Next, specific processing will be described with reference to FIG. FIG. 2 is a diagram showing a processing flow of the information system development test support system in Embodiment 1 of the present invention. An example of business application software that extracts necessary data from a large amount of data by the database server 23, performs data processing on the previously extracted data by the application server 22, and provides necessary information to the client terminal 15 will be described.

  It is assumed that the business processing program developed this time has the following conditions and functions. First, the database server 23 stores data consisting of very large m rows associated with the attributes of A, B, C,..., J,. In the following description, this data is referred to as Table 1. Then, data satisfying the set conditions A, B, and C is extracted from the m rows of data in Table 1, and J and T corresponding to this data are extracted. In the following description, data consisting of A, B, C, J, and T is referred to as Table 2. Furthermore, it is assumed that a value F (J, T) obtained by performing a certain process on J and T in Table 2 is obtained and the statistical process is performed.

  As a result of selecting and extracting a system model corresponding to such a business processing program from the development test support database 11, software configurations suitable for a newly developed business processing program include programs 1 and 2 as shown in FIG. Assume that is required. That is, it can be seen that the user needs to develop the program 1 and the program 2 from the system model corresponding to the newly developed business processing program.

  Specifically, the program 1 is executed on the database server 23, checks the values of A, B, and C for each row of data in Table 1 for each row, and only those that meet the conditions are p1, .., Pm is selected, and the values of J and T associated therewith are extracted to generate the data in Table 2. The program 1 is written in a language such as SQL (Structured Query Language).

  The program 2 is executed on the application server 22 and transfers the data in Table 2 to the application server 22 to obtain F (J, T) which is a function of J and T. Statistical processing is performed. This process is performed while sending the processing result to the client terminal 15 in cooperation with the operator's instruction for the screen displayed on the client terminal 15 and displaying it on the screen.

  Furthermore, it is assumed that the sample software stored in the system template as already proven in correspondence with the system model is the sample program S1, the sample program S2, and the sample data SDATA. FIG. 3 is a diagram showing the relationship between the development target program and the sample program in the first embodiment of the present invention. This sample program S1 is common to the program 1 to be developed this time in that specific data is extracted from a huge amount of data (in this case, sample data SDATA consisting of z rows). It is assumed that the extraction conditions are different from those of program 1.

  Further, the sample program S2 is common to the program 2 to be developed this time in that the extracted data is subjected to arithmetic processing, but the data used in the arithmetic processing or the processing content is different from the program 2. Assuming that Specifically, the sample program S1 in FIG. 3 is a program for extracting data consisting of A, T, U, and X from SDATA, and the sample program S2 is G (U, X) is obtained, and further G (U, X) statistical processing is assumed.

  It is originally desirable that the program 1 and the program 2 to be developed this time should be created by utilizing the proven sample program S1 and sample program S2. However, the software including past know-how accumulated in the system template (in this case, sample program S1, sample program S2, and sample data SDATA) is quite effective except for the person who developed it. It is difficult to use for the development of new software that cannot be understood and some functions can be diverted, and when evaluating and verifying the developed software, the functions and configuration are compared with those of the past. It often happens that it is very difficult to do.

  Therefore, in the present invention, under such circumstances, the performance evaluation of the program 1 and the program 2 that must be newly developed is compared with the evaluation data of the sample software that has already been proven. It easily detects the performance deterioration factor due to the above defect.

  In order to perform such performance evaluation, the test controller 13 uses the sample program S1, the sample program S2, and the sample data SDATA as a system template as sample software corresponding to the selected system model based on the user's operation. Remove from 12.

  Further, the test controller 13 combines the extracted sample program S1, sample program S2, and sample data SDATA with the developed program 1 and program 2 based on the user's operation to configure a system to be tested. . FIG. 4 is a diagram showing a configuration of a test target system according to Embodiment 1 of the present invention. Specifically, the program 1 and the program 2 are incorporated in place of the sample program S1 and the sample program S2. Further, in order to adapt the sample data SDATA to this embedded system, the number of rows of the sample data SDATA is changed to m and the items are changed to A to T. New data NEWDATA that is equivalent to the data is generated.

  The newly generated data NEWDATA can be used to evaluate the program 1 and the program 2. Furthermore, since the generated data NEWDATA is generated based on the sample data SDATA used for the evaluation of the sample program S1 and the sample program S2 with a track record, it is possible to evaluate the performance based on equivalent data.

  As a result of such processing, a test target system composed of the program 1, the program 2, and the data NEWDATA is configured. Then, the test controller 13 sends the program 1 and the data NEWDATA to the database server 23 that is the installation destination. Further, the test controller 13 sends the program 2 to the application server 22 that is the installation destination.

  Next, the test controller 13 supports the development test of the test program corresponding to the previously extracted system model and the test evaluation data as the evaluation result in order to perform the system test verification of the newly configured test target system. Retrieved from the database 11. Further, the test controller 13 refers to the extracted test program on the basis of the user's operation, and for the test target system including the developed program as a test program having the same function as the test program. Create a new test program. Then, the test controller 13 sends the created test program to the plurality of client terminals 15.

  Further, the test controller 13 creates a verification module 24 for monitoring the response time and input / output operation of the program 1 and the program 2 according to the execution of the new test program based on the operation of the user, The verification module 24 is sent to the database server 23, the application server 22, and the Web server 21.

  The plurality of client terminals 15 execute the test program. By setting up a test program to be executed multiple times from the same client, it is possible to perform a test that meets the load conditions. At this time, the verification module 24 mounted on the Web server 21, application server 22, and database server 23 monitors the execution time of the program on each server and delivery with other programs, and evaluates the execution result in the evaluation verification system 14. Send to.

  The evaluation verification system 14 receives the execution result of the new test program for the test target system from the verification module 24 of each server. Furthermore, the evaluation verification system 14 compares the test evaluation data extracted previously with the data of the current execution result, generates comparison data, and evaluates the system that is the test target. Specific evaluation can be performed as follows.

  If the developer of the program 1 developed this time is different from the proven developer of the sample program S1 accumulated in the system template 12, the know-how for realizing high-speed processing is not utilized. It is considered that a problem occurs in the process of extracting data that meets the conditions from the data NEWDATA, and the processing time in the database server 23 is significantly deteriorated as compared with the test evaluation data with a track record.

  Similarly, if the developer of the program 2 developed this time is different from the developer of the sample program S2 that has been accumulated in the system template 12 and the execution format of the statistical processing program is defective, the application server 22 It is considered that the execution time and the exchange of data with the client terminal 15 are significantly deteriorated as compared with the test evaluation data with a track record.

  In this manner, based on the comparison data generated from the proven test evaluation data and the execution result, the user can compare the newly developed program 1 or program 2 with the data compared to the proven sample program. It is easy to evaluate whether there are any inefficiencies in exchanges or processing transfers. Based on the structural evaluation data of the software obtained by the verification module, it is possible to easily grasp the structural defects of the newly developed programs 1 and 2.

  The sample software including past know-how accumulated in the system template cannot be easily understood except for the person who developed it, and it is difficult to understand the contents, effects, etc. Also, it is difficult to use the software, and it is extremely difficult to compare the functions and configurations with those of the past when evaluating and verifying the developed software.

  However, even when it is difficult to convey detailed know-how inside the software, it is relatively easy to leave the sample software, the test program, and the test evaluation data. Therefore, by accumulating the sample software of proven software and its test evaluation data, it is possible to easily carry out evaluation verification of a program newly developed for a similar system model.

  According to the first embodiment, a part of software templates, test programs, and test data with past results are used, and a test program for a newly developed program is created and a performance evaluation test is performed. Thus, it is possible to obtain an information system development test support system that can easily detect defects in the software configuration.

  Although the case where the program 1 and the program 2 are developed and verified has been described in the first embodiment, the embodiment of the present invention is not limited to this. For example, the present invention can also be applied to a case where only the program 2 is newly developed and the program 1 is diverted. Even when both the program 1 and the program 2 are developed, it is also possible to perform the performance evaluation test by applying the sample program to only one of them in the development process.

Embodiment 2. FIG.
In the first embodiment, the case has been described in which one system model that matches the usage pattern of the development system is registered in the development test support database 11. In the second embodiment, a case will be described in which there are a plurality of system models in the development test support database 11 in FIG.

  For example, in the example of FIG. 2, when the contents of A are expressed as a function and another table is attached thereto, the program 1 is all stored in the database server 23 as in the first embodiment. Instead of executing, it is more efficient to transfer a necessary part to the application server 22 and execute it.

  If there is such a track record in the past, a system model suitable for executing the business management program by the program 1 and the program 2 is configured to execute the program 1 on the database server 23 according to the contents of the item A. There are two types of system models (corresponding to the case of the first embodiment) and system models configured to execute the program 1 on the application server 22.

  In such a case, two system models can be registered in the development test support database 11 by having the content of the item A as a parameter. On the other hand, the user can select a more efficient system model from the two recommended system models in accordance with the content of the item A, and perform system configuration and performance evaluation verification based on the selected system model.

  According to the second embodiment, an information system development test support system that provides a plurality of system models can be obtained according to the difference in data structure to be processed. This makes it possible to select a more efficient system model according to the contents of the data to be processed, and to easily develop a system having a system configuration suitable for the system model and perform a performance evaluation test. .

Embodiment 3 FIG.
In the third embodiment, a system capable of displaying the functions of the system model, the processing contents of the program, the data structure, etc. in an easy-to-understand manner for the user will be described. In order for a user to select an optimal system model or to configure a test target system corresponding to the selected system model, it is important to display the contents of the system model in an easy-to-understand manner to the user. .

  FIG. 5 is a diagram showing a display example of the system model according to Embodiment 3 of the present invention. The development test support database 11 includes, as system model data, for each program included in the system model, functional requirements of the program, input data structure of the program, processing contents of the program, output data structure of the program, program The server type information is installed.

  Based on such system model data, the software structure description of the system model as shown in FIG. 5 can be displayed on the screen, and the user can easily grasp the contents of the system model. Even when it is difficult to convey detailed know-how inside proven software, it is relatively easy to leave a software structure description in a simplified range as shown in FIG.

  According to the third embodiment, the user can easily understand the inside of the system model by using the system model in which the data related to the software structure description is stored. This makes it possible to perform test verification while understanding the flow of the program, and to easily extract the problem.

Embodiment 4 FIG.
In the first embodiment, the case where an information system development test support system is used to support software development in the same organization has been described. In the fourth embodiment, a case will be described in which an information system development test support system according to the present invention is installed in a specific company and used by a customer of the company for verification of a system under development.

  The development test support system shown in FIG. 1 can be connected to a development system of a specific company via a system network. As a result, the system model, test program, and test evaluation data stored in the development test support database 11 and the sample software stored in the system template are utilized even for programs under development at a specific company. Thus, a performance evaluation test can be performed.

  In such an operation, the client terminal 15 can use a client terminal owned by a specific company.

  According to Embodiment 4, the information system development test support system according to the present invention can easily perform a performance evaluation test on a development system that can be connected via a system network. As a result, it is possible to easily detect defects in the software configuration of the developed program, improve the efficiency of customer software development, and perform support projects.

Embodiment 5. FIG.
In the first embodiment, the case where data of different systems developed in the past is used as the system model or sample software has been described. In the fifth embodiment, a case where data at the time of version update of a development system is stored in the same system will be described. The version update time corresponds to, for example, a past development stage or a change stage after delivery.

  In the same system developed in the past, not only the final system data, but also the system model, sample software, test program, and test evaluation data in each stage changed in the adjustment stage or after delivery are stored. Thus, the user can select a suitable data from various data when performing performance evaluation of the system being developed, and can configure the optimum verification system to perform performance evaluation.

  According to the fifth embodiment, by accumulating the system model, sample software, test program, and test evaluation data at the time of version update of the development system, the available performance data increases, and the user can The system to be tested can be configured by selecting the one that suits the current development system, and appropriate performance evaluation can be performed.

Embodiment 6 FIG.
In the fifth embodiment, a case has been described in which data at the time of version update of the development system is stored in the same system. In the sixth embodiment, a case where performance evaluation of a development system is performed based on a plurality of test evaluation data using these data will be described.

  As described in the fifth embodiment, when the test evaluation data in a plurality of stages are accumulated, in addition to selecting one of the test evaluation data, a plurality of test evaluation data are used, By analyzing the data that is changing in, the performance of the development system can be evaluated.

  Specifically, the evaluation verification system 14 receives the execution result from the verification module of each server by executing the test program, and stores other test evaluation data corresponding to the version update from the development test support database 11. Take out. Then, the evaluation verification system 14 can compare the execution result with a plurality of test evaluation data, generate comparison data, identify the changed portion, and present the information to the user.

  According to the sixth embodiment, the performance evaluation of the development system can be performed based on a plurality of performance data by accumulating the test evaluation data at the time of updating the version of the development system. This makes it possible to evaluate the performance of the development system with reference to the test evaluation data improved in the development process or the change process after delivery, etc. It can be detected.

1 is an overall configuration diagram including an information system development test support system in Embodiment 1 of the present invention. It is the figure which showed the flow of the process of the information system development test support system in Embodiment 1 of this invention. It is the figure which showed the relationship between the program of the development object in Embodiment 1 of this invention, and a sample program. It is a figure which shows the structure of the system of the test object in Embodiment 1 of this invention. It is the figure which showed the example of a display of the system model in Embodiment 3 of this invention.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 10 Development test support system, 11 Development test support database, 12 System template, 13 Test controller, 14 Evaluation verification system, 15 Client terminal, 20 Development system, 21 Web server, 22 Application server, 23 Database server, 24 Verification module, 30 network.

Claims (6)

An information system development test support system for supporting system development of software applied to a Web three-tier system including a Web server and an application server located between a client terminal and a database server,
A system model that associates a software function with a usage form of each server suitable for the software function, a test program that evaluates the performance of software corresponding to the system model, and test evaluation data of the test program for the system model An accumulated development test support database;
A system template in which a sample software group including a sample program and sample data of the system model is stored;
A function for retrieving from the development test support database a system model that conforms to the software to be inspected based on the operation input, and a sample program and sample data corresponding to the system model that conforms to the software to be tested based on the operation input A test program corresponding to the system model based on operation input and a function for generating a test target system by incorporating the test target software into the sample program and sample data. A function for generating a new test program suitable for the system under test by editing the test program extracted from the test support database, and the test program based on the operation input A function for generating a verification module for monitoring each response time and input / output operation of software executed by the Web server, the application server, and the database server when using the system under test to evaluate the Web; A test controller having a function of mounting the system to be tested and the verification module on a server, an application server, and a database server, and a function of mounting the generated new test program on each client terminal;
When the new test program is executed on each client terminal, data collected by the verification module of each server is received as an execution result, and test evaluation data corresponding to a system model that matches the software to be tested is An information system development test support system comprising: an evaluation verification system that extracts data from a development test support database and generates comparison data between the execution result and the test evaluation data. In the information system development test support system according to claim 1,
The development test support database is an information system development test support system in which a plurality of system models are stored in accordance with the amount of data to be processed as a usage form of each server suitable for the software function. In the information system development test support system according to claim 1 or 2,
The development test support database includes, as system model data, function requirements, input data structure, processing contents, output data structure, and information on a server type on which the program is mounted, for each program included in the system model. An information system development test support system characterized by In the information system development test support system according to any one of claims 1 to 3,
The development test support database stores respective system models, test programs, and test evaluation data corresponding to the version update of the development system,
An information system development test support system, wherein the system template stores a sample software group including each sample program and sample data corresponding to the version update of the development system. In the information system development test support system according to claim 4,
The evaluation verification system extracts test evaluation data at the time of version update from the development test support database together with test evaluation data corresponding to a system model compatible with the software to be tested, and extracts the execution results and the plurality of test evaluations extracted. An information system development test support system characterized by generating comparison data with data. An information system development test for supporting system development of an external system by connecting the information system development test support system according to any one of claims 1 to 5 to the external system via a network Support system.

Images