CN104182333A - Performance testing method and equipment - Google Patents
Performance testing method and equipment Download PDFInfo
- Publication number
- CN104182333A CN104182333A CN201310195624.9A CN201310195624A CN104182333A CN 104182333 A CN104182333 A CN 104182333A CN 201310195624 A CN201310195624 A CN 201310195624A CN 104182333 A CN104182333 A CN 104182333A
- Authority
- CN
- China
- Prior art keywords
- application software
- performance test
- performance
- measured
- result
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000012360 testing method Methods 0.000 title claims abstract description 79
- 238000013515 script Methods 0.000 claims abstract description 13
- 238000011056 performance test Methods 0.000 claims description 129
- 238000000034 method Methods 0.000 claims description 40
- 230000001960 triggered effect Effects 0.000 claims description 16
- 238000009530 blood pressure measurement Methods 0.000 abstract 2
- 230000008569 process Effects 0.000 description 22
- 230000004044 response Effects 0.000 description 19
- 230000006870 function Effects 0.000 description 17
- 230000008859 change Effects 0.000 description 12
- 238000010586 diagram Methods 0.000 description 12
- 238000004590 computer program Methods 0.000 description 7
- 238000012545 processing Methods 0.000 description 6
- 238000005516 engineering process Methods 0.000 description 5
- 238000012986 modification Methods 0.000 description 5
- 230000004048 modification Effects 0.000 description 5
- 238000003860 storage Methods 0.000 description 5
- 230000007547 defect Effects 0.000 description 4
- 230000003287 optical effect Effects 0.000 description 3
- 230000032683 aging Effects 0.000 description 2
- 230000000052 comparative effect Effects 0.000 description 2
- 230000007423 decrease Effects 0.000 description 2
- 230000018109 developmental process Effects 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000012544 monitoring process Methods 0.000 description 2
- 238000003825 pressing Methods 0.000 description 2
- 241000931705 Cicada Species 0.000 description 1
- 230000002159 abnormal effect Effects 0.000 description 1
- 238000004458 analytical method Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 238000011156 evaluation Methods 0.000 description 1
- 230000000977 initiatory effect Effects 0.000 description 1
- 238000012423 maintenance Methods 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000002265 prevention Effects 0.000 description 1
- 238000012163 sequencing technique Methods 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 230000007704 transition Effects 0.000 description 1
Landscapes
- Debugging And Monitoring (AREA)
- Stored Programmes (AREA)
Abstract
The invention discloses a performance testing method and performance testing equipment. The performance testing method comprises the main contents that aiming at each application software, performance testing parts are created in advance; the performance testing parts comprise testing scripts and operating environment parameters, which are required when the application software is subjected to pressure measurement; when the application software needs to be tested, the performance testing parts can be directly called to establish a testing scene and the application software is subjected to pressure measurement; a testing environment does not need to be manually created; efficiency of testing the application software can be effectively improved; even though under the condition that the application software has high updating efficiency, performance of the application software also can be timely tested by utilizing the scheme adopted by the embodiment of the invention; the problem of runtime exception, which is caused by delay of performance testing, of the application software is avoided.
Description
Technical field
The present invention relates to field of computer technology, relate in particular to a kind of performance test methods and equipment.
Background technology
After applied software development, the software code of application software will be in Website server on-line running, user can Website login server and the application service of using the software code of operation to provide." checking product details " this application software (the follow-up application software A that is referred to as) in shopping website of take is example, the software code of application software A moves in the server of shopping website, user logins after this server, can call this application software A by the input interface on the page (as " details " button on the page), to obtain the application service of checking a certain product details.
After applied software development operation, still need constantly this application software to be safeguarded, upgraded, such as: increasing function, the change existing function of application software of application software or delete the existing function of application software etc., is by more newly arriving of the software code of application software realized to the maintenance of application software, renewal." checking product details " this application software A of still take is example, in order to increase to user, provide " crowd's age of buying product " this function, the software code of " buying crowd's age of product " this son application can be distributed in the software code of application software A to the software code of the application software A after being upgraded.While moving the software code of the application software A after upgrading in the server of shopping website, when user moves application software A, can check " crowd's age of purchase product " this content in product details.
In fact, in large-scale business website, moving the software code of several application software in Website server, for arbitrary application software, its renewal frequency is very high, even can reach the renewal frequency of annual tens thousand of times.High-frequency renewal like this is changed larger possibly to the software code of application software, therefore need test the performance of application software, judges the son application of issuing when which renewal of execution operates the performance of application software has been caused to obvious impact.
At present, the performance test mode of application software is mainly contained to following two kinds:
Mode one:
By the performance of the application software of moving in server is monitored in real time, to judge, whether each renewal of this application software has been caused to impact to the performance of application software.For example, in real time the system overhead of application software A is monitored, when monitoring out the system overhead generation significant change of application software A, definite the last time has been caused impact on the renewal operational correspondence of application software A by the performance of software A.
Mode one can realize the performance test to application software more easily, but, while moving under real environment due to application software, the variation of its performance can be subject to network topology environment or the variable effect of flowing of access, that is to say, when the performance of monitoring out application software is affected, not necessarily the renewal process of application software is caused, therefore the monitored results of, utilizing mode one to obtain is inaccurate.
Mode two:
By being the software code dry run environment of the application software after each renewal, to test this operation of renewal on application software and whether the performance of application software has been caused to impact, specific practice as shown in Figure 1, mainly comprises following flow process:
The first step: carry out and upgrade after operation at the software code to application software, whether assessment needs to carry out performance test.
Industry is generally referred to as trunk code by application software software code of on-line running in server, in this step, the software code of carrying out the son application of issuing when renewal operates is integrated into after trunk code, can assess the trunk code after upgrading, judge whether to carry out performance test to the trunk code after upgrading.
Concrete assessment is according to being: when this to the content update of trunk code many or upgrade after trunk code occur during in operation when abnormal, can think and need to carrying out performance test processing.
Second step: manual creation test scene.
In this step, the function that need test according to application software to be measured, creates respectively test scene, as the performance need test of the function 1 of application software A and function 2, for function 1 and function 2, create two test scenes respectively.
The test scene of take for function 1 is example, and the constructive process of this test scene is comprised to following operation:
First generating the test script of calling function 1, is then the operational process configuration operation environmental parameter of function 1, as parameters such as test duration, test pressures (parallel trigger quantity), to create the test scene for function 1.
The 3rd step: the trunk code of application software to be measured is pressed to survey under the test scene creating.
In this step, the trunk code of application software to be measured is the trunk code after this application software last update.
The 4th step: press the history run result of surveying result and statistics to compare this, determine whether this operation of renewal to application software impacts its performance, and report test result.
Mode two can reflect the influence degree that the renewal operational correspondence of application software is caused by the performance of software to a certain extent, but, manual creation test scene need to expend a large amount of time, particularly in the situation that upgrading operation annual tens thousand of times, for each renewal operation, all want manual creation test environment, can cause testing efficiency low, after software code after renewal moves on line, can not to its performance impact, test immediately, may occur that application software performance upgraded the excessive and problem of reporting to the police of operating influence.
Summary of the invention
The embodiment of the present application provides a kind of performance test methods and equipment, in order to solve the existence problem low to the testing efficiency of application software in prior art.
A performance test methods, described method comprises:
From performance test storehouse, choose the performance test part associated with application software to be measured, in described performance test part, comprise test script and running environment parameter;
The described performance test part that utilization is chosen is pressed survey to the trunk code of described application software to be measured;
Pressure survey result and setting threshold are compared, determine the performance of described application software to be measured.
A performance test apparatus, described equipment comprises:
Test block is chosen module, for choose the performance test part associated with application software to be measured from performance test storehouse, comprises test script and running environment parameter in described performance test part;
Press and survey module, for utilizing the described performance test part of choosing to press survey to the trunk code of described application software to be measured;
Performance determination module, for pressure survey result and setting threshold are compared, determines the performance of described application software to be measured.
The application's beneficial effect is as follows:
In the scheme of the embodiment of the present application, by creating performance test part for each application software in advance, make when needs are tested application software, directly invocation performance test block builds test scene and application software is pressed to survey, and without manual creation test environment, can effectively improve the testing efficiency to application software.
Accompanying drawing explanation
Fig. 1 causes the testing process schematic diagram of performance impact to the renewal operation of application software in background technology;
Fig. 2 is the schematic diagram of the embodiment of the present application one performance test block;
Fig. 3 carries out the method step schematic diagram of performance test to application software in the embodiment of the present application two;
Fig. 4 is that the embodiment of the present application two performance accumulative totals affect schematic diagram;
Fig. 5 is that the embodiment of the present application two performance accumulative total impacts are compared schematic diagram with baseline result;
Fig. 6 is the structural representation of the embodiment of the present application three performance testing apparatuss.
Embodiment
In the scheme of the embodiment of the present application, for each application software, create performance test part in advance, test script and running environment parameter required when application software is pressed to survey in described performance test part, have been comprised, when needs are tested application software, directly invocation performance test block builds test scene and application software is pressed to survey, obtains the performance test results to this application software.
Due in the scheme of the embodiment of the present application without manual creation test environment, but directly call the performance test part having created, build test scene, can effectively improve the testing efficiency to application software, even in the situation that application software renewal frequency is high, utilize the scheme of the embodiment of the present application also can to the performance of application software, test in time, avoid causing due to performance test delay the problem of application software operation exception.
It should be noted that, the embodiment of the present application be take and an application software to be measured is carried out to performance test is described as example, but the scheme of the embodiment of the present application is also not limited to walk abreast the performance of a plurality of application software to be measured is tested, identical for the test mode of each application software to be measured.
Below in conjunction with specific embodiment, the application's scheme is described in detail.
Embodiment mono-:
The embodiment of the present application one has been described a kind of scheme that creates performance test part, and application software is being carried out carrying out before performance test, comprises the following steps:
The first step: be the performance test part Resources allocation creating.
In this step, can be performance test part Resources allocation to be created, as being performance test part memory allocated space etc.
Second step: in the performance test part creating, generate this performance test part and its for application software between incidence relation.
Because performance test part creates for a certain application software, therefore, can set up the incidence relation between this performance test part and this application software, that is: in performance test part, record the sign of the application software with incidence relation.
On the one hand, the performance test that performance test block can be at least one application software provides service, and therefore, a performance test block can be set up incidence relation with at least one application software; On the other hand, the test environment of an application software need be built by least one performance test part, and therefore, an application software can be set up incidence relation with at least one performance test part.
The 3rd step: generate test script and the running environment parameter for associated application software in the performance test part creating.
" checking product details " this application software A of take is example, the test script creating is " calling application software A; initiate to check the request of product details ", generate the request of survey of pressing, if calling the path of application software A is www.aliexpress.com, the pressure generating is surveyed request for calling www.aliexpress.com.
The running environment parameter creating can comprise presses survey time (as 15 minutes), concurrent user number (request of initiating to check product details as parallel in 10 users) etc.
The 4th step: generate the triggered time in the performance test part creating.
This step is the preferred steps that creates performance test part, the described triggered time can be considered the working time of this performance test part, that is: the trigger condition of the application software performance test associated with this performance test part, when the triggered time arrives, this performance test part can move automatically, for application software is built test environment, the performance of application software is tested.
For example: if the triggered time is 8:00 and 20:00, expression is when 8:00 or 20:00 arrival, the trunk code can Automatically invoked at current time with the application software of incidence relation, and automatic compiling build test environment, utilize test script and running environment parameter to press survey to the trunk code calling.
As shown in Figure 2, wherein, test script (as pressed the request of survey) and running environment parameter (as pressed survey time, concurrent user number) are the key elements of pressing survey process to the content schematic diagram of the performance test part obtaining by above four steps establishments; Triggered time is to trigger to press the condition of surveying as optional parameter, is used to specify performance test part and when moves; The incidence relation of performance test part and application software shows which application software performance test part belongs to, thereby can when a certain application software is carried out to performance test, choose suitable performance test part.
The present embodiment one not to above second and third, the sequencing of four steps limits, can carry out in any order above-mentioned three steps and generate corresponding parameter, or above-mentioned three steps of executed in parallel generate corresponding parameter.
Utilize the scheme of above-described embodiment one to create after performance test part, a plurality of performance test parts form performance test library.In the time need to testing the performance of a certain application software, can first automatically choose performance test part, then automatically perform the performance test part of choosing, last automatic analysis test result, complete the performance test process to application software, specific practice is referring to embodiment bis-.
Embodiment bis-:
As shown in Figure 3, for application software being carried out in the present embodiment two the method step schematic diagram of performance test, mainly comprise the following steps:
Step 101: choose the performance test part associated with application software to be measured from performance test storehouse.
In the performance test part creating, comprised the sign with this performance test part with the application software of incidence relation in embodiment mono-, therefore, can from performance test storehouse, choose the performance test part that comprises described application software sign to be measured, the performance test part selecting is the performance test part associated with application software to be measured.
Suppose that the performance test part of choosing in this step 101 is the performance test part shown in Fig. 2, can be when the triggered time of performance test part (8:00 and 20:00) arrives, automatically perform subsequent step, that is: the trigger condition using the triggered time of performance test part as performance test.
The scheme of the present embodiment also can not usingd the trigger condition of triggered time as performance test, and using the trigger condition of manual triggers as performance test, that is: after executing this step 101, no matter whether the triggered time arrives, all can manual triggers continue to carry out subsequent step.
Step 102: utilize the described performance test part of choosing to press survey to the trunk code of described application software to be measured.
In this step 102, press the trunk code of surveying to refer to: at the up-to-date trunk code of current time application software to be measured.
After obtaining the up-to-date trunk code of application software to be measured, the performance test part that utilization is chosen is built test environment automatically, and the trunk code of application software to be measured is pressed to survey under described test scene, obtain this pressure for this application software to be measured and survey result.
For example, when the test scene of building with the performance test part shown in Fig. 2 is pressed survey to the trunk code of application software A to be measured, walk abreast and to www.aliexpress.com path, initiate 10 requests of checking product details, continue after 15 minutes, obtain the pressure of application software A to be measured to survey result.
Described pressure is surveyed result and is included but not limited to following content:
Trunk code release number, average response duration, number of transactions (TPS), the error rate of completing per second.
Step 103: pressure survey result and setting threshold are compared, determine the performance of described application software to be measured.
According to press surveying, the content that result comprises is different, and the content comparing in this step 103 is also different, take below to press to survey result and describe as trunk code release number, average response duration, TPS as example.
Concrete executive mode in this step 103 includes but not limited to following two kinds of modes:
Mode one: this press is surveyed to result and compare with default baseline result, when this presses the difference satisfied first of surveying result and baseline result to impose a condition, determine that the performance of application software to be measured is affected.
Described baseline result refers to the performance reference value of application software, and be often referred to application software under the special scenes performance index of (as constant concurrent number, constant duration) can reflect the theoretic performance of this application software.Baseline result includes but not limited to average response duration, TPS, error rate.
Whether described first impose a condition greatlyr with the difference of baseline result for reflecting that this press to survey result, if difference is larger, determines that this presses difference satisfied first of surveying result and baseline result to impose a condition.Different with the content of baseline result according to press surveying result, the described first also difference that imposes a condition.For example, if press the content of surveying in result and baseline result, be average response duration, when this presses the difference of the average response duration of surveying result and baseline result to be greater than setting value (as 10%), think that meeting first imposes a condition.
Suppose the baseline result that table 1 is application software to be measured, table 2 presses the pressure after surveying to survey result for this to application software to be measured.
| Performance test part title | Average response duration (ms) | TPS | Maximum deviation |
| 123 | 85.0 | 116.0 | 10% |
Table 1
| Performance test part title | Average response duration (ms) | TPS | Trunk code release number |
| 123 | 88.0 | 110.0 | 225578 |
Table 2
For the content in table 1 and table 2, the average response duration in this pressure survey result and the average response duration in baseline result can be compared, and, the TPS in this pressure survey result and the TPS in baseline result are compared.If the deviation of arbitrary comparative result is excessive, as be greater than 10%, think that the performance of application software to be measured is affected, can press the version number that surveys the trunk code using to determine the renewal of recently this application software being done according to this, and report renewal defect.
Because each renewal of trunk code all can be recorded Yi Ge version number, therefore, can press the version number that surveys the trunk code using to determine the renewal of recently this application software being done according to this.In the present embodiment, can adopt SVN Version Control mode, certainly, the present embodiment is also not limited to other Version Control modes, as git, cvs etc.
Utilize mode one can effectively prevent performance gradual change, this be because:
It is few but upgrade characteristic frequently that the renewal process of the trunk code of application software has update content, each more new capital is to carry out around little function point, therefore, although each, upgrade the performance impact of application software little, but along with update times constantly increases, the performance impact of application software is also in continuous increase, until there is performance bottleneck.Example as shown in Figure 4, in T1～T4 time, respectively the trunk code of application software A is upgraded, when the trunk code of application software A is upgraded at every turn, the performance of application software A can decline 3%, although each renewal is smaller to the performance impact of application software A, after upgrading for 4 times, cause the accumulative total hydraulic performance decline of application software A to reach 12%.
In mode one, the pressure that at every turn obtains is surveyed to result and compares with baseline result, can the performance of gradual change in baseline result, set maximum deviation time, think that the performance of application software is affected, and report renewal defect.As shown in Figure 5, suppose that the average response duration in baseline result is 80ms, according to 4 times shown in Fig. 4, upgrade after operation, each renewal operates the average response duration increase that all can cause application software, but 3 times upgrade after operation, although increasing, the average response duration of application software do not also have the average response time surpassing in baseline result, after the 4th is upgraded, the average response duration of application software surpasses the average response time in baseline result, and difference is greater than 10%, therefore, think that the performance of application software is affected, and report renewal defect.
Mode two: press the pressure survey result after surveying to compare to described application software to be measured this pressure survey result and last time, when the difference satisfied second of twice pressure survey result imposes a condition, determine that the performance of application software is affected.
Whether described second impose a condition greatlyr for reflecting that twice pressure surveyed the difference of result, if difference is larger, determines that this is pressed to survey result and press the difference of surveying result to meet second to impose a condition with last.Different according to content that press to survey result, described second impose a condition also different.For example, the content of surveying result if press is average response duration, when the difference of the average response duration of twice pressure survey result is greater than setting value (as 10%), thinks that meeting second imposes a condition.
Suppose that table 3 is the last time to press the pressure after surveying to survey result to application software to be measured.
| Performance test part title | Average response duration (ms) | TPS | Trunk code release number |
| 123 | 87.0 | 113.0 | 225577 |
Table 3
For the content in table 2 and table 3, the average response duration that twice pressure can be surveyed in result compares, and, the TPS in twice pressure survey result is compared.If the deviation of arbitrary comparative result is excessive, as be greater than 10%, think that the performance of application software to be measured is affected, can press the version number that surveys the trunk code using to determine the renewal of recently this application software being done according to this, and report renewal defect.
Utilize mode two can effectively guarantee the whether affected real-time of performance, this be because:
Baseline result is generally changeless, and therefore, aging situation easily appears in baseline result.And the last pressure obtaining to survey result be real-time update along with the continuous execution of performance test process, therefore, utilize the performance impact result that mode two obtains to there is higher real-time.
Whether preferably, the scheme of the present embodiment is also not limited to the scheme that mode one and mode two are combined, that is: first utilize the performance of a pair of application software to be measured of mode to be affected and judge; When the result of utilizing mode one does not determine that the performance of application software to be measured is affected, continue to utilize the performance of two pairs of application software to be measured of mode whether to be affected and judge.
The scheme that mode one and mode two combine can prevent performance gradual change simultaneously and improve the whether affected real-time of performance, simultaneously, also can be according to the result of determination of mode one and mode two association schemes, accurately know the performance change trend of application software, utilize this performance change trend constantly to revise baseline result, avoid the problem that baseline result is aging.
Embodiment tri-:
As shown in Figure 6, be the structural representation of the present embodiment three performance testing apparatuss, described equipment comprises: test block is chosen module 11, pressed and survey module 12 and performance determination module 13, wherein:
Test block is chosen module 11 for choose the performance test part associated with application software to be measured from performance test storehouse, comprises test script and running environment parameter in described performance test part; Press and survey module 12 for utilizing the described performance test part of choosing to press survey to the trunk code of described application software to be measured; Performance determination module 13, for pressure survey result and setting threshold are compared, is determined the performance of described application software to be measured.
Test block is chosen module, while having the sign of application software of incidence relation specifically for also comprising with this performance test part in described performance test part, chooses the performance test part that comprises described application software sign to be measured from performance test storehouse.
Described equipment also comprises trigger module 14, while having the triggered time for the running environment parameter comprising at described performance test part, determines that while arriving the described triggered time, triggering described pressure surveys module 12.
Performance determination module 13 can be determined by two kinds of modes the performance of described application software to be measured:
1, performance determination module 13, specifically for the pressure survey result obtaining after this pressure survey and default baseline result are compared, when this presses the difference satisfied first of survey result and baseline result to impose a condition, determines that the performance of application software to be measured is affected.
2, performance determination module 13 presses pressure survey result survey after to compare with last to described application software to be measured specifically for this being pressed the pressure obtaining after survey survey result, when the difference satisfied second of twice pressure survey result imposes a condition, determine that the performance of application software to be measured is affected.
Utilize the scheme of each embodiment of the application, can obtain following effect:
1), improve testing efficiency.The scheme of the embodiment of the present application passes through to create performance test part, fixed performance test environment, and during without each test, manual creation test environment, has improved testing efficiency.Meanwhile, by introducing the triggered time in performance test part, can regularly to the trunk code of application software, test, and without manpower intervention, also not need manual evaluation whether to need to test.
2), stable test environment.In the scheme of the embodiment of the present application, because test environment is that performance test part by being pre-created is built, and the attribute such as test script in performance test part and running environment parameter is constant, the test environment of building is a metastable test environment, therefore, press survey result to have more reference significance, can not be subject to the interference that real network topology environment or flowing of access change.
3), the performance issue of prevention gradual change.In the scheme of the embodiment of the present application, by setting baseline result, prevent the performance deficiency gradual change problem that may exist, the performance change of accumulative total will by with relatively the showing of baseline result.
Those skilled in the art should understand, the application's embodiment can be provided as method, system or computer program.Therefore, the application can adopt complete hardware implementation example, implement software example or in conjunction with the form of the embodiment of software and hardware aspect completely.And the application can adopt the form that wherein includes the upper computer program of implementing of computer-usable storage medium (including but not limited to magnetic disk memory, CD-ROM, optical memory etc.) of computer usable program code one or more.
The application is with reference to describing according to process flow diagram and/or the block scheme of the method for the embodiment of the present application, equipment (system) and computer program.Should understand can be in computer program instructions realization flow figure and/or block scheme each flow process and/or the flow process in square frame and process flow diagram and/or block scheme and/or the combination of square frame.Can provide these computer program instructions to the processor of multi-purpose computer, special purpose computer, Embedded Processor or other programmable data processing device to produce a machine, the instruction of carrying out by the processor of computing machine or other programmable data processing device is produced for realizing the device in the function of flow process of process flow diagram or a plurality of flow process and/or square frame of block scheme or a plurality of square frame appointments.
These computer program instructions also can be stored in energy vectoring computer or the computer-readable memory of other programmable data processing device with ad hoc fashion work, the instruction that makes to be stored in this computer-readable memory produces the manufacture that comprises command device, and this command device is realized the function of appointment in flow process of process flow diagram or a plurality of flow process and/or square frame of block scheme or a plurality of square frame.
These computer program instructions also can be loaded in computing machine or other programmable data processing device, make to carry out sequence of operations step to produce computer implemented processing on computing machine or other programmable devices, thereby the instruction of carrying out is provided for realizing the step of the function of appointment in flow process of process flow diagram or a plurality of flow process and/or square frame of block scheme or a plurality of square frame on computing machine or other programmable devices.
In a typical configuration, described computer equipment comprises one or more processors (CPU), input/output interface, network interface and internal memory.Internal memory may comprise the volatile memory in computer-readable medium, and the forms such as random access memory (RAM) and/or Nonvolatile memory, as ROM (read-only memory) (ROM) or flash memory (flash RAM).Internal memory is the example of computer-readable medium.Computer-readable medium comprises that permanent and impermanency, removable and non-removable media can realize information by any method or technology and store.Information can be module or other data of computer-readable instruction, data structure, program.The example of the storage medium of computing machine comprises, but be not limited to phase transition internal memory (PRAM), static RAM (SRAM), dynamic RAM (DRAM), the random access memory of other types (RAM), ROM (read-only memory) (ROM), Electrically Erasable Read Only Memory (EEPROM), fast flash memory bank or other memory techniques, read-only optical disc ROM (read-only memory) (CD-ROM), digital versatile disc (DVD) or other optical memory, magnetic magnetic tape cassette, the storage of tape magnetic rigid disk or other magnetic storage apparatus or any other non-transmission medium, can be used for the information that storage can be accessed by computing equipment.According to defining herein, computer-readable medium does not comprise the computer readable media (transitory media) of non-standing, as data-signal and the carrier wave of modulation.
Although described the application's preferred embodiment, once those skilled in the art obtain the basic creative concept of cicada, can make other change and modification to these embodiment.So claims are intended to all changes and the modification that are interpreted as comprising preferred embodiment and fall into the application's scope.
Obviously, those skilled in the art can carry out various changes and modification and the spirit and scope that do not depart from the application to the application.Like this, if within these of the application are revised and modification belongs to the scope of the application's claim and equivalent technologies thereof, the application is also intended to comprise these changes and modification interior.
Claims (10)
1. a performance test methods, is characterized in that, described method comprises:
From performance test storehouse, choose the performance test part associated with application software to be measured, in described performance test part, comprise test script and running environment parameter;
The described performance test part that utilization is chosen is pressed survey to the trunk code of described application software to be measured;
Pressure survey result and setting threshold are compared, determine the performance of described application software to be measured.
2. performance test methods as claimed in claim 1, is characterized in that, also comprises the sign with this performance test part with the application software of incidence relation in described performance test part;
From performance test storehouse, choose the performance test part associated with application software to be measured, specifically comprise:
From performance test storehouse, choose the performance test part that comprises described application software sign to be measured.
3. performance test methods as claimed in claim 1, is characterized in that, in the running environment parameter that described performance test part comprises, has the triggered time;
Before the performance test part that utilization is chosen is pressed survey to the trunk code of application software to be measured, described method also comprises:
Determine and arrive the described triggered time.
4. the performance test methods as described in as arbitrary in claim 1～3, is characterized in that, pressure is surveyed to result and setting threshold compares, and determines the performance of described application software to be measured, specifically comprises:
The pressure survey result obtaining after this pressure is surveyed and default baseline result compare, and when this presses the difference satisfied first of survey result and baseline result to impose a condition, determine that the performance of application software to be measured is affected.
5. the performance test methods as described in as arbitrary in claim 1～3, is characterized in that, pressure is surveyed to result and setting threshold compares, and determines the performance of described application software to be measured, specifically comprises:
Press the pressure survey result and the last time that after survey, obtain to press the pressure survey result after surveying to compare to described application software to be measured this, when the difference satisfied second of twice pressure survey result imposes a condition, determine that the performance of application software to be measured is affected.
6. a performance test apparatus, is characterized in that, described equipment comprises:
Test block is chosen module, for choose the performance test part associated with application software to be measured from performance test storehouse, comprises test script and running environment parameter in described performance test part;
Press and survey module, for utilizing the described performance test part of choosing to press survey to the trunk code of described application software to be measured;
Performance determination module, for pressure survey result and setting threshold are compared, determines the performance of described application software to be measured.
7. performance test apparatus as claimed in claim 6, is characterized in that,
Test block is chosen module, while having the sign of application software of incidence relation specifically for also comprising with this performance test part in described performance test part, chooses the performance test part that comprises described application software sign to be measured from performance test storehouse.
8. performance test apparatus as claimed in claim 6, is characterized in that, described equipment also comprises:
Trigger module, while having the triggered time for the running environment parameter comprising at described performance test part, determines that while arriving the described triggered time, triggering described pressure surveys module.
9. the performance test apparatus as described in as arbitrary in claim 6～8, is characterized in that,
Performance determination module, specifically for the pressure survey result obtaining after this pressure survey and default baseline result are compared, when this presses the difference satisfied first of survey result and baseline result to impose a condition, determines that the performance of application software to be measured is affected.
10. the performance test apparatus as described in as arbitrary in claim 6～8, is characterized in that,
Performance determination module, specifically for this being pressed the pressure obtaining after survey survey result, to described application software to be measured, press the pressure survey result after surveying to compare with last, when the difference satisfied second of twice pressure survey result imposes a condition, determine that the performance of application software to be measured is affected.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310195624.9A CN104182333B (en) | 2013-05-23 | 2013-05-23 | A kind of performance test methods and equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310195624.9A CN104182333B (en) | 2013-05-23 | 2013-05-23 | A kind of performance test methods and equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104182333A true CN104182333A (en) | 2014-12-03 |
| CN104182333B CN104182333B (en) | 2018-03-09 |
Family
ID=51963399
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310195624.9A Active CN104182333B (en) | 2013-05-23 | 2013-05-23 | A kind of performance test methods and equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104182333B (en) |
Cited By (20)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104579825A (en) * | 2014-12-18 | 2015-04-29 | 百度在线网络技术（北京）有限公司 | Method and device for monitoring server of application in real time and computer equipment |
| CN104778123A (en) * | 2015-03-30 | 2015-07-15 | 微梦创科网络科技（中国）有限公司 | Method and device for detecting system performance |
| CN105224432A (en) * | 2015-11-11 | 2016-01-06 | 中国建设银行股份有限公司 | A kind of performance test method for parameter configuration, device, pressing machine and system |
| CN105512041A (en) * | 2015-12-23 | 2016-04-20 | 北京金山安全软件有限公司 | Method and device for testing application program performance and electronic equipment |
| CN105764070A (en) * | 2014-12-15 | 2016-07-13 | 华为技术有限公司 | Scene map training and wireless network testing methods and device |
| CN106201856A (en) * | 2015-05-04 | 2016-12-07 | 阿里巴巴集团控股有限公司 | A kind of multi version performance test methods and device |
| CN106776337A (en) * | 2016-12-29 | 2017-05-31 | 北京金山安全软件有限公司 | Performance analysis method and device and electronic equipment |
| CN106802856A (en) * | 2015-11-26 | 2017-06-06 | 腾讯科技（深圳）有限公司 | The performance test methods of game application, server and game application client |
| CN107153601A (en) * | 2016-03-02 | 2017-09-12 | 阿里巴巴集团控股有限公司 | Unit performance method of testing and equipment |
| CN107220171A (en) * | 2016-03-22 | 2017-09-29 | 阿里巴巴集团控股有限公司 | The method of testing and device of a kind of virtual machine |
| CN107480040A (en) * | 2016-06-08 | 2017-12-15 | 阿里巴巴集团控股有限公司 | Workflow stability test method and apparatus |
| CN108255715A (en) * | 2018-01-08 | 2018-07-06 | 平安普惠企业管理有限公司 | A kind of test result processing method and terminal device |
| CN108874637A (en) * | 2017-05-09 | 2018-11-23 | 北京京东尚科信息技术有限公司 | A kind of method of pressure test, system, electronic equipment and readable storage medium storing program for executing |
| CN109669874A (en) * | 2018-12-28 | 2019-04-23 | 广州君海网络科技有限公司 | A kind of game services end pressure test platform and test method |
| CN110514980A (en) * | 2019-09-20 | 2019-11-29 | 上海华力微电子有限公司 | The generation method and device of wafer-level test scheme |
| CN110716830A (en) * | 2018-07-12 | 2020-01-21 | 中移（杭州）信息技术有限公司 | Pressure measuring machine selection method and device, electronic equipment and storage medium |
| CN110780990A (en) * | 2019-09-12 | 2020-02-11 | 中移（杭州）信息技术有限公司 | Performance detection method, performance detection device, server and storage medium |
| CN110998539A (en) * | 2017-06-16 | 2020-04-10 | 阿里巴巴集团控股有限公司 | Performance impact analysis of system updates |
| CN111104304A (en) * | 2018-10-25 | 2020-05-05 | 武汉斗鱼网络科技有限公司 | Multi-task scene performance testing method, storage medium, electronic device and system |
| CN111400186A (en) * | 2020-03-19 | 2020-07-10 | 时时同云科技(成都)有限责任公司 | Performance test method and system |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070174701A1 (en) * | 2005-12-21 | 2007-07-26 | Samsung Electronics Co., Ltd. | Selective test method and test apparatus thereof |
| CN101174240A (en) * | 2006-11-03 | 2008-05-07 | 凌阳科技股份有限公司 | Software testing management method and system thereof |
| CN101373446A (en) * | 2007-08-24 | 2009-02-25 | 英业达股份有限公司 | Method for testing pressure of file system |
| CN101576846A (en) * | 2008-05-09 | 2009-11-11 | 北京世纪拓远软件科技发展有限公司 | Method for testing software performance |
| CN101625658A (en) * | 2009-08-04 | 2010-01-13 | 卓望信息技术(北京)有限公司西城分公司 | Method for testing software system performance |
| CN101727390A (en) * | 2009-12-28 | 2010-06-09 | 金蝶软件（中国）有限公司 | Method and device for debugging performance test scripts |
| CN102075384A (en) * | 2010-12-20 | 2011-05-25 | 创新科存储技术有限公司 | Performance test system and method |
-
2013
- 2013-05-23 CN CN201310195624.9A patent/CN104182333B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070174701A1 (en) * | 2005-12-21 | 2007-07-26 | Samsung Electronics Co., Ltd. | Selective test method and test apparatus thereof |
| CN101174240A (en) * | 2006-11-03 | 2008-05-07 | 凌阳科技股份有限公司 | Software testing management method and system thereof |
| CN101373446A (en) * | 2007-08-24 | 2009-02-25 | 英业达股份有限公司 | Method for testing pressure of file system |
| CN101576846A (en) * | 2008-05-09 | 2009-11-11 | 北京世纪拓远软件科技发展有限公司 | Method for testing software performance |
| CN101625658A (en) * | 2009-08-04 | 2010-01-13 | 卓望信息技术(北京)有限公司西城分公司 | Method for testing software system performance |
| CN101727390A (en) * | 2009-12-28 | 2010-06-09 | 金蝶软件（中国）有限公司 | Method and device for debugging performance test scripts |
| CN102075384A (en) * | 2010-12-20 | 2011-05-25 | 创新科存储技术有限公司 | Performance test system and method |
Cited By (26)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105764070A (en) * | 2014-12-15 | 2016-07-13 | 华为技术有限公司 | Scene map training and wireless network testing methods and device |
| CN104579825A (en) * | 2014-12-18 | 2015-04-29 | 百度在线网络技术（北京）有限公司 | Method and device for monitoring server of application in real time and computer equipment |
| CN104778123B (en) * | 2015-03-30 | 2017-08-25 | 微梦创科网络科技（中国）有限公司 | A kind of method and device of detecting system performance |
| CN104778123A (en) * | 2015-03-30 | 2015-07-15 | 微梦创科网络科技（中国）有限公司 | Method and device for detecting system performance |
| CN106201856A (en) * | 2015-05-04 | 2016-12-07 | 阿里巴巴集团控股有限公司 | A kind of multi version performance test methods and device |
| CN105224432A (en) * | 2015-11-11 | 2016-01-06 | 中国建设银行股份有限公司 | A kind of performance test method for parameter configuration, device, pressing machine and system |
| CN106802856B (en) * | 2015-11-26 | 2020-02-04 | 腾讯科技（深圳）有限公司 | Performance testing method of game application program, server and game application client |
| CN106802856A (en) * | 2015-11-26 | 2017-06-06 | 腾讯科技（深圳）有限公司 | The performance test methods of game application, server and game application client |
| CN105512041A (en) * | 2015-12-23 | 2016-04-20 | 北京金山安全软件有限公司 | Method and device for testing application program performance and electronic equipment |
| CN105512041B (en) * | 2015-12-23 | 2018-09-25 | 北京金山安全软件有限公司 | Method and device for testing application program performance and electronic equipment |
| CN107153601A (en) * | 2016-03-02 | 2017-09-12 | 阿里巴巴集团控股有限公司 | Unit performance method of testing and equipment |
| CN107220171A (en) * | 2016-03-22 | 2017-09-29 | 阿里巴巴集团控股有限公司 | The method of testing and device of a kind of virtual machine |
| CN107480040A (en) * | 2016-06-08 | 2017-12-15 | 阿里巴巴集团控股有限公司 | Workflow stability test method and apparatus |
| CN106776337A (en) * | 2016-12-29 | 2017-05-31 | 北京金山安全软件有限公司 | Performance analysis method and device and electronic equipment |
| CN108874637A (en) * | 2017-05-09 | 2018-11-23 | 北京京东尚科信息技术有限公司 | A kind of method of pressure test, system, electronic equipment and readable storage medium storing program for executing |
| CN110998539A (en) * | 2017-06-16 | 2020-04-10 | 阿里巴巴集团控股有限公司 | Performance impact analysis of system updates |
| CN110998539B (en) * | 2017-06-16 | 2023-06-13 | 阿里巴巴集团控股有限公司 | Performance impact analysis of system updates |
| CN108255715A (en) * | 2018-01-08 | 2018-07-06 | 平安普惠企业管理有限公司 | A kind of test result processing method and terminal device |
| CN108255715B (en) * | 2018-01-08 | 2021-02-09 | 平安普惠企业管理有限公司 | Test result processing method and terminal equipment |
| CN110716830A (en) * | 2018-07-12 | 2020-01-21 | 中移（杭州）信息技术有限公司 | Pressure measuring machine selection method and device, electronic equipment and storage medium |
| CN110716830B (en) * | 2018-07-12 | 2023-04-18 | 中移（杭州）信息技术有限公司 | Pressure measuring machine selection method and device, electronic equipment and storage medium |
| CN111104304A (en) * | 2018-10-25 | 2020-05-05 | 武汉斗鱼网络科技有限公司 | Multi-task scene performance testing method, storage medium, electronic device and system |
| CN109669874A (en) * | 2018-12-28 | 2019-04-23 | 广州君海网络科技有限公司 | A kind of game services end pressure test platform and test method |
| CN110780990A (en) * | 2019-09-12 | 2020-02-11 | 中移（杭州）信息技术有限公司 | Performance detection method, performance detection device, server and storage medium |
| CN110514980A (en) * | 2019-09-20 | 2019-11-29 | 上海华力微电子有限公司 | The generation method and device of wafer-level test scheme |
| CN111400186A (en) * | 2020-03-19 | 2020-07-10 | 时时同云科技(成都)有限责任公司 | Performance test method and system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104182333B (en) | 2018-03-09 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104182333A (en) | Performance testing method and equipment | |
| CN108768728B (en) | Operation and maintenance task processing method and device, computer equipment and storage medium | |
| US9043788B2 (en) | Experiment manager for manycore systems | |
| Aggarwal et al. | The power of system call traces: Predicting the software energy consumption impact of changes | |
| US11307957B2 (en) | Systems and methods for determining optimal cost-to-serve for cloud applications in the public cloud | |
| US10013656B1 (en) | Methods and apparatus for analytical processing of provenance data for HPC workflow optimization | |
| US20230145163A1 (en) | Pipeline release validation | |
| US20190317808A1 (en) | Distributed Multiple Tier Multi-Node Serverless Framework for Complex Analytics Task Execution | |
| CN112068852B (en) | Method, system, equipment and medium for installing open-source software based on domestic server | |
| US11681511B2 (en) | Systems and methods for building and deploying machine learning applications | |
| CN113965389B (en) | Network security management method, device and medium based on firewall log | |
| US20170139818A1 (en) | Validation using scenario runners | |
| US9842044B2 (en) | Commit sensitive tests | |
| US9542294B2 (en) | Method to apply perturbation for resource bottleneck detection and capacity planning | |
| CN104298589A (en) | Performance test method and performance test equipment | |
| US8850407B2 (en) | Test script generation | |
| Örgün et al. | Software development overall efficiency improvement in a CMMI level 5 organization within the scope of a case study | |
| US11119879B2 (en) | Detection of resource bottlenecks in execution of workflow tasks using provenance data | |
| CN116028108B (en) | Method, device, equipment and storage medium for analyzing dependent package installation time | |
| US9501766B2 (en) | Generating a storage drive qualification test plan | |
| US11681608B2 (en) | Complex system for data pipeline test automation | |
| US20230237044A1 (en) | Evaluation framework for anomaly detection using aggregated time-series signals | |
| CN106649081A (en) | Method and apparatus for debugging offline package running in client application | |
| Kounev et al. | Model-based techniques for performance engineering of business information systems | |
| KR102418892B1 (en) | Method of saving energy based on confidence interval and apparatus using the same |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20240221 Address after: Singapore Patentee after: Alibaba Singapore Holdings Ltd. Country or region after: Singapore Address before: Cayman Islands Grand Cayman capital building, a four storey No. 847 mailbox Patentee before: ALIBABA GROUP HOLDING Ltd. Country or region before: Cayman Islands |