CN110362478A - Application upgrade test method, device, computer equipment and storage medium - Google Patents
Application upgrade test method, device, computer equipment and storage medium Download PDFInfo
- Publication number
- CN110362478A CN110362478A CN201910531884.6A CN201910531884A CN110362478A CN 110362478 A CN110362478 A CN 110362478A CN 201910531884 A CN201910531884 A CN 201910531884A CN 110362478 A CN110362478 A CN 110362478A
- Authority
- CN
- China
- Prior art keywords
- test
- order
- data
- history
- upgrading
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/368—Test management for test version control, e.g. updating test cases to a new software version
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Computer Hardware Design (AREA)
- Quality & Reliability (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Debugging And Monitoring (AREA)
Abstract
This application involves a kind of application upgrade test method, device, computer equipment and storage mediums.The described method includes: obtaining the service customer end after upgrading according to test data test order generated；Determine order label corresponding with the test order；History Order corresponding with the order label is searched from data bank；The History Order is by the service customer end before upgrading according to the Test data generation；The test order and the History Order are compared, determine the difference section between the test order and the History Order；Matching degree between default upgrade requirement and the difference section according to corresponding to the service customer end after the upgrading, determination carry out the service customer end after upgrading to test obtained client test result.System testing efficiency can be improved using this method based on measuring technology.
Description
Technical field
This application involves the field of test technology, more particularly to a kind of application upgrade test method, device, computer equipment
And storage medium.
Background technique
With the development of computer technology, more and more business can pass through operation system (including service customer end and industry
Business server) Lai Shixian, for example service customer end is provided and is used to user, service server is as background process server.With
The abundant and extension of business tine, it is often necessary to operation system is upgraded, that is, application program is upgraded.For
The stabilization of operation system function after ensureing upgrading, it is often necessary to the operation system after upgrading be tested, to determine industry
The upgrade case of business system.
The method commonly tested the system after upgrading mainly takes artificial mode, artificial to carry out business visitor
Joint test between family end and service server, that is, end-to-end integration testing.Using manually test method end to end
Lead to system testing low efficiency.
Summary of the invention
Based on this, it is necessary in view of the above technical problems, provide a kind of application upgrade that can be improved system testing efficiency
Test method, device, computer equipment and storage medium.
A kind of application upgrade test method, which comprises
Service customer end after obtaining upgrading is according to test data test order generated；
Determine order label corresponding with the test order；
History Order corresponding with the order label is searched from data bank；Before the History Order is by upgrading
The service customer end is according to the Test data generation；
The test order and the History Order are compared, determine that the test order and the history are ordered
The difference section in separate room；
Matching between default upgrade requirement and the difference section according to corresponding to the service customer end after the upgrading
Degree, determination carry out the service customer end after upgrading to test obtained client test result.
A kind of system upgrade test device, described device include:
Module is obtained, for obtaining the service customer end after upgrading according to test data test order generated；
Determining module, for determining order label corresponding with the test order；
Searching module, for searching History Order corresponding with the order label from data bank；The history is ordered
The service customer end before single pass-through upgrading is according to the Test data generation；
Analysis module determines that the test is ordered for the test order and the History Order to be compared
Difference section between the single and described History Order；
The determining module is also used to default upgrade requirement and institute according to corresponding to the service customer end after the upgrading
The matching degree between difference section is stated, determines and the service customer end after upgrading is carried out to test obtained client test knot
Fruit.
A kind of computer equipment, including memory and processor, the memory are stored with computer program, the processing
Device performs the steps of when executing the computer program
Service customer end after obtaining upgrading is according to test data test order generated；
Determine order label corresponding with the test order；
History Order corresponding with the order label is searched from data bank；Before the History Order is by upgrading
The service customer end is according to the Test data generation；
The test order and the History Order are compared, determine that the test order and the history are ordered
The difference section in separate room；
Matching between default upgrade requirement and the difference section according to corresponding to the service customer end after the upgrading
Degree, determination carry out the service customer end after upgrading to test obtained client test result.
A kind of computer readable storage medium, is stored thereon with computer program, and the computer program is held by processor
It is performed the steps of when row
Service customer end after obtaining upgrading is according to test data test order generated；
Determine order label corresponding with the test order；
History Order corresponding with the order label is searched from data bank；Before the History Order is by upgrading
The service customer end is according to the Test data generation；
The test order and the History Order are compared, determine that the test order and the history are ordered
The difference section in separate room；
Matching between default upgrade requirement and the difference section according to corresponding to the service customer end after the upgrading
Degree, determination carry out the service customer end after upgrading to test obtained client test result.
Above-mentioned application upgrade test method, device, computer equipment and storage medium, the service customer end after obtaining upgrading
According to test data test order generated, order label corresponding with test order is determined, to carry out Version Control.
History Order corresponding with order label is searched from data bank again, test order and History Order are compared,
Determine difference section between the two.And the default upgrade requirement according to corresponding to the service customer end after upgrading, with the difference portion
Matching degree between point determines client test result.Automated intelligent the service customer end after upgrading can be surveyed in this way
Examination, without artificially manually carrying out the joint test of client and server, so that it may obtain client test result, greatly improve
The efficiency of system testing.
Detailed description of the invention
Fig. 1 is the application scenario diagram of application upgrade test method in one embodiment；
Fig. 2 is the flow diagram of application upgrade test method in one embodiment；
Fig. 3 is the flow diagram for carrying out testing procedure in one embodiment to service server；
Fig. 4 is the application system figure of application upgrade test method in one embodiment；
Fig. 5 is the structural block diagram of application upgrade test device in one embodiment；
Fig. 6 is the structural block diagram of application upgrade test device in another embodiment；
Fig. 7 is the internal structure chart of computer equipment in one embodiment.
Specific embodiment
It is with reference to the accompanying drawings and embodiments, right in order to which the objects, technical solutions and advantages of the application are more clearly understood
The application is further elaborated.It should be appreciated that specific embodiment described herein is only used to explain the application, not
For limiting the application.
Application upgrade test method provided by the present application, can be applied in application environment as shown in Figure 1.Wherein, eventually
End 110 is communicated with service server 120 by network.Test equipment 130 is communicated with terminal 110 by network.It surveys
Examination equipment 130 is communicated with service server 120 by network.Operation has service customer end, the industry after upgrading in terminal 110
Client of being engaged in is according to the test order of Test data generation, and test equipment 130, which obtains, tests order, and according to test order to industry
Business client and service server 120 are tested respectively, to obtain client test result and server test result.Its
In, terminal 110 can be, but not limited to be various personal computers, laptop, smart phone, tablet computer and it is portable can
Wearable device, server 120 can be realized with the server cluster of the either multiple server compositions of independent server.It surveys
Examination equipment can be terminal or server.
In one embodiment, as shown in Fig. 2, providing a kind of application upgrade test method, it is applied to Fig. 1 in this way
In test equipment 130 for be illustrated, comprising the following steps:
S202, the service customer end after obtaining upgrading is according to test data test order generated.
Wherein, application upgrade refers to the upgrading of application program, including at least the upgrading and business service of service customer end
At least one of upgrading of device.Service customer end is mounted in the application program on user terminal, can pass through network connection
It is communicated with service server.Service customer end specifically can be operation individual application program at the terminal, can also be with
It is the web interface that can be opened in a browser that service server provides.In practical applications, due to business demand, usually
It can encounter and need the case where function upgrading is carried out to service customer end, after the service customer end and upgrading before there is upgrading at this time
Service customer end.The test of application upgrade can specifically include to the test of the service customer end after upgrading and to liter
The test etc. of service server after grade.
Test data is to upgrade the data of front and back difference for test macro.Wherein, test data can be stored in test text
In part.Test file is the file for test, can specifically include multiple groups test cases.Every group of test cases all includes complete
Test data.Test file specifically can be text file, form document or PDF (Portable Document Format,
Portable document format) file etc., without limitation to the file format of test file at this.Testing order is service customer end root
It (is mainly presented in the form of message) according to test data order generated.
Specifically, service customer end can obtain test data, and carry out data processing to the test data of typing, generate phase
The test order answered.When service customer end, which will test order, is sent to service server in the form of message, test equipment can
It intercepts and obtains test order transmitted by service customer end.
It in one embodiment, can be by the way that artificially manually for mode by test data typing to service customer end, business is objective
Order is tested according to Test data generation in family end accordingly.In another embodiment, test equipment can obtain test text automatically
Part, and automatically by the test data typing in test file to service customer end, service customer end is according to Test data generation phase
The test order answered.
S204 determines order label corresponding with test order.
Wherein, order label is a kind of tool for the order that identifies or classify, and facilitates positioning and searches corresponding order.
Order label can be used for for distinguishing different types of test cases.Specifically, test equipment can be after obtaining test order
The order label that test Order splitting matches.For example, for according to type-A test data test order generated, test
Equipment can be corresponding test Order splitting A label；For the test data test order generated according to B type, test
Equipment can be corresponding test Order splitting B label.
In one embodiment, for the test order of same type, test equipment can distribute same order label for it.
Before and after service customer end upgrading, by the test data of same type test order generated, what test equipment was distributed is ordered
Single label is also identical.In this way, test equipment can be ordered by test order corresponding to analysis same order label and history
Difference between list, to determine the upgrade case of service customer end.
S206 searches History Order corresponding with order label from data bank；History Order passes through the industry before upgrading
Client of being engaged in is according to Test data generation.
Wherein, History Order be upgrading before service customer end according to test data order generated (mainly with message
Form present).Specifically, test equipment searches History Order associated with the order label determined from data bank, and
Obtain the order information of corresponding History Order.Order information is information relevant to order, can specifically include product type,
Sales Channel, quantity, timestamp, sequence number etc..
In one embodiment, online in service customer end in use, test equipment can by service customer end generate ordering
History Order of the single and corresponding order label associated storage in data bank, when as next upgrading test.Correspondingly, rear
When continuous service customer end upgrades, the test order generated of the service customer end after upgrading is updated to data bank by test equipment
In, so as to the order information stored in the data bank that timely updates.The order information of update is then used as the history of next upgrading test
The History Order information of order.
In one embodiment, which further includes the step of the test order information of storage test order
Suddenly, which specifically includes: backing up the History Order information of History Order；The test order information for testing order is covered into history
Order information, and test order information is stored into data bank, so that storing the business visitor of latest edition in the data bank
Test order information corresponding to the end of family.
Specifically, test equipment can store the History Order information back-up stored in data bank to other computer equipments
Or in other store paths, in case tracking of information is traced to the source.In turn, test equipment can order the test of the test order currently obtained
Single information covers corresponding History Order information, and stores into data bank, so that only storing latest edition business in data bank
Test order information corresponding to client.In this way, test equipment can be believed according to newest History Order when upgrading next time
Cease the upgrade case to determine service customer end.
In one embodiment, during the upgrading test of current business client, part order label institute is only generated
Corresponding test order.When the test order information that will test order covers corresponding History Order information, by same order
Test order information corresponding to label covers corresponding History Order information.So that order information corresponding to each order label
It is all the order information of current latest edition.
In above-described embodiment, the History Order information of History Order is backed up, the test order information for testing order is covered
History Order information, and store into data bank.It can ensure that the order information stored in data bank is the order letter of latest edition
Breath, convenient for accurately determining the upgrading test result of client.
Test order and History Order are compared S208, determine the difference between test order and History Order
Part.
Specifically, Transaction Information collector can will test the history of order information and the correspondence same order label found
Order information is compared, to determine the difference section between test order and History Order.
In one embodiment, for same type of test order, test equipment can distribute identical order mark for it
Label.When the service customer end of different editions carries out data processing to the test data of same type, after generating corresponding test order,
Test equipment can be by comparing the difference between test order and History Order corresponding to same order label, to analyze industry
The component that business client specifically upgrades.
In one embodiment, step S208, that is, test order and History Order are compared, it determines and surveys
The step of difference section between trial order and History Order, specifically includes: obtaining order keyword；It order and is gone through from test respectively
In the order information of history order, order key message corresponding with order keyword is extracted；To the order key message of extraction
It is compared, determines the difference section between test order and History Order.
Wherein, order keyword is the word of key message in corresponding order, such as " product type " or " quantity on order "
Deng.Specifically, test equipment can obtain preset order keyword, from the test order information of test order, extract and order
The corresponding order key message of single keyword；From the History Order information of History Order, extract opposite with order keyword
The order key message answered.
Further, the order key message of the comparable test order of test equipment, believes with the order key of History Order
Difference between breath, so that it is determined that the upgrading test result of service customer end.In this way, test equipment can be avoided not influencing to survey
The non-critical information (for example, the information such as timestamp and sequence number) for trying logic is substantially increased to test order and History Order
The comparison efficiency and effect being compared.
S210, the matching degree between default upgrade requirement and difference section according to corresponding to the service customer end after upgrading,
Determination carries out the service customer end after upgrading to test obtained client test result.
Wherein, default upgrade requirement is the upgrade function effect planned in advance before staging business client.For example, pre-
If upgrade requirement specifically can be the functional requirement met needed for time upgrading.Specifically, test equipment can be obtained and be risen in advance
Default upgrade requirement corresponding to service customer end after grade.Test equipment by comparing default upgrade requirement and difference section it
Between matching degree, to analyze whether the difference section is difference brought by staging business client, and analyze the difference and be
It is no to meet preset function requirement, and then judge whether service customer end upgrades successfully, that is, determine service customer end upgrading
Test result.
In one embodiment, whether test equipment can full by the difference section for judging to test between order and History Order
Which of the default upgrade requirement of foot and the default upgrade requirement of satisfaction part, to determine default upgrade requirement and difference section
Between matching degree.In one embodiment, if difference section is unsatisfactory for preset function requirement, test equipment can further divide
Analysis causes the reason of upgrading failure and corresponding solution.Test equipment can be according to test order information and History Order information
Between difference section, reason of discrepancies, updating result and analysis and corresponding solution etc. the reason of when upgrading failure, it is raw
It is reported at the upgrading test of service customer end.
Above-mentioned application upgrade test method, the service customer end after obtaining upgrading are ordered according to test data test generated
It is single, order label corresponding with test order is determined, to carry out Version Control.It is searched and order label from data bank again
Test order and History Order are compared corresponding History Order, to determine to the service customer end after upgrading
It carries out testing obtained client test result.In this way, the preceding service customer end with after upgrading of upgrading basis respectively can be compared
Difference between test data order generated, to determine the upgrade case of service customer end.Automated intelligent to upgrading after
Service customer end tested, without artificially manually carry out client and server joint test, so that it may obtain client
Test result is held, the efficiency of system testing is substantially increased.
In one embodiment, which further includes the steps that testing service server, should
Step specifically includes the following steps:
S302 searches the test order information of test order from data bank.
Specifically, when test equipment stores the test order information for testing order covering History Order information to data bank
In after, test equipment can search corresponding test order information from data bank.
Test order information is sent to service server by S304.
Specifically, test order information can be sent to service server by test equipment, and the test order information of transmission is used
Business processing is carried out to test order information in instruction service server, to obtain corresponding order processing data.In a reality
It applies in example, order processing data are the data suitable for down-stream system.Wherein service server carries out industry to test order information
Business processing specifically can be related to the function of service server, for example, service server carries out format and class to test order information
Order processing data can be obtained in conversion in type；Alternatively, service server, which can test order information to multiple groups, carries out General Office
Reason, to obtain order processing data etc., the application is it is not limited here.
S306 obtains service server and carries out the obtained order processing data of business processing to test order information.
Specifically, test equipment can be obtained service server by network connection and carry out business processing to test order information
Obtained order processing data.
In one embodiment, when service server carries out the obtained order processing of business processing to test order information
After data, order processing data can be stored into database.Service server can be spaced at preset timed intervals, by order processing number
According to being sent to test equipment.Alternatively, when the memory capacity of the order processing data of generation reaches preset capacity, service server
Order processing data are sent to test equipment.
In one embodiment, step S306, that is, obtain service server and test order information is carried out at business
The step of managing obtained order processing data specifically includes: by service server to the data format of test order information
And/or data type is converted, and the order processing data of matching target data format and/or target data type are obtained；Really
Fixed order note identification corresponding with test order information；Timing searches corresponding order according to order note identification from service server
Handle data.
Wherein, data format (data format) is the rule for describing data and being stored in file or record.It can be word
The text formatting of symbol form or the compressed format of binary data form etc..Data type (data type) is one group of data institute
The classification of category, the set of the identical value of one group of property is primarily referred to as in data structure and is defined on this value set one
The general name of group operation.Order note identification is used for the unique identification order, specifically can be letter, character, Chinese character or number etc..
In one embodiment, service customer end carries out data processing to test data, when generating test order, accordingly
Ground generates the order note identification of test order, and updates test file according to the order note identification.Test equipment can be from test file
Obtain order note identification corresponding with test order.Service server carries out business processing to test order information, obtains order
After handling data, order note identification and order processing data correlation can be stored in local.Further, test equipment can timing according to
Corresponding order processing data are searched from service server according to order note identification.
In one embodiment, service server carries out the content of business processing to test order information, specifically can be
Service server converts the data format of test order information, obtains matching target data format order processing data,
And/or service server converts the data type of test order information, obtains at the order of matching target data type
Manage data.Wherein, target data format and target data type are pre-set, relevant to practical business demand data formats
And data type, for example it is suitable for the data format and data type of down-stream system.
In one embodiment, service server turns the data format and/or data type of test order information
It changes, after obtaining the order processing data of matching target data format and/or target data type, order processing data can be stored
Into database.In the operation logic of service server, there are a central data management module, all preservation data to number
All pass through this data management module according to the operation in library to be operated.For service server, there is a special code
The data for being saved in database can be saved in local file with Json format by insertion setting.Test equipment can be ordered according to test
Single order note identification, finds the order processing data of corresponding Json format from service server.
In above-described embodiment, turned by data format and data type of the service server to test order information
It changes, may be matched the order processing data of target data format and target data type, foundation and test order information phase
Corresponding order note identification is periodically searched corresponding order processing data from service server, be can be convenient, fast and accurately
Obtain order processing data.
S308 determines that server corresponding with service server is surveyed according to order processing data and expected results data
Test result.
Wherein, it is contemplated that result data is the desired result data of this operation system upgrading, that is, normal data.Tool
Body, order processing data and expected results data can be compared for test equipment, determine and take to the business after upgrading
Business device carries out testing obtained test result.When order processing data with expected results data presetting by identical or difference
In range, then determine that the service server of this time upgrading meets upgrade requirement；When order processing data and expected results data
Difference is more than preset range, then determines this service server upgrading failure, and test equipment can be determined according to the part of difference
Upgrade the reason of failing and is correspondingly improved measure etc..
In above-described embodiment, test order information is sent to service server, and obtain service server and order to test
Single information carries out the obtained order processing data of business processing, further according to order processing data and expected results data, determines
Server test result corresponding with service server tests the service server after upgrading to automated intelligent, nothing
Need the joint test for artificially manually carrying out client and server, so that it may obtain server test result, substantially increase and be
The efficiency of unified test examination.
In one embodiment, which further includes the generation step of application upgrade test report, should
Step specifically includes: according to client test result and server test result, updating test text corresponding with test data
Part；According to updated test file, corresponding application upgrade test report is generated.
Wherein, test report be to carrying out testing obtained report after system upgrade, test report be test phase most
Output object afterwards, usually may include test method, test result and defect report, test result and suggestion etc..Specifically, it tests
Equipment can update test file corresponding with test data according to client test result and server test result.Again according to
According to updated test file, corresponding application upgrade test report is generated.
In one embodiment, test report can be shown in the form of a file, or be shown in the form of a web page.Wherein,
It shows and is such as shown with text formatting, table format or picture format etc. in the form of a file.
In above-described embodiment, according to client test result and server test result, update corresponding with test data
Test file, then according to updated test file, accurate, comprehensive application upgrade test report can be generated.
It should be understood that although each step in the flow chart of Fig. 2-3 is successively shown according to the instruction of arrow,
These steps are not that the inevitable sequence according to arrow instruction successively executes.Unless expressly stating otherwise herein, these steps
Execution there is no stringent sequences to limit, these steps can execute in other order.Moreover, at least one in Fig. 2-3
Part steps may include that perhaps these sub-steps of multiple stages or stage are not necessarily in synchronization to multiple sub-steps
Completion is executed, but can be executed at different times, the execution sequence in these sub-steps or stage is also not necessarily successively
It carries out, but can be at least part of the sub-step or stage of other steps or other steps in turn or alternately
It executes.
The application system figure of application upgrade test method is shown with reference to Fig. 4, Fig. 4.In one embodiment, test equipment
Including test data composer, information collector and automatic test device.For above-mentioned test data composer, information collector
It with automatic test device, can be deployed in respectively in different servers, collectively form a server cluster；It can also be deployed in same
In one server, realized by the disparate modules in the same server.
In one embodiment, test equipment further includes scheduler, for above-mentioned test data composer, information collector
The allotment of each service can be carried out by scheduler and is set before executing the application upgrade test method with automatic test device
It sets.For example each service run in this test process and the operation order of each server are set etc..
In one embodiment, test data composer is by test data automatic input to service customer end, business client
Hold the test order according to Test data generation.When the test order is sent to service server by service customer end, information
Collector intercepts and obtains test order.Information collector is also used to determine order label corresponding with test order, from money
Expect to search History Order corresponding with order label in library, and test order and History Order are compared, determines
Test the difference section between order and History Order；The default upgrade requirement according to corresponding to the service customer end after upgrading, with
Matching degree between difference section, determination carry out the service customer end after upgrading to test obtained client test result.
In one embodiment, information collector is also used to back up the History Order information of History Order, and test is ordered
Single test order information covers History Order information, and test order information is stored into data bank, so that in data bank
Store test order information corresponding to the service customer end of latest edition.
In one embodiment, automatic test device from data bank for searching the test order information of test order；
Test order information is sent to service server；Service server is obtained to carry out obtained by business processing test order information
Order processing data；Automatic test device is according to order processing data and expected results data, determining and service server phase
Corresponding server test result.
In one embodiment, service server converts the data format and data type of test order information,
Obtain the order processing data of matching target data format and target data type；Automatic test device is also used to determine and test
The corresponding order note identification of order information；Timing searches corresponding order processing number according to order note identification from service server
According to.
In one embodiment, automatic test device is also used to according to client test result and server test result,
Update test file corresponding with test data；According to updated test file, corresponding application upgrade test report is generated
It accuses.
In one embodiment, information collector is also used to obtain order keyword；It is ordered respectively from test order and history
In single order information, order key message corresponding with order keyword is extracted；The order key message of extraction is carried out
Analysis is compared, determines the difference section between test order and History Order.
Above-mentioned application upgrade test macro, the service customer end after obtaining upgrading are ordered according to test data test generated
It is single, order label corresponding with test order is determined, to carry out Version Control.It is searched and order label from data bank again
Test order and History Order are compared corresponding History Order, determine difference section between the two.And according to
Matching degree between default upgrade requirement and the difference section corresponding to service customer end after upgrading determines that client is tested
As a result.Automated intelligent the service customer end after upgrading can be tested in this way, without it is artificial manually carry out client and
The joint test of server, so that it may obtain client test result, substantially increase the efficiency of system testing.
In one embodiment, as shown in figure 5, providing a kind of application upgrade test device 500, comprising: obtain module
501, determining module 502, searching module 503 and analysis module 504, in which:
Module 501 is obtained, for obtaining the service customer end after upgrading according to test data test order generated.
Determining module 502, for determining order label corresponding with order is tested.
Searching module 503, for searching History Order corresponding with order label from data bank；History Order passes through
Service customer end before upgrading is according to Test data generation.
Analysis module 504 determines that test order and history are ordered for that will test order and History Order is compared
The difference section in separate room.
Determining module 502 is also used to the default upgrade requirement according to corresponding to the service customer end after upgrading and difference portion
Matching degree between point, determination carry out the service customer end after upgrading to test obtained client test result.
In one embodiment, which further includes backup module 505 and covering memory module
506, in which:
Backup module 505, for backing up the History Order information of History Order.
Memory module 506 is covered, the test order information for that will test order covers History Order information, and will test
Order information is stored into data bank, so that storing the letter of test order corresponding to the service customer end of latest edition in data bank
Breath.
In one embodiment, which further includes sending module 507, in which:
Searching module 503 is also used to search the test order information of test order from data bank；
Sending module 507 is sent to service server for that will test order information；
It obtains module 501 and is also used to obtain service server to the test order information progress obtained order of business processing
Handle data；
Determining module 502 is also used to according to order processing data and expected results data, and determination is opposite with service server
The server test result answered.
In one embodiment, module 501 is obtained to be also used to through service server to the data lattice for testing order information
Formula and/or data type are converted, and the order processing data of matching target data format and/or target data type are obtained；
Determine order note identification corresponding with test order information；Timing is searched from service server according to order note identification and is ordered accordingly
Single processing data.
With reference to Fig. 6, in one embodiment, which further includes update module 508 and generation mould
Block 509, in which:
Update module 508, for updating opposite with test data according to client test result and server test result
The test file answered.
Generation module 509, for generating corresponding application upgrade test report according to updated test file.
In one embodiment, analysis module 504 is also used to obtain order keyword；It is ordered respectively from test order and history
In single order information, order key message corresponding with order keyword is extracted；The order key message of extraction is carried out
Analysis is compared, determines the difference section between test order and History Order.
Above-mentioned application upgrade test device, the service customer end after obtaining upgrading are ordered according to test data test generated
It is single, order label corresponding with test order is determined, to carry out Version Control.It is searched and order label from data bank again
Test order and History Order are compared corresponding History Order, determine difference section between the two.And according to
Matching degree between default upgrade requirement and the difference section corresponding to service customer end after upgrading determines that client is tested
As a result.Automated intelligent the service customer end after upgrading can be tested in this way, without it is artificial manually carry out client and
The joint test of server, so that it may obtain client test result, substantially increase the efficiency of system testing.
Specific about application upgrade test device limits the limit that may refer to above for application upgrade test method
Fixed, details are not described herein.Modules in above-mentioned application upgrade test device can fully or partially through software, hardware and its
Combination is to realize.Above-mentioned each module can be embedded in the form of hardware or independently of in the processor in computer equipment, can also be with
It is stored in the memory in computer equipment in a software form, in order to which processor calls the above modules of execution corresponding
Operation.
In one embodiment, a kind of computer equipment is provided, which can be server, internal junction
Composition can be as shown in Figure 7.The computer equipment includes processor, memory and the network interface connected by system bus.
Wherein, the processor of the computer equipment is for providing calculating and control ability.The memory of the computer equipment includes non-easy
The property lost storage medium, built-in storage.The non-volatile memory medium is stored with operating system, computer program and database.It should
Built-in storage provides environment for the operation of operating system and computer program in non-volatile memory medium.The computer equipment
Network interface be used to communicate with external terminal by network connection.To realize one when the computer program is executed by processor
Kind application upgrade test method.
It will be understood by those skilled in the art that structure shown in Fig. 7, only part relevant to application scheme is tied
The block diagram of structure does not constitute the restriction for the computer equipment being applied thereon to application scheme, specific computer equipment
It may include perhaps combining certain components or with different component layouts than more or fewer components as shown in the figure.
In one embodiment, a kind of computer equipment, including memory and processor are provided, memory is stored with meter
Calculation machine program, when computer program is executed by processor, so that the step of processor executes above-mentioned application upgrade test method.This
The step of locating application upgrade test method can be the step in the application upgrade test method of above-mentioned each embodiment.
In one embodiment, a kind of computer readable storage medium is provided, computer program, computer journey are stored with
When sequence is executed by processor, so that the step of processor executes above-mentioned application upgrade test method.Application upgrade test side herein
The step of method, can be the step in the application upgrade test method of above-mentioned each embodiment.
Those of ordinary skill in the art will appreciate that realizing all or part of the process in above-described embodiment method, being can be with
Relevant hardware is instructed to complete by computer program, the computer program can be stored in a non-volatile computer
In read/write memory medium, the computer program is when being executed, it may include such as the process of the embodiment of above-mentioned each method.Wherein,
To any reference of memory, storage, database or other media used in each embodiment provided herein,
Including non-volatile and/or volatile memory.Nonvolatile memory may include read-only memory (ROM), programming ROM
(PROM), electrically programmable ROM (EPROM), electrically erasable ROM (EEPROM) or flash memory.Volatile memory may include
Random access memory (RAM) or external cache.By way of illustration and not limitation, RAM is available in many forms,
Such as static state RAM (SRAM), dynamic ram (DRAM), synchronous dram (SDRAM), double data rate sdram (DDRSDRAM), enhancing
Type SDRAM (ESDRAM), synchronization link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM
(RDRAM), direct memory bus dynamic ram (DRDRAM) and memory bus dynamic ram (RDRAM) etc..
Each technical characteristic of above embodiments can be combined arbitrarily, for simplicity of description, not to above-described embodiment
In each technical characteristic it is all possible combination be all described, as long as however, the combination of these technical characteristics be not present lance
Shield all should be considered as described in this specification.
The several embodiments of the application above described embodiment only expresses, the description thereof is more specific and detailed, but simultaneously
It cannot therefore be construed as limiting the scope of the patent.It should be pointed out that coming for those of ordinary skill in the art
It says, without departing from the concept of this application, various modifications and improvements can be made, these belong to the protection of the application
Range.Therefore, the scope of protection shall be subject to the appended claims for the application patent.
Claims (10)
1. a kind of application upgrade test method, which comprises
Service customer end after obtaining upgrading is according to test data test order generated；
Determine order label corresponding with the test order；
History Order corresponding with the order label is searched from data bank；The History Order passes through described before upgrading
Service customer end is according to the Test data generation；
The test order and the History Order are compared, determined between the test order and the History Order
Difference section；
Matching degree between default upgrade requirement and the difference section according to corresponding to the service customer end after the upgrading,
Determination carries out the service customer end after upgrading to test obtained client test result.
2. the method according to claim 1, wherein the method also includes:
Back up the History Order information of the History Order；
The test order information of the test order is covered into the History Order information, and the test order information is stored
Extremely in the data bank, so that storing test order information corresponding to the service customer end of latest edition in the data bank.
3. according to the method described in claim 2, it is characterized in that, the method also includes:
The test order information of the test order is searched from the data bank；
The test order information is sent to service server；
It obtains the service server and the obtained order processing data of business processing is carried out to the test order information；
According to the order processing data and expected results data, server test corresponding with the service server is determined
As a result.
4. according to the method described in claim 3, it is characterized in that, described obtain the service server to the test order
Information carries out the obtained order processing data of business processing, comprising:
It is converted, is obtained by data format and/or data type of the service server to the test order information
Match the order processing data of target data format and/or target data type；
Determine order note identification corresponding with the test order information；
Corresponding order processing data are searched in timing according to the order note identification from the service server.
5. according to the method described in claim 3, it is characterized in that, the method also includes:
According to the client test result and the server test result, test corresponding with the test data is updated
File；
According to updated test file, corresponding application upgrade test report is generated.
6. method according to any one of claims 1 to 5, which is characterized in that described by the test order and described to go through
History order is compared, and determines the difference section between the test order and the History Order, comprising:
Obtain order keyword；
Respectively from the order information of the test order and the History Order, extract corresponding with the order keyword
Order key message；
The order key message of extraction is compared, determines the difference between the test order and the History Order
Different part.
7. a kind of application upgrade test device, which is characterized in that described device includes:
Module is obtained, for obtaining the service customer end after upgrading according to test data test order generated；
Determining module, for determining order label corresponding with the test order；
Searching module, for searching History Order corresponding with the order label from data bank；The History Order is logical
The service customer end before crossing upgrading is according to the Test data generation；
Analysis module, for the test order and the History Order to be compared, determine the test order and
Difference section between the History Order；
The determining module is also used to the default upgrade requirement according to corresponding to the service customer end after the upgrading and the difference
Matching degree between different part, determination carry out the service customer end after upgrading to test obtained client test result.
8. device according to claim 7, which is characterized in that described device further include:
Backup module, for backing up the History Order information of the History Order；
Memory module is covered, for the test order information of the test order to be covered the History Order information, and by institute
Test order information is stated to store into the data bank.
9. a kind of computer equipment, including memory and processor, the memory are stored with computer program, feature exists
In the step of processor realizes any one of claims 1 to 6 the method when executing the computer program.
10. a kind of computer readable storage medium, is stored thereon with computer program, which is characterized in that the computer program
The step of method described in any one of claims 1 to 6 is realized when being executed by processor.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910531884.6A CN110362478B (en) | 2019-06-19 | 2019-06-19 | Application upgrade test method and device, computer equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910531884.6A CN110362478B (en) | 2019-06-19 | 2019-06-19 | Application upgrade test method and device, computer equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110362478A true CN110362478A (en) | 2019-10-22 |
| CN110362478B CN110362478B (en) | 2023-04-18 |
Family
ID=68217398
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910531884.6A Active CN110362478B (en) | 2019-06-19 | 2019-06-19 | Application upgrade test method and device, computer equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110362478B (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112231224A (en) * | 2020-10-30 | 2021-01-15 | 平安银行股份有限公司 | Business system testing method, device, equipment and medium based on artificial intelligence |
| CN112463630A (en) * | 2020-12-08 | 2021-03-09 | 广州品唯软件有限公司 | Version difference testing method and device, computer equipment and storage medium |
| CN113656315A (en) * | 2021-08-19 | 2021-11-16 | 北京百度网讯科技有限公司 | Data testing method and device, electronic equipment and storage medium |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103631705A (en) * | 2012-08-24 | 2014-03-12 | 百度在线网络技术（北京）有限公司 | Regression testing method and device for search engine |
| CN105450464A (en) * | 2014-08-27 | 2016-03-30 | 阿里巴巴集团控股有限公司 | Test method and test device for service interfaces |
| US20170262359A1 (en) * | 2016-03-11 | 2017-09-14 | Wipro Limited | Method and system for enabling self-maintainable test automation |
| CN107730385A (en) * | 2017-07-27 | 2018-02-23 | 上海壹账通金融科技有限公司 | Simulation process method, apparatus, storage medium and the computer equipment of sequence information |
| CN108170453A (en) * | 2018-01-17 | 2018-06-15 | 中国平安人寿保险股份有限公司 | A kind of MIT method for upgrading system, storage medium and terminal device |
| CN108170606A (en) * | 2018-01-03 | 2018-06-15 | 中国工商银行股份有限公司 | The test system and method for system software upgrading class application |
| CN109871315A (en) * | 2019-01-03 | 2019-06-11 | 平安科技（深圳）有限公司 | The diagnostic method and device of system upgrade failure based on machine learning |
-
2019
- 2019-06-19 CN CN201910531884.6A patent/CN110362478B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103631705A (en) * | 2012-08-24 | 2014-03-12 | 百度在线网络技术（北京）有限公司 | Regression testing method and device for search engine |
| CN105450464A (en) * | 2014-08-27 | 2016-03-30 | 阿里巴巴集团控股有限公司 | Test method and test device for service interfaces |
| US20170262359A1 (en) * | 2016-03-11 | 2017-09-14 | Wipro Limited | Method and system for enabling self-maintainable test automation |
| CN107730385A (en) * | 2017-07-27 | 2018-02-23 | 上海壹账通金融科技有限公司 | Simulation process method, apparatus, storage medium and the computer equipment of sequence information |
| CN108170606A (en) * | 2018-01-03 | 2018-06-15 | 中国工商银行股份有限公司 | The test system and method for system software upgrading class application |
| CN108170453A (en) * | 2018-01-17 | 2018-06-15 | 中国平安人寿保险股份有限公司 | A kind of MIT method for upgrading system, storage medium and terminal device |
| CN109871315A (en) * | 2019-01-03 | 2019-06-11 | 平安科技（深圳）有限公司 | The diagnostic method and device of system upgrade failure based on machine learning |
Non-Patent Citations (1)
| Title |
|---|
| 张洪秀: "大型分布式交易系统动态升级机制的设计与实现" * |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112231224A (en) * | 2020-10-30 | 2021-01-15 | 平安银行股份有限公司 | Business system testing method, device, equipment and medium based on artificial intelligence |
| CN112463630A (en) * | 2020-12-08 | 2021-03-09 | 广州品唯软件有限公司 | Version difference testing method and device, computer equipment and storage medium |
| CN113656315A (en) * | 2021-08-19 | 2021-11-16 | 北京百度网讯科技有限公司 | Data testing method and device, electronic equipment and storage medium |
| CN113656315B (en) * | 2021-08-19 | 2023-01-24 | 北京百度网讯科技有限公司 | Data testing method and device, electronic equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110362478B (en) | 2023-04-18 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110399293B (en) | System test method, device, computer equipment and storage medium | |
| WO2020186786A1 (en) | File processing method and apparatus, computer device and storage medium | |
| CN108874926A (en) | Mass data inquiry method, device, computer equipment and storage medium | |
| US20210279164A1 (en) | Real Time Application Error Identification and Mitigation | |
| CN109359939A (en) | Business datum method of calibration, device, computer equipment and storage medium | |
| CN109542412A (en) | Interface message generation method, device, computer equipment and storage medium | |
| CN110321284B (en) | Test data entry method, device, computer equipment and storage medium | |
| CN108334625B (en) | User information processing method and device, computer equipment and storage medium | |
| CN108874661B (en) | Test mapping relation library generation method and device, computer equipment and storage medium | |
| CN109144799A (en) | Integrated testing method, apparatus, computer equipment and storage medium | |
| CN112100219A (en) | Report generation method, device, equipment and medium based on database query processing | |
| CN110362478A (en) | Application upgrade test method, device, computer equipment and storage medium | |
| CN109446065A (en) | User tag test method, device, computer equipment and storage medium | |
| CN108509424A (en) | Institutional information processing method, device, computer equipment and storage medium | |
| CN110362479B (en) | System upgrade test method and system | |
| CN109902272A (en) | Electronic form data processing method, device, computer equipment and storage medium | |
| CN110413507B (en) | System test method, device, computer equipment and storage medium | |
| CN109062925A (en) | Automatically generate the method, apparatus, computer equipment and storage medium of insert sentence | |
| CN110647459B (en) | Application testing method and device | |
| WO2018177205A1 (en) | Regression testing method, device, computer apparatus, and storage medium | |
| CN112286934A (en) | Database table importing method, device, equipment and medium | |
| CN108399125A (en) | Automated testing method, device, computer equipment and storage medium | |
| CN108897772B (en) | Data source supplementing method and device, computer equipment and storage medium | |
| CN110442478A (en) | Product failure processing method, device, computer equipment and storage medium | |
| CN110647452B (en) | Test method, test device, computer equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |