CN108255720A - Software automatic test system based on cloud computing framework - Google Patents
Software automatic test system based on cloud computing framework Download PDFInfo
- Publication number
- CN108255720A CN108255720A CN201810029578.8A CN201810029578A CN108255720A CN 108255720 A CN108255720 A CN 108255720A CN 201810029578 A CN201810029578 A CN 201810029578A CN 108255720 A CN108255720 A CN 108255720A
- Authority
- CN
- China
- Prior art keywords
- test
- server
- software
- equipment
- user
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/3688—Test management for test execution, e.g. scheduling of test suites
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/3684—Test management for test design, e.g. generating new test cases
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/3692—Test management for test results analysis
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Computer Hardware Design (AREA)
- Quality & Reliability (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Debugging And Monitoring (AREA)
Abstract
The invention discloses a kind of software automatic test system based on cloud computing framework, including：Client, application server, service dispatch system and device server；The service dispatch system includes file server, actuator, device management server and database；A kind of software automatic test system based on cloud computing framework provided by the invention first, will build cloud platform to ensure the reasonable distribution of the storage of data and resource.The realization of cloud platform is equally beneficial for the promotion of the fault-tolerant and efficiency in software test.Secondly as cloud computing is included in, single software test procedure can be uploaded to by internet with result and resource-sharing is carried out in cloud platform storage space.Finally, after the software test path of magnanimity is analyzed, the software developed can automatically analyze out feasible test path, so as to fulfill the purpose of automation software testing.
Description
Technical field
The present invention relates to field of computer technology, specifically, more particularly to a kind of software based on cloud computing framework is certainly
Dynamic test system.
Background technology
Software test is a kind of audit to reality output and anticipated output or comparison procedure, be ensure software quality,
Improve the key of software reliability.With the fast development of science and technology, domestic and international related check testing agency is to newly developed
Software quality proposes increasingly higher demands, and the degree of automation of software test is also increasingly paid attention to.Software test not only into
For an organic component of software development, and in occupation of sizable proportion in the software systems of exploitation.With the U.S.
Software development and production average fund input for, usual ratio is：Demand analysis and planning are determining respectively to account for 3 percent,
Design accounts for 5 percent, and programming accounts for 7 percent, and test accounts for 1 15, goes into operation and maintenance accounts for six or seven ten percent.Test
Status in software development is self-evident.
In recent years, the appearance of cloud computing technology brings tremendous influence to software organization of production and Software Architecture Design.
The appearance of this emerging service pattern of cloud computing changes the production and consumption mode of software product.And the method for software test,
Technology and tool are also required to change therewith.Under cloud computing environment, software test procedure can be moved in cloud, and applies cloud meter
The resources such as calculating and the storage of platform offer are provided and carry out various test activities.This be a kind of novel software test mode and
One whole new set of applications of cloud computing technology.
Existing cloud test system is in the starting stage, although can meet some specialized market's demands, still deposits
In many deficiencies, including：
(1) access time is long, and testing efficiency is low to wait the unacceptable problem of users.
(2) test system configurations are complicated, wherein both included complicated test environment configuration, once also relate to portion during operation
Divide function or component error, cause to test system outage, test system crash and test interface confusion etc..
(3) problem analysis of the test content with demand when inconsistent shows as actual demand and expected test in test
As a result when inconsistent, how to search and the position of Wrong localization and reason.
Invention content
In order to solve problem of the prior art, an embodiment of the present invention provides the software automatic tests based on cloud computing framework
System.The technical solution is as follows：
On the one hand, a kind of software automatic test system based on cloud computing framework is provided, including：Client, using clothes
Business device, service dispatch system and device server；
The service dispatch system includes file server, actuator, device management server and database；
The client creates, test case creation, equipment connection, the recording of script, script for completing test event
Editor, resource/component edits, script perform, operation is checked in report；
The application server receives the behaviour of user using real-time messages agreement or scalable message processing Presence Protocol
It asks, and device directive is forwarded to the actuator in the service dispatch system；The actuator is by the device directive
It is sent to device management server；
Test module is provided in the device server, the test module is described automatic using the mechanism that automatically configures
Configuration mechanism includes test pattern customization, Resources Customization, error handle, isolation and tracking；The test module uses black box certainly
Dynamicization measuring technology.
Further, when client be desktop application, then on the basis of having primary customer end function, increase equipment
The function of management server, client at this time also become an equipment manager, pass through input/output interface technology of new generation
It is attached with device management server, user can come out the collaborative share connected on oneself computer.
Further, the application server uses distributed deployment.
Further, the actuator is used to manage the device directive concentratedly；
The device management server is for centralized management equipment server；
The file server uses distributed file server for preserving user file.
Further, it is connect between the device server, device management server, actuator by input and output of new generation
Vocal imitation skill communicates.
Further, the device management server monitors the equipment state that all devices server connects,
The state of each device server is sent to Web server end in real time by the actuator, it will by Web server
Equipment state informs client in real time；
The device management server by the device directive received be sent on the device server specified and by
Device server gives the equipment specified to perform operation by novel mobile equipment debugging mechanics of communication.
Further, it when test pattern customizes, according to the test that the current software under testing needs of user carry out, selects different
At the time of test pattern will influence the type, quantity and use of used resource.
Further, the black box automatization testing technique during iterative development using carrying out regression test.
Further, described the step of regression test is carried out during iterative development, specifically includes：
User is recorded per single stepping first；
Secondly, all records are converted into a kind of process of script description, with the operation of analog subscriber；Then it plays back
When the described process of script is converted to operation on screen；
Finally, the output record of system under test (SUT) is obtained.
Further, in Black-box Testing, according to feedack in test and the information of test result, into
Row mistake positioning and to test result carry out aggregative quantity evaluation.
The advantageous effect that technical solution provided in an embodiment of the present invention is brought is：
A kind of software automatic test system based on cloud computing framework provided by the invention first, will build cloud platform
Ensure the storage of data and the reasonable distribution of resource.The realization of cloud platform is equally beneficial for the fault-tolerant and efficiency in software test
It is promoted.Secondly as cloud computing is included in, single software test procedure can upload to cloud platform with result by internet
Resource-sharing is carried out in storage space.Finally, after the software test path of magnanimity is analyzed, the software developed can be certainly
It is dynamic to analyze feasible test path, so as to fulfill the purpose of automation software testing.
Description of the drawings
To describe the technical solutions in the embodiments of the present invention more clearly, make required in being described below to embodiment
Attached drawing is briefly described, it should be apparent that, the accompanying drawings in the following description is only some embodiments of the present invention, for
For those of ordinary skill in the art, without creative efforts, other are can also be obtained according to these attached drawings
Attached drawing.
Fig. 1 is the schematic diagram of the software automatic test system based on cloud computing framework in the embodiment of the present invention；
Fig. 2 is the software automatic test system hierarchical chart based on cloud computing framework in the embodiment of the present invention；
Fig. 3 is the flow chart of medium cloud test Solution of the embodiment of the present invention；
Fig. 4 is the flow chart of medium cloud testing service flow profiling of the embodiment of the present invention.
Specific embodiment
To make the object, technical solutions and advantages of the present invention clearer, below in conjunction with attached drawing to embodiment party of the present invention
Formula is described in further detail.
The present invention provides a kind of software automatic test system based on cloud computing framework, referring to Fig. 1, including：Client,
Application server, service dispatch system and device server；
The service dispatch system includes file server, actuator, device management server and database；
The client creates, test case creation, equipment connection, the recording of script, script for completing test event
The operations such as editor, resource/component edits, script perform, report is checked；
The application server receives the behaviour of user using real-time messages agreement or scalable message processing Presence Protocol
It asks, and device directive is forwarded to the actuator in the service dispatch system；The actuator is by the device directive
It is sent to device management server；
Test module is provided in the device server, the test module is described automatic using the mechanism that automatically configures
Configuration mechanism includes test pattern customization, Resources Customization, error handle, isolation and tracking；The test module uses black box certainly
Dynamicization measuring technology.
Specifically, client (webpage) is the operation interface of user, completes test event on the surface and creates, test is used
Example (script) establishments, the recording of script, scripting editing, resource/component edits, script execution, is reported and the behaviour such as checks equipment connection
Make.If user installation is Fat Client (desktop application), on the basis of having primary customer end function, increases and set
The function of standby management server, client at this time also become an equipment manager, pass through input/output interface skill of new generation
Art is attached with device management server, and user can come out the collaborative share connected on oneself computer.
Web server (Apache, Squid) receives client and the request at interface is operated, such as webpage, picture.
Using RTMP, (Real Time Messaging Protocol's application server (Red5, Openfire) disappear in real time
Cease agreement) or XMPP (Extensible Messaging and Presence Protocol scalable messages processing scenes
Agreement) receive user's operation request and device directive is transmitted to actuator, actuator sends an instruction to equipment management service
Device.Application server can be with distributed deployment, to carry the concurrency of bigger.
Actuator is the centralized management part of all instructions, and such as the project that user creates, test case data needs to issue
Device directive, the equipment that is being lined up uses request etc..
Device management server is the centralized management to equipment, the equipment of all devices server connection all concentrate herein into
Row management.
File server is to preserve user file (script file, document scene, resource file, the application program uploaded
Deng).Using distributed file server Windows DFS, FastDFS or HDFS (Hadoop Distributed File
System)。
Device management server is to monitor the equipment state that all devices server connects first, by each equipment
State be sent to Web server end in real time by actuator, equipment state is informed into client in real time by Web server.
Secondly, the instruction received is sent on the device server specified and is passed through by device server new by device management server
The mobile equipment debugging mechanics of communication of type gives the equipment specified to perform operation.Device server, device management server, actuator
Between communicated by input/output interface technology of new generation.
Modules can carry out distributed deployment, while role can also mutually convert, to improve the covering model of cloud
It encloses, theoretically, all client computer devices can convert the device server in framework thus, that is to say, that
User in cloud community can come out the collaborative share of oneself, and be connected on the computer of oneself, then the users to share
Mobile equipment just becomes an equipment in test cloud, and the user in other clouds is it is seen that the equipment, and on the device
It carries out the automatic test of oneself needs and obtains test report.
In the present embodiment, referring to Fig. 2, the software automatic test system based on cloud computing structure is divided into IaaS, PaaS, SaaS
With tetra- layers of TaaS；
(1)IaaS(Infrastructure as a Service)：It is calculating, storage, network and build test wrapper
Some tools needed for border are supplied to user as service, allow users to obtain IT infrastructure on demand.Pass through this core group
Part is by the computing resource of hardware, Internet resources and memory resource pool.
(2)PaaS(Platform as a Service)：Using the exploitation, test and deployed environment of test software as clothes
Business, is supplied to user based on internet, provides database, operating system, test development environment etc. to the user.
(3)SaaS(Software as a Service)：User does not grasp operating system, hardware or cloud computing and puts down
The network infrastructure of platform, only using only application program.It is that a kind of software service providers are supplied to user in a manner of leasing
The concept of service, this pattern usually have customizable, configurable, multi-tenant efficiency and expansible characteristic, often by
The form of account number cipher or certificate is supplied to user.By taking cloud tests website Sauce Labs as an example, http://
As portal, user can be tested www.saucelabs.com by uploading test script.Registered user, by purchasing on demand
Resource is bought, by assigned user class, and user class determines the resources of virtual machine and testing time that user can be assigned to.
(4) TaaS (Testing as a servie) tests service：It is that a kind of internet that is based on provides software test clothes
The application model of business, user can use various testing services online, such as test Automated Design, automated function test, testing tube
Reason etc..The function distributing of management to test event and test script pretreatment in the application server, application server
For the demand of response test person.The corresponding priority and dependence for obtaining test script of analysis and pretreatment to test script
Etc. information, convert local standard compliant test script so that it can perform test in cloud.
(5) cloud security management：User is helped to ensure to include identity combination certification, record management, user management, web access
The safety of cloud service of management and configuration etc., global visual angle is provided for administrative staff, it is ensured that the uninterrupted operation security of customer service,
And provide the cloud internal and external environment of reliable safety.
(6) cloud service management：The platform of operation cloud testing service from service request, monitoring management to service, it can be achieved that tie
All activities of beam are the management of an automation.
Further, when client be desktop application, then on the basis of having primary customer end function, increase equipment
The function of management server, client at this time also become an equipment manager, pass through input/output interface technology of new generation
It is attached with device management server, user can come out the collaborative share connected on oneself computer.
Further, the application server uses distributed deployment.
Further, the actuator is used to manage the device directive concentratedly；
The device management server is for centralized management equipment server；
The file server uses distributed file server for preserving user file.
Further, it is connect between the device server, device management server, actuator by input and output of new generation
Vocal imitation skill communicates.
Further, the device management server monitors the equipment state that all devices server connects,
The state of each device server is sent to Web server end in real time by the actuator, it will by Web server
Equipment state informs client in real time；
The device management server by the device directive received be sent on the device server specified and by
Device server gives the equipment specified to perform operation by novel mobile equipment debugging mechanics of communication.
Further, the function that automatically configures in cloud test platform includes test pattern customization, Resources Customization, at mistake
Reason, isolation and tracking etc..
When test pattern customizes, according to the test that the current software under testing needs of user carry out, different test patterns is selected
Used in will influencing at the time of the type of resource, quantity and use.For example, if unit testing, then system needs
Resource carry load the function module of tape test and its required resource of test module, and system testing then needs to expend more
More resources.After test pattern configuration, according to the environmental requirement under the test pattern, system running environment configuration is carried out,
The combination and configuration of test cases, configuration of software under testing etc., and the corresponding calculating of distribution and storage resource beyond the clouds, so as to complete
Into the customization of resource.The processing of mistake and the configuration of test pattern and test cases are closely related.This project is tested in processing
When mistake, intend the resource requirement according to module and importance, different weights is assigned to module, then according to the ratio of weight
Whether rate decision module can be reassembled as the module of a bigger.The processing of mistake is carried out in module level, is conducive to be properly positioned
The position of mistake.When division module, according to concurrency, alternative, importance between module etc., which mistake determined
Must stop testing, and handled during appearance, can ignore when which mistake occurs, when which mistake occurs can temporarily every
From, and other tests are carried out, so as to efficiently use cloud test resource, improve the flexibility of test, accelerated test progress.
Cloud computing technology possesses the parallel computation of high speed and the advantage of mass storage.Software test code and configuration data are made
For one kind of big data, high in the clouds will be uploaded to and stored and shared.Particularly cross-system platform is shared, can will be various
Terminal links together, and there is stronger durability can simultaneously effectively reduce cost.
Further, the black box automatization testing technique in the application is returned using during iterative development
Test, so as to greatly reduce the workload of Black-box Testing.Its specific steps can be divided into the following steps：We can will use first
It is all recorded per single stepping at family；Secondly, all records are converted into a kind of process of script description, with analog subscriber
Operation；Script described process is converted to the operation on screen when then playing back；Finally, system under test (SUT) is obtained
Output record.
After test result generation, test result is compared and evaluated with expected results.In different test moulds
Under formula, the evaluation of test result has the characteristics that different.Such as when unit testing, it is preferred that emphasis is just whether to-be-measured cell
Function needed for really completing, correctness and fault-tolerant ability for being exported under different input conditions etc.；And when performance test,
Whether the performance for focusing on system offer of test meets in many aspects such as maximum throughput, number of users, connection numbers prominent
Requirement on hair and maximum performance.This project intends the difference according to test pattern, sets the scoring mark of module or system to be measured
Standard, after testing is complete, according to the TOP SCORES of system and distribution of grading, whether evaluation system meets wanting for design
The reason of asking and failing to meet design requirement, so as to provide support for further improvement.
Occur partially or wholly failure during the test, cause some or all different by occurring in test
Chang Shi, this project is intended carrying out data analysis according to the mass data stored in cloud platform, using self-adapted genetic algorithm, fault tree
The methods of positioning failure the reason of, for design and developer solve the problems, such as, so as to continue test job.
The key technology of the software automatic test system based on cloud computing framework in the application is as follows：
(1) distribution, deployment, the scheduling of virtual test node
Cloud test platform can build test environment automatically, and primary work is distribution virtual test node.According to test need
Ask quantity, configuration of the empty machine of application etc.；Then according to environment configurations template automatic distributing deployment operation system, software systems and
Test system etc., to complete building for test environment；In addition cloud test platform can be according to virtual test node during the test
State and resource Expenditure Levels, dynamic dispatching void machine operation, stop and redistribute, so as to reach test need
It will.
(2) test case deployment, scheduling, collection
Before test implementation, it is necessary first to formulate test concrete scheme, be concentrated mainly on deployment scheduling strategy, i.e., which is virtual
Which script test node performs, collects and surveyed on which information, the execution sequence of each test node and same test node
Sequencing that example on probation performs etc.；Then test script deployment, scheduling are carried out according to deployment scheduling strategy；Finally perform survey
Examination, the result information for collecting needs are analyzed.Certainly this is different from the deployment scheduling of virtual test node, but there is also
Certain association, such as when the failure of virtual test node or inadequate resource, cloud test platform can Dynamical Deployment, schedule virtual
Test node may relate to the stopping of certain test nodes, redistribute, at this moment deployment, scheduling and the result of test case
Collection be also required to carry out corresponding dynamic and adjust.
(3) cross-platform data is shared
The process and result of software test each time will be all passed to by internet in the storage space of cloud platform.Work as phase
When needing test like software, software testing system will automatically analyze feasible test path and expected results and automate soft
Part is tested.Since such data sharing is based on technique of internet, the software development of cross-system platform just seems particularly heavy
It will.
This project will connect different soft ware platforms based on cloud computing technology, carry out integrated management.
During software test, if test software is cross-system platform software, corresponding software testing system also exists test
The operational effect of the software under each system platform, and carry out comprehensive assessment.Current multisystem platform (Windows, Linux,
Android, iOS etc.) together under winged background, meaning that the software test of cross-system platform has its special.
The software automatic test system based on cloud computing framework in the application has the beneficial effect that：
(1) rounded system structure
The cloud computing theory of mainstream is combined by this project with the actual demand of software test.Propose cloud test platform
Architecture, including client part, application server, service dispatch system and device server etc..Testing service by
Client part is submitted, and by service dispatch system configuration and distributes corresponding test resource, and test control is sent out to device server
Message processed, and collect test result and return to service dispatch system, so as to complete testing service.The architecture has resource sequentially
Distribution, customization flexibly, high degree of automation, the features such as scalability is strong, fault freedom is strong, be test architecture based on cloud
One innovation of aspect.
(2) sound test module configuration
In the configuration of automatic test, under different test patterns, by different test modules according to computing resource, net
The demand of network resource, storage resource etc. and the difference of importance set weight, so as to whether determine complementary module
Can combine and intermodule it is parallel, can isolated relation, reasonably carry out test module arrangement, be testing scheme it is flexible,
Healthy and strong, reusable lays the foundation, and is an innovation in terms of testing scheme configuration.
(3) the test result evaluation of system
In Black-box Testing, according to feedack in test and the information of test result, determining for mistake is carried out
Position and aggregative quantity evaluation is carried out to test result, be test result processing so as to scientifically and rationally evaluating and testing test result
One innovation of aspect.
(4) cross-platform method for testing software
In today of multisystem platform joint development, more and more software developments are required cross-platform operation.Correspondingly,
Method for testing software is also required to the requirement that can reach cross-platform test.At present the method for testing software of mainstream do not refer to across
The concept of platform test, the multi-platform software test method that this project proposes can also be seen as a kind of innovation.
In the present embodiment, software test with cloud computing technology is combined, is to solve traditional software test process
In the building of the installation of such as system that encounters and environment, the installation of testing tool and configuration and the study of testing tool and make
With etc. variety of problems.Interaction platform is tested by analyzing and designing cloud, management cloud infrastructure resource that can be unified provides firmly
The support of part by friendly Web interactive interfaces and is the service interface that testing service provides, and can be realized a kind of efficient
The test process of rate, low complex degree.Interaction platform can be tested by cloud to realize a kind of cloud testing service.User is tested to submit
After test request, cloud test platform scheduling virtual machine is simultaneously tested on a virtual machine, and test result is fed back after the completion of test
To user.
In order to solve the problems, such as that traditional software is tested, the scheme of the system is provided, first, in traditional test frame
The problem of static resource efficiency of management is low improves the utilization ratio of resource with reference to virtualization technology.With the substantially single of virtualization
Test platform based on first virtual instance VM (Virtual Machine) carries out the hardware resource on server abundant
Utilization.Then, for test assignment execution efficiency it is low the problem of, used using independent test in test assignment is concurrently performed
Example, the resource of dispersion is integrated, this relates to distributed calculating.Meanwhile provide the interactive survey based on Web service
Interface is tried, bringing more easily test to tester experiences.
One synthesis of these solutions is exactly a test cloud, and the equilibrium of resource is provided by a test cloud
One easy-to-use test platform of optimization and offer.Fig. 3 is cloud test Solution.
Interaction platform is tested by cloud and provides cloud testing service for test user, the web interface that platform provides close friend can be with
Easily receive the test request of user, so solicited message is stored for virtual machine test call, later according to
The request scale at family carries out the configuration and scheduling of virtual machine by interaction platform, is then just tested beyond the clouds, and test is completed
Test result is collected afterwards and generates corresponding report and feeds back to user, sees Fig. 4.
(1) receive user test request
First, the testing service needed is selected.User can select and subscribe required test according to the demand of oneself
Service.Two kinds of involved testing tools before such as, such as pressure test is carried out to website using AB (ApacheBench),
It then needs to submit the relevant parameters such as the request number of test, the request number once generated, number of concurrent, testing time.
System can be accordingly configured according to the request scale parameter of user later, selection such as the quantity, operating system of virtual machine,
CPU configurations of virtual machine etc.；It is the conceivable result parameter of user, such as number of transactions per second, the average transaction corresponding time, average per second
The parameters such as the flow on network.Secondly, test target is set.User needs to set test target, and such as website is carried out
The performance test of pressure will then set corresponding target URL；To carry out relevant functional test, may be related to corresponding
Test script will then upload corresponding software test script as needed.
(2) request data storage and analysis
Server needs the testing service demand information uploaded to user and corresponding test target information to carry out data and deposit
Storage.Database is directly possibly stored to for some users request, virtual generator terminal test case AGENT is waited for call later；And
The test script information uploaded to user also needs to carry out relevant analysis, and storing or be converted into dependence test tool can recognize
With matched test script, the software test after being is ready.
(3) configuration and scheduling virtual machine
First, virtual machine is taken to be configured from resources of virtual machine pond.Resources of virtual machine pond, it can be with logical abstraction
Mode neatly manages resource.Virtual machine pool pattern is a kind of basic cloud computing architecture mode, and this pattern provides one
Kind can quickly supply the mechanism of required virtual machine, and this mechanism is by resources of virtual machine pond is safeguarded, to manage the whole of virtual machine
A life cycle.
Secondly, the Web service interface of cloud operating system is called to carry out stand-alone configuration, starts virtual machine instance.
Again, virtual machine AGENT obtains test data from server by API, reports final state to server, goes forward side by side
Enter armed state.AGENT is the software with franchise (administrator right) operated on VME operating system, passes through API
Test data is passed to AGENT, test command is performed by AGENT in virtual generator terminal.
AGENT is deployed in operation system image by the system preparation stage in virtual instance, when virtual machine instance starts
Afterwards, AGENT can receive test command in the case where cloud tests the control of interaction platform and perform test assignment, and be able to carry out ordering
Enable the management configuration and environment configurations completed to virtual machine.
Then, startup of server institute virtual machine in need, after obtaining last consistent virtual machine confirmation message, publication is most
The whole testing time.After server starts required virtual machine, virtual machine just enters test armed state, most
Whole server will obtain the consistent confirmation message of awaiting orders of virtual machine, then according to the operation conditions of virtual machine and the demand of test
Condition, server can issue the exact testing time to virtual machine instance.
(4) cloud is tested and collects result generation report
First, AGENT obtains timeline, sets the test starting time.AGENT passes through the interface with cloud test interaction platform
The final test timeline of server publication is obtained, then AGENT sets the corresponding test starting time according to timeline.
Secondly, AGENT at the appointed time starts to be tested by being pre-configured with.AGENT is set virtually according to timeline
The corresponding test starting time of example, such AGENT can at the appointed time start thread according to test configurations, test request
Corresponding test request is tested.
Again, AGENT monitors test process and finally collects result and report server.AGENT can during the test
To be monitored to test process, last test result is just collected by AGENT by testing requirement after the completion of test
And report to server, after server receives the test result that AGENT is sent, and then corresponding test result is analyzed
And statistics.
Then, server is counted, and generates result form and chart.The test result number that server reports AGENT
According to being summarized and being counted, report or chart are ultimately generated according to the relevant parameter of the requirement of test, test result, is most surveyed at last
Test result is presented to the user.
Specifically, AGENT is the software with franchise (administrator right) operated on VME operating system.
The apparatus embodiments described above are merely exemplary, wherein can be as the unit that separating component illustrates
Or may not be physically separate, the component shown as unit may or may not be physical unit, i.e.,
A place can be located at or can also be distributed in multiple network element.It can select according to the actual needs therein
Some or all of module realizes the purpose of this embodiment scheme.Those of ordinary skill in the art are not paying creative labor
In the case of dynamic, you can to understand and implement.
The foregoing is merely a prefered embodiment of the invention, is not intended to limit the invention, all in the spirit and principles in the present invention
Within, any modification, equivalent replacement, improvement and so on should all be included in the protection scope of the present invention.
Claims (10)
1. a kind of software automatic test system based on cloud computing framework, which is characterized in that including：Client, application server,
Service dispatch system and device server；
The service dispatch system includes file server, actuator, device management server and database；
The client creates for completing test event, and test case creation, equipment connection, the recording of script, script are compiled
It collects, resource/component edits, script perform, operation is checked in report；
The operation that the application server receives user using real-time messages agreement or scalable message processing Presence Protocol please
It asks, and device directive is forwarded to the actuator in the service dispatch system；The actuator sends the device directive
To device management server；
Test module is provided in the device server, the test module uses and automatically configures mechanism, described to automatically configure
Mechanism includes test pattern customization, Resources Customization, error handle, isolation and tracking；The test module is automated using black box
Measuring technology.
2. the system as claimed in claim 1, which is characterized in that when client be desktop application, then having primary customer end
On the basis of function, the function of device management server is increased, client at this time also becomes an equipment manager, passes through
Input/output interface technology of new generation is attached with device management server, the equipment that user can will connect on oneself computer
It shares out.
3. system as claimed in claim 2, which is characterized in that the application server uses distributed deployment.
4. system as claimed in claim 3, which is characterized in that the actuator is used to manage the device directive concentratedly；
The device management server is for centralized management equipment server；
The file server uses distributed file server for preserving user file.
5. system as claimed in claim 4, which is characterized in that the device server, device management server, actuator it
Between communicated by input/output interface technology of new generation.
6. system as claimed in claim 5, which is characterized in that the device management server connects all devices server
The equipment state connect is monitored, and the state of each device server is sent to Web in real time by the actuator
Equipment state is informed client by server end in real time by Web server；
The device directive received is sent on the device server specified and by equipment by the device management server
Server gives the equipment specified to perform operation by novel mobile equipment debugging mechanics of communication.
7. system as claimed in claim 6, which is characterized in that when test pattern customizes, according to the current software under testing need of user
The test to be carried out, at the time of selecting different test patterns that will influence the type, quantity and use of used resource.
8. system as claimed in claim 7, which is characterized in that the black box automatization testing technique is opened using in iteration
Regression test is carried out during hair.
9. system as claimed in claim 8, which is characterized in that described the step of regression test is carried out during iterative development
It specifically includes：
User is recorded per single stepping first；
Secondly, all records are converted into a kind of process of script description, with the operation of analog subscriber；It will when then playing back
The described process of script is converted to the operation on screen；
Finally, the output record of system under test (SUT) is obtained.
10. system as claimed in claim 9, which is characterized in that in Black-box Testing, according to the letter fed back in test
The information of breath and test result carries out the positioning of mistake and carries out aggregative quantity evaluation to test result.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810029578.8A CN108255720A (en) | 2018-01-12 | 2018-01-12 | Software automatic test system based on cloud computing framework |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810029578.8A CN108255720A (en) | 2018-01-12 | 2018-01-12 | Software automatic test system based on cloud computing framework |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108255720A true CN108255720A (en) | 2018-07-06 |
Family
ID=62727129
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810029578.8A Pending CN108255720A (en) | 2018-01-12 | 2018-01-12 | Software automatic test system based on cloud computing framework |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108255720A (en) |
Cited By (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110188034A (en) * | 2019-05-10 | 2019-08-30 | 广州高鸿信息科技有限公司 | A kind of method for testing software based on information sharing |
| CN110413525A (en) * | 2019-07-29 | 2019-11-05 | 国网新疆电力有限公司电力科学研究院 | Safety detecting method and device |
| CN110412389A (en) * | 2019-08-23 | 2019-11-05 | 中国南方电网有限责任公司超高压输电公司南宁局 | String mends protective device and the string based on cloud computing mends protection test macro |
| CN110471719A (en) * | 2019-08-16 | 2019-11-19 | 北京明略软件系统有限公司 | Operation method and device, storage medium, the electronic device of script file |
| CN110708210A (en) * | 2019-08-30 | 2020-01-17 | 深圳壹账通智能科技有限公司 | Cloud test configuration method and device, computer equipment and storage medium |
| CN111159003A (en) * | 2018-11-07 | 2020-05-15 | 马上消费金融股份有限公司 | Batch processing test method and device |
| CN111290937A (en) * | 2018-12-08 | 2020-06-16 | 南京慕测信息科技有限公司 | Extensible mobile application automatic test platform based on hybrid cloud |
| CN111338930A (en) * | 2019-12-19 | 2020-06-26 | 烽火通信科技股份有限公司 | Automatic test system and method based on multiple processes and multiple tenants |
| CN111581158A (en) * | 2020-05-04 | 2020-08-25 | 上海维信荟智金融科技有限公司 | Distributed file storage method and system |
| CN111651357A (en) * | 2020-06-03 | 2020-09-11 | 厦门力含信息技术服务有限公司 | Software automation testing method based on cloud computing |
| CN111767225A (en) * | 2020-06-29 | 2020-10-13 | 厦门力含信息技术服务有限公司 | Third-party software testing system and method in cloud computing environment |
| CN111800310A (en) * | 2020-06-17 | 2020-10-20 | 北京智网信测科技有限公司 | Scheduling algorithm for task management module of Internet of things testing cloud platform |
| CN112379864A (en) * | 2020-10-26 | 2021-02-19 | 合科软件（北京）有限责任公司 | Software system |
| CN112486812A (en) * | 2020-11-26 | 2021-03-12 | 北京海量数据技术股份有限公司 | Distributed framework software testing method and device supporting cloud |
| CN114143222A (en) * | 2021-12-07 | 2022-03-04 | 无锡物联网产业研究院 | Internet of things key equipment cloud testing method for typical application of smart city |
| CN115150298A (en) * | 2021-03-31 | 2022-10-04 | 北京金山云网络技术有限公司 | Virtual gateway testing method and device, storage medium and electronic equipment |
| CN116450400A (en) * | 2023-06-19 | 2023-07-18 | 北京翼辉信息技术有限公司 | Application program abnormality analysis method and device, electronic equipment and storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150186252A1 (en) * | 2013-12-31 | 2015-07-02 | International Business Machines Corporation | Testing of transaction tracking software |
| CN105302718A (en) * | 2015-10-26 | 2016-02-03 | 浪潮电子信息产业股份有限公司 | Design method of multiplexing software-oriented test model |
| CN105607998A (en) * | 2015-12-11 | 2016-05-25 | 成都新兴信息技术研究所 | System and method for performing embedded software debug online |
| CN106649085A (en) * | 2016-09-23 | 2017-05-10 | 郑州云海信息技术有限公司 | Cloud computing-based software test system |
-
2018
- 2018-01-12 CN CN201810029578.8A patent/CN108255720A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150186252A1 (en) * | 2013-12-31 | 2015-07-02 | International Business Machines Corporation | Testing of transaction tracking software |
| CN105302718A (en) * | 2015-10-26 | 2016-02-03 | 浪潮电子信息产业股份有限公司 | Design method of multiplexing software-oriented test model |
| CN105607998A (en) * | 2015-12-11 | 2016-05-25 | 成都新兴信息技术研究所 | System and method for performing embedded software debug online |
| CN106649085A (en) * | 2016-09-23 | 2017-05-10 | 郑州云海信息技术有限公司 | Cloud computing-based software test system |
Cited By (24)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111159003B (en) * | 2018-11-07 | 2021-03-16 | 马上消费金融股份有限公司 | Batch processing test method and device |
| CN111159003A (en) * | 2018-11-07 | 2020-05-15 | 马上消费金融股份有限公司 | Batch processing test method and device |
| CN111290937B (en) * | 2018-12-08 | 2024-01-30 | 深圳慕智科技有限公司 | Extensible mobile application automation test platform based on hybrid cloud |
| CN111290937A (en) * | 2018-12-08 | 2020-06-16 | 南京慕测信息科技有限公司 | Extensible mobile application automatic test platform based on hybrid cloud |
| CN110188034A (en) * | 2019-05-10 | 2019-08-30 | 广州高鸿信息科技有限公司 | A kind of method for testing software based on information sharing |
| CN110413525A (en) * | 2019-07-29 | 2019-11-05 | 国网新疆电力有限公司电力科学研究院 | Safety detecting method and device |
| CN110471719A (en) * | 2019-08-16 | 2019-11-19 | 北京明略软件系统有限公司 | Operation method and device, storage medium, the electronic device of script file |
| CN110412389A (en) * | 2019-08-23 | 2019-11-05 | 中国南方电网有限责任公司超高压输电公司南宁局 | String mends protective device and the string based on cloud computing mends protection test macro |
| CN110708210B (en) * | 2019-08-30 | 2022-05-03 | 深圳壹账通智能科技有限公司 | Cloud test configuration method and device, computer equipment and storage medium |
| CN110708210A (en) * | 2019-08-30 | 2020-01-17 | 深圳壹账通智能科技有限公司 | Cloud test configuration method and device, computer equipment and storage medium |
| CN111338930A (en) * | 2019-12-19 | 2020-06-26 | 烽火通信科技股份有限公司 | Automatic test system and method based on multiple processes and multiple tenants |
| CN111581158A (en) * | 2020-05-04 | 2020-08-25 | 上海维信荟智金融科技有限公司 | Distributed file storage method and system |
| CN111651357B (en) * | 2020-06-03 | 2023-04-07 | 厦门力含信息技术服务有限公司 | Software automation testing method based on cloud computing |
| CN111651357A (en) * | 2020-06-03 | 2020-09-11 | 厦门力含信息技术服务有限公司 | Software automation testing method based on cloud computing |
| CN111800310B (en) * | 2020-06-17 | 2021-11-26 | 北京智网信测科技有限公司 | Scheduling method for task management module of Internet of things test cloud platform |
| CN111800310A (en) * | 2020-06-17 | 2020-10-20 | 北京智网信测科技有限公司 | Scheduling algorithm for task management module of Internet of things testing cloud platform |
| CN111767225B (en) * | 2020-06-29 | 2021-05-07 | 厦门力含信息技术服务有限公司 | Third-party software testing system and method in cloud computing environment |
| CN111767225A (en) * | 2020-06-29 | 2020-10-13 | 厦门力含信息技术服务有限公司 | Third-party software testing system and method in cloud computing environment |
| CN112379864A (en) * | 2020-10-26 | 2021-02-19 | 合科软件（北京）有限责任公司 | Software system |
| CN112486812A (en) * | 2020-11-26 | 2021-03-12 | 北京海量数据技术股份有限公司 | Distributed framework software testing method and device supporting cloud |
| CN115150298A (en) * | 2021-03-31 | 2022-10-04 | 北京金山云网络技术有限公司 | Virtual gateway testing method and device, storage medium and electronic equipment |
| CN115150298B (en) * | 2021-03-31 | 2023-11-03 | 北京金山云网络技术有限公司 | Virtual gateway testing method and device, storage medium and electronic equipment |
| CN114143222A (en) * | 2021-12-07 | 2022-03-04 | 无锡物联网产业研究院 | Internet of things key equipment cloud testing method for typical application of smart city |
| CN116450400A (en) * | 2023-06-19 | 2023-07-18 | 北京翼辉信息技术有限公司 | Application program abnormality analysis method and device, electronic equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108255720A (en) | Software automatic test system based on cloud computing framework | |
| US20210311858A1 (en) | System and method for providing a test manager for use with a mainframe rehosting platform | |
| CN101946258B (en) | Model based deployment of computer based business process on dedicated hardware | |
| US8924791B2 (en) | System including a vendor computer system for testing software products in a cloud network | |
| CN105027108B (en) | Example host is configured | |
| EP2026212B1 (en) | Automatic test generation for reference testing | |
| CN110221962A (en) | A kind of centralization software testing management system and method | |
| CN110162471A (en) | A kind of method for testing pressure and system based on container cloud | |
| CN105308577B (en) | For providing the method, system and computer-readable memory of load testing service | |
| US7827273B2 (en) | Machine cluster topology representation for automated testing | |
| CN102880543B (en) | For the test data supply chain manager of integration testing platform | |
| CN106844198A (en) | Distributed dispatching automation test platform and method | |
| CN105487977A (en) | Agility-oriented automatic test management system and method | |
| WO2009082381A1 (en) | Incorporating development tools in system for deploying computer based process on shared infrastructure | |
| CN106484623A (en) | A kind of method of software test, apparatus and system | |
| Bai et al. | Vee@ Cloud: The virtual test lab on the cloud | |
| CN116466959A (en) | Deployment method and device of micro-service system, readable storage medium and electronic equipment | |
| CN105338045A (en) | Cloud computing resource processing device, method and cloud computing system | |
| CN109977012A (en) | Joint debugging test method, device, equipment and the computer readable storage medium of system | |
| Ostermann et al. | Integration of an event-based simulation framework into a scientific workflow execution environment for grids and clouds | |
| Denaro et al. | Performance testing of distributed component architectures | |
| Lu et al. | CF4BDA: A conceptual framework for big data analytics applications in the cloud | |
| Kaushik et al. | Micro Frontend Based Performance Improvement and Prediction for Microservices Using Machine Learning | |
| Ostermann et al. | Multi‐layered simulations at the heart of workflow enactment on clouds | |
| CN113127884B (en) | Vulnerability parallel verification method and device based on virtualization |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20180706 |
|
| RJ01 | Rejection of invention patent application after publication |