CN102144221A - Compact framework for automated testing - Google Patents
Compact framework for automated testing Download PDFInfo
- Publication number
- CN102144221A CN102144221A CN2009801344757A CN200980134475A CN102144221A CN 102144221 A CN102144221 A CN 102144221A CN 2009801344757 A CN2009801344757 A CN 2009801344757A CN 200980134475 A CN200980134475 A CN 200980134475A CN 102144221 A CN102144221 A CN 102144221A
- Authority
- CN
- China
- Prior art keywords
- test
- module
- stream
- execution
- user
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/22—Detection or location of defective computer hardware by testing during standby operation or during idle time, e.g. start-up testing
- G06F11/26—Functional testing
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Computer Hardware Design (AREA)
- Quality & Reliability (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Debugging And Monitoring (AREA)
- Stored Programmes (AREA)
Abstract
A system and method (''utility'') for automated testing using a compact framework is provided. The utility includes a plurality of functionalities that include development of a test module, development of a test flow, and execution of a test flow. Each of these functionalities may be separated by the compact framework, such that automated testing functions may be divided into individual roles. The individual roles may include test developer, test flow designer, and test flow executor. The utility may also include an authenticator that is operable to determine the individual role of a user (e.g., using a GUI), and to provide the functionality that corresponds to that role. The utility may provide one or more displays that provide real time data feedback.; Further, the utility may be operable to generate customized test results reports that enable a user to analyze the performance of one or more devices under test.
Description
Background technology
In the design and manufacturing of electronic installation, need the checking design and guarantee that device provides desired function and feature.As a result of, develop automatic test, can test the also function and the feature of verification electronic installation thus.Because tested device increases on complicacy, so also developed complicated more automatization test system.
The successful exploitation and the production accurately and reliably tested for this device of installing may be crucial.Be reflected on the performance of this device to flaw possible errors in the automatic test course delay in having caused thus developing and the unnecessary loss in the production.After this manner, device is crucial with reliably testing for effectively and efficiently developing or manufacturing a product accurately.
Under the situation that automatic test is used for during researching and developing product being evaluated, requirement accurate and effective automatic test strengthens therein.Although being used for the automatic test of device aborning may not can change continually, but the automatic test that uses during researching and developing may need to be provided for to revise the ability of testing and generating new test to lack the test development time fast, so that satisfy the testing requirement of handling the change that is associated with these research and development.
Used and be operating as the control proving installation and gather about the program of the data of this device and carry out automatic test.Traditionally, this has required the various contributions from different personnel, to guarantee appropriate test development.For example, the computer programmer can produce the source code that carries out automatic test by it.Yet possible is to be used for that automatic test is carried out calculation of coding machine programmer and to know little about it or not understanding for the requirement of overall test routine or test stream.This computer programmer who is used for this test procedure is developed or other same people may not know and need test what feature or assembly of new equipment that he or she may not know to be used for this device yet and evaluates the sum of necessary order, test or the kind of test fully.After this manner, may require field professional (for example, Test Engineer) fully catch each that need tested device little aspect on assist the computer programmer.This has caused burden for people and the field professional both be used to develop this test procedure, and this causes increasing on the cost of developing of test procedure and the complicacy.
In addition, the 3rd people may carry out the execution of described test.In the case, may require that the 3rd people is the same with computer programmer and Test Engineer in the exploitation of test procedure and design to be proficient in, so that carry out this test rightly.In this, the exploitation of test processes must relate to across the cooperation of the complexity in multiple source and exchange, perhaps relates to single, the people through highly training that are familiar with whole test program development, design and carry out.In arbitrary example, the cost of interpolation and complicacy cause being used to creating the condition of not expecting of automatization test system (especially, in research and development at an automatization test system of product design).
In addition, carry out exploitation, the design of test procedure rightly and carry out necessary backup system (such as, graphic user interface, computer hardware, communicator etc.) control often have to created each in succession test procedure develop again.This has caused requiring more time and money to develop, design and carry out the complicacy of the increase of test procedure effectively.The change that test is carried out often requires brand-new program, and this need come thoroughly from the beginning development and testing program at each new procedures.This may cause the long delivery time when exploitation and execution test procedure.
At this background technology, developed the compact framework (compactframework) that is used for automatic test.
Summary of the invention
Describe and illustrate following examples and each side thereof in conjunction with being intended for system, instrument and method exemplary and illustrative and that on scope, do not limit.In each embodiment, reduced or eliminated one or more the problems referred to above, other embodiment improve at other simultaneously.
According to first aspect, a kind of system that is used for automatic test that uses compact framework is provided, this system comprises: a plurality of functions, described a plurality of functions comprise the execution of development﹠ testing stream of exploitation, the test stream of test module.In addition, this system comprises authenticator, and this authenticator is determined user's characteristic, makes to define the function that provides to the user by this characteristic.In addition, this system comprises graphic user interface, and this graphic user interface is corresponding to described a plurality of functions.
Further improvement in this respect can comprise the automated test device that is operating as this compactness framework of execution, and can comprise the testing hardware that is used for operationally this automated test device being connected to device under test or unit.And an embodiment can comprise data display equipment, and this data display equipment is operable as the real time data of demonstration about the execution of test stream.These data also can show with graphic form.In addition, an embodiment can comprise results processor, is used for the term of execution data of gathering at test stream are formatd.The exploitation of this test module and execution can comprise: provide and carry out source code and/or specify one or more external procedures to call.After coming according to new test request (for example, being used for the test of new technology or product) described test module and correlation function developed, this compactness framework can load the assembly of being developed and carry out them in this system.
According on the other hand, a kind of method of using the automatic test of compact framework is provided, make to carry out this compactness framework, and should the compactness framework determine first user's characteristic.In addition, this method comprises that definition comprises the exploitation of test module, one or more functions of testing the execution of the development﹠ testing stream that flows.This method also comprises and depends on that described user personality comes to provide in these functions at least one to described first user.
Among the embodiment in this regard, define this test stream by a plurality of test modules.In addition, current aspect embodiment can comprise the real time data that shows the execution that is used to describe this compactness framework.The embodiment of this method can also comprise: first user's function is ended, and provide different functions to second user.In addition, the reporting format that this user determines of the data formatting of gathering when carrying out test module can being served as reasons.
This method can also comprise following examples, thread that wherein can be by suspending current operation, suspends when finishing the test module of current operation or both suspend the execution of test stream.
According on the other hand, a kind of compact framework that is used for automatic test is provided, this compactness framework comprises: the test module development module is operating as test module is developed and defined.This compactness framework also comprises a plurality of test modules, described a plurality of test module has parameter and result data, described parameter and result data have been described the configuration and the results processor of this test module, make to utilize different parameters and result data to carry out each test module.This compactness framework also comprises configuration module and execution module, and this configuration module is operating as definition test stream, and this test stream comprises at least one in the described test module, and this execution module is operating as this test stream of execution.In addition, test development module, configuration module and execution module are based on user's characteristic.Compact framework in this respect can also comprise following examples, wherein by this compactness framework generate can be in response to user's requirement formative reporting the result.
Except above-mentioned demonstration aspect and embodiment, describe with reference to the accompanying drawings and by research is following, further aspect and embodiment will become obvious.
Description of drawings
Fig. 1 is the synoptic diagram of an embodiment of automatization test system.
Fig. 2 is the process flow diagram of execution of having described the compact framework of demonstration.
Fig. 3 is a process flow diagram of having described to be used for the function of development and testing module.
Fig. 4 is a process flow diagram of having described to be used for the function of design test stream.
Fig. 5 is a process flow diagram of having described to be used to carry out the function of test module.
Fig. 6 is a process flow diagram of having described to be used for the replacement function of development and testing module.
Fig. 7 is a process flow diagram of having described test stream result's processing.
Fig. 8 be described to be used for the term of execution suspend the process flow diagram of two kinds of methods of test stream.
Fig. 9 shows the detail flowchart of the execution of test stream.
Figure 10 shows the illustrating of tissue of test stream and test module.
Embodiment
Now, will make reference to accompanying drawing, described accompanying drawing assists to illustrate various correlated characteristic of the present invention at least.In this, present following description for the purpose of illustration and description, and should following description be not intended to limit the invention to disclosed form here.As a result, the distortion that matches with the technology and the knowledge of following instruction and correlative technology field and revising all is in the scope of the present invention.Described here embodiment is intended to also to make that those skilled in the art can use according to such or other embodiment and with concrete (a plurality of) of the present invention or (a plurality of) use desired various modifications to come together to utilize the present invention.
Forward Fig. 1 to, show an embodiment of automatization test system 100 of the present invention.This system 100 comprises automated test device (ATE) 110, and it is in the communicating by letter of operation with being subjected to measurement unit (UUT) 120.UUT 120 can be hardware, software or its combination of any kind.Can finish communication between ATE 110 and the UUT 120 via testing hardware 130.Testing hardware 130 can be communication/control interface, (a plurality of) connector of any cable, cable family, physical hardware interface, software realization or any other hookup that allows to carry out the operation communication between UUT 120 and the ATE 110.In addition, testing hardware 130 can provide other testing tools, sensor, actuator or carry out and test necessary other devices as described further below.Graphic user interface (GUI) 140 is operating as input and the order of reception from the user, with control ATE 110.ATE 110 can be the computing machine with microprocessor, storer and other related hardwares such as display, keyboard and mouse etc.The ATE 110 of present embodiment can be operating as and carry out compact framework.
In the present embodiment, compact framework is to be used to control ATE 110 UUT 120 is carried out the computer program of test function.UUT 120 in the present embodiment can be with lower device, is promptly producing before this device, is being in the device of development.More specifically, UUT 120 can be cell phone, PDA, computing machine or any other electronic installation.
Compact framework is used to verify by execution and comes one or more cycle testss of the function of UUT 120 UUT 120 is tested.In this compactness framework, described cycle tests is defined as test module, described test module can be compiled as test stream or test module family that definition will be carried out in single test stream.Test module provides instruction to ATE 110, so that UUT 120 is carried out test.This can comprise the parameter etc. that input is provided or monitors UUT 120 in response to some test condition to UUT 120.Can and be revised as the specific function of testing UUT 120 or UUT assembly etc. with the test module exploitation.
Can come image data in response to the test of carrying out by ATE 110.In the present embodiment of automatization test system 100, can be to be used for coming image data at the recorded primitive form of compact framework direct representation.Then, the raw data of being gathered can be converted to human-readable and result's report that can be used to assess UUT 120 by slip-stick artist and deviser etc.Equally, can in database or other storage mediums, store original or formative data, to be used for review or result treatment in the future after a while.Because UUT 120 may be the complex appts with many assemblies and function, so may need to adopt many test subroutines or test module fully to evaluate the performance of UUT 120.After this manner, a plurality of test modules can be added to test stream, so that during single test stream, carry out different test subroutines.That is, test stream can be the test module family that will carry out successively with test UUT 120.
Can develop needs many different products that form is tested above the use.In addition, the change that existing product is carried out may cause for change, revise or create new demand of testing.Because the quick step of the exploitation of the change on as a whole device and the function that provides by described device has been provided, so when product is in the research and development, be used to revise or create this demand enhancing of new test.When continuously new product being developed, compact framework is suitable for various devices and assembly are tested, and be provided for revising fast test process, with the ability of the required test condition that adapts to variation.
Correspondingly, in the present embodiment, test module exploitation, the design of test stream and test stream are carried out the unique function that is provided by compact framework are provided all.User to each task of being responsible for being associated with each function provides these functions.Like this, each function that is provided by this compactness framework can be suitable for specific user's responsibility, to eliminate complicacy and difficulty.This can be included as each function provides function special GUI140.After this manner, can present and the specific function of finishing the compact framework that this task is associated to each user with responsibility special duty.Can provide special GUI 140 to each function.Yet, owing in single compact framework, carry out each function, so any overlapping between also can the predetermined function set.That is, the test module developer can not need to have any knowledge about the design of test stream, and test stream deviser can not need to have any knowledge about the exploitation of test flow module.Although use this compactness framework to finish whole two tasks, described function is separated from one another, can finish each task relatively isolator.
For example, consider following situation, wherein new feature is added to device, and therefore need be used to evaluate the new test of this feature.Suppose not have to test the existing test module of this new function, then the test module developer will have to generate be used for the packaging and testing subroutine, with the new test module of the validity of verifying this new feature.Then, the test module developer can development module, and need not wherein will to use any knowledge of the test stream situation of this module.Similarly, do not know that the test stream deviser who how to develop this test module can merge the test stream of this new test module by design, and adopt test module newly developed to test this new function.Because two users carry out these tasks and this two users do not need to understand being carried out by another user of task, so type that can be by function being suitable for just carry out the user of each function, come to simplify and optimize the function that each need adopt for particular task.
Forward Fig. 2 now to, show flow process Figure 200 of the operation that is used to describe compact framework.Operating in the step 210 of compact framework started, and in this step 210, ATE 110 (referring to Fig. 1) initiates the execution of compact framework.Then, this compactness framework for example uses graphic user interface to obtain information about the user in step 220.This user profile can comprise User login sign and password or be used to distinguish user's any other of identifier.In case identified, then can be in advance in this compactness framework with user definition for having some characteristic.This can be to the given single characteristic of user, perhaps can be a plurality of characteristics.Further again, the user can be associated with all characteristics.This user profile of obtaining in step 220 is used for determining in step 230,240 and 250 what function the user can visit.One embodiment of the present of invention comprise three characteristics, and described three characteristics comprise test module developer 230, test stream deviser 240 and test stream executor 250.These characteristics correspond respectively to the function that comprises the following: the design 242 of the exploitation 232 of test module, test stream and execution test stream 252.Below, further describe the execution of these functions.
In Fig. 2, in step 230, this compactness framework determines that the user role information obtained is whether corresponding to test module developer's user role information.If corresponding, then should in step 231, show corresponding to the special GUI 140 of test module developer's function by the compactness framework.So this user visits the compact form and function that is used for the development and testing module in step 232.In step 240, the user personality information evaluation that will obtain from step 220 is for determining whether this user has the characteristic that is associated with test stream deviser.Once more, if like this, then should show the special GUI 140 that is associated with the design of test stream by the compactness framework in step 241, this special GUI 140 is used for providing the visit of flowing design function for test in step 242.Similarly, in step 250, this compactness framework determines whether this user has test stream executor characteristic.If like this, then should in step 251, show the special GUI 140 of test execution by the compactness framework, the special GUI 140 of this test execution is used for making user capture carry out the form and function that is associated with test stream in step 252.
Should be appreciated that the user can have two user personalities, and therefore, have the right to carry out two functions that are associated.As example, the user can have and is used for both characteristics of test module developer 230 and test stream executor 250.In the case, the user will have the right to visit the function that is used for development and testing module 232 and carries out test module 252.Be also to be understood that the user can have all characteristics, and have the right to carry out all functions 232,242 and 252.In addition, although current embodiment comprise and three three characteristics that function is corresponding, it is contemplated that the characteristic with different numbers and the other system of corresponding function.
In process flow diagram shown in Figure 3 300, described to be used for the function of development and testing module 232 in further detail.Test module is generally the instruction set that is used to control in order to the ATE 110 that particular test functionality is provided.In this, when UUT 120 is developed, test that look for novelty possibly or amended.Correspondingly, can develop new and different test modules, to satisfy this requirement.In order to promote the quick exploitation and the modification of test module, in step 310, compact framework has determining of following (a plurality of) characteristic in response to the user, be provided at the test module development function of initiating in this framework, described (a plurality of) characteristic makes this user to visit to be used for the function that test module is developed.In step 320, the developer can come input command via the special GUI 140 of function (referring to Fig. 1).The special GUI 140 of function makes this user can visit and carry out this function to the control that the user provides the function that is associated with the exploitation 232 of test module.
Test module developer 230 can have at least two kinds of potential modes that test module is developed or revised.In step 330, the test module developer can directly key in source code by the special GUI 140 of function.This source code representation ATE 110 can be used for UUT 120 is carried out the steering order of one or more tests.This framework can compile and load the source code that generates in step 330, so that generate this test module.
In addition or alternatively, the test module developer can develop external libraries in step 340.This external libraries can comprise that dynamic link library or this framework are used to carry out other external datas of the function of desired test module.In case the developer has keyed in source code in step 330 or develop in step 340 and 350 and specified suitable external libraries, then this developer can be assigned to classification with this test module in step 360.As following further explanation, can come the tested tissue module by classification, when selecting the test that will carry out UUT, assist them with box lunch test stream deviser.In addition, each test module may be in step 370 requirement will be by the parameter-definition of developer's definition, the limit and default value as a result.This parameter-definition comprises the required parameter value of test subroutine of carrying out test module.Although as following further explanation, these parameters also can be keyed in by test execution person, the function that this test module developer can defined parameters, and set up out what parameter is necessary for the test of carrying out being carried out by this test module.This test module developer also defines the limit and default value as a result in step 370.In step 370 by each parameter of test developer definition, the limit and default value can be stored in the storer with this test module as a result.In this, this test module can as can in various tests stream, utilize, predefined test subroutine so that one or more devices are tested.And, because the function of test module development﹠ testing stream design is unique function, so the test module developer does not need to have any knowledge about the design of test stream, this is unique owing to moving the desired data of each test module, and stores with this test module.
With reference now to Figure 10,, shows the synoptic diagram that is used to that test module is shown and tests the tissue of stream.As shown in Figure 3, the test module developer defines the classification (for example, classification (Category) 1, classification 2, classification n) that is used for each test module in step 360.Should be appreciated that although figure 10 illustrates three classifications, the number to classification does not limit.In order to explain, classification 1 comprises three test modules 1040 (being labeled as 1,2 and 3).Therefore, be appreciated that in the exploitation of the test module of test module 1,2 and 3, the test module developer defined in these test modules each will be associated with classification 1.Similarly, test module 4,5 and 6 is defined as belongs to classification 2, and test module 7,8 and 9 is defined as belongs to classification n.Shown in the top test module (that is, test module 3,6 and 9) of each classification, each test module has defined for each test module unique supplemental characteristic and result treatment data.
Forward Fig. 4 now to, process flow diagram 400 has described to make the function that the user can design test stream.In case compact framework has been determined the characteristic (referring to Fig. 2) that the user has test stream deviser in step 240, then should in step 410, initiate test stream design function by the compactness framework.This test stream deviser can create new test stream then in step 450.Optional step 460 is all or part of the duplicating to existing test stream, to create new test stream in step 450.After having created new test stream, the test that the deviser can select to revise is flowed.Alternatively, test stream deviser can begin by the existing test stream of selecting to revise in step 420.Then, the tabulation of this deviser selected test module that will in this test stream, comprise in step 430.As previously mentioned, can come the tested tissue module, make test stream deviser can be more prone to the desired test module of accessing according to classification.In this, test stream deviser can select test module from list of categories in step 440, the promptly selected suitable test module corresponding with required test subroutine function.Moreover when the many assemblies that may test UUT 120 in single test stream and function, this Test Design person can compile various test modules, so that finish desired test routine.In case test stream deviser has finished the compiling of this test module tabulation in step 430, then this test stream deviser can dispose this test stream in step 470.This can comprise initial input or the adjustment that parameter is provided to existing parameter, and the developer of this test module makes described existing parameter can be used for adjusting.
Return with reference to Figure 10, described a plurality of test streams corresponding (for example, test stream (Test Flow) 1, test stream 2 and test stream n) with the different test routines that will carry out.As understanding, each test stream has the various test modules 1040 of definition in this test stream.For example, show the test stream 1 that comprises test module 1,3,6,4 and 5.Be appreciated that and the test module 1040 of any number can be associated with test stream, so that finish desired test routine.In addition, the order of execution test module 1040 can be in by test and flow in any order of deviser's appointment.In addition, test stream deviser can create the test stream of any number.
Fig. 5 illustrates and is used to represent in order to carry out the process flow diagram 500 of the function (referring to the step 252 of Fig. 2) of testing stream.In case compact framework has correctly been determined the characteristic (for example, the step 250 of Fig. 2) that the user has test stream executor, then should in step 510, initiate test stream design function by the compactness framework.Next, this executor desired test stream that can in step 520, select to carry out.Then, can test stream to this and load, and in step 530, can present the configured board corresponding, make this executor to make necessary adjustment to the configuration of this test stream to the executor with the special GUI of function 140.Alternatively, in step 540, this test stream executor can to the parameter setting that is used for each test module and as a result the limit (limit) be configured.Step 540 is optionally, and this is because each test module can have as the default parameters setting that is associated with it that provided by the test module developer and the acquiescence limit as a result.Finally, in step 550, this test stream executor carries out test stream, makes this compactness framework carry out each test module that comprises in specified test stream.
In process flow diagram shown in Figure 6 600, described to carry out the alternative embodiment of test stream.In step 610, test stream executor can initiate the execution of this test stream.In step 620, compact framework can be carried out wherein test and flow each test module that the deviser is compiled as test stream.Continuously, during the reason, in step 640, from the execution of this test stream, gather instant data feedback, and show in real time herein, make this test stream executor can monitor the progress of this test execution in real time.This instant data feedback can also provide data with graphic form, to be used for the simplification explaination of these data.In addition, the test module developer can use this instant data feedback when test module is developed, so that performance and the progress of this test module by executed in real time the time assessed.In step 630, the raw data that is associated with the execution of each test module can be compiled as one or more reports.
Figure 7 illustrates and be used to describe in order to the baseline results data are carried out the process flow diagram 700 of the formative result treatment that is associated.Test stream executor in step 701 by selecting desired initial report data to begin.Compact framework can also comprise report processor, and this report processor operations is transformed to human-readable test report for carrying out the raw data of collecting during 600 at test module.This test stream executor can select suitable test report processor in step 702.In step 703, selected report processor is operating as the selected original test data of selecting in step 701 is carried out conversion in 702, to generate test report.This test report can comprise the data at the report value of testing the performance during flowing and being associated with its performance about UUT 120, perhaps can comprise " by (pass) " or " by (the fail) " sign that is used for various test modules or assembly.
Term of execution test was flowed, test execution person can control the operation of test stream, shown in the process flow diagram 800 of Fig. 8.In step 820, test stream is in the running status, makes test flow 600 execution well afoot.This test stream executor can provide " stopping (stop) " order 821, makes this test stream directly enter stop condition 860 from running status 802.This order is interrupted the execution of this test stream.Alternatively, this test stream executor can key in " hanging up (suspend) " order 823.This should test stream and place suspended state 830, made compact framework stop the execution of this test stream at following thread place, and this thread runs in the current test module of just carrying out in this test stream.Then, this test stream may be advanced to halted state 850.
Alternatively, when this test stream was moving, this test stream executor can key in " suspending (paused by module) according to module " order 824.This instructs this compactness framework to suspend the execution of this test stream when finishing the test module of current execution.Then, this compactness framework can place this test stream according to module halted state 840.When finishing the module of current operation, this test stream advances to halted state 850.In in being in halted state, this test stream executor can key in " stopping " order 821, places halted state 860 should test stream.This test stream executor can also key in " restarting (resume) " order 822, turns back to running status 820 should test stream.Should " restarting " order 822 can instruct this test stream to turn back to running status 820 immediately, perhaps turn back to running status afterwards satisfy condition (for example, passed through the preset time section, maybe this device is in a certain temperature etc.).
Fig. 9 illustrates the detail flowchart 900 that is used to carry out the method for testing stream.The execution of this test stream begins in step 901.Initially, in step 902, should test the situation that flows and be set to " RUN ".Then, compact framework initiates to be used to carry out the processing of each test module that is associated with this test stream in step 903.Step 904 determines whether test stream executor has keyed in module pause command 824.If keyed in module pause command 824, then this processing advances to step 922, and tests the stream situation and be set to " suspend (pause) ".Based on the order that restarts in step 923, should test stream " RUN " was set back, and should continue by test stream.If this executor does not key in module pause command 824, then this test stream directly advances to step 905.In step 905, load the test module program, thereby can carry out this program.
In step 906, this test module brings into operation by carrying out subroutine 1 (924).Then, this test stream advances to step 912, wherein at this test stream this test module is carried out initialization.This test parameter that relates to being defined by test module developer, test stream deviser or test stream executor loads.The test module example begins to carry out in step 913.This test module example is meant the test module when carried out parametrization in step 912 after, makes to move specific test module example at concrete test module.Then, this test stream advances to pre-execution inspection in step 914, advance to then and carry out and results acquisition step 915, and finally advance to pre-service as a result in step 916.Then, result for retrieval in step 917.
Then, this test stream advances to step 907, wherein writes down described result by carrying out subroutine 2 (925).In step 918, this compactness framework at first determine whether this test module the term of execution described result's situation assessed.In described result treatment has been defined in example in the result treatment data of this test module, define according to this and to handle described result, and this processing proceeds to step 908.If the so described result treatment of definition is as yet then formed an alliance described result and the input results limit in step 919 (align).In step 920, described result is assessed 920 and write down 921.In step 908, report described result and result status to test stream executor then.Then, this compactness framework is checked this test stream, to determine whether to exist another test module that will carry out, i.e. step 909.If exist, then this cycle of treatment is got back to step 904.If there is no, then this processing advances to step 910, and in step 910, should test stream situation be set to " stopping ".Then, this test stream stops in step 911.
As understanding, each test stream can not stored the independent example of each test module.For example, in step 912, when in this test stream, carrying out each test module, the test module example is carried out initialization.Though this test module example is visited by this test stream, this test module still can maintain in the single memory location.After this manner, when the test module developer makes amendment to test module, do not need to upgrade all test streams that adopt this test module.That is, adopt each test stream of this test module will carry out amended test module.This has prevented that test stream from will continue to adopt the possibility of expired or discarded test module.This has also prevented have to refresh test continuously stream of Test Design person, with the latest edition of each test module of reflection in described test stream.When coming that at each test stream test module carried out initialization, will carry out initialization to the test module of current version.Similarly, a plurality of test streams can utilize single test module in this wise.For example, as shown in figure 10, test module 4 is included among test stream 1, test stream 2 and the test stream n.In the case, each the test stream will the term of execution access test module 4 example.
Although at length illustrated and described the present invention at accompanying drawing with in preceding description, this diagram and describe will be considered to exemplary and not be binding in essence.For example, some embodiment that describes hereinbefore can make up and/or otherwise arrange (for example, can carry out treatment element with other order) with other described embodiment.Correspondingly, should be appreciated that, only illustrated and described the preferred embodiments of the present invention and distortion thereof, and expectation protection enters institute in the spirit of the present invention and changes and revise.
Claims (20)
1. system that is used for automatic test that uses compact framework comprises:
A plurality of functions comprise at least one in the following: the execution of the development﹠ testing stream of the exploitation of test module, test stream;
Authenticator can be operating as the characteristic of determining the user, and described characteristic has defined described user can carry out in described one or more function which; And
Graphic user interface is corresponding to described a plurality of functions.
2. according to the system of claim 1, also comprise:
Automated test device is operating as and carries out described compact framework, so that the unit is tested.
3. according to the system of claim 1, also comprise:
Data display equipment can be operating as the real time data that demonstration is associated with the execution of described compact framework.
4. according to the system of claim 3, wherein said data display equipment is operating as the diagrammatic representation that shows described real time data.
5. according to the system of claim 1, wherein said compact framework also comprises:
Results processor is operating as data layout is turned to a plurality of user-defined reporting formats.
6. according to the system of claim 1, the exploitation of wherein said test module comprises the modification of source code, and wherein said compact framework is operating as described source code is compiled and loads.
7. according to the system of claim 6, wherein said compact framework is operating as and dynamically carries out described source code in working time.
8. according to the system of claim 1, the exploitation of wherein said test module comprises the designated external invocation of procedure.
9. according to the system of claim 2, also comprise:
A plurality of described automated test devices.
10. method that is used for automatic test of using compact framework may further comprise the steps:
Carry out described compact framework;
Determine first user's characteristic;
Definition comprises the exploitation of test module, one or more functions of testing the execution of the development﹠ testing stream that flows; And
Depend on that described user personality comes to provide in described one or more function at least one to described first user.
11. according to the method for claim 10, wherein said test stream comprises a plurality of test modules.
12. the method according to claim 10 also comprises:
Show the real time data relevant with the described execution of described compact framework.
13. the method according to claim 10 also comprises:
The described step that provides is ended;
Determine second user's characteristic;
The characteristic that depends on described second user to provide in described one or more function at least one to described second user, and at least one is different with described first user at described second user for described in wherein said one or more functions.
14. the method according to claim 10 also comprises:
Carry out test module;
Described execution according to test module generates the baseline results data; And
The described baseline results data that use is formatted as user-defined reporting format generate report.
15. the method according to claim 10 also comprises:
Carry out test module;
Execution comprises the test stream of described test module;
Receive order; And
In response to described order, suspend the execution of described test stream, make described test sagging play the execution of described test module.
16. the method according to claim 15 also comprises:
Restart the execution of described test stream.
17. the method according to claim 10 also comprises:
Carry out test module;
Execution comprises the test stream of described test module;
Receive order; And
In response to described order, after the execution of finishing described test module, suspend the execution of described test stream.
18. the method according to claim 17 also comprises:
Restart the execution of described test stream.
19. a compact framework that is used for automatic test comprises:
The test module developer component is operating as test module is developed and defined;
A plurality of test modules, each in the wherein said test module comprise supplemental characteristic and result treatment data, and in wherein said a plurality of test module each is operating as being subjected to measurement unit to carry out test;
Configuration module is operating as definition test stream, and this test stream comprises at least one in described a plurality of test module; And
Execution module is operating as and carries out described test stream;
Wherein one or more users depend on that described one or more users' characteristic carries out described test module, described configuration module and described execution module.
20. the compact framework that is used for automatic test according to claim 19 also comprises:
Result report, comprise generate by described execution module, in response to described one or more users' input formative raw data.
Applications Claiming Priority (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US12/204,541 | 2008-09-04 | ||
| US12/204,541 US8005639B2 (en) | 2008-09-04 | 2008-09-04 | Compact framework for automated testing |
| PCT/US2009/055917 WO2010028168A2 (en) | 2008-09-04 | 2009-09-03 | Compact framework for automated testing |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102144221A true CN102144221A (en) | 2011-08-03 |
| CN102144221B CN102144221B (en) | 2014-03-12 |
Family
ID=41726621
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN200980134475.7A Expired - Fee Related CN102144221B (en) | 2008-09-04 | 2009-09-03 | Compact framework for automated testing |
Country Status (3)
| Country | Link |
|---|---|
| US (1) | US8005639B2 (en) |
| CN (1) | CN102144221B (en) |
| WO (1) | WO2010028168A2 (en) |
Families Citing this family (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8688795B2 (en) * | 2010-06-01 | 2014-04-01 | The United States Of America As Represented By The Secretary Of The Navy | GPS embedded interactive network interface |
| US9965464B2 (en) | 2014-12-05 | 2018-05-08 | Microsoft Technology Licensing, Llc | Automatic process guidance |
| US11068827B1 (en) | 2015-06-22 | 2021-07-20 | Wells Fargo Bank, N.A. | Master performance indicator |
| US9749064B2 (en) * | 2015-08-28 | 2017-08-29 | FedEx Supply Chain Logistics & Electronics, Inc. | Automated radio frequency testing management system |
| CN107608659A (en) * | 2017-08-25 | 2018-01-19 | 北京智行鸿远汽车有限公司 | Design method applied to the LabVIEW of response multitask software architecture |
| CN115061920A (en) * | 2022-06-24 | 2022-09-16 | 西安羚控电子科技有限公司 | Flow chart type automatic test method and system |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040268308A1 (en) * | 2003-06-26 | 2004-12-30 | Microsoft Corporation | Mining dependencies for testing and risk management |
| CN1797356A (en) * | 2004-12-29 | 2006-07-05 | 佛山市顺德区顺达电脑厂有限公司 | Automatic test device and process method in use for computer device |
| US20070220341A1 (en) * | 2006-02-28 | 2007-09-20 | International Business Machines Corporation | Software testing automation framework |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040225459A1 (en) * | 2003-02-14 | 2004-11-11 | Advantest Corporation | Method and structure to develop a test program for semiconductor integrated circuits |
| US7620856B2 (en) | 2006-12-28 | 2009-11-17 | Sap Portals Israel Ltd. | Framework for automated testing of enterprise computer systems |
-
2008
- 2008-09-04 US US12/204,541 patent/US8005639B2/en not_active Expired - Fee Related
-
2009
- 2009-09-03 CN CN200980134475.7A patent/CN102144221B/en not_active Expired - Fee Related
- 2009-09-03 WO PCT/US2009/055917 patent/WO2010028168A2/en active Application Filing
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040268308A1 (en) * | 2003-06-26 | 2004-12-30 | Microsoft Corporation | Mining dependencies for testing and risk management |
| CN1797356A (en) * | 2004-12-29 | 2006-07-05 | 佛山市顺德区顺达电脑厂有限公司 | Automatic test device and process method in use for computer device |
| US20070220341A1 (en) * | 2006-02-28 | 2007-09-20 | International Business Machines Corporation | Software testing automation framework |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2010028168A3 (en) | 2010-06-10 |
| WO2010028168A2 (en) | 2010-03-11 |
| US20100057395A1 (en) | 2010-03-04 |
| CN102144221B (en) | 2014-03-12 |
| US8005639B2 (en) | 2011-08-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US7895565B1 (en) | Integrated system and method for validating the functionality and performance of software applications | |
| US7076713B1 (en) | Test generator for converting a model of computer component object behavior and stimulus values to test script | |
| US20050028133A1 (en) | System and method for rapid design, prototyping, and implementation of distributed scalable architecture for task control and automation | |
| US20110307860A1 (en) | Simulation-based interface testing automation system and method for robot software components | |
| CN102224491A (en) | Testing machine with workflow based test procedure | |
| US20060129892A1 (en) | Scenario based stress testing | |
| CN104077140A (en) | Automatic compiling method and compiling device for continuous integration | |
| US11619923B2 (en) | Digital twin management system and method | |
| CN102144221B (en) | Compact framework for automated testing | |
| Dubey | Evaluating software engineering methods in the context of automation applications | |
| US8458663B2 (en) | Static code analysis | |
| CN112270149A (en) | Verification platform automation integration method and system, electronic equipment and storage medium | |
| EP4296803A1 (en) | Device configuration object template with user interaction for device properties generator | |
| CN117931620A (en) | Automatic test method for reducing test technical threshold of intelligent terminal system | |
| Lehrig et al. | The architectural template method: templating architectural knowledge to efficiently conduct quality‐of‐service analyses | |
| CN111078444A (en) | System and method for safety analysis of failure behavior | |
| Wu | Model-based design for effective control system development | |
| Hauck et al. | Deriving performance-relevant infrastructure properties through model-based experiments with Ginpex | |
| Nezhad et al. | Behavior-driven development for real-time embedded systems | |
| KR20140121583A (en) | Method and system for certifying application | |
| Moseh et al. | Classification and Evaluation Framework of Automated testing tools for agile software: Technical Review | |
| Heger | An Approach for Guiding Developers to Performance and Scalability Solutions | |
| Ben Hafaiedh et al. | A formal model-based approach to design failure-aware Internet of Things architectures | |
| Gustafsson et al. | All-times–a european project on integrating timing technology | |
| CN109669868A (en) | The method and system of software test |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20140312 Termination date: 20170903 |