CN111338607A - Method and device for selecting service data for testing and electronic equipment - Google Patents
Method and device for selecting service data for testing and electronic equipment Download PDFInfo
- Publication number
- CN111338607A CN111338607A CN202010129551.3A CN202010129551A CN111338607A CN 111338607 A CN111338607 A CN 111338607A CN 202010129551 A CN202010129551 A CN 202010129551A CN 111338607 A CN111338607 A CN 111338607A
- Authority
- CN
- China
- Prior art keywords
- bucket
- sub
- slot
- identifier
- target
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 54
- 238000012360 testing method Methods 0.000 title claims abstract description 50
- 238000002474 experimental method Methods 0.000 claims abstract description 70
- 238000004891 communication Methods 0.000 claims description 18
- 238000004590 computer program Methods 0.000 claims description 12
- 238000011161 development Methods 0.000 description 16
- 230000008569 process Effects 0.000 description 9
- 230000006870 function Effects 0.000 description 6
- 238000010586 diagram Methods 0.000 description 4
- 238000010187 selection method Methods 0.000 description 4
- 239000002699 waste material Substances 0.000 description 4
- 230000009471 action Effects 0.000 description 3
- 238000004422 calculation algorithm Methods 0.000 description 3
- 230000014759 maintenance of location Effects 0.000 description 3
- 238000000638 solvent extraction Methods 0.000 description 3
- 238000000926 separation method Methods 0.000 description 2
- 238000013500 data storage Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F8/00—Arrangements for software engineering
- G06F8/20—Software design
- G06F8/24—Object-oriented
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F8/00—Arrangements for software engineering
- G06F8/30—Creation or generation of source code
- G06F8/38—Creation or generation of source code for implementing user interfaces
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Computer Hardware Design (AREA)
- Quality & Reliability (AREA)
- Human Computer Interaction (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The embodiment of the invention provides a method and a device for selecting service data for testing and electronic equipment, wherein the method comprises the following steps: the method comprises the steps of determining target experiment configuration corresponding to a service type to be processed based on a pre-established corresponding relation between the service type and the experiment configuration, selecting a target sub-bucket, and sending service data to be tested contained in the target sub-bucket.
Description
Technical Field
The present invention relates to the field of internet technologies, and in particular, to a method and an apparatus for selecting service data for testing, and an electronic device.
Background
During the development of internet products, developers may face choices of various implementation schemes for implementing the same service function, for example, in the development of a web interface, the color of a certain button is red or blue, and the position of the button is on the left side of the web interface, on the right side of the web interface, or in the middle of the web interface.
Most of the traditional selection problems of multiple implementation schemes are determined by collective discussion of developers, however, for some business functions, the discussion of the developers cannot determine whether the business functions are better implementation schemes, and therefore, AB test (AB Testing) experiments are required to be carried out on multiple implementation schemes of the same business function.
In brief, in the AB test, multiple implementation schemes of the same service function are allocated to the experimental objects of different experimental groups for use, feedback information (such as click rate, page retention rate, and the like) of the experimental objects in different implementation schemes during the use process is recorded, and the implementation scheme more meeting the development requirement among the multiple implementation schemes is determined by comparing the feedback information of the experimental objects of different implementation schemes.
The inventor finds that the prior art at least has the following problems in the process of implementing the invention:
in the development process of internet products, different service types have different test requirements, so that an AB test experiment needs to be independently developed for each service type, and waste on development resources is caused.
Disclosure of Invention
The embodiment of the invention aims to provide a method for selecting service data for testing, so as to reduce waste on development resources. The specific technical scheme is as follows:
the embodiment of the invention provides a method for selecting service data for testing, which comprises the following steps:
receiving a service data request sent by a service request end, wherein the service data request is used for requesting to acquire service data required by a service to be processed in the service request end, and the service data request carries a request end identifier of the service request end and a service type to which the service to be processed belongs, and is used as the service type to be processed;
determining an experimental configuration corresponding to the service type to be processed as a target experimental configuration based on a pre-established corresponding relationship between the service type and the experimental configuration, wherein the target experimental configuration comprises a preset bucket dividing strategy identification and a plurality of bucket dividing identifications;
according to the bucket dividing strategy represented by the bucket dividing strategy identification, aiming at the request end identification, selecting a bucket from buckets represented by the bucket dividing strategy identifications respectively to serve as a target bucket, wherein the bucket represented by each bucket dividing identification comprises a group of to-be-tested business data of an AB test experiment to which the experiment configuration belongs;
and sending the service data to be tested contained in the target sub-bucket to the service request terminal.
Further, the plurality of sub-buckets includes at least a first sub-bucket and a second sub-bucket;
the selecting, according to the bucket dividing policy represented by the bucket dividing policy identifier, a bucket from the buckets represented by the multiple bucket dividing identifiers as a target bucket according to the request end identifier includes:
when the bucket dividing strategy represented by the bucket dividing strategy identification is an odd-even bucket dividing strategy, determining the odd-even property of the numerical value represented by the request terminal identification;
when the numerical value represented by the request terminal identification is an odd number, selecting the first sub-bucket as a target sub-bucket;
and when the numerical value represented by the request terminal identification is an even number, selecting the second sub-bucket as a target sub-bucket.
Further, the selecting, according to the bucket dividing policy indicated by the bucket dividing policy identifier, a bucket from the buckets indicated by the bucket dividing identifiers as a target bucket according to the request end identifier includes:
when the bucket dividing strategy represented by the bucket dividing strategy identification is a Hash bucket dividing strategy, carrying out Hash operation on the request end identification to obtain a Hash operation value;
performing modular operation on the hash operation value according to the number of the plurality of sub-bucket identifiers to obtain a modular operation value;
and selecting the sub-bucket with the pre-allocated sub-bucket serial number matched with the modulus operation numerical value from the sub-buckets represented by the sub-bucket identifications as a target sub-bucket.
Further, the selecting, according to the bucket dividing policy indicated by the bucket dividing policy identifier, a bucket from the buckets indicated by the bucket dividing identifiers as a target bucket according to the request end identifier includes:
and when the sub-bucket strategy represented by the sub-bucket strategy identification is a self-defined sub-bucket strategy, selecting sub-buckets as target sub-buckets according to the preset selected probability of each sub-bucket in the sub-buckets represented by the plurality of sub-bucket identifications aiming at the request end identification.
Further, the selecting, for the request end identifier, a sub-bucket from the sub-buckets represented by the sub-bucket identifiers according to a preset selected probability of each sub-bucket as a target sub-bucket includes:
according to the size of the preset selected probability of each sub-bucket, in a preset number of slot slots, determining a slot corresponding to each sub-bucket;
randomly selecting a slot from the preset number of slots as a target slot;
and determining the sub-bucket corresponding to the target slot as a target sub-bucket.
Further, the determining, in a preset number of slots according to the size of the preset selected probability of each sub-bucket, the slot corresponding to each sub-bucket includes:
for each sub-bucket, determining the product of the selected probability of the sub-bucket and the preset number as the number of slots of the slot corresponding to the sub-bucket;
and determining the slots with the number of slots in a preset number of slots based on the number of the slots to serve as the slots corresponding to the sub-barrel.
Further, the slot identifiers of the slots with the preset number form a numerical value queue which continuously increases from a preset numerical value;
the determining, based on the slot number, the slot of the slot number in a preset number of slots as a slot corresponding to the sub-bucket includes:
based on the number of the slots, determining two slot identifiers with the slot identifier value different from a reference value in the slot identifiers of the preset number of slots, wherein the reference value is obtained by subtracting one from the slot number, the slot identifier with the smaller slot identifier value in the two slot identifiers is used as a starting slot identifier of the sub-bucket, and the slot identifier with the larger slot identifier value is used as an ending slot identifier of the sub-bucket;
and determining a slot corresponding to the slot identifier from the slot identifier value of the initial slot identifier to the slot identifier value of the final slot identifier as the slot corresponding to the sub-barrel.
An embodiment of the present invention further provides a device for selecting service data for testing, where the device includes:
a request receiving module, configured to receive a service data request sent by a service request end, where the service data request is used to request to obtain service data required by a service to be processed in the service request end, and the service data request carries a request end identifier of the service request end and a service type to which the service to be processed belongs, and is used as the service type to be processed;
the experimental configuration determining module is used for determining an experimental configuration corresponding to the service type to be processed as a target experimental configuration based on a pre-established corresponding relation between the service type and the experimental configuration, wherein the target experimental configuration comprises a preset bucket dividing strategy identifier and a plurality of bucket dividing identifiers;
a bucket selection module, configured to select a bucket from the buckets represented by the multiple bucket identifiers as a target bucket according to the bucket allocation policy represented by the bucket allocation policy identifier, and for the request end identifier, where the bucket represented by each bucket identifier includes a set of to-be-tested service data of the AB test experiment to which the experiment configuration belongs;
and the service data sending module is used for sending the service data to be tested contained in the target sub-bucket to the service request terminal.
Further, the plurality of sub-buckets includes at least a first sub-bucket and a second sub-bucket;
the bucket dividing selection module is specifically configured to determine parity of a numerical value represented by the requester identifier when the bucket dividing policy represented by the bucket dividing policy identifier is an odd-even bucket dividing policy, select the first bucket as a target bucket when the numerical value represented by the requester identifier is an odd number, and select the second bucket as a target bucket when the numerical value represented by the requester identifier is an even number.
Further, the sub-bucket selection module is specifically configured to, when the sub-bucket policy indicated by the sub-bucket policy identifier is a hash sub-bucket policy, perform hash operation on the request end identifier to obtain a hash operation value, perform modulo operation on the hash operation value according to the number of the plurality of sub-bucket identifiers to obtain a modulo operation value, and select, from the sub-buckets indicated by the plurality of sub-bucket identifiers, a sub-bucket whose pre-allocated sub-bucket serial number matches the modulo operation value as a target sub-bucket.
Further, the bucket dividing selection module is specifically configured to, when the bucket dividing policy indicated by the bucket dividing policy identifier is a self-defined bucket dividing policy, select, for the request end identifier, a bucket in the buckets indicated by the multiple bucket dividing identifiers according to a preset selected probability of each bucket, and use the selected bucket as the target bucket.
Further, the sub-bucket selection module is specifically configured to determine, in a preset number of slots, a slot corresponding to each sub-bucket according to a size of a preset selected probability of each sub-bucket, randomly select, in the preset number of slots, a slot as a target slot, and determine, as a target sub-bucket, a sub-bucket corresponding to the target slot.
Further, the sub-bucket selecting module is specifically configured to determine, for each sub-bucket, a product of the size of the selected probability of the sub-bucket and the preset number as the number of slots of the slot corresponding to the sub-bucket, and determine, based on the number of slots, the number of slots of the slot number in the preset number of slots as the slot corresponding to the sub-bucket.
Further, the slot identifiers of the slots with the preset number form a numerical value queue which continuously increases from a preset numerical value;
the sub-bucket selection module is specifically configured to determine, based on the number of the slots, two slot identifiers having a slot identifier value that differs from a reference value among the slot identifiers of the slots of the preset number, where the reference value is the slot number minus one, and of the two slot identifiers, a slot identifier having a smaller slot identifier value is used as a starting slot identifier of the sub-bucket, and a slot identifier having a larger slot identifier value is used as an ending slot identifier of the sub-bucket, and determine a slot corresponding to a slot identifier having a slot identifier value between the slot identifier value of the starting slot identifier and the slot identifier value of the ending slot identifier, and use the slot corresponding to the sub-bucket.
The embodiment of the invention also provides electronic equipment which comprises a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory are communicated with each other through the communication bus;
a memory for storing a computer program;
and the processor is used for realizing the steps of any service data selection method for testing when the program stored in the memory is executed.
The present invention also provides a computer-readable storage medium, in which a computer program is stored, and when the computer program is executed by a processor, the steps of any one of the above methods for selecting service data for testing are implemented.
Embodiments of the present invention further provide a computer program product containing instructions, which when run on a computer, cause the computer to perform any one of the above methods for selecting service data for testing.
According to the method, the device and the electronic equipment for selecting the service data for testing, provided by the embodiment of the invention, the experimental configuration corresponding to the service type to be processed can be determined based on the pre-established corresponding relationship between the service type and the experimental configuration, different experimental configurations correspond to different AB test experiments, and when different service types are faced, only the relationship between the service type and the experimental configuration needs to be modified, so that the AB test experiments meeting the development requirements can be configured for the service type.
Of course, not all of the advantages described above need to be achieved at the same time in the practice of any one product or method of the invention.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below.
Fig. 1 is a flowchart of a method for selecting service data for testing according to an embodiment of the present invention;
FIG. 2 is a schematic diagram of a system for selecting service data for testing according to an embodiment of the present invention;
FIG. 3 is a flow chart of a target bucket selection method according to an embodiment of the present invention;
FIG. 4 is a flow chart of a target bucket selection method according to another embodiment of the present invention;
FIG. 5 is a flow chart of a target bucket selection method according to another embodiment of the present invention;
fig. 6 is a schematic structural diagram of a device for selecting service data for testing according to an embodiment of the present invention;
fig. 7 is a schematic structural diagram of an electronic device according to an embodiment of the present invention.
Detailed Description
In order to provide an implementation scheme for reducing waste on development resources, embodiments of the present invention provide a method, an apparatus, and an electronic device for selecting service data for testing, and the following describes embodiments of the present invention with reference to the drawings in the specification. And the embodiments and features of the embodiments in the present application may be combined with each other without conflict.
The technical solution in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention.
In an embodiment of the present invention, a method for selecting service data for testing is provided, as shown in fig. 1, the method includes the following steps:
s101: and receiving a service data request sent by a service request end.
S102: and determining the experimental configuration corresponding to the service type to be processed as the target experimental configuration based on the pre-established corresponding relation between the service type and the experimental configuration.
S103: and according to the bucket dividing strategy represented by the bucket dividing strategy identification, aiming at the request end identification, selecting a bucket from the buckets represented by the bucket dividing identifications as a target bucket.
S104: and sending the service data to be tested contained in the target sub-bucket to a service request end.
In the method for selecting to-be-tested service data for testing as shown in fig. 1, a service data request sent by a service request end may be received, where the service data request is used to request to obtain service data required by a service to be processed in the service request end, the service data request carries a request end identifier of the service request end and a service type to which the service to be processed belongs, and serves as the service type to be processed, and an experimental configuration corresponding to the service type to be processed is determined as a target experimental configuration based on a pre-established correspondence between the service type and the experimental configuration, where the target experimental configuration includes a preset bucket dividing policy identifier and a plurality of bucket dividing identifiers, and according to a bucket dividing policy indicated by the bucket dividing policy identifier, for the request end identifier, in a bucket indicated by each of the plurality of bucket dividing identifiers, selecting the sub-buckets as target sub-buckets, wherein the sub-bucket represented by each sub-bucket identifier comprises a group of service data to be tested, and sending the service data to be tested contained in the target sub-bucket to a service request terminal, because the experimental configuration corresponding to the service type to be processed can be determined based on the corresponding relationship between the service type and the experimental configuration established in advance, different experimental configurations correspond to different AB test experiments, and when facing different service types, the AB test experiment meeting the development requirement can be configured for the service type only by modifying the relation between the service type and the experiment configuration, so that only one development is needed for each different experiment configuration, in the subsequent use process, when different service types need developed experiment configuration, AB test experiments meeting the service types do not need to be developed again, and therefore waste of development resources is reduced.
Meanwhile, the development is only needed once aiming at the ZZhongzhong experiment configuration, so that the development efficiency of the AB test experiment is improved.
The method for selecting the service data for testing as shown in fig. 1 provided in the embodiment of the present invention may be applied to a service providing server, such as a video server, a Web (network) server, and the like, and may also be applied to a request scheduling server.
In step S101, the service data request may be used to request to obtain service data required by a service to be processed in the service request end, where the service data request carries a request end identifier of the service request end and a service type to which the service to be processed belongs, and the service type is used as the service type to be processed.
In the schematic diagram of the system for selecting the service data for testing shown in fig. 2, the client 1, the client 2, and the client 3 are service request terminals connected to the server, and the client 1, the client 2, and the client 3 may send a service data request to the server when the service to be processed needs to be executed.
In a test scenario, the service to be processed may be a Web page display task or an APP (application program) interface display task, and specifically, when a service request end needs to open a Web page or an APP interface, it needs to request Web page data or APP data from a server.
Illustratively, when a client needs to request Web page data from a server, it may send a service data request carrying a domain name of the Web page, such as https:// www.xxxx.com, to the server.
The Web page data or the APP data may be service data required by the service to be processed according to the embodiment of the present application.
Optionally, when the client sends the service data request to the server, the service data request may also carry a request end identifier of the service request end and a service type to which the service to be processed belongs.
The request identifier may be a User Identification (UID) of a User logged in by the client, or may be an equipment identifier of the client. The service type of the service to be processed may be different according to different requirements of each AB test experiment, that is, the service type of the task to be processed may be predetermined according to actual requirements, in a simple word, in one test task, the client requests the server to acquire the Web page data of the specified Web page, and the AB test experiment is performed for comparing the influence of the page background in the specified Web page on the retention rate, so that the service type of the service to be processed may be a page background task. Meanwhile, the purpose of the other group of AB test experiments is to compare the influence of the layout in the specified Web page on the retention rate, so that the service type to which the service to be processed belongs can be a page layout task.
In step S102, the experiment configuration may be configuration information of an AB test experiment that needs to be performed.
Optionally, the pre-established correspondence between the service type and the experimental configuration may be implemented by a pre-created relationship table for recording the correspondence between the service type and the experimental configuration, for example, the service type and the experimental configuration having the correspondence may be recorded in the relationship table as a line of record, and when the experimental configuration corresponding to the service type to be processed needs to be determined, the experimental configuration corresponding to the service type to be processed may be determined by retrieving the service type to be processed in the relationship table.
The optional experiment configuration may also be stored in a configuration file in JSON (Java Script Object Notation) format, where the experiment configuration in the relationship table may be a storage address, a configuration file identifier, and the like of the configuration file for recording the experiment configuration.
Optionally, the experiment configuration may further include a preset sub-bucket policy identifier and a plurality of sub-bucket identifiers, and further may include experiment information such as an experiment ID (Identity document), an experiment name, start time of an experiment, end time of an experiment, and an experiment state, where one experiment name corresponds to one service type, and the experiment state includes an experiment valid state and an experiment invalid state.
In step S103, the sub-bucket represented by each sub-bucket identifier includes a set of to-be-tested service data of the AB test experiment to which the experiment configuration belongs, and optionally, the to-be-tested service data included in different sub-buckets are different.
The sub-bucket policy represented by the sub-bucket policy identifier may be a pre-configured policy configuration file, the sub-bucket policy is recorded in the policy configuration file, and may be, for example, an odd-even sub-bucket policy, a hash (hash) sub-bucket policy, or a self-defined sub-bucket policy, and optionally, different sub-bucket policies may be distinguished in the policy configuration file using different fields, the odd-even sub-bucket policy may include a specific execution manner of the odd-even sub-bucket, the hash sub-bucket policy may include a specifically-used hash algorithm, and the self-defined sub-bucket policy may include a selected probability of each sub-bucket.
In one embodiment, the policy profile may also include a policy name, a policy ID, a creation time, a creator, and the like.
And different bucket separation strategies can select target buckets from the buckets represented by the bucket separation identifications aiming at the request terminal identification.
In step S104, each sub-bucket includes a set of service data to be tested, so after the target sub-bucket is determined, the service data to be tested included in the target sub-bucket may be sent to the service request end.
When the plurality of sub-buckets include at least a first sub-bucket and a second sub-bucket, in an embodiment of the present invention, a target sub-bucket determining method is provided to implement the step S103, as shown in fig. 3, the method includes the following steps:
s301: and when the bucket dividing strategy represented by the bucket dividing strategy identification is an odd-even bucket dividing strategy, judging the odd-even property of the numerical value represented by the request end identification.
In this step, when the plurality of buckets includes the first bucket and the second bucket, or only includes the first bucket and the second bucket, the target bucket may be selected using the parity bucket policy.
Optionally, the implementation scheme of the AB test experiment on the service in development includes a scheme a and a scheme B, for example, if the page background of the scheme a is green, and the page background of the scheme B is blue, the service data to be tested included in the first sub-bucket may be the service data of the scheme a, and the service data to be tested included in the second sub-bucket may be the service data of the scheme B.
Optionally, the parity of the value represented by the requester id may be determined, and for example, if the requester id is 20311515, the requester id may be determined to be odd, and if the requester id is 20311516, the requester id may be determined to be even.
Optionally, when the value indicated by the requester identifier is odd, step S302 is performed. When the value indicated by the requester id is even, step S303 is performed.
S302: the first sub-bucket is selected as the target sub-bucket.
S303: and selecting the second sub-bucket as a target sub-bucket.
In the method for determining target buckets as shown in fig. 3, when the bucket partitioning policy indicated by the bucket partitioning policy identifier is an odd-even bucket partitioning policy, the parity of the value indicated by the request end identifier is determined, and when the value indicated by the request end identifier is an odd number, the first bucket is selected as the target bucket, and when the value indicated by the request end identifier is an even number, the second bucket is selected as the target bucket.
In another embodiment of the present invention, there is further provided a target bucket determining method to implement the step S103, as shown in fig. 4, the method includes the following steps:
s401: and when the sub-bucket strategy represented by the sub-bucket strategy identification is a Hash sub-bucket strategy, carrying out Hash operation on the request end identification to obtain a Hash operation value.
In this step, any string of characters is input, and after the hash operation is performed on the request terminal identifier, another string of characters can be obtained, and optionally, a string numerical value of the character string after the operation can be calculated as a hash operation value.
Optionally, the Hash operation may be a Hash operation Algorithm such as MD4, MD5, SHA-1(Secure Hash Algorithm 1), and the like.
S402: and performing modular operation on the hash operation value according to the number of the plurality of sub-bucket identifiers to obtain a modular operation value.
In this step, the number of the plurality of sub-bucket identifiers may be the number of different service implementation schemes in the AB test experiment, each service implementation scheme corresponds to service data to be tested, and different service data to be tested correspond to different sub-buckets.
The above modulo operation on the hash operation value according to the number of the plurality of sub-bucket identifiers is to perform a modulo operation on the hash operation value, where the modulo operation is also called a remainder operation.
By performing the modulo arithmetic according to the number, the obtained modulo arithmetic values can all be made smaller than the number.
For example, when there are three buckets, that is, the number of the plurality of bucket identifiers is 3, the resulting remainder value of any hash operation result may only be three values of 0, 1 and 2. When the number is 4, the resulting remainder value is only possible at four values of 0, 1, 2 and 3. When the number is 5, it results in a remainder value that is only possible in five values, 0, 1, 2, 3 and 4.
S403: and selecting a sub-bucket with the pre-allocated sub-bucket serial number matched with the modulus operand value from the sub-buckets represented by the plurality of sub-bucket identifications as a target sub-bucket.
In this step, each sub-bucket is pre-assigned with a sub-bucket serial number, and for example, when there are 3 sub-buckets, the sub-bucket serial numbers of the 3 sub-buckets may be 0, 1, and 2, respectively. Therefore, when the modulo operation value is 1, the sub-bucket with the sub-bucket serial number of 1 is taken as the target sub-bucket.
In the method for determining target buckets as shown in fig. 4 provided by the embodiment of the invention,
when the sub-bucket strategy represented by the sub-bucket strategy identification is a Hash sub-bucket strategy, Hash operation is carried out on the request end identification to obtain a Hash operation value, modular operation is carried out on the Hash operation value according to the quantity of the sub-bucket identifications to obtain a modular operation value, sub-buckets with pre-distributed sub-bucket serial numbers matched with the modular operation value are selected from the sub-buckets represented by the sub-bucket identifications to serve as target sub-buckets, the request end identification can correspond to the serial numbers of the sub-buckets through Hash operation and modular operation, and the probability that different sub-buckets are selected is the same due to Hash operation, so that the fairness of selection of the sub-buckets is ensured.
In an embodiment of the present invention, the step S103 may select the sub-bucket as the target sub-bucket according to the size of the preset selected probability of each sub-bucket, and optionally, may be implemented by providing a target sub-bucket determination method as shown in fig. 5 according to another embodiment of the present invention, where the method includes the following steps:
s501: and according to the size of the preset selected probability of each sub-bucket, determining the slot corresponding to each sub-bucket in a preset number of slots.
In this step, the preset selected probability of each sub-bucket may be a flow rate ratio of each sub-bucket, and for example, if there are three sub-buckets, the flow rate ratios are 1/5, 2/5 and 2/5, respectively, the selected probabilities of the three sub-buckets are 20%, 40% and 40%, respectively.
The slot is a slot (slot) in Vue (a progressive JavaScript frame used for constructing a user interface), wherein the slot is used for deciding to insert the carried content into a specified certain position, so that the template is blocked, and has a modular characteristic and greater reusability.
Optionally, the preset number may be determined according to actual requirements, for example, 100, 1000, and the like.
In one embodiment, for each sub-bucket, a product of a magnitude of the selected probability of the sub-bucket and a preset number is determined as a slot number of slots corresponding to the sub-bucket, and a slot number of slots is determined as slots corresponding to the sub-bucket from among the preset number of slots based on the slot number.
For example, if the size of the selected probability of the sub-bucket a is 50%, and the preset number is 1000, 1000 × 50% is calculated to be 500, that is, the number of slots corresponding to the sub-bucket a is 500, and further, 500 slots are selected from the 1000 slots as the slots corresponding to the sub-bucket a.
Optionally, the slot identifiers of the slots with the preset number form a value queue which continuously increases from the preset value.
For example, if the preset number is 1000, the slot identifiers of the 1000 slots form a 0-999 value queue, where each value in 0-999 corresponds to only one slot.
In an embodiment, optionally, based on the number of slots, in slot identifiers of a preset number of slots, two slot identifiers whose slot identifier values differ by a reference value are determined, where the reference value is the slot number minus one, of the two slot identifiers, a slot identifier with a smaller slot identifier value is used as a starting slot identifier of the sub-bucket, a slot identifier with a larger slot identifier value is used as an ending slot identifier of the sub-bucket, and a slot corresponding to a slot identifier whose slot identifier value is between the slot identifier value of the starting slot identifier and the slot identifier value of the ending slot identifier is determined as a slot corresponding to the sub-bucket.
For example, if the preset number is 1000, the slot identifiers of the 1000 slots form a 0-999 numerical queue, and if the fractional bucket selection probability is 10%, the reference value is 100-1-99, and the slot identifier is 0 and the slot identifier sum 99 differs from 99, so that it may be determined that the slot identifier 0 is a start slot identifier, the slot identifier 99 is an end slot identifier, and 100 slot identifiers in 0-99 are slots corresponding to the fractional bucket.
S502: and randomly selecting the slot from the preset number of slots as a target slot.
In this step, a slot may be randomly selected as a target slot from a preset number of slots for the service request terminal.
As is exemplary. And if the slot with the slot mark 100 is randomly selected from the slots with the slot marks of 0-999, the slot with the slot mark 100 is taken as a target slot.
S503: and determining the sub-bucket corresponding to the target slot as the target sub-bucket.
In this step, each slot corresponds to a sub-bucket, so that the sub-bucket corresponding to the target slot can be used as the target sub-bucket.
In the method for determining target sub-buckets shown in fig. 5 provided in the embodiment of the present invention, the slots corresponding to each sub-bucket may be determined in the preset number of slots according to the size of the preset selected probability of each sub-bucket, and the slots may be randomly selected from the preset number of slots to serve as the target slots, and the sub-buckets corresponding to the target slots may be determined to serve as the target sub-buckets.
For ease of understanding, a practical embodiment is provided that incorporates the following:
in one embodiment, the experiment configuration is configured as a configuration table stored in a database, and the configuration table may be named as an AB _ experiment _ info table, where the experiment ID, the experiment name (corresponding to the service type), the experiment chinese name, the start time of the experiment, the experiment end time, the experiment status, the bucket policy identifier, and the plurality of bucket identifiers are recorded in the AB _ experiment _ info table.
For each sub-bucket policy represented by a sub-bucket policy identifier, the sub-bucket policy is configured and assigned as a sub-bucket policy table stored in the database, and the sub-bucket policy table may be named as an AB _ strategy _ info table, in which information such as a sub-bucket policy identifier, a sub-bucket policy type (parity sub-bucket policy, hash bucket policy, custom sub-bucket policy, etc.), a sub-bucket policy name, a table creation time, and a table creator is recorded.
For each sub-bucket represented by each sub-bucket identifier in the configuration table, the sub-bucket has a custom bucket configuration table stored in a database, and the custom bucket configuration table can be named as a bucket configuration table, wherein the bucket configuration table records a sub-bucket identifier, a sub-bucket traffic proportion, a sub-bucket name, custom parameters corresponding to the sub-bucket, sub-bucket creation time and a sub-bucket creator, wherein the custom parameters corresponding to the sub-bucket can include some parameters which are directly returned to a calling party after the sub-bucket is selected, and the calling party can perform some other operations according to the parameters.
The method comprises the steps that an experiment name corresponding to a service type is recorded in an ab _ experience _ info table, a sub-bucket strategy identification in the ab _ strategy _ info table and a sub-bucket identification in a bucket _ config table, association among the service type, the sub-bucket strategy and the sub-bucket is achieved, and when the experiment configuration of the service type needs to be changed, the association between the experiment configuration and the service type can be achieved only by changing the experiment name corresponding to the service type in the needed experiment configuration.
In an embodiment, when determining a target sub-bucket by using a slot, a slot start position corresponding to each sub-bucket may be recorded in a newly-created bucket _ slot _ relationship table, and when a slot corresponding to a sub-bucket needs to be determined, the slot start position corresponding to each sub-bucket may be analyzed by comprehensive analysis, for example, the total number of slots is 1000, and the number is 0 to 999, where the slot start position of the sub-bucket 1 is 0, the slot start position of the sub-bucket 2 is 400, the slot start position of the sub-bucket 3 is 700, the number of the slot corresponding to the sub-bucket 1 is 0 to 399, the number of the slot corresponding to the sub-bucket 2 is 400 to 699, and the number of the slot corresponding to the sub-bucket 3 is 700 to 999. The slot starting position corresponding to each sub-bucket in the bucket _ slot _ relation table is not fixed, and can be updated when configuration updating is carried out every time, so that developers can conveniently modify the flow rate ratio of each sub-bucket.
The bucket dividing strategy can be conveniently adjusted through the slots, recalculation of the slot to which each service request end belongs is not needed, and development efficiency is improved. For example, in the first experiment, there are two buckets, i.e., an experiment component bucket and a control component bucket, and 10% of the service requests are allocated to the experiment component bucket and the other 90% of the service requests are allocated to the control component bucket in the first experiment. At this time, the slot positions corresponding to the designated experimental component buckets are 0-99, and the slot positions corresponding to the comparison groups are 100-999. In the second experiment, the service requests needing to be distributed to the experimental component bucket and the comparison component bucket are the same and are both 50%, only the slot positions of the two component buckets are required to be adjusted to be 0-499 and 500-999, the service requests which are distributed to the slots with the positions of 100-499 in the prior art are transferred from the comparison component bucket to the experimental component bucket, the slot positions do not need to be redistributed to the service requests in the whole process, and the development efficiency is improved.
Furthermore, when the method needs to be realized online, the strategy only needs to be executed when the interface is called every time, and the generality of offline and online bucket dividing strategies can be realized.
Based on the same inventive concept, according to the method for selecting service data for testing provided by the embodiment of the present invention, an embodiment of the present invention further provides a device for selecting service data for testing, as shown in fig. 6, the device includes:
a request receiving module 601, configured to receive a service data request sent by a service request end, where the service data request is used to request to obtain service data required by a service to be processed in the service request end, and the service data request carries a request end identifier of the service request end and a service type to which the service to be processed belongs, and the service type is used as a service type to be processed;
an experiment configuration determining module 602, configured to determine, based on a pre-established correspondence between a service type and an experiment configuration, an experiment configuration corresponding to a service type to be processed, as a target experiment configuration, where the target experiment configuration includes a preset bucket dividing policy identifier and a plurality of bucket dividing identifiers;
a bucket selection module 603, configured to select, according to the bucket dividing policy indicated by the bucket dividing policy identifier, a bucket from the buckets indicated by the multiple bucket dividing identifiers, as a target bucket, where the bucket indicated by each bucket dividing identifier includes a set of to-be-tested service data of the AB test experiment to which the experimental configuration belongs;
a service data sending module 604, configured to send the service data to be tested included in the target sub-bucket to the service request end.
Further, the plurality of sub-barrels at least comprise a first sub-barrel and a second sub-barrel;
the bucket selection module 603 is specifically configured to determine parity of a value represented by the requester identifier when the bucket policy identifier indicates that the bucket policy is an odd-even bucket policy, select a first bucket as a target bucket when the value represented by the requester identifier is an odd number, and select a second bucket as the target bucket when the value represented by the requester identifier is an even number.
Further, the sub-bucket selecting module 603 is specifically configured to, when the sub-bucket policy indicated by the sub-bucket policy identifier is the hash sub-bucket policy, perform hash operation on the request end identifier to obtain a hash operation value, perform modulo operation on the hash operation value according to the number of the plurality of sub-bucket identifiers to obtain a modulo operation value, and select, from the sub-buckets indicated by the plurality of sub-bucket identifiers, a sub-bucket whose pre-allocated sub-bucket serial number matches the modulo operation value as the target sub-bucket.
Further, the sub-bucket selecting module 603 is specifically configured to, when the sub-bucket policy indicated by the sub-bucket policy identifier is the self-defined sub-bucket policy, select a sub-bucket as the target sub-bucket according to the size of the preset selected probability of each sub-bucket in the sub-buckets indicated by the multiple sub-bucket identifiers for the request end identifier.
Further, the sub-bucket selecting module 603 is specifically configured to determine, according to a size of a preset selected probability of each sub-bucket, a slot corresponding to each sub-bucket in a preset number of slots, randomly select a slot as a target slot in the preset number of slots, and determine a sub-bucket corresponding to the target slot as a target sub-bucket.
Further, the sub-bucket selecting module 603 is specifically configured to determine, for each sub-bucket, a product of a size of the selected probability of the sub-bucket and a preset number as a slot number of slots corresponding to the sub-bucket, and determine, based on the slot number, a slot number of slots in the preset number of slots as slots corresponding to the sub-bucket.
Further, the slot identifiers of a preset number of slots form a numerical value queue which continuously increases from a preset numerical value;
the sub-bucket selecting module 603 is specifically configured to determine, based on the number of the slots, two slot identifiers having a slot identifier value different by a reference value in the slot identifiers of the preset number of slots, where the reference value is the number of the slots minus one, and of the two slot identifiers, the slot identifier having a smaller slot identifier value is used as the initial slot identifier of the sub-bucket, and the slot identifier having a larger slot identifier value is used as the ending slot identifier of the sub-bucket, and determine a slot corresponding to the slot identifier between the slot identifier value of the initial slot identifier and the slot identifier value of the ending slot identifier, and use the slot corresponding to the sub-bucket.
An embodiment of the present invention further provides an electronic device, as shown in fig. 7, including a processor 701, a communication interface 702, a memory 703 and a communication bus 704, where the processor 701, the communication interface 702, and the memory 703 complete mutual communication through the communication bus 704,
a memory 703 for storing a computer program;
the processor 701 is configured to implement the following steps when executing the program stored in the memory 703:
receiving a service data request sent by a service request end, wherein the service data request is used for requesting to acquire service data required by a service to be processed in the service request end, and the service data request carries a request end identifier of the service request end and a service type to which the service to be processed belongs, and is used as the service type to be processed;
determining an experimental configuration corresponding to the service type to be processed as a target experimental configuration based on a pre-established corresponding relationship between the service type and the experimental configuration, wherein the target experimental configuration comprises a preset bucket dividing strategy identification and a plurality of bucket dividing identifications;
according to the bucket dividing strategy represented by the bucket dividing strategy identification, aiming at the request end identification, selecting a bucket from the buckets represented by the bucket dividing identifications as a target bucket, wherein the bucket represented by each bucket dividing identification comprises a group of service data;
and sending the service data contained in the target sub-bucket to the service request terminal.
The communication bus mentioned in the electronic device may be a Peripheral Component Interconnect (PCI) bus, an Extended Industry Standard Architecture (EISA) bus, or the like. The communication bus may be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, only one thick line is shown, but this does not mean that there is only one bus or one type of bus.
The communication interface is used for communication between the electronic equipment and other equipment.
The Memory may include a Random Access Memory (RAM) or a Non-Volatile Memory (NVM), such as at least one disk Memory. Optionally, the memory may also be at least one memory device located remotely from the processor.
The Processor may be a general-purpose Processor, including a Central Processing Unit (CPU), a Network Processor (NP), and the like; but may also be a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other Programmable logic device, discrete Gate or transistor logic device, discrete hardware component.
In a further embodiment of the present invention, a computer-readable storage medium is further provided, in which a computer program is stored, and the computer program, when executed by a processor, implements the steps of any of the above-mentioned methods for selecting service data for testing.
In a further embodiment of the present invention, there is also provided a computer program product containing instructions which, when run on a computer, cause the computer to perform any of the above-described embodiments of the method for selecting business data for testing.
In the above embodiments, the implementation may be wholly or partially realized by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When loaded and executed on a computer, cause the processes or functions described in accordance with the embodiments of the invention to occur, in whole or in part. The computer may be a general purpose computer, a special purpose computer, a network of computers, or other programmable device. The computer instructions may be stored in a computer readable storage medium or transmitted from one computer readable storage medium to another, for example, from one website site, computer, server, or data center to another website site, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, Digital Subscriber Line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device, such as a server, a data center, etc., that incorporates one or more of the available media. The usable medium may be a magnetic medium (e.g., floppy Disk, hard Disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., Solid State Disk (SSD)), among others.
It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
All the embodiments in the present specification are described in a related manner, and the same and similar parts among the embodiments may be referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, as for the apparatus, the electronic device, the computer-readable storage medium, and the computer program product, since they are substantially similar to the method embodiments, the description is simple, and the relevant points can be referred to the partial description of the method embodiments.
The above description is only for the preferred embodiment of the present invention, and is not intended to limit the scope of the present invention. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention shall fall within the protection scope of the present invention.
Claims (15)
1. A method for selecting service data for testing, comprising:
receiving a service data request sent by a service request end, wherein the service data request is used for requesting to acquire service data required by a service to be processed in the service request end, and the service data request carries a request end identifier of the service request end and a service type to which the service to be processed belongs, and is used as the service type to be processed;
determining an experimental configuration corresponding to the service type to be processed as a target experimental configuration based on a pre-established corresponding relationship between the service type and the experimental configuration, wherein the target experimental configuration comprises a preset bucket dividing strategy identification and a plurality of bucket dividing identifications;
according to the bucket dividing strategy represented by the bucket dividing strategy identification, aiming at the request end identification, selecting a bucket from buckets represented by the bucket dividing strategy identifications respectively to serve as a target bucket, wherein the bucket represented by each bucket dividing identification comprises a group of to-be-tested business data of an AB test experiment to which the experiment configuration belongs;
and sending the service data to be tested contained in the target sub-bucket to the service request terminal.
2. The method of claim 1, wherein the plurality of buckets includes at least a first bucket and a second bucket;
the selecting, according to the bucket dividing policy represented by the bucket dividing policy identifier, a bucket from the buckets represented by the multiple bucket dividing identifiers as a target bucket according to the request end identifier includes:
when the bucket dividing strategy represented by the bucket dividing strategy identification is an odd-even bucket dividing strategy, determining the odd-even property of the numerical value represented by the request terminal identification;
when the numerical value represented by the request terminal identification is an odd number, selecting the first sub-bucket as a target sub-bucket;
and when the numerical value represented by the request terminal identification is an even number, selecting the second sub-bucket as a target sub-bucket.
3. The method of claim 1, wherein selecting a bucket from the buckets represented by the bucket identifiers for the requester identifier according to the bucket policy represented by the bucket policy identifier as a target bucket comprises:
when the bucket dividing strategy represented by the bucket dividing strategy identification is a Hash bucket dividing strategy, carrying out Hash operation on the request end identification to obtain a Hash operation value;
performing modular operation on the hash operation value according to the number of the plurality of sub-bucket identifiers to obtain a modular operation value;
and selecting the sub-bucket with the pre-allocated sub-bucket serial number matched with the modulus operation numerical value from the sub-buckets represented by the sub-bucket identifications as a target sub-bucket.
4. The method of claim 1, wherein selecting a bucket from the buckets represented by the bucket identifiers for the requester identifier according to the bucket policy represented by the bucket policy identifier as a target bucket comprises:
and when the sub-bucket strategy represented by the sub-bucket strategy identification is a self-defined sub-bucket strategy, selecting sub-buckets as target sub-buckets according to the preset selected probability of each sub-bucket in the sub-buckets represented by the plurality of sub-bucket identifications aiming at the request end identification.
5. The method according to claim 4, wherein the selecting, for the requester id, a sub-bucket as a target sub-bucket according to a preset selected probability of each sub-bucket from the sub-buckets represented by the plurality of sub-bucket ids comprises:
according to the size of the preset selected probability of each sub-bucket, in a preset number of slots, determining the slot corresponding to each sub-bucket;
randomly selecting a slot from the preset number of slots as a target slot;
and determining the sub-bucket corresponding to the target slot as a target sub-bucket.
6. The method according to claim 5, wherein the determining, in a preset number of slots according to the size of the preset selected probability of each sub-bucket, the slot corresponding to each sub-bucket comprises:
for each sub-bucket, determining the product of the selected probability of the sub-bucket and the preset number as the number of slots of the slot corresponding to the sub-bucket;
and determining the slots with the number of slots in a preset number of slots based on the number of the slots to serve as the slots corresponding to the sub-barrel.
7. The method of claim 6, wherein the slot identifications of the predetermined number of slots constitute a queue of values that successively increase from a predetermined value;
the determining, based on the slot number, the slot of the slot number in a preset number of slots as a slot corresponding to the sub-bucket includes:
based on the number of the slots, determining two slot identifiers with the slot identifier value different from a reference value in the slot identifiers of the preset number of slots, wherein the reference value is obtained by subtracting one from the slot number, the slot identifier with the smaller slot identifier value in the two slot identifiers is used as a starting slot identifier of the sub-bucket, and the slot identifier with the larger slot identifier value is used as an ending slot identifier of the sub-bucket;
and determining a slot corresponding to the slot identifier from the slot identifier value of the initial slot identifier to the slot identifier value of the final slot identifier as the slot corresponding to the sub-barrel.
8. A device for selecting traffic data for testing, comprising:
a request receiving module, configured to receive a service data request sent by a service request end, where the service data request is used to request to obtain service data required by a service to be processed in the service request end, and the service data request carries a request end identifier of the service request end and a service type to which the service to be processed belongs, and is used as the service type to be processed;
the experimental configuration determining module is used for determining an experimental configuration corresponding to the service type to be processed as a target experimental configuration based on a pre-established corresponding relation between the service type and the experimental configuration, wherein the target experimental configuration comprises a preset bucket dividing strategy identifier and a plurality of bucket dividing identifiers;
a bucket selection module, configured to select a bucket from the buckets represented by the multiple bucket identifiers as a target bucket according to the bucket allocation policy represented by the bucket allocation policy identifier, and for the request end identifier, where the bucket represented by each bucket identifier includes a set of to-be-tested service data of the AB test experiment to which the experiment configuration belongs;
and the service data sending module is used for sending the service data to be tested contained in the target sub-bucket to the service request terminal.
9. The apparatus of claim 8, wherein the plurality of sub-buckets includes at least a first sub-bucket and a second sub-bucket;
the bucket dividing selection module is specifically configured to determine parity of a numerical value represented by the requester identifier when the bucket dividing policy represented by the bucket dividing policy identifier is an odd-even bucket dividing policy, select the first bucket as a target bucket when the numerical value represented by the requester identifier is an odd number, and select the second bucket as a target bucket when the numerical value represented by the requester identifier is an even number.
10. The apparatus according to claim 8, wherein the sub-bucket selecting module is specifically configured to, when the sub-bucket policy indicated by the sub-bucket policy identifier is a hash sub-bucket policy, perform a hash operation on the request-side identifier to obtain a hash operation value, perform a modulo operation on the hash operation value according to the number of the plurality of sub-bucket identifiers to obtain a modulo operation value, and select, as the target sub-bucket, a sub-bucket whose pre-allocated sub-bucket serial number matches the modulo operation value from among the sub-buckets indicated by the plurality of sub-bucket identifiers.
11. The apparatus of claim 8, wherein the bucket selection module is specifically configured to, when the bucket policy indicated by the bucket policy identifier is a custom bucket policy, select, for the request end identifier, a bucket as the target bucket according to a size of a preset selected probability of each bucket from the buckets indicated by the multiple bucket identifiers.
12. The apparatus according to claim 11, wherein the sub-bucket selecting module is specifically configured to determine, according to a size of a preset selected probability of each sub-bucket, a slot corresponding to each sub-bucket in a preset number of slots, randomly select a slot as a target slot in the preset number of slots, and determine a sub-bucket corresponding to the target slot as a target sub-bucket.
13. The apparatus according to claim 12, wherein the bucket selection module is specifically configured to determine, for each of the buckets, a product of a size of the selected probability of the bucket and the preset number as a slot number of a slot corresponding to the bucket, and determine, based on the slot number, the slot number of the slot from among the preset number of slots as a slot corresponding to the bucket.
14. The apparatus of claim 13, wherein the slot identifiers of the predetermined number of slots form a value queue that continuously increases from a predetermined value;
the sub-bucket selection module is specifically configured to determine, based on the number of the slots, two slot identifiers having a slot identifier value that differs from a reference value among the slot identifiers of the slots of the preset number, where the reference value is the slot number minus one, and of the two slot identifiers, a slot identifier having a smaller slot identifier value is used as a starting slot identifier of the sub-bucket, and a slot identifier having a larger slot identifier value is used as an ending slot identifier of the sub-bucket, and determine a slot corresponding to a slot identifier having a slot identifier value between the slot identifier value of the starting slot identifier and the slot identifier value of the ending slot identifier, and use the slot corresponding to the sub-bucket.
15. An electronic device is characterized by comprising a processor, a communication interface, a memory and a communication bus, wherein the processor and the communication interface are used for realizing mutual communication by the memory through the communication bus;
a memory for storing a computer program;
a processor for implementing the method steps of any of claims 1 to 7 when executing a program stored in the memory.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010129551.3A CN111338607A (en) | 2020-02-28 | 2020-02-28 | Method and device for selecting service data for testing and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010129551.3A CN111338607A (en) | 2020-02-28 | 2020-02-28 | Method and device for selecting service data for testing and electronic equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111338607A true CN111338607A (en) | 2020-06-26 |
Family
ID=71182013
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010129551.3A Pending CN111338607A (en) | 2020-02-28 | 2020-02-28 | Method and device for selecting service data for testing and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111338607A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111737143A (en) * | 2020-07-17 | 2020-10-02 | 北京热云科技有限公司 | Method and system for troubleshooting AB test of webpage |
| CN115190076A (en) * | 2022-07-14 | 2022-10-14 | 中国工商银行股份有限公司 | Flow shunting method and device, computer readable storage medium and electronic equipment |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103324566A (en) * | 2012-03-20 | 2013-09-25 | 阿里巴巴集团控股有限公司 | Multi-version test method and device for web page product |
| CN107451020A (en) * | 2017-06-28 | 2017-12-08 | 北京五八信息技术有限公司 | A kind of AB test systems and method of testing |
| CN109040085A (en) * | 2018-08-15 | 2018-12-18 | 湖南快乐阳光互动娱乐传媒有限公司 | Method and device for issuing data |
| CN110442796A (en) * | 2019-08-14 | 2019-11-12 | 北京思维造物信息科技股份有限公司 | A kind of Generalization bounds divide bucket method, device and equipment |
| US10489144B1 (en) * | 2019-07-22 | 2019-11-26 | Capital One Services, Llc | Automated bucket policy management arrangements |
-
2020
- 2020-02-28 CN CN202010129551.3A patent/CN111338607A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103324566A (en) * | 2012-03-20 | 2013-09-25 | 阿里巴巴集团控股有限公司 | Multi-version test method and device for web page product |
| CN107451020A (en) * | 2017-06-28 | 2017-12-08 | 北京五八信息技术有限公司 | A kind of AB test systems and method of testing |
| CN109040085A (en) * | 2018-08-15 | 2018-12-18 | 湖南快乐阳光互动娱乐传媒有限公司 | Method and device for issuing data |
| US10489144B1 (en) * | 2019-07-22 | 2019-11-26 | Capital One Services, Llc | Automated bucket policy management arrangements |
| CN110442796A (en) * | 2019-08-14 | 2019-11-12 | 北京思维造物信息科技股份有限公司 | A kind of Generalization bounds divide bucket method, device and equipment |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111737143A (en) * | 2020-07-17 | 2020-10-02 | 北京热云科技有限公司 | Method and system for troubleshooting AB test of webpage |
| CN111737143B (en) * | 2020-07-17 | 2020-12-22 | 北京热云科技有限公司 | Method and system for troubleshooting AB test of webpage |
| CN115190076A (en) * | 2022-07-14 | 2022-10-14 | 中国工商银行股份有限公司 | Flow shunting method and device, computer readable storage medium and electronic equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11921606B2 (en) | Methods and systems for determining system capacity | |
| JP7304118B2 (en) | Secure, consensual endorsements for self-monitoring blockchains | |
| CN108153670B (en) | Interface testing method and device and electronic equipment | |
| CN109474578B (en) | Message checking method, device, computer equipment and storage medium | |
| CN110661658B (en) | Node management method and device of block chain network and computer storage medium | |
| CN109885786B (en) | Data caching processing method and device, electronic equipment and readable storage medium | |
| CN110532025B (en) | Data processing method, device and equipment based on micro-service architecture and storage medium | |
| CN111290742A (en) | Parameter verification method and device, electronic equipment and readable storage medium | |
| CN111104675A (en) | Method and device for detecting system security vulnerability | |
| CN111523890A (en) | Data processing method and device based on block chain, storage medium and equipment | |
| CN107465687B (en) | Method, device and terminal for realizing permission configuration | |
| CN113591068B (en) | Online login device management method and device and electronic device | |
| CN113760697B (en) | Interface testing method, device, electronic equipment and storage medium | |
| CN110457629A (en) | Permission processing, authority control method and device | |
| CN111338607A (en) | Method and device for selecting service data for testing and electronic equipment | |
| CN108280024B (en) | Flow distribution strategy testing method and device and electronic equipment | |
| CN112685157B (en) | Task processing method, device, computer equipment and storage medium | |
| CN112181599A (en) | Model training method, device and storage medium | |
| CN110471966B (en) | Information data verification method, device, computer equipment and storage medium | |
| CN113608847A (en) | Task processing method, device, equipment and storage medium | |
| US11038915B1 (en) | Dynamic generation of courses of action for incident response in an information technology environment | |
| CN115577381B (en) | Line-level data access method and device and electronic equipment | |
| CN109828908A (en) | Interface testing parameter encryption method, device, electronic equipment and storage medium | |
| CN111163088B (en) | Message processing method, system and device and electronic equipment | |
| CN113794794B (en) | Method, device, equipment and storage medium for adding contact persons based on block chain |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200626 |