CN112969150B - Short message gateway experimental method and device - Google Patents
Short message gateway experimental method and device Download PDFInfo
- Publication number
- CN112969150B CN112969150B CN202110130805.8A CN202110130805A CN112969150B CN 112969150 B CN112969150 B CN 112969150B CN 202110130805 A CN202110130805 A CN 202110130805A CN 112969150 B CN112969150 B CN 112969150B
- Authority
- CN
- China
- Prior art keywords
- short message
- experiment
- domain
- parameter
- gateway
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000002474 experimental method Methods 0.000 title claims abstract description 312
- 238000000034 method Methods 0.000 claims abstract description 44
- 238000012545 processing Methods 0.000 claims abstract description 26
- 238000009826 distribution Methods 0.000 claims description 30
- 238000004519 manufacturing process Methods 0.000 claims description 15
- 238000003860 storage Methods 0.000 claims description 4
- 230000008569 process Effects 0.000 abstract description 16
- 238000010586 diagram Methods 0.000 description 13
- 238000012360 testing method Methods 0.000 description 12
- 239000010410 layer Substances 0.000 description 11
- 235000003642 hunger Nutrition 0.000 description 10
- 239000002356 single layer Substances 0.000 description 8
- 230000037351 starvation Effects 0.000 description 7
- 230000006870 function Effects 0.000 description 5
- 230000009286 beneficial effect Effects 0.000 description 2
- 230000007717 exclusion Effects 0.000 description 2
- 238000012795 verification Methods 0.000 description 2
- 238000004891 communication Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000008707 rearrangement Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
- H04W4/12—Messaging; Mailboxes; Announcements
- H04W4/14—Short messaging services, e.g. short message services [SMS] or unstructured supplementary service data [USSD]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W24/00—Supervisory, monitoring or testing arrangements
- H04W24/06—Testing, supervising or monitoring using simulated traffic
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W88/00—Devices specially adapted for wireless communication networks, e.g. terminals, base stations or access point devices
- H04W88/16—Gateway arrangements
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The embodiment of the application discloses a short message gateway experimental method and a short message gateway experimental device. According to the technical scheme provided by the embodiment of the application, the initial domain is divided based on the preset short message parameter priority to generate the nested flow domain, and the flow domain corresponds to at least one short message parameter; dividing an experiment group according to a preset short message parameter subset, and setting the experiment group in a corresponding flow domain according to the short message parameters of the experiment group, wherein the experiment group comprises at least one short message gateway experiment; and dividing the short message request into corresponding flow domains according to the short message parameters of the short message request, and processing the short message request by a short message gateway experiment arranged in the flow domain to obtain an experiment result. By adopting the technical means, various short message parameter subsets are configured to support various types of experiments, and the method has good expansibility and flexible configuration. A plurality of experiments can be executed simultaneously, so that the experiment efficiency is improved, and the experiment process of a new short message gateway is accelerated.
Description
Technical Field
The embodiment of the application relates to the technical field of short message services, in particular to a short message gateway experimental method and a short message gateway experimental device.
Background
At present, all large applications in the market use short message verification codes when the functions of login, payment, mobile phone number binding and the like are realized. The existing short message system can provide stable short message verification capability for various applications only by accessing a large number of short message gateways. In order to reduce the cost of the short message, each large company generally selects a gateway with higher access cost performance, and for this, a quality comparison experiment needs to be performed on the accessed short message gateway to evaluate the quality of the gateway channel.
In the existing contrast experiment, the gateway access line is tested and manually stopped by technicians, and finally the quality of the gateway channel is judged according to the experimental result. However, the existing contrast experiment needs to invest more labor time cost, the controllability of the practical process is lower, the experiment mode is single, the flow exclusivity is overlarge, and the experiment in other scenes cannot be met. And the experimental result report obtained by manual statistics is easy to have uncertain deviation.
Disclosure of Invention
The embodiment of the application provides a short message gateway experiment method and device, which support the parallel of multiple types of experiments, improve the experiment efficiency and accelerate the promotion of the experiment process of a new short message gateway.
In a first aspect, an embodiment of the present application provides a short message gateway experimental method, including:
dividing an initial domain based on short message parameters with preset priorities to generate parameter traffic domains with corresponding priorities;
dividing an experiment group according to a preset short message parameter subset, and setting the experiment group in a corresponding parameter flow domain according to short message parameters of the experiment group, wherein the experiment group comprises at least one short message gateway experiment;
dividing the short message request into corresponding parameter flow domains according to short message parameters of the short message request, and processing the short message request by a short message gateway experiment arranged in the parameter flow domains.
In a second aspect, an embodiment of the present application provides a short message gateway experimental apparatus, including:
the traffic domain dividing module is configured to divide an initial domain based on short message parameters with preset priorities so as to generate parameter traffic domains with corresponding priorities;
the experimental group setting module is configured to divide experimental groups according to preset short message parameter subsets, and set the experimental groups in corresponding parameter flow domains according to short message parameters of the experimental groups, wherein the experimental groups comprise at least one short message gateway experiment;
the short message request processing module is configured to divide the short message request into corresponding parameter flow domains according to short message parameters of the short message request, and the short message request is processed by a short message gateway experiment set in the parameter flow domains to obtain an experiment result.
In a third aspect, an embodiment of the present application provides an electronic device, including:
a memory and one or more processors;
the memory for storing one or more programs;
when the one or more programs are executed by the one or more processors, the one or more processors are enabled to implement the short message gateway experiment method according to the first aspect.
In a fourth aspect, embodiments of the present application provide a storage medium containing computer-executable instructions, which when executed by a computer processor, are configured to perform the short message gateway experiment method according to the first aspect.
The method comprises the steps that initial domains are divided based on preset short message parameter priorities to generate nested flow domains, and each flow domain corresponds to at least one short message parameter; dividing an experiment group according to a preset short message parameter subset, and setting the experiment group in a corresponding flow domain according to short message parameters of the experiment group, wherein the experiment group comprises at least one short message gateway experiment; dividing the short message request into corresponding flow domains according to short message parameters of the short message request, and processing the short message request by a short message gateway experiment arranged in the flow domains to obtain an experiment result. By adopting the technical means, various short message parameter subsets are configured to support various types of comparison experiments, and the method has good expansibility and flexible configuration. Because the experimental traffic of the short message request is mutually exclusive, no matter how many experimental groups are configured, the experimental groups are in the same experimental layer from the logic level, so that a plurality of experiments can be executed simultaneously, the experimental efficiency is improved, and the experimental process of a new short message gateway is accelerated. The flow distribution is reasonable between the experiments of the same experiment group through the flow distribution mode, so that the problem of flow hunger caused by single-layer experiments is solved, and the experiment efficiency and the accuracy of experiment results are improved. According to the experimental results of the control experimental group and the experimental results of the experimental group, the experimental report is generated, the experimental results are prevented from being counted manually, the labor input cost is reduced, the experimental results are prevented from being deviated during manual counting, and the accuracy of the experimental results is improved.
Drawings
Fig. 1 is a flowchart of an experimental method for a short message gateway according to an embodiment of the present application;
FIG. 2 is a diagram of a nested structure of parameter traffic domains;
FIG. 3 is a schematic diagram of a tree structure of a parameter traffic domain;
FIG. 4 is a flow chart of experimental group configuration in the first embodiment of the present application;
FIG. 5 is a schematic diagram of a single layer split model of a parametric traffic domain;
fig. 6 is a flowchart of short message request distribution in the first embodiment of the present application;
FIG. 7 is a tree diagram of a single-layer offload model for a parametric traffic domain;
fig. 8 is a structural diagram of a short message gateway experimental system provided in the first embodiment of the present application;
fig. 9 is a flowchart of an experimental method for a short message gateway provided in the second embodiment of the present application;
fig. 10 is a schematic structural diagram of a short message gateway experimental apparatus provided in the third embodiment of the present application;
fig. 11 is a schematic structural diagram of an electronic device according to a fourth embodiment of the present application.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, specific embodiments of the present application will be described in detail with reference to the accompanying drawings. It is to be understood that the specific embodiments described herein are merely illustrative of the application and are not limiting of the application. It should be further noted that, for the convenience of description, only some but not all of the relevant portions of the present application are shown in the drawings. Before discussing exemplary embodiments in more detail, it should be noted that some exemplary embodiments are described as processes or methods depicted as flowcharts. Although a flowchart may describe the operations (or steps) as a sequential process, many of the operations can be performed in parallel, concurrently or simultaneously. In addition, the order of the operations may be re-arranged. The process may be terminated when its operations are completed, but may have additional steps not included in the figure. The processes may correspond to methods, functions, procedures, subroutines, and the like.
The short message gateway experimental method and device aim at dividing an initial domain based on preset short message parameter priority to generate a nested flow domain, wherein the flow domain corresponds to at least one short message parameter; dividing an experiment group according to a preset short message parameter subset, and setting the experiment group in a corresponding flow domain according to short message parameters of the experiment group, wherein the experiment group comprises at least one short message gateway experiment; dividing the short message request into corresponding flow domains according to short message parameters of the short message request, and processing the short message request by a short message gateway experiment arranged in the flow domains to obtain an experiment result. Compared with the traditional control experiment mode, the method tests the gateway access line, stops the test manually by technicians, and finally judges the quality of the gateway channel according to the test result. The traditional control experiment mode needs to invest more labor time cost, the controllability of the practice process is lower, the experiment mode is single, the flow exclusivity is overlarge, and the experiment of other scenes cannot be met. And the experimental result report obtained by manual statistics is easy to have uncertain deviation. Based on the method and the device, the problem of single experiment mode is solved, the parallel of multiple types of experiments is supported, the experiment efficiency is improved, and the experiment process of a new short message gateway is accelerated.
The first embodiment is as follows:
fig. 1 is a flowchart of a short message gateway experimental method provided in an embodiment of the present application, where the short message gateway experimental method provided in this embodiment may be executed by a short message gateway experimental apparatus, and the short message gateway experimental apparatus may be implemented in a software and/or hardware manner.
The following description will be given by taking the short message gateway experimental device as an example of a main body for executing the short message gateway experimental method. Referring to fig. 1, the short message gateway experimental method includes:
s110, dividing an initial domain based on short message parameters with preset priority to generate a parameter traffic domain with corresponding priority.
Specifically, in the embodiment of the present application, the short message request is an experimental traffic, the experimental traffic of the short message request type is exclusive, the initial domain is a traffic domain including all traffic, and the short message request initially flows into the initial domain and then flows into the corresponding parameter traffic domain according to the short message parameter. The short message parameters comprise application identifiers, country codes and the like, the initial domain is divided by the application identifiers under the assumption that the priority of the application identifiers is higher than that of the country codes, different application identifiers correspond to different application domains, and further, the application domains are divided by the country codes, and different country domains are different in country codes. Illustratively, referring to fig. 2, fig. 2 is a diagram of a nested structure of parameter traffic domains. As shown in fig. 2, the initial domain is divided into a first application domain and a second application domain by the first application identifier and the second application identifier, the first application domain is divided into a first country domain and a second country domain by the first country code and the second country code, and the second application domain is divided into a third country domain and a fourth country domain by the first country code and the second country code. It can be understood that, although the first application domain and the second application domain are divided by the first country code and the second country code, the short message parameter of the traffic in the first country domain includes the first application identification code and the first country code, and the short message parameter of the traffic in the third country domain includes the second application identification code and the first country code, so that it can be understood that the short message parameter of the traffic in the parameter traffic domain includes the parameter traffic domain parameter to which it belongs and the parameter traffic domain parameter with higher priority to which it belongs.
It can be understood that the parameter traffic domain is configured based on the short message parameters of the short message request, but in actual life, some short message requests exist, the short message parameter with the highest priority is the country code, and the short message parameter with the highest priority of other short message requests is the application identifier. However, in order to ensure that the parameter traffic domains with the same priority are in the same layer, so that the parameter traffic domains with the same priority only need to be searched in the same layer when the parameter traffic domains with the same type are searched, the parameter traffic domains with the same priority can be set in the same layer through the virtual domain. Specifically, referring to fig. 3, fig. 3 is a schematic diagram of a tree structure of a parameter traffic domain. As shown in fig. 3, the model of the parametric traffic domain is abstracted into a multi-way tree, the initial domain serves as a parent node of the multi-way tree, and the parametric traffic domain serves as a child node of the multi-way tree. The short message parameter of the flow in the fifth country domain does not include the application identifier, and the short message parameter of the flow in the fifth country domain can directly flow to the corresponding country domain at first, and the hierarchy of the fifth country domain is the second layer and is the same as the hierarchy of the application domain. Then, a virtual domain is set between the initial domain and the fifth-country domain, and the traffic in the initial domain, which does not include the application identifier, is led to the fifth-country domain by the virtual domain, and the hierarchy of the fifth-country domain is the same as that of the first-country domain.
And S120, dividing an experiment group according to a preset short message parameter subset, and setting the experiment group in a corresponding parameter flow domain according to the short message parameters of the experiment group, wherein the experiment group comprises at least one short message gateway experiment.
Specifically, as shown in step S110, the short message parameters of the traffic in the parameter traffic domain include the parameter traffic domain parameter to which the short message parameters belong, and also include the parameter traffic domain parameter with higher priority to which the short message parameters belong, different types of experiment groups may be set in different parameter traffic domains, or multiple experiments of the same type may be set in one parameter traffic domain. And the experimental traffic based on the short message request type is mutually exclusive, a plurality of experiments can be executed simultaneously, and the experiments are not influenced mutually. Exemplarily, referring to fig. 4, fig. 4 is a flowchart of an experimental group configuration in the first embodiment of the present application. As shown in fig. 4, the experimental group configuration flow includes:
s1201, matching the short message parameter subset corresponding to the experimental group with the short message parameters of the parameter flow domain, and determining the parameter flow domain corresponding to the experimental group;
s1202, determining the position range of each short message gateway experiment in the corresponding parameter flow domain according to the experiment sequence and the experiment proportion value of each short message gateway experiment in the experiment group;
and S1203, configuring each short message gateway experiment in a corresponding parameter traffic domain according to the position range.
Illustratively, referring to fig. 5, fig. 5 is a schematic diagram of a single layer split model of a parametric traffic domain. As shown in fig. 5, a first short message gateway experiment, a second short message gateway experiment, and a third short message gateway experiment are set in a first country domain, wherein the first short message gateway experiment and the second short message gateway experiment are set in the first country domain in parallel. The problem of flow starvation is easily caused by the fact that a plurality of experiments are arranged in parallel, the problem of flow starvation refers to the situation that a small number of previous experiments occupy a large amount of flow, the flow of the following experiments is small, the problem of flow starvation can lead to overload operation of the previous experiments, and the experiment efficiency is low. In order to avoid the problem of flow starvation, experiments which are set in parallel in the same parameter flow domain are set at corresponding positions. For example, assuming that the preset experiment sequence is that the first short message gateway experiment is in the front, the second short message gateway experiment is in the back, the first short message gateway experiment sets a traffic proportion of 10%, and the second short message gateway experiment sets a traffic proportion of 20%, it can be obtained that the position range of the first short message gateway experiment in the first country is 0 to 10, and the position range of the second short message gateway experiment in the first country is 10 to 30.
S130, dividing the short message request into corresponding parameter flow domains according to the short message parameters of the short message request, and processing the short message request by a short message gateway experiment set in the parameter flow domains.
Specifically, the short message parameters of the short message request are matched with the short message parameters corresponding to the parameter traffic domain with the priority from high to low, so that the short message request flows from the high-level parameter traffic domain to the low-level parameter traffic domain. When the short message request flows to the parameter flow field configured with the experimental group, the short message parameters of the short message request are compared with the short message parameter subsets of the experimental group in the parameter flow field, and if the short message parameters of the short message request can be found in the short message parameter subsets, the short message request is processed by the experimental group. If the short message parameters of the short message request cannot be found in the short message parameter subset, the short message request continues to flow to a parameter flow domain of a lower layer or to a production domain, and if the parameter flow domain is the lowest layer flow domain, the short message request flows to the production domain. An online short message gateway is arranged in the production domain, and the short message request flowing into the production domain is directly processed by the online short message gateway.
After the short message request flows into the experiment group, if a plurality of short message gateway experiments are arranged in the experiment group, the short message request needs to be reasonably distributed in order to avoid the problem of flow starvation. Specifically, referring to fig. 6, fig. 6 is a flowchart of short message request distribution in the first embodiment of the present application. As shown in fig. 6, the short message request distribution process includes:
s1301, determining the distribution position of the short message request according to a preset Hash distribution rule;
s1302, judging whether the distribution position of the short message request exceeds the position range of all short message gateway experiments;
s1303, if the distribution position of the short message request exceeds the position range of the short message gateway experiment, dividing the short message request into a production domain, and processing the short message request by an online short message gateway in the production domain;
and S1304, if the distribution position of the short message request is in the position range of the short message gateway experiment, processing the short message request by the corresponding short message gateway experiment.
Specifically, a mod value of the short message request is calculated through a preset traffic distribution formula, where the traffic distribution formula is mod ═ murmurmurhash (% of hash _ key, seed)% 100, the hash _ key is defined by a service type of the short message request, generally including the terminal device I D and the mobile phone number, and the seed value is a parameter traffic field I D (generated by a short message gateway experimental method when dividing the traffic field). Through the murmur Hash function, the experimental flow is fully scattered and is distributed to the corresponding experiment, so that the problem of flow starvation is solved, and the experimental efficiency is improved.
Illustratively, referring to fig. 7, fig. 7 is a tree diagram of a single-layer offload model for a parametric traffic domain. As shown in fig. 7, the short message gateway experiment is a leaf node of the multi-branch tree, and the short message request can reach the corresponding experiment group after passing through the multi-branch tree. Illustratively, the first short message gateway experiment and the second short message gateway experiment are experiments arranged in parallel in the first country, the position range of the first short message gateway experiment in the first country is 0 to 10, and the position range of the second short message gateway experiment in the first country is 10 to 30. The SMS request flows from the initial domain to the first application and finally into the first country domain. The short message parameters of the short message request accord with the short message parameter subset of the experiment group in the first country domain, and the short message request flows into the experiment group consisting of the first short message gateway experiment and the second short message gateway experiment. And calculating to obtain a mod value of the short message request as 8, wherein the mod value of the short message request accords with the position range of the first short message gateway experiment, distributing the short message request to the first short message gateway experiment, and processing the short message request by the first short message gateway experiment.
It can be understood that the flow distribution rule is not only applicable to parallel experiments in an experimental group, but also applicable to an experimental group and a parameter flow domain which are arranged in parallel. As shown in fig. 7, a first country domain and a third short message gateway experiment are set in the first application domain, the first country domain and the third short message gateway experiment are set in parallel, and the experiment traffic flowing into the first application domain is distributed to the first country domain or the third short message gateway experiment according to the traffic distribution rule.
Further, if the distribution position of the short message request exceeds the position range of all short message gateway experiments in the parameter flow domain, the short message request is divided into the production domain. For example, referring to fig. 7, the short message request flowing into the first country domain conforms to the parameter requirement of the experimental group, but the mod value of the short message request is 38, which exceeds the position range of the experimental group, the short message request is divided into the production domains, and the short message request is processed by the online short message gateway in the production domain.
On the other hand, referring to fig. 8, fig. 8 is a structural diagram of a short message gateway experimental system provided in the first embodiment of the present application. As shown in fig. 8, the short message gateway system includes an application service, a short message request distribution system, a test system, a first short message gateway experiment, an online short message gateway, and a second short message gateway experiment. The application service sends a short message request to a short message request distribution system, the short message request distribution system sends the short message request to a test system, and the test system changes the original flow path of the short message request according to the short message parameters of the short message request and the short message parameter subsets of a first short message gateway experiment and a second short message gateway experiment, so that the short message request flows into the corresponding short message gateway experiment, and the flow which does not flow into the experiment flows into an on-line short message gateway according to scheduling so as to be compatible with smooth switching of a new gateway and an old gateway. Understandably, the test system divides the short message requests into corresponding short message gateway experiments according to the parameter traffic domain model in the embodiment of the application. Among other things, the test system may employ an AB test system, which is a method of comparing two versions of a single variable parameter, typically by testing the subject's response to variant a versus variant B, and determining which of the two variants is more effective.
It can be understood that, in the embodiment of the present application, the short message gateway experiment includes various different types of experiments, where the quality of the new short message gateway is tested by a more common type of experiment, including but not limited to a short message system scheduling algorithm comparison experiment, a short message document brand-free comparison experiment, and the like. In addition, based on the characteristic of mutual exclusion between short message requests, the experimental traffic of the short message request type is also mutually exclusive, and the embodiment of the application constructs a model of parallel experiments in the same layer based on the characteristic of mutual exclusion of the experimental traffic so as to realize the simultaneous operation of multiple experiments. Because the main body for processing the short message request is the short message gateway, the embodiment of the application can be realized based on the experimental type of the short message request for testing, and is not limited to testing the short message gateway.
In summary, the initial domain is divided based on the preset short message parameter priority to generate a nested traffic domain, wherein the traffic domain corresponds to at least one short message parameter; dividing an experiment group according to a preset short message parameter subset, and setting the experiment group in a corresponding flow domain according to short message parameters of the experiment group, wherein the experiment group comprises at least one short message gateway experiment; dividing the short message request into corresponding flow domains according to short message parameters of the short message request, and processing the short message request by a short message gateway experiment arranged in the flow domains to obtain an experiment result. By adopting the technical means, various short message parameter subsets are configured to support various types of comparison experiments, and the method has good expansibility and flexible configuration. Because the experimental traffic of the short message request is mutually exclusive, no matter how many experimental groups are configured, the experimental groups are in the same experimental layer from the logic level, so that a plurality of experiments can be executed simultaneously, the experimental efficiency is improved, and the experimental process of a new short message gateway is accelerated. The flow distribution is fair and reasonable between the experiments of the same experiment group through the flow distribution mode, so that the problem of flow hunger caused by single-layer experiments is solved, and the experiment efficiency and the accuracy of experiment results are improved.
Example two:
fig. 9 is a flowchart of a short message gateway experimental method provided in the second embodiment of the present application. Referring to fig. 9, a short message gateway experimental method includes:
s210, dividing an initial domain based on short message parameters with preset priority to generate a parameter traffic domain with corresponding priority.
S220, dividing an experiment group according to a preset short message parameter subset, and setting the experiment group in a corresponding parameter flow domain according to the short message parameters of the experiment group, wherein the experiment group comprises at least one short message gateway experiment.
S230, dividing the short message request into corresponding parameter flow domains according to the short message parameters of the short message request, and processing the short message request by a short message gateway experiment set in the parameter flow domains.
The specific implementation process of steps S210 to S230 may refer to steps S110 to S130.
S240, when the short message request processing times of the short message gateway experiment are equal to the preset experiment times, stopping the experiment and obtaining the experiment result of the short message gateway experiment.
And S250, taking other experiment groups as control experiment groups of the experiment groups, generating a first experiment report according to the experiment results of the experiment groups and the experiment results of the other experiment groups, and sending the first experiment report to a preset mailbox.
Furthermore, the online short message gateway in the production domain is used as a comparison experiment group of the experiment group, a second experiment report is generated according to the experiment result of the experiment group and the result of the online short message gateway, and the second experiment report is sent to a preset mailbox.
Illustratively, after the number of short message gateway experiments reaches a preset number of experiments, the experimental result of the short message gateway experiments is obtained. In order to determine the effect of the short message gateway experiment, a comparison experiment group of the short message gateway experiment is set, wherein one comparison type takes the on-line short message gateway as the comparison experiment, and the other comparison type takes the experiment group with different short message parameter subsets as the comparison experiment. And after the short message gateway experiment and the comparison experiment are finished, respectively counting the backfill rates of the short message gateway experiment and the comparison experiment, and calculating the backfill rates of the short message gateway experiment and the comparison experiment to generate an experiment report. And informing the staff in a set mode, for example, sending an experiment report to the corresponding staff through a mailbox. According to the embodiment of the application, the experiment is automatically stopped by setting the experiment times of the short message gateway experiment. And an experiment report is generated by counting the experiment result so as to reduce a large amount of manual counting time.
In summary, the initial domain is divided based on the preset short message parameter priority to generate a nested traffic domain, wherein the traffic domain corresponds to at least one short message parameter; dividing an experiment group according to a preset short message parameter subset, and setting the experiment group in a corresponding flow domain according to short message parameters of the experiment group, wherein the experiment group comprises at least one short message gateway experiment; dividing the short message request into corresponding flow domains according to short message parameters of the short message request, and processing the short message request by a short message gateway experiment arranged in the flow domains to obtain an experiment result. By adopting the technical means, various short message parameter subsets are configured to support various types of comparison experiments, and the method has good expansibility and flexible configuration. Because the experimental traffic of the short message request is mutually exclusive, no matter how many experimental groups are configured, the experimental groups are in the same experimental layer from the logic level, so that a plurality of experiments can be executed simultaneously, the experimental efficiency is improved, and the experimental process of a new short message gateway is accelerated. The flow distribution is fair and reasonable among the experiments of the same experiment group in a flow distribution mode, so that the problem of flow starvation caused by single-layer experiments is solved, and the experiment efficiency and the accuracy of experiment results are improved. According to the experimental results of the control experimental group and the experimental results of the experimental group, the experimental report is generated, the experimental results are prevented from being counted manually, the labor input cost is reduced, the experimental results are prevented from being deviated during manual counting, and the accuracy of the experimental results is improved.
Example three:
on the basis of the foregoing embodiments, fig. 10 is a schematic structural diagram of a short message gateway experimental apparatus provided in the third embodiment of the present application. Referring to fig. 10, the short message gateway experimental apparatus provided in this embodiment specifically includes: a traffic domain dividing module 21, an experimental group setting module 22 and a short message request processing module 23.
The traffic domain dividing module 21 is configured to divide an initial domain based on short message parameters with preset priorities to generate parameter traffic domains with corresponding priorities;
an experiment group setting module 22, configured to divide experiment groups according to preset short message parameter subsets, and set the experiment groups in corresponding parameter flow domains according to short message parameters of the experiment groups, where the experiment groups include at least one short message gateway experiment;
the short message request processing module 23 is configured to divide the short message request into corresponding parameter traffic domains according to short message parameters of the short message request, and process the short message request by a short message gateway experiment set in the parameter traffic domains to obtain an experiment result.
The initial domain is divided based on the preset short message parameter priority to generate a nested traffic domain, wherein the traffic domain corresponds to at least one short message parameter; dividing an experiment group according to a preset short message parameter subset, and setting the experiment group in a corresponding flow domain according to short message parameters of the experiment group, wherein the experiment group comprises at least one short message gateway experiment; dividing the short message request into corresponding flow domains according to short message parameters of the short message request, and processing the short message request by a short message gateway experiment arranged in the flow domains to obtain an experiment result. By adopting the technical means, various short message parameter subsets are configured to support various types of comparison experiments, and the method has good expansibility and flexible configuration. Because the experimental traffic of the short message request is mutually exclusive, no matter how many experimental groups are configured, the experimental groups are in the same experimental layer from the logic level, so that a plurality of experiments can be executed simultaneously, the experimental efficiency is improved, and the experimental process of a new short message gateway is accelerated. The flow distribution is fair and reasonable between the experiments of the same experiment group through the flow distribution mode, so that the problem of flow hunger caused by single-layer experiments is solved, and the experiment efficiency and the accuracy of experiment results are improved. According to the experimental results of the control experimental group and the experimental results of the experimental group, the experimental report is generated, the experimental results are prevented from being counted manually, the human input cost is reduced, the experimental results are prevented from being counted manually, deviation is avoided, and the accuracy of the experimental results is improved.
The short message gateway experimental apparatus provided in the third embodiment of the present application can be used to execute the short message gateway experimental methods provided in the first embodiment and the second embodiment, and has corresponding functions and beneficial effects.
Example four:
an embodiment of the present application provides an electronic device, and with reference to fig. 10, the electronic device includes: a processor 31, a memory 32, a communication module 33, an input device 34, and an output device 35. The memory 32 for storing one or more programs; when the one or more programs are executed by the one or more processors 31, the one or more processors 31 implement the short message gateway experiment method provided in the above embodiment. The electronic device provided by the embodiment can be used for executing the short message gateway experimental method provided by the embodiment one and the embodiment two, and has corresponding functions and beneficial effects.
Example five:
the embodiment of the application also provides a storage medium containing computer executable instructions, and the computer executable instructions are used for executing the short message gateway experiment method when being executed by a computer processor. Of course, the storage medium containing the computer-executable instructions provided in the embodiments of the present application is not limited to the above-mentioned short message gateway experimental method, and may also perform related operations in the short message gateway experimental method provided in any embodiments of the present application.
The foregoing is considered as illustrative of the preferred embodiments of the invention and the technical principles employed. The present application is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, although the present application has been described in more detail with reference to the above embodiments, the present application is not limited to the above embodiments, and may include other equivalent embodiments without departing from the spirit of the present application, and the scope of the present application is determined by the scope of the claims.
Claims (11)
1. A short message gateway experimental method is characterized by comprising the following steps:
dividing an initial domain based on short message parameters with preset priorities to generate parameter traffic domains with corresponding priorities; the initial domain is a flow domain containing all short message requests;
dividing an experiment group according to a preset short message parameter subset, and setting the experiment group in a corresponding parameter flow domain according to short message parameters of the experiment group, wherein the experiment group comprises at least one short message gateway experiment;
dividing the short message request into corresponding parameter flow domains according to short message parameters of the short message request, and processing the short message request by a short message gateway experiment arranged in the parameter flow domains;
and when the short message request processing times of the short message gateway experiment are equal to the preset experiment times, stopping the experiment and acquiring the experiment result of the short message gateway experiment.
2. The method of claim 1, wherein after the dividing the initial domain based on the short message parameters with preset priority to generate the parameter traffic domain with corresponding priority, the method further comprises:
and setting the parameter traffic domains with the same priority at the same layer through the virtual domain.
3. The method of claim 1, wherein the dividing the experiment groups according to the preset short message parameter subsets and setting the experiment groups in the corresponding parameter traffic domains according to the short message parameters of the experiment groups comprises:
matching the short message parameter subset corresponding to the experimental group with the short message parameters of the parameter flow domain to determine the parameter flow domain corresponding to the experimental group;
determining the position range of each short message gateway experiment in the corresponding parameter flow domain according to the experiment sequence and the experiment proportion value of each short message gateway experiment in the experiment group;
and configuring each short message gateway experiment in a corresponding parameter flow domain according to the position range.
4. The method of claim 1, wherein the processing of the short message request by the short message gateway experiment set in the parameter traffic domain comprises:
determining the distribution position of the short message request according to a preset Hash distribution rule;
and if the distribution position of the short message request is located in the position range of the short message gateway experiment, processing the short message request by the corresponding short message gateway experiment.
5. The method of claim 1, wherein the processing of the short message request by the short message gateway experiment set in the parameter traffic domain comprises:
determining the distribution position of the short message request according to a preset Hash distribution rule;
and if the distribution position of the short message request exceeds the position range of all short message gateway experiments in the parameter flow domain, dividing the short message request into a production domain, and processing the short message request by an online short message gateway in the production domain.
6. The method of claim 5, wherein before the short message request is processed by the short message gateway experiment set in the parameter traffic domain, the method further comprises:
and if the short message parameters of the short message request flowing into the parameter flow domain are not matched with the short message parameter subset of the experimental group in the parameter flow domain, dividing the short message request into the production domain, and processing the short message request by an online short message gateway in the production domain.
7. The method of claim 1, wherein after the stopping the experiment and obtaining the experiment result of the short message gateway experiment, further comprising:
and taking other experiment groups as control experiment groups of the experiment groups, generating a first experiment report according to the experiment results of the experiment groups and the experiment results of the other experiment groups, and sending the first experiment report to a preset mailbox.
8. The method of claim 1, wherein after the stopping the experiment and obtaining the experiment result of the short message gateway experiment, further comprising:
and taking the on-line short message gateway in the production domain as a control experiment group of the experiment group, generating a second experiment report according to the experiment result of the experiment group and the result of the on-line short message gateway, and sending the second experiment report to a preset mailbox.
9. A short message gateway experimental device is characterized by comprising:
the traffic domain dividing module is configured to divide an initial domain based on short message parameters with preset priorities so as to generate parameter traffic domains with corresponding priorities; the initial domain is a flow domain containing all short message requests;
the experimental group setting module is configured to divide experimental groups according to preset short message parameter subsets, and set the experimental groups in corresponding parameter flow domains according to short message parameters of the experimental groups, wherein the experimental groups comprise at least one short message gateway experiment;
the short message request processing module is configured to divide the short message request into corresponding parameter flow domains according to short message parameters of the short message request, and the short message request is processed by a short message gateway experiment set in the parameter flow domains;
the short message gateway experimental device further comprises: and when the short message request processing times of the short message gateway experiment are equal to the preset experiment times, stopping the experiment and acquiring the experiment result of the short message gateway experiment.
10. An electronic device, comprising:
a memory and one or more processors;
the memory for storing one or more programs;
when executed by the one or more processors, cause the one or more processors to implement the short message gateway experiment method of any of claims 1-8.
11. A storage medium containing computer-executable instructions, which when executed by a computer processor, are configured to perform the short message gateway experiment method of any of claims 1-8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110130805.8A CN112969150B (en) | 2021-01-29 | 2021-01-29 | Short message gateway experimental method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110130805.8A CN112969150B (en) | 2021-01-29 | 2021-01-29 | Short message gateway experimental method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112969150A CN112969150A (en) | 2021-06-15 |
| CN112969150B true CN112969150B (en) | 2022-05-31 |
Family
ID=76272552
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110130805.8A Active CN112969150B (en) | 2021-01-29 | 2021-01-29 | Short message gateway experimental method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112969150B (en) |
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110445672A (en) * | 2019-07-05 | 2019-11-12 | 深圳壹账通智能科技有限公司 | Test method, terminal to be tested and Related product |
Family Cites Families (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR100749744B1 (en) * | 2005-05-27 | 2007-08-17 | 엘지전자 주식회사 | Method for testing sms service in the mobile terminal |
| CN100389627C (en) * | 2005-10-25 | 2008-05-21 | 中国移动通信集团公司 | Testing equipment of short message interface |
| CN102111495B (en) * | 2010-12-08 | 2013-11-27 | 北京新媒传信科技有限公司 | Method for testing short messages |
| US20180316789A1 (en) * | 2017-04-28 | 2018-11-01 | Cyara Solutions Pty Ltd | Automated sms regression and functional testing |
| CN107948942A (en) * | 2017-11-23 | 2018-04-20 | 北京百悟科技有限公司 | A kind of short message service automated testing method and device |
| CN110177378A (en) * | 2019-05-21 | 2019-08-27 | 深圳壹账通智能科技有限公司 | A kind of automated testing method and relevant device |
| CN110413533A (en) * | 2019-09-03 | 2019-11-05 | 江苏满运软件科技有限公司 | AB test method, system, equipment and storage medium |
-
2021
- 2021-01-29 CN CN202110130805.8A patent/CN112969150B/en active Active
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110445672A (en) * | 2019-07-05 | 2019-11-12 | 深圳壹账通智能科技有限公司 | Test method, terminal to be tested and Related product |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112969150A (en) | 2021-06-15 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109710236B (en) | Service development and implementation method, device, platform and medium based on shared service | |
| US20190181901A1 (en) | Local profile assistant and application programming interface | |
| CN109391498B (en) | Management method of network component and network equipment | |
| AU2017404864A1 (en) | Network slice management method, unit and system | |
| CN109327627A (en) | Telephone number recognition methods, device and storage medium based on block chain | |
| CN111260257A (en) | Wind control model construction method, wind control auditing device and computer equipment | |
| CN113516507A (en) | Resource charging method and device for multi-cloud management platform | |
| CN112631686A (en) | Data processing method, data processing device, computer equipment and storage medium | |
| CN113885959B (en) | Data processing method, device, equipment and medium based on interface configuration | |
| CN106844319B (en) | Report generation method and device | |
| CN106326062A (en) | Method and device for controlling running state of application program | |
| CN106855862B (en) | Rapid comparison method and device | |
| CN111654879B (en) | Business push method, device, control equipment and storage medium | |
| CN112969150B (en) | Short message gateway experimental method and device | |
| CN113722114A (en) | Data service processing method and device, computing equipment and storage medium | |
| CN113923130B (en) | Multi-tenant open interface resource configuration method, device and terminal | |
| CN113377652A (en) | Test data generation method and device | |
| CN112671572B (en) | Method and device for intelligent equipment network distribution, storage medium and electronic device | |
| CN112632083A (en) | Method, device and equipment for updating index data | |
| CN113486118A (en) | Consensus node selection method and device | |
| CN111464618A (en) | Message pushing method, device, equipment and storage medium | |
| WO2022089321A1 (en) | Method and apparatus for scheduling access point, and server and storage medium | |
| CN111159207A (en) | Information processing method and device | |
| CN113297080B (en) | Simple test method for Internet of things platform | |
| CN108400901A (en) | Test method, terminal device and the computer readable storage medium of application |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |