CN111526028B - Data processing method, device and equipment - Google Patents
Data processing method, device and equipment Download PDFInfo
- Publication number
- CN111526028B CN111526028B CN201910104240.9A CN201910104240A CN111526028B CN 111526028 B CN111526028 B CN 111526028B CN 201910104240 A CN201910104240 A CN 201910104240A CN 111526028 B CN111526028 B CN 111526028B
- Authority
- CN
- China
- Prior art keywords
- application
- node
- data
- information
- application node
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 63
- 238000012545 processing Methods 0.000 claims abstract description 233
- 238000004088 simulation Methods 0.000 claims abstract description 233
- 238000000034 method Methods 0.000 claims abstract description 176
- 230000006854 communication Effects 0.000 claims description 134
- 238000004891 communication Methods 0.000 claims description 129
- 230000004044 response Effects 0.000 claims description 102
- 230000008859 change Effects 0.000 claims description 72
- 230000006399 behavior Effects 0.000 claims description 43
- 230000002452 interceptive effect Effects 0.000 claims description 30
- 230000003993 interaction Effects 0.000 claims description 14
- 238000004806 packaging method and process Methods 0.000 claims description 13
- 230000002159 abnormal effect Effects 0.000 claims description 9
- 238000004458 analytical method Methods 0.000 claims description 5
- 238000005553 drilling Methods 0.000 abstract description 31
- 238000010586 diagram Methods 0.000 description 34
- 230000008569 process Effects 0.000 description 31
- 238000003860 storage Methods 0.000 description 22
- 238000004590 computer program Methods 0.000 description 18
- 238000007405 data analysis Methods 0.000 description 15
- 238000013461 design Methods 0.000 description 11
- 238000011084 recovery Methods 0.000 description 8
- 230000000694 effects Effects 0.000 description 7
- 238000012795 verification Methods 0.000 description 7
- 238000013507 mapping Methods 0.000 description 5
- 230000006870 function Effects 0.000 description 4
- 230000007246 mechanism Effects 0.000 description 4
- 230000011664 signaling Effects 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 3
- 238000011156 evaluation Methods 0.000 description 3
- 230000005540 biological transmission Effects 0.000 description 2
- 238000001514 detection method Methods 0.000 description 2
- 238000004519 manufacturing process Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- HRULVFRXEOZUMJ-UHFFFAOYSA-K potassium;disodium;2-(4-chloro-2-methylphenoxy)propanoate;methyl-dioxido-oxo-$l^{5}-arsane Chemical compound [Na+].[Na+].[K+].C[As]([O-])([O-])=O.[O-]C(=O)C(C)OC1=CC=C(Cl)C=C1C HRULVFRXEOZUMJ-UHFFFAOYSA-K 0.000 description 2
- 230000002776 aggregation Effects 0.000 description 1
- 238000004220 aggregation Methods 0.000 description 1
- 238000009960 carding Methods 0.000 description 1
- 238000009826 distribution Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000002360 preparation method Methods 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000012549 training Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/14—Network analysis or design
- H04L41/145—Network analysis or design involving simulating, designing, planning or modelling of a network
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/06—Management of faults, events, alarms or notifications
- H04L41/0654—Management of faults, events, alarms or notifications using network fault recovery
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Computer And Data Communications (AREA)
Abstract
The embodiment of the invention provides a data processing method, a device and equipment, wherein the method comprises the following steps: acquiring basic data information and service call link routing data of an application to be processed, wherein the application to be processed comprises one or more application containers; establishing a simulation model according to the basic data information, wherein the simulation model comprises a plurality of node models corresponding to the application containers; and processing the application to be processed according to the simulation model and the service call link routing data. The simulation model is established through the basic data information, the application is processed by utilizing the simulation model and the service call link routing data, large-scale simulation disaster tolerance drilling is performed on the application under the condition of consuming few resources, the practicability is high, the cost of the simulation drilling is low, the simulation disaster tolerance drilling can be performed at a higher frequency, the stability of the online service is ensured, and the accuracy and the reliability of the application processing by the simulation model are improved.
Description
Technical Field
The present invention relates to the field of internet technologies, and in particular, to a data processing method, apparatus, and device.
Background
At present, the problem of availability verification of a large-scale distributed application cluster in a fault scene is solved, disaster recovery drilling is usually performed according to expected planning, a drilling involvement range, drilling time, a recovery plan and the like are determined in advance, and online drilling in expectation is performed. However, although the above-mentioned disaster recovery drilling is expected and planned, the uncertainty of the online application in the fault scenario will usually have inevitable impact on the service, which is likely to damage the service; in addition, in the drill execution process, developers who focus on application need to be on-site on duty, so that the labor cost is high; in addition, the real online fault drilling cannot be executed at high frequency, so that the evaluation on the online cluster disaster tolerance capability is difficult to realize actual accuracy, and the real-time performance and the accuracy of the availability verification are reduced.
Disclosure of Invention
Embodiments of the present invention provide a data processing method, apparatus, and device, which can avoid affecting services when processing an application, and are low in cost.
In a first aspect, an embodiment of the present invention provides a data processing method, including:
acquiring basic data information and service call link routing data of an application to be processed, wherein the application to be processed comprises one or more application containers;
establishing a simulation model according to the basic data information, wherein the simulation model comprises a plurality of node models corresponding to the application containers;
and processing the application to be processed according to the simulation model and the service call link routing data.
In a second aspect, an embodiment of the present invention provides a data processing apparatus, including:
the system comprises a first acquisition module, a second acquisition module and a third acquisition module, wherein the first acquisition module is used for acquiring basic data information and service call link routing data of an application to be processed, and the application to be processed comprises one or more application containers;
the first processing module is used for establishing a simulation model according to the basic data information, and the simulation model comprises a plurality of node models corresponding to the application containers;
and the processing module is used for processing the application to be processed according to the simulation model and the service call link routing data.
In a third aspect, an embodiment of the present invention provides an electronic device, including: a memory, a processor; wherein the memory is configured to store one or more computer instructions, wherein the one or more computer instructions, when executed by the processor, implement a data processing method of the first aspect.
In a fourth aspect, an embodiment of the present invention provides a computer storage medium for storing a computer program, where the computer program enables a computer to implement the data processing method in the first aspect when executed.
Establishing a simulation model through the acquired basic data information, and then analyzing and processing the service call link routing data by using the simulation model, thereby realizing large-scale simulation disaster tolerance drilling on the application to be processed under the condition of consuming few resources, greatly reducing the manpower, machine resource consumption and service loss of the real disaster tolerance drilling, and effectively reducing the processing cost; moreover, the application is processed by using the simulation model, so that the method has high effectiveness, low cost of simulation drilling and high efficiency, can perform the simulation disaster tolerance drilling at higher frequency, finds online unstable factors caused by application change or other reasons more timely, eliminates risks as early as possible and ensures the stability of online services; in addition, an asynchronous message communication mechanism between the node models in the simulation model enables the simulation model to be closer to a distributed scene of the online application, so that various online service scenes can be restored and simulated more accurately, and the accuracy and reliability of the application processing by the simulation model are improved.
In a fifth aspect, an embodiment of the present invention provides a data processing method, including:
receiving and processing an information acquisition request sent by a computing node;
determining basic data information of the application to be processed corresponding to the information acquisition information;
and sending the basic data information to the processing computing node.
In a sixth aspect, an embodiment of the present invention provides a data processing apparatus, including:
the first receiving module is used for receiving and processing an information acquisition request sent by a computing node;
the first determining module is used for determining basic data information of the application to be processed corresponding to the information acquisition information;
and the first sending module is used for sending the basic data information to the processing computing node.
In a seventh aspect, an embodiment of the present invention provides an electronic device, which includes a first processor and a first memory, where the first memory is used to store one or more computer instructions, and when the one or more computer instructions are executed by the first processor, the data processing method in the fifth aspect is implemented.
In an eighth aspect, an embodiment of the present invention provides a computer storage medium for storing a computer program, where the computer program is used to enable a computer to implement the data processing method in the fifth aspect when executed.
By receiving the information acquisition request sent by the processing computing node, determining the basic data information of the application to be processed corresponding to the information acquisition request, and sending the basic data information to the processing computing node, the processing computing node is effectively ensured to timely and accurately acquire the basic data information of the application to be processed, the stable reliability of simulation model establishment is ensured, and the use accuracy of the processing method is further improved.
In a ninth aspect, an embodiment of the present invention provides a data communication method, including:
a first application node acquires a service call request event message;
and packaging the service calling request event message into a network event message, and sending the network event message to a second application node through the network node.
In a tenth aspect, an embodiment of the present invention provides a data communication apparatus, including:
the second acquisition module is used for acquiring the service call request event message;
and the second processing module is used for packaging the service calling request event message into a network event message and sending the network event message to a second application node through a network node.
In an eleventh aspect, an embodiment of the present invention provides an electronic device, which includes a first processor and a first memory, where the first memory is used to store one or more computer instructions, and where the one or more computer instructions, when executed by the first processor, implement the data communication method in the ninth aspect.
In a twelfth aspect, an embodiment of the present invention provides a computer storage medium for storing a computer program, where the computer program is used to make a computer implement the data communication method in the ninth aspect when executed.
The first application node packages the service call request event message into the network event message by acquiring the service call request event message and sends the network event message to the second application node through the network node, so that the process of simulating a communication link between the first application node and the second application node is realized, the accuracy and reliability of usability processing of the first application node are effectively improved, and the practicability of the method is further ensured.
In a thirteenth aspect, an embodiment of the present invention provides a data communication method, including:
receiving a service invocation request event message sent by a network node;
performing service processing according to the service call request event message to obtain a response message;
and packaging the response message into a network event response message, and sending the network event response message to the first application node through the network node.
In a fourteenth aspect, an embodiment of the present invention provides a data communication apparatus, including:
a second receiving module, configured to receive a service invocation request event message sent by a network node;
the third processing module is used for carrying out service processing according to the service calling request event message to obtain a response message;
and the second sending module is used for packaging the response message into a network event response message and sending the network event response message to the first application node through the network node.
In a fifteenth aspect, an embodiment of the present invention provides an electronic device, which includes a first processor and a first memory, where the first memory is used to store one or more computer instructions, and where the one or more computer instructions, when executed by the first processor, implement the data communication method in the thirteenth aspect.
In a sixteenth aspect, an embodiment of the present invention provides a computer storage medium for storing a computer program, where the computer program is used to enable a computer to implement the data communication method in the thirteenth aspect when executed.
The method comprises the steps of receiving a service calling request event message sent by a network node, carrying out service processing according to the service calling request event message, obtaining a response message, packaging the response message into a network event response message, and sending the network event response message to a first application node through the network node, thereby realizing the process of simulating a communication link between the first application node and a second application node, effectively improving the accurate reliability of processing the usability of the first application node and the second application node, and further ensuring the practicability of the method.
In a seventeenth aspect, an embodiment of the present invention provides a data communication method, including:
receiving a network event message sent by a first application node;
determining the working state of the first application node and a second application node according to the network event message;
if the first application node is in a normal state, unpacking the network event message into a service call request event message;
and sending the service calling request event message to the second application node.
In an eighteenth aspect, an embodiment of the present invention provides a data communication apparatus, including:
a third receiving module, configured to receive a network event message sent by the first application node;
a second determining module, configured to determine a working state of the first application node and a second application node according to the network event message;
the analysis module is used for unpacking the network event message into a service call request event message if the first application node is in a normal state;
and the third sending module is used for sending the service calling request event message to the second application node.
Nineteenth aspect, an embodiment of the present invention provides an electronic device, which includes a first processor and a first memory, where the first memory is used to store one or more computer instructions, and where the one or more computer instructions, when executed by the first processor, implement the data communication method in the seventeenth aspect.
In a twentieth aspect, an embodiment of the present invention provides a computer storage medium for storing a computer program, wherein the computer program is configured to enable a computer to implement the data communication method in the seventeenth aspect when executed.
In a twenty-first aspect, an embodiment of the present invention provides a state changing method, applied to an application node, including:
acquiring a state change message;
and judging whether the state of the application node is changed or not according to the state change message.
In a twenty-second aspect, an embodiment of the present invention provides a state changing apparatus, which is applied to an application node, and the apparatus includes:
the third acquisition module is used for acquiring the state change message;
and the judging module is used for judging whether the state of the application node is changed or not according to the state change message.
In a twenty-third aspect, an embodiment of the present invention provides an electronic device, which includes a first processor and a first memory, where the first memory is used to store one or more computer instructions, and when the one or more computer instructions are executed by the first processor, the state change method in the twenty-first aspect is implemented.
In a twenty-fourth aspect, an embodiment of the present invention provides a computer storage medium for storing a computer program, where the computer program is used to enable a computer to implement the state change method in the twenty-first aspect when executed.
By acquiring the state change message and then judging whether the state of the application node is changed or not according to the state change message, the application node can change the working state of the application node according to the requirement, the dynamic adjustment of the state of the application node is effectively facilitated, the execution result of behavior processing logic can be influenced according to the adjusted node state, and the practicability of the state change method is further improved.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the embodiments or the description of the prior art will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and other drawings can be obtained by those skilled in the art without creative efforts.
Fig. 1 is a first flowchart of a data processing method according to an embodiment of the present invention;
FIG. 2 is a first schematic diagram illustrating a simulation model established according to the basic data information according to an embodiment of the present invention;
FIG. 3 is a second schematic diagram of creating a simulation model according to the basic data information according to the embodiment of the present invention;
fig. 4 is a flowchart of a data processing method according to an embodiment of the present invention;
FIG. 5 is a diagram illustrating a processing computing node in data communication with a data cache server according to an embodiment of the present invention;
FIG. 6 is a schematic diagram illustrating a processing computing node in data communication with a data cache server according to an embodiment of the present invention;
fig. 7 is a first flowchart of a data communication method according to an embodiment of the present invention;
fig. 8 is a signaling diagram of a first application node performing data communication with a second application node through a network node according to an embodiment of the present invention;
fig. 9 is a flowchart of sending a network event message to a second application node through a network node according to an embodiment of the present invention;
fig. 10 is a signaling diagram of a first application node performing data communication with a second application node through a data cache server according to an embodiment of the present invention;
fig. 11 is a second flowchart of a data communication method according to an embodiment of the present invention;
fig. 12 is a flowchart of a data communication method according to an embodiment of the present invention;
fig. 13 is a first flowchart of a state change method according to an embodiment of the present invention;
fig. 14 is a second flowchart of a status changing method according to an embodiment of the present invention;
fig. 15 is a first schematic structural diagram of a data processing apparatus according to an embodiment of the present invention;
fig. 16 is a schematic structural diagram of an electronic device corresponding to the data processing apparatus provided in the embodiment shown in fig. 15;
fig. 17 is a second schematic structural diagram of a data processing apparatus according to an embodiment of the present invention;
fig. 18 is a schematic structural diagram of an electronic device corresponding to the data processing apparatus provided in the embodiment shown in fig. 17;
fig. 19 is a first schematic structural diagram of a data communication device according to an embodiment of the present invention;
fig. 20 is a schematic structural diagram of an electronic device corresponding to the data communication apparatus provided in the embodiment shown in fig. 19;
fig. 21 is a second schematic structural diagram of a data communication device according to an embodiment of the present invention;
fig. 22 is a schematic structural diagram of an electronic device corresponding to the data communication apparatus provided in the embodiment shown in fig. 21;
fig. 23 is a third schematic structural diagram of a data communication device according to an embodiment of the present invention;
fig. 24 is a schematic structural diagram of an electronic device corresponding to the data communication apparatus provided in the embodiment shown in fig. 23;
fig. 25 is a schematic structural diagram of a state changing device according to an embodiment of the present invention;
fig. 26 is a schematic structural diagram of an electronic device corresponding to the state changing device provided in the embodiment shown in fig. 25.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The terminology used in the embodiments of the invention is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. As used in the examples of the present invention and the appended claims, the singular forms "a", "an", and "the" are intended to include the plural forms as well, and "a" and "an" generally include at least two, but do not exclude at least one, unless the context clearly dictates otherwise.
It should be understood that the term "and/or" as used herein is merely one type of association that describes an associated object, meaning that three relationships may exist, e.g., a and/or B may mean: a exists alone, A and B exist simultaneously, and B exists alone. In addition, the character "/" herein generally indicates that the former and latter related objects are in an "or" relationship.
The words "if", as used herein, may be interpreted as "at … …" or "at … …" or "in response to a determination" or "in response to a detection", depending on the context. Similarly, the phrases "if determined" or "if detected (a stated condition or event)" may be interpreted as "when determined" or "in response to a determination" or "when detected (a stated condition or event)" or "in response to a detection (a stated condition or event)", depending on the context.
It should also be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a good or system that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such good or system. Without further limitation, an element defined by the phrase "comprising a … …" does not exclude the presence of additional like elements in a commodity or system comprising the element.
In addition, the sequence of steps in each method embodiment described below is only an example and is not strictly limited.
In order to facilitate understanding of the technical solution of the present application, the following briefly describes the prior art: at present, a large-scale distributed application cluster can include thousands of applications, and for the application cluster, there are two general schemes for solving the availability verification under the failure scenario: (1) In the disaster recovery drilling with the expected planning, a drilling range (related business unit BU and application), drilling time, a recovery plan, and the like are determined in advance, and on-line drilling within an expectation is performed based on the drilling range. (2) And establishing a small-scale cluster, performing online environment simulation, and performing disaster recovery drilling in a simulation environment.
However, with the first solution described above, the following drawbacks are present: (1) The business is easy to be damaged, and although drills are expected and planned, the business is usually affected to some extent inevitably due to the uncertainty of the performance of the online application in a fault scene; (2) The cost is high, the practice of one computer room (IDC for short) can be performed frequently, dozens of BUs can be involved, the preparation, execution and duplication of the practice need to be participated by related personnel of each BU, and particularly, during the execution process of the practice, developers who are mainly applied need to be on-site; (3) Due to the two reasons, the real-time performance is low, and the real online fault drilling cannot be executed at high frequency, so that the evaluation on the online application cluster disaster tolerance capability is difficult to achieve practically and accurately.
For the second solution described above, the following drawbacks apply: (1) The accuracy problem is that the on-line simulation environment which is physically built is difficult to reach the percentage coverage of the on-line application environment, so that the on-line problem under some scenes can not be reproduced in a small-scale simulation environment, and the accuracy of evaluation is influenced; (2) The cost is high, and the hardware cost is additionally increased because the on-line environment is physically simulated, but the simulated environment cannot be used for production.
Fig. 1 is a first flowchart of a data processing method according to an embodiment of the present invention; in order to solve the above problem, as shown in fig. 1, the embodiment provides a data processing method, where an execution subject of the processing method may be a processing apparatus, and it is understood that the processing apparatus may be implemented as software or a combination of software and hardware, and when the processing apparatus is integrated on another device, the device integrated with the processing apparatus may be referred to as a processing computing node or a processing computing device. Specifically, the method may include:
s101: and acquiring basic data information and service call link routing data of the application to be processed, wherein the application to be processed comprises one or more application containers.
The application to be processed may refer to a single application program, or the application to be processed may also include an application cluster of thousands of applications, and a person skilled in the art may select different applications to be processed according to a specific application scenario. In this embodiment, the application to be processed may be an application cluster, which may include one or more application containers; and the basic data information refers to a set of the application information and the network information of the application to be processed, which may include at least one of the following: application service information, application deployment information, network equipment information and machine room IDC information. In addition, the specific implementation manner for acquiring the basic data information is not limited in this embodiment, and those skilled in the art may perform any setting according to specific application requirements and design requirements, for example: basic data information of the application to be processed can be stored in an offline database, and the basic data information of the application to be processed can be obtained by accessing the offline database; or, the basic data information is stored on other terminal equipment, and the terminal equipment can return corresponding basic data information according to the information acquisition request by sending the information acquisition request to other terminal equipment, so that the basic data information can be accurately and effectively received. For example, the basic data information is stored in the data cache server, and in this case, the obtaining of the basic data information of the application to be processed may include:
s1011: and sending an information acquisition request to a data cache server for storing basic data information.
S1012: and receiving basic data information sent by the data cache server according to the information acquisition request.
The data cache server can store a plurality of applications to be processed and basic data information corresponding to each application to be processed, after sending an information acquisition request to the data cache server, the data cache server can acquire an application identifier of the application to be processed through the information acquisition request, then determine the basic data information corresponding to the application to be processed according to the application identifier, and return the determined basic data information, so that the basic data information can be accurately and effectively received.
By storing the basic data information of the application to be processed in the data cache server, the data resources of the processing computing node are effectively saved, the accuracy and the reliability of obtaining the basic data information are ensured, and the stability and the reliability of the processing method are further improved.
In addition, the service invocation link routing data may refer to on-line link routing data of the application to be processed, which is used as an input to the simulation model to implement a processing operation on the availability of the application to be processed. The specific implementation manner for acquiring the service invocation link routing data is not limited in this embodiment, and a person skilled in the art may perform any setting according to specific application requirements and design requirements, for example: the service call link routing data of the application to be processed can be stored in a database, and the service call link routing data of the application to be processed can be obtained by accessing the database; or, the service call link routing data is stored in other terminal equipment, and the terminal equipment can return corresponding service call link routing data according to the data acquisition request by sending the data acquisition request to the other terminal equipment, so that the service call link routing data can be accurately and effectively received. For example, the service invocation link routing data is stored in the data cache server, and at this time, the obtaining of the service invocation link routing data of the application to be processed may include:
s1013: and sending a data acquisition request to a data cache server for storing the service call link routing data.
S1014: and receiving service call link routing data sent by the data cache server according to the data acquisition request.
The data cache server can store a plurality of applications to be processed and service call link routing data corresponding to each application to be processed, after sending an information acquisition request to the data cache server, the data cache server can acquire an application identifier of the application to be processed through the information acquisition request, then determine the service call link routing data corresponding to the application to be processed according to the application identifier, and return the determined service call link routing data, so that the service call link routing data can be accurately and effectively received.
It can be understood that, when the application identifier of the application to be processed, the basic data information of the application to be processed, and the service invocation link routing data of the application to be processed are stored in the data cache server, the corresponding relationship between the basic data information and the application identifier, and the corresponding relationship between the service invocation link routing data and the application identifier may be stored in the same or different storage areas, and when the corresponding relationship between the basic data information and the application identifier, and the corresponding relationship between the service invocation link routing data and the application identifier are stored in the same storage area, the basic data information and the service invocation link routing data corresponding to the application identifier may be determined at the same time by the application identifier of one application to be processed.
By storing the service call link routing data of the application to be processed in the data cache server, the data resources of the processing computing node are effectively saved, the accurate reliability of the service call link routing data acquisition is ensured, and the stable reliability of the processing method is further improved.
Of course, those skilled in the art may also use other manners to obtain the basic data information and the service invocation link routing data, as long as the accuracy and reliability of obtaining the basic data information and the service invocation link routing data can be ensured, which is not described herein again.
S102: and establishing a simulation model according to the basic data information, wherein the simulation model comprises a plurality of node models corresponding to the application containers.
After the basic data information is obtained, a simulation model can be established by utilizing the basic data information, the established simulation model comprises a plurality of node models corresponding to the application container, and the plurality of node models in the simulation model are communicated in an asynchronous communication mode, so that different node models can execute different behavior logics aiming at different messages, and the behavior expression of an extremely complex large-scale distribution application cluster can be simulated by combining a large number of node models.
Specifically, referring to fig. 2, the creating of the simulation model according to the basic data information may include:
s1021: and acquiring an abstract model framework.
The abstract model framework can be predefined or preset, and can include three components of model attributes, model states and model behaviors, it can be understood that different model attributes and model states can determine different model behaviors, different model attributes, model states and model behaviors can determine different simulation models, and the determined different simulation models can have different processing logics; therefore, the simulation model has good expandability, different node models can be realized according to different application scenes during specific application, and the capability of the large-scale distributed application cluster simulation model is more fully utilized to complete behavior simulation of the distributed application cluster in different application scenes.
S1022: and determining model attributes, model states and model behaviors corresponding to the abstract model framework according to the basic data information.
S1023: and establishing a simulation model according to the model attributes, the model state, the model behaviors and the abstract model framework.
After the basic data information is acquired, analysis processing can be performed on the basic data information, so that model attributes, model states and model behaviors corresponding to an abstract model framework are determined, and then a simulation model is established based on the abstract model framework and the determined model attributes, model states and model behaviors, wherein the established simulation model is preferably a distributed simulation model, and specifically, a node model (model) and a node model (model) in the simulation model are interconnected through an asynchronous message communication mechanism, so that an integral distributed simulation model is formed. Therefore, when the application to be processed is a large-scale distributed application cluster, the behavior characteristics of the large-scale distributed application cluster can be better embodied through the distributed simulation model; in addition, each node model (model) in the simulation model can execute different behavior logics according to the attribute of the model and the current state, and the behavior logics of the application nodes and the network equipment in the distributed application under different states are simulated with higher simulation degree, so that the high simulation of the model behaviors is effectively realized.
It should be noted that the created simulation model may include at least one of the following: the network node model is used for realizing data communication between the two application node models. Specifically, the network node model corresponds to a network node attribute, a network node state, and a network node behavior, and as shown in fig. 2 to 3, the network node state includes: normal status, error status, interrupt status, etc., network node attributes may include device ID, network node behavior may include intercept behavior and non-intercept behavior, etc. In addition, the application node model corresponds to application node attributes, application node states, and application node behaviors, and as shown in fig. 2 to 3, the application node attributes may include: machine attributes and application attributes, the machine attributes may include: IP address, data center interconnect switch DSW to which the application belongs, aggregation device PSW, etc., and the application attribute may include an application name, an application packet, etc.; the application node states may include a normal state, an error state, an overload state, and the like, and the application node behaviors may include a simulated service processing behavior and a routing service processing behavior, where the simulated service processing behavior refers to a behavior that the application node can perform service processing by itself, and the routing service processing behavior refers to a behavior that the application node performs data interaction with a downstream application node during a process of processing a service.
It is to be understood that the network node attribute, the network node status, and the network node behavior and the application node attribute, the application node status, and the application node behavior in this embodiment may not only include the above examples, but also include other similar contents, and are not described herein again.
S103: and processing the application to be processed according to the simulation model and the service call link routing data.
After the simulation model is obtained, the simulation model can be used for analyzing and processing the service call link routing data, so that the operation of processing the application to be processed is realized.
According to the data processing method provided by the embodiment, the simulation model is established through the acquired basic data information, and then the simulation model is used for analyzing and processing the service call link routing data, so that large-scale simulation disaster tolerance drilling is performed on the application to be processed under the condition of consuming few resources, the consumption of manpower and machine resources and the service loss of real disaster tolerance drilling are greatly reduced, and the processing cost is effectively reduced; moreover, the application is processed by using the simulation model, so that the method has high effectiveness, low cost of simulation drilling and high efficiency, can perform the simulation disaster tolerance drilling at higher frequency, finds online unstable factors caused by application change or other reasons more timely, eliminates risks as early as possible and ensures the stability of online services; in addition, an asynchronous message communication mechanism between the node models in the simulation model enables the simulation model to be closer to a distributed scene of on-line application, so that various on-line service scenes can be more accurately restored and simulated, and the accuracy and reliability of the simulation model for processing the application are improved.
On the basis of the foregoing embodiment, with reference to fig. 1, in this embodiment, a specific implementation manner of processing the application to be processed according to the simulation model and the service invocation link routing data is not limited, and a person skilled in the art may set the processing according to a specific design requirement, and preferably, the processing of the application to be processed according to the simulation model and the service invocation link routing data in this embodiment may include:
s1031: and establishing a simulation fault scene based on the simulation model.
When the to-be-processed application is processed by using the simulation model, a simulation fault scene in which the to-be-processed application is located needs to be established first, the simulation fault scene can be set and established according to the requirements of a user, and specifically, establishing the simulation fault scene based on the simulation model may include:
s10311: and acquiring simulation configuration information.
Wherein the simulation configuration information comprises at least one of: simulation exercise range, fault environment setting information and white list configuration information. However, the specific implementation manner for acquiring the simulation configuration information is not limited in this embodiment, and those skilled in the art may perform arbitrary setting according to specific application requirements and design requirements, for example: the simulation configuration information may be user input directly to the processing compute node; or the simulation configuration information can be stored in an offline database, and the simulation configuration information can be obtained by accessing the offline database; or the simulation configuration information is stored on other terminal equipment, and the terminal equipment can return corresponding simulation configuration information according to the information acquisition request by sending the information acquisition request to the other terminal equipment, so that the simulation configuration information can be accurately and effectively received.
S10312: and setting state information in the simulation model according to the simulation configuration information, and establishing a simulation fault scene.
After the simulation configuration information is acquired, the state information in the simulation model can be set based on the simulation configuration information, so that the establishment of a simulation fault scene is realized.
S1032: and under the simulation fault scene, processing the application to be processed according to the simulation model and the service call link routing data.
After the simulation fault scenario is established by using the simulation model, the application to be processed may be processed by using the simulation model and the service invocation link routing data, and specifically, the processing of the application to be processed according to the simulation model and the service invocation link routing data may include:
s10321: inputting the service call link routing data into a simulation model, and acquiring a simulation result corresponding to the service call link routing data;
s10322: acquiring service call link standard data corresponding to the application to be processed;
the service call link standard data are standard data which are compared aiming at simulation results obtained based on service call link routing data so as to realize processing on the availability of the application to be processed; the specific implementation manner of obtaining the standard data of the service invocation link is similar to the specific implementation manner of obtaining the routing data of the service invocation link, and the content stated in the step S101 may be specifically mentioned, and is not described herein again.
S10323: and processing the application to be processed according to the simulation result and the standard data of the service call link.
Specifically, the processing the application to be processed according to the simulation result and the standard data of the service call link may include:
s103231: obtaining the matching degree of the simulation result and the standard data of the service call link;
s103232: if the matching degree is greater than or equal to a preset threshold value, determining that the usability of the application to be processed is good; or,
s103233: and if the matching degree is smaller than the preset threshold value, determining that the usability of the application to be processed is poor.
After the simulation result and the service invocation link standard data are obtained, the matching degree of the simulation result and the service invocation link standard data can be obtained, the matching degree is used for reflecting the completion degree of the link communication data of the application to be processed, and it can be understood that the higher the matching degree is, the higher the completion degree of the link communication data of the application to be processed is. For example, the matching degree of the simulation result and the service call link standard data includes the following data: the matching degree P1 is 98%, the matching degree P2 is 60% and the matching degree P3 is 90%, wherein P1> P3> P2, at this time, the obtained matching degree can be compared with a preset threshold P, wherein the preset threshold P is 85%, it can be known through comparison that both the matching degree P1 and the matching degree P3 can be greater than the preset threshold P, the matching degree P2 is less than the preset threshold P, and then it can be determined at this time: the usability of the to-be-processed application corresponding to the matching degree P1 and the usability of the to-be-processed application corresponding to the matching degree P3 are good, and the completion degree of the link communication data of the to-be-processed application corresponding to the matching degree P1 is greater than that of the link communication data of the to-be-processed application corresponding to the matching degree P3; and the usability to be applied corresponding to the matching degree P2 is poor.
Optionally, in order to improve the convenience of using the method, after processing the application to be processed according to the simulation model and the service call link routing data, the method in this embodiment may further include:
s201: and generating a processing report according to the processing result.
After the application to be processed is processed, the processing result corresponding to the application to be processed can be obtained, and a processing report can be generated according to the processing result so as to facilitate the user to check and call, thereby effectively improving the convenience degree of the method.
Fig. 4 is a flowchart of a data processing method according to an embodiment of the present invention; referring to fig. 4, this embodiment provides another data processing method, where an execution subject of the processing method may be a processing apparatus, it may be understood that the processing apparatus may be implemented as software, or a combination of software and hardware, and when the processing apparatus is integrated on another device, the device integrated with the processing apparatus may be referred to as a data cache server, and the data cache server may be communicatively connected to the processing computing node or the processing computing device described above to implement a processing operation on an application to be processed. Specifically, the method may include:
s301: and receiving and processing an information acquisition request sent by the computing node.
The information obtaining request is used for obtaining basic data information of the application to be processed, and the basic data information can be stored in the data cache server, so that the processing computing node can send the information obtaining request to the data cache server in order to accurately obtain the basic data information, and the data cache server can receive the information obtaining request.
S302: and determining basic data information of the application to be processed corresponding to the information acquisition information.
After the information acquisition request is received, the application identifier of the application to be processed included in the information acquisition request can be identified, and the mapping relationship between the application identifier of the application to be processed and the basic data information can be stored in the data cache server.
S303: and sending the basic data information to the processing computing node.
After the basic data information is acquired, the basic data information can be sent to the processing and computing node in time, so that the processing and computing node can receive the basic data information accurately in time.
According to the data processing method provided by the embodiment, the basic data information of the to-be-processed application corresponding to the information acquisition information is determined by receiving the information acquisition request sent by the processing and computing node, and the basic data information is sent to the processing and computing node, so that the processing and computing node can effectively and accurately acquire the basic data information of the to-be-processed application in time, the stability and reliability of the establishment of the simulation model are ensured, and the use accuracy of the processing method is further improved.
Optionally, before receiving and processing the information acquisition request sent by the computing node, the method in this embodiment may further include:
s401: and acquiring basic data information of the application to be processed through a preset database.
S402: and storing the basic data information of the application to be processed.
It is to be understood that the basic data information may not be always stored in the data caching server, and specifically, the basic data information may be obtained by the data caching server from a preset database, where the preset database may be an offline database for storing the basic data information of the application to be processed. The basic data information is obtained through the preset database and stored in the data cache server, so that not only is the consumption of data resources avoided, but also the basic data information is convenient for a user to call and check, and the practicability of the processing method is further improved.
Optionally, the data cache server may further store service invocation link routing data, at this time, the processing computing node may obtain the service invocation link routing data through the data cache server, and specifically, the method in this embodiment may further include:
s501: and receiving and processing a data acquisition request sent by the computing node.
Specifically, the processing and computing node may send a data acquisition request to the data cache server in order to accurately acquire the service invocation link routing data, so that the data cache server may receive the data acquisition request.
S502: and determining service call link routing data of the application to be processed corresponding to the data acquisition request.
After the data obtaining request is received, the application identifier of the application to be processed included in the data obtaining request can be identified, and the mapping relationship between the application identifier of the application to be processed and the service invocation link routing data can be stored in the data cache server.
S503: and sending the service call link routing data to the processing computing node.
After the service invoking link routing data is obtained, the service invoking link routing data can be sent to the processing computing node in time, so that the processing computing node can receive the service invoking link routing data in time and accurately, the timely reliability of processing operation of the application to be processed is ensured, and the use accuracy of the processing method is improved.
Optionally, before receiving and processing the data acquisition request sent by the computing node, the method in this embodiment may further include:
s601: and acquiring the original data of the service call link of the application to be processed through the tracking log.
S602: and converging the original data of the service call link to obtain service call link routing data corresponding to the original data of the service call link.
S603: and storing the service call link routing data of the application to be processed.
It can be understood that the service invocation link routing data may not be always stored in the data cache server, specifically, the data cache server may obtain the service invocation link original data through the Trace log, and after obtaining the service invocation link original data, in order to enable the data cache server to stably and reliably store the service invocation link routing data, the service invocation link original data may be aggregated, so that the service invocation link routing data may be obtained, and then, the data cache server may store the obtained service invocation link routing data, so that not only is the consumption of data resources avoided, but also the user may conveniently invoke and check the service invocation link routing data, and the practicability of the processing method is further improved.
Optionally, the data cache server may further store standard data of a service invocation link, where the standard data of the service invocation link is standard data for comparing simulation results obtained based on the routing data of the service invocation link, so as to implement processing of the availability of the application to be processed. At this time, the processing computing node may obtain the service invocation link standard data through the data cache server, specifically, the method in this embodiment may further include:
s701: and receiving and processing a data acquisition request sent by the computing node.
S702: and determining the standard data of the service call link of the application to be processed corresponding to the data acquisition request.
S703: and sending the service call link standard data to the processing computing node.
The specific implementation process and implementation effect of the steps in this embodiment are similar to those of steps S501 to S503 in the embodiment, and the above statements may be specifically referred to, and are not repeated herein.
Optionally, before receiving and processing the data acquisition request sent by the computing node, the method in this embodiment may further include:
s700: and acquiring and storing service call link standard data corresponding to the application to be processed.
It can be understood that the standard data of the service invocation link may not be stored in the data cache server all the time, but may be obtained by the data cache server from a preset database, and the obtaining is performed by the user through directly inputting or setting through the data cache server. The standard data of the service call link are stored in the data cache server, so that not only are data resources saved, but also the user can conveniently call the standard data of the service call link, and the practicability of the processing method is further improved.
In specific application, in order to facilitate understanding of the above technical solutions, an application cluster is taken as an example for description, and as shown in fig. 5 to 6, an execution main body of the processing method includes a processing computing node and a data cache server, where the data cache server is used to extract and aggregate various types of data required by a simulation model engine. The processing and computing node includes a simulation model engine and a data analysis unit, the simulation model engine is a specific implementation of a large-scale distributed application cluster simulation model, for example, the simulation model engine may be used to establish a disaster recovery fault simulation model, and in the simulation disaster recovery training model, the simulation model engine may be implemented by using an Actor mode, where the Actor mode is a concurrency model and is different from a traditional shared memory concurrency model, and the Actor model share node is implemented by cooperating all threads (or processes) in a message transmission manner, and these threads (or processes) are called Actor.
Specifically, the method comprises the following steps:
step 1: the data cache server obtains basic data information of the application cluster through an offline database, wherein the basic data information may include application information, network information and the like.
And 2, step: the data cache server acquires original data of the service call link through trace logs, and performs convergence processing on the original data of the service call link to acquire routing information of the service call link, wherein the routing information of the service call link is online data;
it can be understood that the simulation model stores simpler data information, such as: a data identification or an identity identification. And the information other than the data identifier or the identity identifier may be referred to as extended attribute information, and depending on the type of the simulation model, the extended attribute information may include application node extended attribute information corresponding to the application node model and network node extended attribute information corresponding to the network node model. In this case, in consideration of the consumption of data resources, the data cache server may also store other types of data required by the simulation model engine, for example: the simulation model engine can also read the application node extension attribute information and the network node extension attribute information from the data cache server based on the use requirement.
And step 3: the simulation model engine reads the basic data information and the service call link routing information through the data cache server, and can build a distributed simulation model based on the basic data information.
And 4, step 4: the simulation model engine can acquire the simulation drilling configuration information and establish a fault simulation scene through the simulation drilling configuration information and the simulation model.
And 5: based on the established fault simulation scene, the service call link routing information is input into the simulation model for verification processing, so that model processing information can be obtained.
Step 6: the simulation model engine may synchronize model processing information to the data analysis unit in real time.
And 7: the data analysis unit can acquire the original service calling link comparison data from the data cache server and analyze and compare the original service calling link comparison data with the model carding information, so that the availability of the application cluster is verified.
And 8: and a simulation drill report can be generated according to the verification processing result so as to facilitate the user to check and call.
In addition, the processing computing node in this embodiment may further communicate with other processing computing nodes through the data analysis unit, and as shown in fig. 6 specifically, taking the application node 1 as the processing computing node as an example, a communication process between the application node 1 and the data analysis unit includes the following steps:
(1) The application node 1 acquires the service calling request event message, processes the service calling request event message and acquires a service calling request event processing result;
(2) Sending the service calling request event processing result to a data analysis unit;
(3) After receiving the result of the service calling request event, the data analysis unit can record the service request event and return the processing result of the corresponding service request event;
(4) The application node 1 may receive the processing result returned by the data analysis unit;
(5) Based on the processing result, a service call can be initiated to a downstream application node (application node 2) through the network node;
(6) After receiving the service invocation request event message, the application node 2 may process the service invocation request event message to generate a response message;
(7) The application node 2 may send a response message to the data analysis unit;
(8) The data analysis unit may record a service request event based on the received response message, and process the service request event to generate a processing result;
(9) The data analysis unit sends the generated processing result to the application node 2;
(10) After receiving the processing result, the application node 2 sends service calling response information to a calling application node (application node 1) through a network node;
(11) After receiving the service invocation response message, the application node 1 may process the service invocation response message and generate a processing result;
(12) The application node 1 sends the processing result of the generated service call request response event to the data analysis unit;
(13) After receiving the processing result, the data analysis unit records a service request response event and processes the service request response event to generate a processing result;
(14) The data analysis unit sends the generated processing result to the application node 1, so that the communication process of the application node 1 and the application node 2 for data processing through the data analysis unit is realized.
Compared with the prior art, the processing method provided by the application embodiment has the following advantages:
(1) The cost is low; the existing abundant service is utilized to call link data resources and basic data information resources, a high-efficiency distributed application simulation model is constructed, large-scale simulation disaster tolerance drilling can be performed under the condition of consuming few resources, and the manpower, machine resource consumption and service loss of real disaster tolerance drilling are greatly reduced; in addition, the method can move under the condition of a single machine, specifically, the number of simulation models which can be operated by the single machine is in the million level, the network-cut simulation disaster tolerance exercises at IDC level can be realized, and the logic of the model engine part can be operated on the single machine, so that the resources are effectively saved.
(2) The effectiveness is high; the simulation model is used for simulation drilling, the cost is low, the efficiency is high, the simulation disaster tolerance drilling can be performed at a higher frequency, online unstable factors caused by application change or other reasons can be found in time, risks can be eliminated as early as possible, and the stability of online services is ensured.
(3) The simulation degree is high; the model behavior of the simulation model can be changed based on different model attributes and model states, so that dynamic replacement of model behavior logic is realized, and subsequent continuous iteration is facilitated to develop a more accurate logic module for simulating the online application behavior; meanwhile, an asynchronous message communication mechanism is adopted between the node models in the simulation model, the distributed scene applied on line is closer, and various on-line service scenes can be restored and simulated more accurately.
(4) The expandability is good; not only behavior logic, model attribute and state interface can be conveniently expanded and realized, but also simulation and simulation of more distributed application service scenes except disaster-tolerant drilling are covered by utilizing the capability of a simulation model engine, more service problems can be solved with low cost and high efficiency, and the practicability of the method is further improved.
Fig. 7 is a first flowchart of a data communication method according to an embodiment of the present invention; fig. 8 is a signaling diagram of a first application node performing data communication with a second application node through a network node according to an embodiment of the present invention; referring to fig. 7 to 8, the present embodiment provides a data communication method, the execution subject of the data communication method may be a data communication apparatus, it is understood that the data communication apparatus may be implemented as software, or a combination of software and hardware, and when the data communication apparatus is integrated on other devices, the device integrated with the processing apparatus may be referred to as a first application node or a first application device. For convenience of description, a first application node is taken as an example of an execution subject, and the first application node may perform data communication with a second application node through a network node at this time, and in particular, when the application is applied, the first application node may specifically be an application node simulation model established according to first basic data information, and the network node may be a network node simulation model established according to second basic data information, and may include a first data center interconnection switch DSW1 (a first network communication node), a machine room IDC (a central network node), and a second data center interconnection switch DSW2 (a second network communication node).
Specifically, the method may include:
s801: the first application node obtains a service invocation request event message.
S802: and packaging the service call request event message into a network event message, and sending the network event message to the second application node through the network node.
The service invocation request event message is used for realizing data communication between the first application node and the second application node, the service invocation request event message between the first application node and the second application node needs to be forwarded through the network node, and in order to enable the network node to receive the service invocation request event message, the first application node needs to encapsulate the service invocation request event message into the network event message suitable for the network node, so that the network node can accurately receive the network event message corresponding to the service invocation request event message and forward the network event message to the second application node.
Specifically, in the process of forwarding the network event message to the second application node by the network node, the network node may perform different routing selections according to the information of the machine room and the switch where the first application node and the second application node are located, and may also perform different behavior logics according to the states of the first application node and the second application node; for example: the second application node is set to a network disconnection state, that is, a network disconnection flag (DSCP identifier) is marked on a network packet, so that the network node intercepts and discards the call information sent to the second application node, thereby implementing the simulation of the communication link between the first application node and the second application node.
The data communication method provided by the embodiment acquires the service invocation request event message, encapsulates the service invocation request event message into the network event message, and sends the network event message to the second application node through the network node, thereby realizing the process of simulating the communication link between the first application node and the second application node, effectively improving the accuracy and reliability of the verification processing of the usability of the first application node, and further ensuring the practicability of the method.
On the basis of the above embodiment, with continuing reference to fig. 7-8, the method in this embodiment may further include:
s901: receiving, by the network node, a network event response message sent by the second application node.
S902: and unpacking the network event response message into a corresponding response message.
If the communication link between the first application node and the second application node is in a normal state, the second application node may receive, through the network node, a service invocation request event message sent by the first application node, and after the second application node receives the service invocation request event message, the second application node may perform service processing on the service invocation request event message, so that a response message may be generated, at this time, the second application node may package the response message into a network event response message in order that the response message may be returned to the first application node, and send the network event response message to the first application node through the network node; at this time, the first application node may receive, through the network node, the network event response message sent by the second application node, and after receiving the network event response message, in order to correctly read the response message, the first application node may perform unpacking processing on the network event response message, so that the response message corresponding to the network event response message may be acquired.
Fig. 9 is a flowchart of sending a network event message to a second application node through a network node according to an embodiment of the present invention; based on the foregoing embodiment, with reference to fig. 9 continuously, a specific implementation manner of sending the network event message to the second application node through the network node is not limited in this embodiment, and a person skilled in the art may set the implementation manner according to specific design requirements, and preferably, sending the network event message to the second application node through the network node in this embodiment may include:
s1001: and when the working state of the first application node is a normal state, acquiring the service type information in the service call request event message.
According to the requirement of performing simulation processing on the first application node, the working state of the first application node may include: the method includes acquiring service type information through a service invocation request event message when a working state of a first application node is a normal state, wherein the service invocation request event message may include service parameter information, first application node related information, second application node related information and the like, the service type information may be acquired by acquiring the service parameter information in the service invocation request event message, and it can be understood that different service type information may correspond to different behavior processing logics.
It can be understood that, when the working state of the first application node is a fault state or an overload state, the first application node may be considered to be in an abnormal working state, and at this time, the data communication process between the first application node and the second application node is stopped.
S1002: and calling a simulation service processing method according to the service type information.
After the service type information is obtained, a preset mapping relationship between the service type information and the service processing method may be used to determine a simulation service processing method corresponding to the service type information, so that the first application node may perform simulation service processing on the service invocation request event message by using the simulation service processing method.
S1003, carrying out: and processing the service call request event message by using a simulation service processing method to obtain a downstream service call request event message.
S1004: and sending the downstream service call request event message to the second application node through the network node.
After the downstream service invocation request event message is obtained, the downstream service invocation request event message can be sent to the second application node through the network node. Specifically, sending the downstream service invocation request event message to the second application node through the network node may include:
s10041: and calling a routing service processing method according to the service type information.
After the service type information is obtained, a routing service processing method corresponding to the service type information may be determined by using a preset mapping relationship between the service type information and the service processing method, so that the first application node may perform service processing on the downstream service invocation request event message by using the routing service processing method.
S10042: and processing the downstream service call request event message by using a routing service processing method to obtain a target message of the downstream service call request event.
S10043: and sending the downstream service call request event target message to the second application node through the network node.
When the downstream service invocation request event target message is obtained, the processing process of the downstream service invocation request event message by using the routing service processing method is successful, and then the downstream service invocation request event target message can be sent to the second application node through the network node.
It can be understood that, when the routing service processing method is used for processing the downstream service invocation request event message, a routing processing result can be obtained, whether the routing service processing is successful or not can be judged based on the routing processing result, and when the routing service processing is failed, the data communication process between the first application node and the second application node is stopped. For example, when the routing service processing method is used for processing the downstream service call request event message, if the preset target application node is found to be illegal through the routing processing result, the target application node corresponds to the application a, and the returned data address is the application B; or, the corresponding target application node cannot be found, and the target application node returns a null value, so that it can be determined that the process of processing the downstream service invocation request event message by the current routing service processing method fails according to the routing processing result, and the data communication process between the first application node and the second application node can be stopped.
When the first application node receives the service calling request event message, the preset simulation service processing logic can be called according to the service type in the service calling request event message, after the service processing is carried out by utilizing the simulation service processing logic, the preset routing simulation processing logic is called, then the processed data is packaged into the network event message and sent to the second application node through the network node, the simulation of the link communication between the first application node and the second application node is effectively realized, and the accuracy and the reliability of the processing of the first application node are improved.
Fig. 10 is a signaling diagram of a first application node performing data communication with a second application node through a data cache server according to an embodiment of the present invention; on the basis of the foregoing embodiment, with continued reference to fig. 10, after obtaining the service type information in the service invocation request event message, the method in this embodiment may further include:
s1101: and sending interactive object request information to the data cache server according to the service type information.
S1102: and receiving the interactive object information sent by the data cache server according to the interactive object request information.
Optionally, after the interactive object information is acquired, the method in this embodiment may further include:
s1103: and determining a second application node for performing data interaction with the first application node according to the interaction object information.
Specifically, when verifying the availability of the first application node, it is necessary to determine interactive object information for performing data interaction with the first application node, where the interactive object information is used to determine a second application node for performing data interaction with the first application node. It should be noted that, in consideration of consumption of data resources, the interactive object information performing data interaction with the first application node is stored in the data cache server, at this time, in order to obtain the interactive object information, after obtaining the service type information in the service invocation request event message, the interactive object request information may be sent to the data cache server according to the service type information, at this time, the interactive object request information includes a node identifier of the first application node, after the data cache server receives the interactive object request information, the interactive object information corresponding to the interactive object request information may be determined by using a mapping relationship between the node identifier of the first application node and the interactive object information stored in advance, and after obtaining the interactive object information, the second application node performing data interaction with the first application node may be determined.
Optionally, after receiving the interactive object information sent by the data caching server according to the interactive object request information, the method in this embodiment may further include:
s1201: and sending a route acquisition request to the data cache server according to the interactive object information.
S1202: and receiving the routing information sent by the data cache server according to the routing acquisition request, wherein the routing information corresponds to the second application node.
In order to implement data interaction between the first application node and the second application node, routing information of the second application node needs to be determined, and it should be noted that the routing information of the second application node is stored in the data cache server, at this time, the first application node may send a route acquisition request to the data cache server according to the interaction object information, after the data cache server receives the route acquisition request, the corresponding routing information may be determined based on the interaction object information included in the route acquisition request, and then the determined routing information is returned to the first application node, so that the second application node may receive the routing information sent by the data cache server, and after the routing information is acquired, the first application node may perform data communication with the second application node based on the routing information, thereby effectively ensuring stable reliability of the data communication method.
Fig. 11 is a second flowchart of a data communication method according to an embodiment of the present invention; referring to fig. 8 and 11, the present embodiment provides another data communication method, where an execution subject of the data communication method may be a data communication apparatus, it may be understood that the data communication apparatus may be implemented as software or a combination of software and hardware, and when the data communication apparatus is integrated on another device, the device integrated with the processing apparatus may be referred to as a second application node or a second application device. For convenience of description, a second application node is taken as an example of an execution subject, and the second application node may perform data communication with the first application node through a network node at this time, and in particular, when the application is applied, the second application node may specifically be an application node simulation model established according to the first basic data information, and the network node may be a network node simulation model established according to the second basic data information, and may include a first data center interconnection switch DSW1 (a first network communication node), a machine room IDC (a central network node), and a second data center interconnection switch DSW2 (a second network communication node).
Specifically, the method may include:
s1301: a service invocation request event message sent by a network node is received.
S1302: and carrying out service processing according to the service call request event message to obtain a response message.
S1303: and packaging the response message into a network event response message, and sending the network event response message to the first application node through the network node.
The service invocation request event message is sent by the first application node through the network node, and at this time, the second application node may receive the service invocation request event message sent by the network node. After receiving the service invocation request event message, the second application node may perform service processing according to the service invocation request event message, and may obtain the response message after the processing, and then in order to enable the first application node to know the service processing result of the second application node, the second application node needs to send the response message to the first application node, and in order to enable the network node to receive the response message sent by the second application node, the second application node needs to encapsulate the response message into a network event response message suitable for the network node, so that the network node may accurately receive the network event response message corresponding to the response message, and forward the network event response message to the first application node.
Specifically, in the process of forwarding the network event response message to the first application node by the network node, the network node may perform different routing selections according to the information of the machine room and the switch where the first application node and the second application node are located, and may also perform different behavior logics according to the states of the first application node and the second application node; for example: the first application node is set with a network disconnection state, that is, a network data packet is marked with a network disconnection mark (DSCP identifier), so that the network node intercepts and discards the calling information sent to the first application node, thereby realizing the simulation of a communication link between the first application node and the second application node.
The data communication method provided by this embodiment receives a service invocation request event message sent by a network node, performs service processing according to the service invocation request event message, obtains a response message, encapsulates the response message into a network event response message, and sends the network event response message to a first application node through the network node, thereby implementing a process of simulating a communication link between the first application node and a second application node, effectively improving the accuracy and reliability of verification processing on the usability of the first application node and the second application node, and further ensuring the practicability of the method.
Fig. 12 is a flowchart of a data communication method according to an embodiment of the present invention; referring to fig. 8 and 12, the embodiment provides a data communication method, the execution subject of the data communication method may be a data communication device, it is understood that the data communication device may be implemented as software, or a combination of software and hardware, and when the data communication device is integrated on other devices, the device integrated with the processing device may be referred to as a network node or a network device. The network node may implement data communication between the first application node and the second application node, and in particular, in application, the network node may be a network node simulation model established according to the second basic data information, and may include a first data center interconnection switch DSW1 (first network communication node), a machine room IDC (central network node), and a second data center interconnection switch DSW2 (second network communication node).
Specifically, the method may include:
s1401: and receiving the network event message sent by the first application node.
S1402: and determining the working state of the first application node and the second application node according to the network event message.
S1403: and if the first application node is in a normal state, unpacking the network event message into a service call request event message.
S1404: and sending the service calling request event message to the second application node.
After the first application node sends the network event message, the network node may receive the network event message, and the network node may determine a working state of the first application node (source node) and the second application node according to the network event message, and when the first application node is in a normal state, the network node may unpack the network event message to process the network event message into a service invocation request event message and send the service invocation request event message to the second application node, so that the second application node may receive the service invocation request event message sent by the first application node through the network node.
Specifically, referring to fig. 8, the network node may include a DSW1, an IDC, and a DSW2, after the first application node transmits the network event message, after the DSW1 receives the network event message, the DSW1 may determine the working state of the first application node and the second application node according to the network event message, after the working state of the first application node is a normal state, the DSW1 may transmit the network event message to the IDC, after the IDC receives the network event message, the states of the first application node and the second application node may be determined again to determine whether the first application node and the second application node are in a cross-machine room state, if the first application node and the second application node are not in the cross-machine room state, the IDC may forward the network event message to the DSW2, and after receiving the network event message, the DSW2 may unpack the network event message into the service invocation request event message and transmit the service invocation request event message to the second application node, so that the second application node may accurately receive the service invocation request event message transmitted by the first application node.
Optionally, the method in this embodiment may further include:
s1501: and if the first application node is in an abnormal state, judging whether the first application node and the second application node are in a cross-machine-room state or not.
S1502: and if the first application node and the second application node are not in a cross-machine state, unpacking the network event message into a service call request event message. Or,
s1503: and if the first application node and the second application node are in a cross-machine-room state, intercepting the network event message.
When the working state of the first application node is judged, if the working state of the first application node is an abnormal state, whether the first application node and the second application node are in a cross-machine room state or not can be judged, namely when the first application node and the second application node are in the cross-machine room state, the first application node and the second application node are in different machine rooms, and at the moment, communication of the network event message can be stopped. When the first application node and the second application node are not in a cross-machine-room state, the first application node and the second application node are in the same machine room, at this time, the network event message can be unpacked and processed into a service call request event message, and the service call request time message is sent to the second application node, so that data communication between the first application node and the second application node is realized.
Optionally, the method in this embodiment may further include:
s1601: receiving a network event response message sent by the second application node;
s1602: determining the working state of the first application node according to the network event response message;
s1603: and if the first application node is in a normal state, sending the network event response message to the first application node.
It is understood that, the method in this embodiment may further include:
s1604: and if the first application node is in an abnormal state, intercepting the network event response message.
Specifically, referring to fig. 8, after receiving a service invocation request event message sent by the DSW2, the second application node may perform simulated service processing based on the service invocation request event message, and generate a response message, then the second application node encapsulates the response message into a network event response message according to a target address, and sends the network event response message to the DSW2, and after receiving the network event response message, the DSW2 determines a state of the first application node based on the network event response message; intercepting the network event response message when the first application node is in an abnormal state; when the first application node is in a normal state, the DSW2 can send a network event response message to the IDC, after the IDC receives the network event response message, the states of the first application node and the second application node can be judged again to determine whether the first application node and the second application node are in a machine room crossing state or not, and if the first application node and the second application node are in the machine room crossing state, the network event response message can be intercepted; if the first application node and the second application node are not in the cross-machine-room state, the IDC may forward the network event response message to the DSW1, and after receiving the network event response message, the DSW1 may unpack the network event response message into a corresponding response message and send the response message to the first application node, so that the first application node may accurately receive the response message sent by the second application node.
Fig. 13 is a first flowchart of a state change method according to an embodiment of the present invention; fig. 14 is a second flowchart of a status changing method according to an embodiment of the present invention; referring to fig. 13-14, the present embodiment provides a state change method, which is applicable to an application node and a network node, and it can be understood that the application node may include an application node simulation model built according to basic data information, and the network node may include a network node simulation model built according to basic data information. Specifically, the method may include:
s1701: a state change message is obtained.
S1702: and judging whether the state of the application node is changed or not according to the state change message.
The state change message is a broadcast message, all application nodes can receive the state change message, but not all application nodes need to perform state change operation according to the state change message, the state change message at this time includes a node range which needs to perform state change, and the application nodes which need to perform state change operation can be determined according to the node range. Therefore, after the state change message is acquired, the node range which needs to be subjected to state change can be determined based on the state change message, and whether the state of the current application node needs to be changed or not is judged according to the node range; specifically, the determining whether to change the state of the application node according to the state change message may include:
s17021: and determining a change node range corresponding to the state change message.
S17022: and if the application node is positioned in the range of the change node, changing the state of the application node according to the state change message.
S17023: and if the application node is not in the range of the change node, keeping the state of the application node unchanged.
For example, the range of the change node corresponding to the status change message includes: the application node 11, the application node 13, the application node 21 and the application node 22, so that after the application node 11 receives the state change message, the application node 11 is within the range of the change node, so that the current node state can be changed based on the received state change message; after the application node 12 receives the state change message, the application node 12 is no longer in the range of the change node, so that the current node state can be guaranteed to be unchanged.
According to the state changing method provided by the embodiment, the state changing message is acquired, and whether the state of the application node is changed or not is judged according to the state changing message, so that the application node can change the working state of the application node according to the requirement, the dynamic adjustment of the node state is effectively facilitated, the execution result of behavior processing logic can be influenced according to the adjusted node state, and the practicability of the state changing method is further improved.
Fig. 15 is a first schematic structural diagram of a data processing apparatus according to an embodiment of the present invention; referring to fig. 15, the present embodiment provides a data processing apparatus, which may execute the data processing method described above, and specifically, the data processing apparatus may include:
a first obtaining module 11, configured to obtain basic data information and service invocation link routing data of an application to be processed, where the application to be processed includes one or more application containers;
the establishing module 12 is used for establishing a simulation model according to the basic data information, wherein the simulation model comprises a plurality of node models corresponding to the application containers;
and the first processing module 13 is configured to process the application to be processed according to the simulation model and the service call link routing data.
When the first obtaining module 11 obtains the basic data information of the application to be processed, the first obtaining module 11 is configured to: sending an information acquisition request to a data cache server for storing basic data information; and receiving basic data information sent by the data cache server according to the information acquisition request.
Optionally, the base data information comprises at least one of: application service information, application deployment information, network equipment information and machine room IDC information.
Optionally, when the first obtaining module 11 obtains the service invocation link routing data of the application to be processed, the first obtaining module 11 is configured to perform: sending a data acquisition request to a data cache server for storing service call link routing data; and receiving service call link routing data sent by the data cache server according to the data acquisition request.
Optionally, a plurality of node models in the simulation model communicate with each other in an asynchronous communication manner.
Alternatively, when the building module 12 builds the simulation model according to the basic data information, the building module 12 may be configured to perform: obtaining an abstract model framework; determining model attributes, model states and model behaviors corresponding to the abstract model framework according to the basic data information; and establishing a simulation model according to the model attributes, the model state, the model behaviors and the abstract model framework.
Optionally, the simulation model comprises at least one of: the network node model is used for realizing data communication between the two application node models.
Optionally, when the first processing module 13 processes the application to be processed according to the simulation model and the service call link routing data, the first processing module 13 may be configured to perform: establishing a simulation fault scene based on the simulation model; and under the simulation fault scene, processing the application to be processed according to the simulation model and the service call link routing data.
When the first processing module 13 establishes the simulation fault scenario based on the simulation model, the first processing module 13 may be configured to perform: acquiring simulation configuration information; and setting state information in the simulation model according to the simulation configuration information, and establishing a simulation fault scene.
Optionally, the simulation configuration information includes at least one of: simulation exercise range, fault environment setting information and white list configuration information.
When the first processing module 13 processes the application to be processed according to the simulation model and the service call link routing data, the first processing module 13 may be configured to perform: inputting the service call link routing data into a simulation model, and acquiring a simulation result corresponding to the service call link routing data; acquiring service call link standard data corresponding to the application to be processed; and processing the application to be processed according to the simulation result and the standard data of the service call link.
Optionally, when the first processing module 13 processes the application to be processed according to the simulation result and the service call link standard data, the first processing module 13 may be configured to perform: obtaining the matching degree of the simulation result and the standard data of the service call link; if the matching degree is greater than or equal to a preset threshold value, determining that the usability of the application to be processed is good; or if the matching degree is smaller than the preset threshold, determining that the usability of the application to be processed is poor.
Optionally, the establishing module 12 in this embodiment may be further configured to perform: and after the application to be processed is processed according to the simulation model and the service call link routing data, generating a processing report according to a processing result.
The apparatus shown in fig. 15 can perform the method of the embodiment shown in fig. 1-3, and the detailed description of this embodiment can refer to the related description of the embodiment shown in fig. 1-3. The implementation process and technical effect of the technical solution refer to the descriptions in the embodiments shown in fig. 1 to fig. 3, and are not described herein again.
In one possible design, the structure of the data processing apparatus shown in fig. 15 may be implemented as an electronic device, which may be a mobile phone, a tablet computer, a server, or other devices. As shown in fig. 16, the electronic device may include: a first processor 21 and a first memory 22. Wherein the first memory 22 is used for storing programs that support the electronic device to execute the data processing method provided in the embodiments shown in fig. 1-3, and the first processor 21 is configured to execute the programs stored in the first memory 22.
The program comprises one or more computer instructions, wherein the one or more computer instructions, when executed by the first processor 21, are capable of performing the steps of:
acquiring basic data information and service call link routing data of an application to be processed, wherein the application to be processed comprises one or more application containers;
establishing a simulation model according to the basic data information, wherein the simulation model comprises a plurality of node models corresponding to the application containers;
and processing the application to be processed according to the simulation model and the service call link routing data.
Optionally, the first processor 21 is further configured to perform all or part of the steps in the embodiments shown in fig. 1 to 3.
The electronic device may further include a first communication interface 23, which is used for the electronic device to communicate with other devices or a communication network.
In addition, the embodiment of the present invention provides a computer storage medium for storing computer software instructions for an electronic device, which includes a program for executing the data processing method in the method embodiments shown in fig. 1 to fig. 3.
Fig. 17 is a second schematic structural diagram of a data processing apparatus according to an embodiment of the present invention; referring to fig. 17, the present embodiment provides another data processing apparatus, which may execute the data processing method described above, and specifically, the data processing apparatus may include:
a first receiving module 31, configured to receive an information acquisition request sent by a processing computing node;
a first determining module 32, configured to determine basic data information of the application to be processed corresponding to the information acquisition information;
a first sending module 33, configured to send the basic data information to the processing computing node.
Optionally, before receiving the information acquisition request sent by the processing computing node, the first receiving module 31 in this embodiment is further configured to perform: acquiring basic data information of an application to be processed through a preset database; and storing the basic data information of the application to be processed.
Optionally, the first receiving module 31, the first determining module 32, and the first sending module 33 in this embodiment may be further configured to execute the following steps:
a first receiving module 31, configured to receive a data acquisition request sent by a processing computing node;
a first determining module 32, configured to determine service invocation link routing data of the application to be processed corresponding to the data obtaining request;
a first sending module 33, configured to send the service invocation link routing data to the processing computing node.
Optionally, before receiving the data obtaining request sent by the processing computing node, the first receiving module 31 in this embodiment is further configured to perform: acquiring original data of a service call link of an application to be processed through a tracking log; the original data of the service call link is converged to obtain service call link routing data corresponding to the original data of the service call link; and storing the service call link routing data of the application to be processed.
Optionally, the first receiving module 31 in this embodiment is further configured to obtain and store service invocation link standard data corresponding to the application to be processed.
The apparatus shown in fig. 17 can perform the method of the embodiment shown in fig. 4-6, and the detailed description of this embodiment can refer to the related description of the embodiment shown in fig. 4-6. The implementation process and technical effect of the technical solution refer to the descriptions in the embodiments shown in fig. 4 to 6, and are not described herein again.
In one possible design, the structure of the data processing apparatus shown in fig. 17 may be implemented as an electronic device, which may be a mobile phone, a tablet computer, a server, or other devices. As shown in fig. 18, the electronic device may include: a second processor 41 and a second memory 42. Wherein the second memory 42 is used for storing programs that support the electronic device to execute the data processing method provided in the embodiments shown in fig. 4-6, and the second processor 41 is configured to execute the programs stored in the second memory 42.
The program comprises one or more computer instructions, wherein the one or more computer instructions, when executed by the second processor 41, are capable of performing the steps of:
receiving and processing an information acquisition request sent by a computing node;
determining basic data information of the application to be processed corresponding to the information acquisition information;
and sending the basic data information to the processing computing node.
Optionally, the second processor 41 is further configured to perform all or part of the steps in the embodiments of fig. 4-6.
The electronic device may further include a second communication interface 43 for communicating with other devices or a communication network.
In addition, the embodiment of the present invention provides a computer storage medium for storing computer software instructions for an electronic device, which includes a program for executing the data processing method in the method embodiments shown in fig. 4 to 6.
Fig. 19 is a first schematic structural diagram of a data communication device according to an embodiment of the present invention; referring to fig. 19, the present embodiment provides a data communication apparatus, which may perform the data communication method described above, and specifically, the data communication apparatus may include:
a second obtaining module 51, configured to obtain a service invocation request event message;
and the second processing module 52 is configured to encapsulate the service invocation request event message into a network event message, and send the network event message to the second application node through the network node.
Optionally, the second obtaining module 51 and the second processing module 52 in this embodiment may be further configured to perform the following steps:
a second obtaining module 51, configured to receive, by the network node, a network event response message sent by the second application node;
the second processing module 52 is configured to unpack the network event response message into a corresponding response message.
Optionally, when the second processing module 52 sends the network event message to the second application node through the network node, the second processing module 52 may be configured to perform: when the working state of the first application node is a normal state, acquiring service type information in the service calling request event message; calling a simulation service processing method according to the service type information; processing the service call request event message by using a simulation service processing method to obtain a downstream service call request event message; and sending the downstream service call request event message to the second application node through the network node.
Optionally, after obtaining the service type information in the service invocation request event message, the second processing module 52 in this embodiment may be further configured to perform: sending interactive object request information to a data cache server according to the service type information; and receiving the interactive object information sent by the data cache server according to the interactive object request information.
Optionally, the second processing module 52 in this embodiment may be further configured to perform: and determining a second application node for carrying out data interaction with the first application node according to the interaction object information.
Optionally, after receiving the interactive object information sent by the data caching server according to the interactive object request information, the second processing module 52 in this embodiment may be further configured to perform: sending a route acquisition request to a data cache server according to the interactive object information; and receiving the routing information sent by the data cache server according to the routing acquisition request, wherein the routing information corresponds to the second application node.
Optionally, when the second processing module 52 sends the downstream service invocation request event message to the second application node through the network node, the second processing module 52 may be further configured to perform: calling a routing service processing method according to the service type information; processing the downstream service call request event message by using a routing service processing method to obtain a target message of the downstream service call request event; and sending the downstream service call request event target message to the second application node through the network node.
The apparatus shown in fig. 19 can perform the method of the embodiment shown in fig. 7-10, and the detailed description of the embodiment not described in detail can refer to the related description of the embodiment shown in fig. 7-10. The implementation process and technical effect of the technical solution refer to the descriptions in the embodiments shown in fig. 7 to fig. 10, which are not described herein again.
In one possible design, the structure of the data communication apparatus shown in fig. 19 may be implemented as an electronic device, which may be a mobile phone, a tablet computer, a server, or other devices. As shown in fig. 20, the electronic device may include: a third processor 61 and a third memory 62. Wherein the third memory 62 is used for storing programs that support the electronic device to execute the data communication method provided in the embodiments shown in fig. 1-3, and the third processor 61 is configured for executing the programs stored in the third memory 62.
The program comprises one or more computer instructions, wherein the one or more computer instructions, when executed by the third processor 61, are capable of performing the steps of:
acquiring a service call request event message;
and packaging the service calling request event message into a network event message, and sending the network event message to the second application node through the network node.
Optionally, the third processor 61 is further configured to perform all or part of the steps in the embodiments of fig. 1-3.
The electronic device may further include a third communication interface 63 for communicating with other devices or a communication network.
In addition, the embodiment of the present invention provides a computer storage medium for storing computer software instructions for an electronic device, which includes a program for executing the data communication method in the method embodiments shown in fig. 7 to 10.
Fig. 21 is a second schematic structural diagram of a data communication device according to an embodiment of the present invention; referring to fig. 21, the present embodiment provides another data communication apparatus, which may perform the data communication method described above, and specifically, the data communication apparatus may include:
a second receiving module 71, configured to receive a service invocation request event message sent by a network node;
a third processing module 72, configured to perform service processing according to the service call request event message, and obtain a response message;
and a second sending module 73, configured to encapsulate the response message into a network event response message, and send the network event response message to the first application node through the network node.
The apparatus shown in fig. 21 can execute the method of the embodiment shown in fig. 11, and reference may be made to the related description of the embodiment shown in fig. 11 for a part of this embodiment that is not described in detail. The implementation process and technical effect of the technical solution are described in the embodiment shown in fig. 11, and are not described herein again.
In one possible design, the structure of the data communication apparatus shown in fig. 21 may be implemented as an electronic device, which may be a mobile phone, a tablet computer, a server, or other devices. As shown in fig. 22, the electronic device may include: a fourth processor 81 and a fourth memory 82. Wherein the fourth memory 82 is used for storing programs that support the electronic device to execute the data communication method provided in the embodiment shown in fig. 11, and the fourth processor 81 is configured to execute the programs stored in the fourth memory 82.
The program comprises one or more computer instructions which, when executed by the fourth processor 81, is capable of performing the steps of:
acquiring a service call request event message;
and packaging the service calling request event message into a network event message, and sending the network event message to the second application node through the network node.
The electronic device may further include a fourth communication interface 83, which is used for the electronic device to communicate with other devices or a communication network.
In addition, an embodiment of the present invention provides a computer storage medium for storing computer software instructions for an electronic device, which includes a program for executing the data communication method in the method embodiment shown in fig. 11.
Fig. 23 is a third schematic structural diagram of a data communication device according to an embodiment of the present invention; referring to fig. 23, the present embodiment provides another data communication apparatus, which may perform the data communication method described above, and specifically, the data communication apparatus may include:
a third receiving module 91, configured to receive a network event message sent by the first application node;
a second determining module 92, configured to determine, according to the network event message, an operating state of the first application node and a second application node;
an analyzing module 93, configured to unpack the network event message into a service call request event message if the first application node is in a normal state;
a third sending module 94, configured to send the service invocation request event message to the second application node.
Optionally, the analysis module 93 in this embodiment may be further configured to perform: if the first application node is in an abnormal state, judging whether the first application node and the second application node are in a cross-machine-room state or not; if the first application node and the second application node are not in a cross-machine-room state, unpacking the network event message into a service call request event message; or if the first application node and the second application node are in a cross-machine-room state, intercepting the network event message.
Optionally, the third receiving module 91, the second determining module 92 and the third sending module 94 may be further configured to perform the following steps:
a third receiving module 91, configured to receive a network event response message sent by the second application node;
a second determining module 92, configured to determine a working state of the first application node according to the network event response message;
a third sending module 94, configured to send the network event response message to the first application node if the first application node is in a normal state.
Optionally, the analysis module 93 in this embodiment may be further configured to perform: and if the first application node is in an abnormal state, intercepting the network event response message.
The apparatus shown in fig. 23 can perform the method of the embodiment shown in fig. 12, and reference may be made to the related description of the embodiment shown in fig. 12 for a part of this embodiment that is not described in detail. The implementation process and technical effect of the technical solution refer to the description in the embodiment shown in fig. 12, and are not described herein again.
In one possible design, the structure of the data communication apparatus shown in fig. 23 may be implemented as an electronic device, which may be a mobile phone, a tablet computer, a server, or other devices. As shown in fig. 24, the electronic device may include: a fifth processor 101 and a fifth memory 102. Wherein the fifth memory 102 is used for storing programs that support the electronic device to execute the data communication method provided in the embodiment shown in fig. 12, and the fifth processor 101 is configured for executing the programs stored in the fifth memory 102.
The program comprises one or more computer instructions, wherein the one or more computer instructions, when executed by the fifth processor 101, are capable of performing the steps of:
receiving a network event message sent by a first application node;
determining the working state of the first application node and the second application node according to the network event message;
if the first application node is in a normal state, unpacking the network event message into a service call request event message;
and sending the service calling request event message to the second application node.
Optionally, the fifth processor 101 is further configured to perform all or part of the steps in the foregoing embodiment shown in fig. 12.
The electronic device may further include a fifth communication interface 103, which is used for the electronic device to communicate with other devices or a communication network.
In addition, an embodiment of the present invention provides a computer storage medium for storing computer software instructions for an electronic device, which includes a program for executing the data communication method in the method embodiment shown in fig. 12.
Fig. 25 is a schematic structural diagram of a state changing device according to an embodiment of the present invention; referring to fig. 25, the present embodiment provides a state change apparatus applied to an application node, and specifically, the apparatus includes:
a third obtaining module 111, configured to obtain a state change message;
and a determining module 112, configured to determine whether to change the state of the application node according to the state change message.
Alternatively, when the determining module 112 determines whether to change the state of the application node according to the state change message, the determining module 112 may be configured to perform: determining a change node range corresponding to the state change message; if the application node is located in the range of the change node, the state of the application node is changed according to the state change message; or if the application node is not in the range of the change node, keeping the state of the application node unchanged.
The apparatus shown in fig. 25 can perform the method of the embodiment shown in fig. 13-14, and reference can be made to the related description of the embodiment shown in fig. 13-14 for the part not described in detail in this embodiment. The implementation process and technical effect of the technical solution are described in the embodiments shown in fig. 13 to 14, and are not described herein again.
In one possible design, the structure of the state changing apparatus shown in fig. 25 may be implemented as an electronic device, which may be a mobile phone, a tablet computer, a server, or other devices. As shown in fig. 26, the electronic device may include: a sixth processor 121 and a sixth memory 122. Wherein, the sixth memory 122 is used for storing programs that support the electronic device to execute the status changing method provided in the embodiment shown in fig. 13-14, and the sixth processor 121 is configured to execute the programs stored in the sixth memory 122.
The program comprises one or more computer instructions, wherein the one or more computer instructions, when executed by the sixth processor 121, enable the following steps to be performed:
acquiring a state change message;
and judging whether the state of the application node is changed or not according to the state change message.
Optionally, the sixth processor 121 is further configured to perform all or part of the steps in the embodiments shown in fig. 13 to 14.
The electronic device may further include a sixth communication interface 123, which is used for the electronic device to communicate with other devices or a communication network.
In addition, an embodiment of the present invention provides a computer storage medium for storing computer software instructions for an electronic device, which includes a program for executing the state change method in the method embodiments shown in fig. 13 to 14.
The above-described embodiments of the apparatus are merely illustrative, and the units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment. One of ordinary skill in the art can understand and implement it without inventive effort.
Through the above description of the embodiments, those skilled in the art will clearly understand that each embodiment can be implemented by adding a necessary general hardware platform, and of course, can also be implemented by a combination of hardware and software. With this understanding in mind, the above-described solutions and/or portions thereof that are prior art may be embodied in the form of a computer program product, which may be embodied on one or more computer-usable storage media having computer-usable program code embodied therein (including but not limited to disk storage, CD-ROM, optical storage, etc.).
The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
In a typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.
The memory may include forms of volatile memory in a computer readable medium, random Access Memory (RAM) and/or non-volatile memory, such as Read Only Memory (ROM) or flash memory (flash RAM). Memory is an example of a computer-readable medium.
Computer-readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static Random Access Memory (SRAM), dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), read Only Memory (ROM), electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information that can be accessed by a computing device. As defined herein, a computer readable medium does not include a transitory computer readable medium such as a modulated data signal and a carrier wave.
Finally, it should be noted that: the above examples are only intended to illustrate the technical solution of the present invention, but not to limit it; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present invention.
Claims (42)
1. A data processing method, comprising:
acquiring basic data information and service call link routing data of an application to be processed, wherein the application to be processed comprises one or more application containers, and the basic data information refers to a set of application information and network information of the application to be processed;
obtaining an abstract model framework;
determining model attributes, model states and model behaviors corresponding to the abstract model framework according to the basic data information;
establishing a simulation model according to the model attributes, the model states, the model behaviors and the abstract model framework, wherein the simulation model at least comprises the following components: the system comprises a network node model and an application node model, wherein the network node model is used for realizing data communication between the two application node models;
and processing the application to be processed according to the simulation model and the service call link routing data.
2. The method of claim 1, wherein obtaining basic data information of the application to be processed comprises:
sending an information acquisition request to a data cache server for storing the basic data information;
and receiving the basic data information sent by the data cache server according to the information acquisition request.
3. The method of claim 1, wherein the base data information comprises at least one of:
application service information, application deployment information, network equipment information and machine room IDC information.
4. The method of claim 1, wherein obtaining service invocation link routing data for the pending application comprises:
sending a data acquisition request to a data cache server for storing the service call link routing data;
and receiving the service call link routing data sent by the data cache server according to the data acquisition request.
5. The method of claim 1, wherein the plurality of node models in the simulation model communicate with each other in an asynchronous communication manner.
6. The method of claim 1, wherein processing the application to be processed according to the simulation model and the service invocation link routing data comprises:
establishing a simulation fault scene based on the simulation model;
and under the simulation fault scene, processing the application to be processed according to the simulation model and the service call link routing data.
7. The method of claim 6, wherein building a simulated fault scenario based on the simulation model comprises:
acquiring simulation configuration information;
and setting state information in the simulation model according to the simulation configuration information, and establishing the simulation fault scene.
8. The method of claim 7, wherein the simulation configuration information comprises at least one of:
simulation exercise range, fault environment setting information and white list configuration information.
9. The method of claim 6, wherein processing the application to be processed according to the simulation model and the service invocation link routing data comprises:
inputting the service call link routing data into the simulation model, and acquiring a simulation result corresponding to the service call link routing data;
acquiring service call link standard data corresponding to the application to be processed;
and processing the application to be processed according to the simulation result and the service call link standard data.
10. The method of claim 9, wherein processing the application to be processed according to the simulation result and the service call link standard data comprises:
obtaining the matching degree of the simulation result and the standard data of the service call link;
if the matching degree is greater than or equal to a preset threshold value, determining that the usability of the application to be processed is good; or,
and if the matching degree is smaller than a preset threshold value, determining that the usability of the application to be processed is poor.
11. The method of any of claims 1-10, wherein after processing the application to be processed according to the simulation model and the service invocation link routing data, the method further comprises:
and generating a processing report according to the processing result.
12. A data processing method, comprising:
receiving and processing an information acquisition request sent by a computing node;
determining basic data information of the application to be processed corresponding to the information acquisition information, wherein the basic data information refers to a set of application information and network information of the application to be processed;
sending the underlying data information to the processing computing node to cause the processing computing node to perform the method of any of claims 1-11.
13. The method of claim 12, wherein prior to receiving the information acquisition request sent by the processing computing node, the method further comprises:
acquiring basic data information of an application to be processed through a preset database;
and storing the basic data information of the application to be processed.
14. The method of claim 12, further comprising:
receiving and processing a data acquisition request sent by a computing node;
determining service call link routing data of the application to be processed corresponding to the data acquisition request;
and sending the service call link routing data to the processing computing node.
15. The method of claim 14, wherein prior to receiving the data acquisition request sent by the processing computing node, the method further comprises:
acquiring original data of a service call link of an application to be processed through a tracking log;
converging the original data of the service call link to obtain service call link routing data corresponding to the original data of the service call link;
and storing the service call link routing data of the application to be processed.
16. The method of claim 12, further comprising:
and acquiring and storing standard data of the service call link corresponding to the application to be processed.
17. A data communication method, applied to a first application node, wherein the first application node is in communication connection with a second application node through a network node, and wherein the first application node is an application node simulation model established by the method of any one of claims 1 to 11; the method comprises the following steps:
a first application node acquires a service call request event message;
and packaging the service calling request event message into a network event message, and sending the network event message to a second application node through a network node.
18. The method of claim 17, further comprising:
receiving, by the network node, a network event response message sent by the second application node;
and unpacking the network event response message into a corresponding response message.
19. The method of claim 17, wherein sending the network event message to the second application node via the network node comprises:
when the working state of the first application node is a normal state, acquiring service type information in the service calling request event message;
calling a simulation service processing method according to the service type information;
processing the service call request event message by using the simulation service processing method to obtain a downstream service call request event message;
and sending the downstream service call request event message to a second application node through a network node.
20. The method of claim 19, wherein after obtaining the service type information in the service invocation request event message, the method further comprises:
sending interactive object request information to a data cache server according to the service type information;
and receiving the interactive object information sent by the data cache server according to the interactive object request information.
21. The method of claim 20, further comprising:
and determining a second application node for performing data interaction with the first application node according to the interaction object information.
22. The method of claim 20, wherein after receiving the interactive object information sent by the data caching server according to the interactive object request information, the method further comprises:
sending a route acquisition request to the data cache server according to the interactive object information;
and receiving the routing information sent by the data cache server according to the routing acquisition request, wherein the routing information corresponds to the second application node.
23. The method of claim 19, wherein sending the downstream service invocation request event message to a second application node through a network node comprises:
calling a routing service processing method according to the service type information;
processing the downstream service call request event message by using the routing service processing method to obtain a target message of the downstream service call request event;
and sending the downstream service call request event target message to the second application node through a network node.
24. A data communication method, applied to a second application node, said second application node being communicatively connected to a first application node via a network node, said second application node being an application node simulation model established by the method of any one of claims 1 to 11; the method comprises the following steps:
receiving a service invocation request event message sent by a network node;
performing service processing according to the service call request event message to obtain a response message;
and packaging the response message into a network event response message, and sending the network event response message to the first application node through the network node.
25. A data communication method, applied to a network node, wherein the network node is a network node simulation model established by the method of any one of claims 1 to 11; the method comprises the following steps:
receiving a network event message sent by a first application node;
determining the working state of the first application node and a second application node according to the network event message;
if the first application node is in a normal state, unpacking the network event message into a service call request event message;
and sending the service calling request event message to the second application node.
26. The method of claim 25, further comprising:
if the first application node is in an abnormal state, judging whether the first application node and the second application node are in a cross-machine-room state or not;
if the first application node and the second application node are not in a cross-machine-room state, unpacking the network event message into a service call request event message; or,
and if the first application node and the second application node are in a cross-machine-room state, intercepting the network event message.
27. The method of claim 25, further comprising:
receiving a network event response message sent by the second application node;
determining the working state of the first application node according to the network event response message;
and if the first application node is in a normal state, sending the network event response message to the first application node.
28. The method of claim 27, further comprising:
and if the first application node is in an abnormal state, intercepting the network event response message.
29. A state change method, applied to an application node, wherein the application node is an application node simulation model created by the method of any one of claims 1 to 11; the method comprises the following steps:
acquiring a state change message;
and judging whether the state of the application node is changed or not according to the state change message.
30. The method of claim 29, wherein determining whether to change the state of the application node based on the state change message comprises:
determining a change node range corresponding to the state change message;
if the application node is located in the range of the change node, changing the state of the application node according to the state change message; or,
and if the application node is not in the range of the change node, keeping the state of the application node unchanged.
31. A data processing apparatus, comprising:
the system comprises a first acquisition module, a second acquisition module and a third acquisition module, wherein the first acquisition module is used for acquiring basic data information and service call link routing data of an application to be processed, the application to be processed comprises one or more application containers, and the basic data information refers to a set of application information and network information of the application to be processed;
the first processing module is used for acquiring an abstract model framework; determining model attributes, model states and model behaviors corresponding to the abstract model framework according to the basic data information; establishing a simulation model according to the model attributes, the model state, the model behaviors and the abstract model framework, wherein the simulation model at least comprises the following components: the network node model is used for realizing data communication between the two application node models;
and the processing module is used for processing the application to be processed according to the simulation model and the service call link routing data.
32. An electronic device, comprising: a memory, a processor; wherein the memory is to store one or more computer instructions, wherein the one or more computer instructions, when executed by the processor, implement the data processing method of any of claims 1 to 11.
33. A data processing apparatus, characterized by comprising:
the first receiving module is used for receiving and processing an information acquisition request sent by the computing node;
a first determining module, configured to determine basic data information of the to-be-processed application corresponding to the information acquisition information, where the basic data information refers to a set of application information and network information of the to-be-processed application;
a first sending module, configured to send the basic data information to the processing computing node, so as to enable the processing computing node to execute the method according to any one of claims 1 to 11.
34. An electronic device, comprising: a memory, a processor; wherein the memory is to store one or more computer instructions, wherein the one or more computer instructions, when executed by the processor, implement the data processing method of any of claims 12 to 16.
35. A data communication apparatus, wherein the apparatus is applied to a first application node, the first application node is connected to a second application node in communication through a network node, and the first application node is an application node simulation model established by the method of any one of claims 1 to 11; the device comprises:
the second acquisition module is used for acquiring the service call request event message;
and the second processing module is used for packaging the service calling request event message into a network event message and sending the network event message to a second application node through a network node.
36. An electronic device, comprising: a memory, a processor; wherein the memory is configured to store one or more computer instructions, wherein the one or more computer instructions, when executed by the processor, implement the data communication method of any of claims 17-23.
37. A data communication apparatus, applied to a second application node, the second application node being in communication connection with a first application node through a network node, the second application node being an application node simulation model established by the method of any one of claims 1 to 11; the device comprises:
a second receiving module, configured to receive a service invocation request event message sent by a network node;
the third processing module is used for carrying out service processing according to the service calling request event message to obtain a response message;
and the second sending module is used for packaging the response message into a network event response message and sending the network event response message to the first application node through the network node.
38. An electronic device, comprising: a memory, a processor; wherein the memory is to store one or more computer instructions, wherein the one or more computer instructions, when executed by the processor, implement a data communication method as recited in claim 24.
39. A data communication apparatus, applied to a network node, wherein the network node is a network node simulation model established by the method of any one of claims 1 to 11; the device comprises:
the third receiving module is used for receiving the network event message sent by the first application node;
a second determining module, configured to determine a working state of the first application node and a second application node according to the network event message;
the analysis module is used for unpacking the network event message into a service call request event message if the first application node is in a normal state;
and the third sending module is used for sending the service call request event message to the second application node.
40. An electronic device, comprising: a memory, a processor; wherein the memory is configured to store one or more computer instructions, wherein the one or more computer instructions, when executed by the processor, implement the data communication method of any of claims 25-28.
41. A state change device, which is applied to an application node, wherein the application node is an application node simulation model established by the method of any one of claims 1 to 11; the device comprises:
the third acquisition module is used for acquiring the state change message;
and the judging module is used for judging whether the state of the application node is changed or not according to the state change message.
42. An electronic device, comprising: a memory, a processor; wherein the memory is configured to store one or more computer instructions, wherein the one or more computer instructions, when executed by the processor, implement the state change method of any one of claims 29-30.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910104240.9A CN111526028B (en) | 2019-02-01 | 2019-02-01 | Data processing method, device and equipment |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910104240.9A CN111526028B (en) | 2019-02-01 | 2019-02-01 | Data processing method, device and equipment |
Publications (2)
Publication Number | Publication Date |
---|---|
CN111526028A CN111526028A (en) | 2020-08-11 |
CN111526028B true CN111526028B (en) | 2023-04-07 |
Family
ID=71900116
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201910104240.9A Active CN111526028B (en) | 2019-02-01 | 2019-02-01 | Data processing method, device and equipment |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN111526028B (en) |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112333787B (en) * | 2020-11-13 | 2023-09-12 | Oppo广东移动通信有限公司 | Data transmission method, device, storage medium, terminal and network access point equipment |
CN114389849B (en) * | 2021-12-17 | 2024-04-16 | 中电信数智科技有限公司 | Disaster recovery and backup exercise method and system for network security |
Family Cites Families (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7548843B2 (en) * | 2006-04-10 | 2009-06-16 | Microsoft Corporation | Simulation of distributed networks |
US9092561B2 (en) * | 2010-10-20 | 2015-07-28 | Microsoft Technology Licensing, Llc | Model checking for distributed application validation |
US9537932B2 (en) * | 2013-10-23 | 2017-01-03 | Microsoft Technology Licensing, Llc | Emulating test distributed application on server |
US9842045B2 (en) * | 2016-02-19 | 2017-12-12 | International Business Machines Corporation | Failure recovery testing framework for microservice-based applications |
CN108964993B (en) * | 2018-06-29 | 2022-02-18 | 郑州云海信息技术有限公司 | Fault simulation method, device and equipment based on dynamic proxy and readable storage medium |
-
2019
- 2019-02-01 CN CN201910104240.9A patent/CN111526028B/en active Active
Also Published As
Publication number | Publication date |
---|---|
CN111526028A (en) | 2020-08-11 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11630646B2 (en) | Software defined network controller | |
CN106776313B (en) | Method and device for simulating service and centralized management platform | |
US9842045B2 (en) | Failure recovery testing framework for microservice-based applications | |
CN103178996A (en) | Distributed packet-switching chip model verification system and method | |
US10567227B2 (en) | Production software application performance and resiliency testing | |
Zeng et al. | EmuEdge: A hybrid emulator for reproducible and realistic edge computing experiments | |
CN109726016A (en) | A kind of link tracing methods, devices and systems for distributed system | |
US20200327045A1 (en) | Test System and Test Method | |
CN110519127B (en) | Network delay detection method, device and storage medium | |
CN111526028B (en) | Data processing method, device and equipment | |
WO2017173972A1 (en) | Flow tracking method and apparatus, and storage medium | |
CN110224897A (en) | Vulnerable network test method, device, mobile device and the storage medium of application program | |
US10747584B2 (en) | Security-aware partitioning of processes | |
JP6425247B2 (en) | Virtualization infrastructure selection apparatus and method, and program | |
CN114466000B (en) | CDN gateway source returning method and device | |
CN105743724A (en) | Method and device for testing services | |
US20180246845A1 (en) | Virtualizing tcp/ip services with shared memory transport | |
CN111131427B (en) | Cross-domain cooperative system based on central domain and implementation method | |
CN104980352A (en) | Routing method and device for multiline computer room | |
CN112231109B (en) | Buffer resource management system, method and device | |
CN109960924A (en) | Subsystem login method, device and system and electronic equipment | |
CN108259527B (en) | Proxy-based service processing method and device and network element equipment | |
CN106506247B (en) | Virtual network creating method and device | |
CN115037794B (en) | Data acquisition method, device, computer equipment and readable storage medium | |
Femminella et al. | An edge abstraction layer enabling federated and hierarchical orches‑tration of CCAM services in 5G and beyond net‑works |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |