WO2017071384A1

WO2017071384A1 - Message processing method and apparatus

Info

Publication number: WO2017071384A1
Application number: PCT/CN2016/096270
Authority: WO
Inventors: 沈建; 陈正华; 郭斌
Original assignee: 中兴通讯股份有限公司
Priority date: 2015-10-30
Filing date: 2016-08-22
Publication date: 2017-05-04
Also published as: CN106657187A

Abstract

Provided in the present invention are a message processing method and apparatus, the method comprising: receiving a first request message from a client terminal, the first request message being used for requesting processing of predetermined data; determining whether a second request message identical to the first request message has been received prior to receiving the first request message; and when determining that the second request message has been received, implementing processing of the first request message on the basis of the processing state of the second request message. The present invention solves the problem in the prior art of data error caused by repeating the same processing, and achieves the effect of improving execution efficiency and accuracy and reducing system overheads.

Description

Message processing method and device

Technical field

The present invention relates to the field of communications, and in particular, to a packet processing method and apparatus.

Background technique

Cloud Computing is Grid Computing, Distributed Computing, Parallel Computing, Utility Computing, Network Storage Technologies, and Virtualization. And the integration of traditional computer technology and network technology such as load balancing (Load Balance). It aims to integrate multiple relatively low-cost computing entities into a system with powerful computing power through the network. Distributed storage is an area in the field of cloud computing. Its role is to provide distributed storage services for massive data and high-speed read and write access.

A distributed storage system is composed of a plurality of server nodes (hereinafter referred to as "nodes" or "service nodes") and clients connected to each other. In a distributed storage system, when a client sends a message to a service node to perform a data self-increment operation, the service node failure may cause the client to fail to determine whether retransmission is possible. This operation has non-retransmission. This process contains two problems to be solved. One is how to ensure that the service is not interrupted when the service node fails, and the other is how to ensure that the critical message that has been processed but not returned is correctly re-executed.

For a solution to ensure uninterrupted service when a node fails, the service node is generally divided into several service groups, each group consisting of a primary node and multiple standby nodes. The client records the service group node list. When the master node fails, the request message is sent to the standby node for processing, and the service is uninterrupted, but this method does not guarantee the correctness of the non-idempotent operation (such as self-increment) after retransmission. . If the current value of data A is 5, if the node fails before the message is processed but the message is not returned, the resend self-increment will cause A to increase to 7. This is an error.

An effective solution has not been proposed for the problem of data error caused by repeated execution of the same processing existing in the related art.

Summary of the invention

The present invention provides a message processing method and apparatus to at least solve the problem of repeatedly performing the same processing existing in the related art, thereby causing data errors.

According to an aspect of the present invention, a method for processing a message, comprising: receiving a first request message from a client, wherein the first request message is used to request processing of predetermined data; Whether the second request message that is the same as the first request message is received before the first request message; and if the result of the determination is that the second request message is received, according to the second The processing status of the request message processes the first request message.

Optionally, determining whether the first request message is received before receiving the first request message The second request packet includes: obtaining the first packet identifier of the first request packet; determining whether the stored first identifier of the one or more third request packets is the same as the first packet If the judgment result is yes, it is determined that the second request message is received; and/or, if the determination result is no, it is determined that the second request is not received. Message.

Optionally, the packet identifier includes an identifier of the client and a local unique number used to identify the request packet.

Optionally, processing the first request packet according to the processing status of the second request packet, if the processing status of the second request packet is unprocessed, according to the first Requesting the message to process the predetermined data; or, if the processing status of the second request message is processed, ignoring the first request message, and sending the message to the client The processing result of processing the predetermined data.

Optionally, the second request packet is sent by the original primary node, where the original primary node is configured to receive and process the client sending before receiving the first request packet from the client. The node of the request message.

According to another aspect of the present invention, an apparatus for packet processing is provided, comprising: a receiving module, configured to receive a first request message from a client, wherein the first request message is used to request a subscription The data is processed; the determining module is configured to determine whether the second request message that is the same as the first request message is received before receiving the first request message; and the processing module is configured to be in the determining module If the second request message is received, the first request message is processed according to the processing status of the second request message.

Optionally, the determining module includes: an obtaining unit, configured to acquire a first packet identifier of the first request packet; and a determining unit, configured to determine the stored one or more third request packets received in advance Whether the message identifier of the first packet identifier is the same as the identifier of the first packet identifier; the first determining unit is configured to determine that the second packet is received if the judgment result of the determining unit is yes Requesting a message; and/or, the second determining unit is configured to determine that the second request message has not been received if the determination result of the determining unit is negative.

Optionally, the processing module includes: a first processing unit, configured to process the predetermined data according to the first request message if a processing status of the second request message is unprocessed Or the second processing unit is configured to ignore the first request message and send the predetermined data to the client if the processing status of the second request message is processed. The processing result of the processing.

According to the present invention, the first request message is received from the client, wherein the first request message is used to request processing of the predetermined data; and it is determined whether the first request message is received before receiving the first request message. The second request message having the same text; if the result of the judgment is that the second request message is received, the method for processing the first request message according to the processing state of the second request message is because The second request packet that is the same as the first request packet is judged, and the first request packet is processed according to the processing state of the second request packet, thereby avoiding the problem of performing multiple processing on the same packet. Resolving the same processing that exists in the related art repeatedly, resulting in data The wrong problem, in turn, achieves the effect of improving execution efficiency and accuracy and reducing system overhead.

DRAWINGS

The drawings described herein are intended to provide a further understanding of the invention, and are intended to be a part of the invention. In the drawing:

1 is a flowchart of a method of message processing according to an embodiment of the present invention;

2 is a structural block diagram of an apparatus for processing a message according to an embodiment of the present invention;

FIG. 3 is a structural block diagram of a determining module 24 in a message processing apparatus according to an embodiment of the present invention;

4 is a structural block diagram of a processing module 26 in a message processing apparatus according to an embodiment of the present invention;

FIG. 5 is a schematic diagram of a connection between a distributed storage system and a client according to an embodiment of the present invention; FIG.

6 is a flowchart of a method of requesting processing of a message according to an embodiment of the present invention;

7 is a flow chart of message processing under normal conditions according to an embodiment of the present invention;

8 is a flow chart 1 of message processing of a primary service node failure according to an embodiment of the present invention;

9 is a second flowchart of message processing of a primary service node failure in accordance with an embodiment of the present invention.

detailed description

The invention will be described in detail below with reference to the drawings in conjunction with the embodiments. It should be noted that the embodiments in the present application and the features in the embodiments may be combined with each other without conflict.

It is to be understood that the terms "first", "second" and the like in the specification and claims of the present invention are used to distinguish similar objects, and are not necessarily used to describe a particular order or order.

A method for processing a message is provided in this embodiment. FIG. 1 is a flowchart of a method for processing a message according to an embodiment of the present invention. As shown in FIG. 1, the process includes the following steps:

Step S102: Receive a first request message from a client, where the first request message is used to request processing of predetermined data.

Step S104, determining whether a second request message that is the same as the first request message is received before receiving the first request message;

Step S106: If the result of the determination is that the second request message is received, the first request message is processed according to the processing state of the second request message.

After the foregoing step is performed, the first request packet is processed according to the processing state of the second request packet, and the first request packet is processed according to the processing state of the second request packet. The same message into The problem of multiple processing in a row solves the problem of repeatedly performing the same processing in the related art, thereby causing data errors, thereby achieving an effect of improving execution efficiency and accuracy and reducing system overhead.

In an optional embodiment, the step S104 may include: acquiring a first packet identifier of the first request packet, and determining whether the stored packet identifier of the one or more third request packets received in advance exists. The same message identifier as the first message identifier; if the judgment result is yes, it is determined that the second request message is received; and/or, if the determination result is negative, it is determined that the second request has not been received. Message. In this optional embodiment, by storing the packet identifier of the one or more third request packets received in advance, and searching for the presence of the second request packet in the third request packet, it may be determined whether the packet is received before. The second request message is the same as the first request message.

The packet identifier in the foregoing optional embodiment may include: an identifier of the client and a local unique number used to identify the request packet. In this optional embodiment, the packet identifier is divided into two parts: a client identifier and a local unique number, which simplifies the complexity of the packet identifier and facilitates searching for the packet identifier.

In an optional embodiment, step S106 may include: processing the predetermined data according to the first request message if the processing status of the second request message is unprocessed; or, in the second request message When the processing status is processed, the first request message is ignored, and the processing result of processing the predetermined data is sent to the client. In the optional embodiment, when the processing status of the second request packet is processed, the first request packet may be directly ignored, and the processing result of the second request packet is returned to the client, thereby avoiding Data error caused by processing the processed request message again.

The second request message in the foregoing embodiment and the optional embodiment may be sent by the client. In an optional embodiment, the second request message may be sent by the original master node, where the original master node is receiving The node for receiving and processing the request message sent by the client before the first request message from the client. In this optional embodiment, the original primary node receives the second request message during normal operation and forwards the second request message to other nodes for processing, but has not returned the response of the second request message to the client. A failure occurred while the message was in progress. However, the other node has not failed, and the second request packet has been processed. When the other node receives the first request packet sent by the client and is the same as the second request packet, the other node may perform the processing according to the processing status. deal with.

Through the description of the above embodiments, those skilled in the art can clearly understand that the method according to the above embodiment can be implemented by means of software plus a necessary general hardware platform, and of course, by hardware, but in many cases, the former is A better implementation. Based on such understanding, the technical solution of the present invention, which is essential or contributes to the prior art, may be embodied in the form of a software product stored in a storage medium (such as ROM/RAM, disk, The optical disc includes a number of instructions for causing a terminal device (which may be a cell phone, a computer, a server, or a network device, etc.) to perform the methods described in various embodiments of the present invention.

In the embodiment, a device for processing a message is provided, which is used to implement the foregoing embodiments and preferred embodiments, and details are not described herein. As used below, the term "module" may implement a combination of software and/or hardware of a predetermined function. Although the apparatus described in the following embodiments is preferably implemented in software, hardware, or a combination of software and hardware, is also possible and contemplated.

2 is a structural block diagram of an apparatus for processing a message according to an embodiment of the present invention. As shown in FIG. 2, the apparatus includes receiving Module 22, determination module 24, and processing module 26 are described below.

The receiving module 22 is configured to receive a first request message from the client, where the first request message is used to request processing of the predetermined data; the determining module 24 is connected to the receiving module 22, and is configured to determine that the receiving message is Whether a second request message identical to the first request message is received before the request message is received; the processing module 26 is connected to the determining module 24, and is configured to receive the second request message at the judgment result of the determining module 24. In the case of the text, the first request message is processed according to the processing state of the second request message.

FIG. 3 is a structural block diagram of a determining module 24 in a message processing apparatus according to an embodiment of the present invention. As shown in FIG. 3, the determining module 24 includes an obtaining unit 32, a determining unit 34, and a first determining unit 36 and/or a Second determining unit 38, the determining module 24 will be described below.

The obtaining unit 32 is configured to obtain the first packet identifier of the first request packet, and the determining unit 34 is connected to the obtaining unit 32, and is configured to determine the stored pre-received one or more third request packet reports. Whether the message identifier is the same as the first message identifier in the text identifier; the first determining unit 36 is connected to the determining unit 34, and is configured to determine that the second receiving unit is received if the determining result of the determining unit 34 is YES. The request message; and/or the second determining unit 38 is connected to the determining unit 34, and is configured to determine that the second request message has not been received if the determining result of the determining unit 34 is negative.

The packet identifier in the foregoing embodiment and the optional embodiment may include an identifier of the client and a local unique number for identifying the request packet.

4 is a structural block diagram of a processing module 26 in a message processing apparatus according to an embodiment of the present invention. As shown in FIG. 4, the processing module 26 includes a first processing unit 42 or a second processing unit 44, and the processing module is provided below. 26 for explanation.

The first processing unit 42 is configured to process the predetermined data according to the first request message if the processing status of the second request message is unprocessed; or the second processing unit 44 is configured to be in the second request When the processing status of the message is processed, the first request message is ignored, and the processing result of processing the predetermined data is sent to the client.

The second request message in the foregoing embodiment and the optional embodiment may be sent by the original primary node, where the original primary node is configured to receive and process the request report sent by the client before receiving the first request message from the client. The node of the text.

A method and an apparatus for processing a message according to an embodiment of the present invention are described by taking a distributed storage system as an example.

In the distributed storage system, the embodiment of the present invention can ensure seamless handover of services and retransmission of messages when a node fails. The content of the solution of the embodiment of the present invention may include the following steps:

Pre-step: The client establishes a connection with multiple server nodes (assumed node A, node B) in the distributed storage system. FIG. 5 is a schematic diagram of a connection between a distributed storage system and a client according to an embodiment of the present invention. As shown in FIG. 5, server nodes establish a connection with each other and operate normally, and nodes A and B respectively serve the primary service node and backup service of the client. node.

FIG. 6 is a flowchart of a method for processing a request message according to an embodiment of the present invention. As shown in FIG. 6, the process includes:

Step S602: adding a message identifier to the packet sent by the client to the server node, where the message identifier has a client identifier The combination of the (clientID) and the local unique number (uniqueNUM), ie {clientID, uniqueNUM}.

Step S604: The client records the status status of each communication message to record whether the message is sent, whether it is processed, whether retransmission is required, and the like.

Step S606: The server uses the map structure to save the localized processing status of the received message. If the local message has been processed, the message is not processed when the resend message is received, and the non-reproducibility of some operations is avoided (for example, Increase/decrease).

Step S608: The client waits for the return message to time out due to the failure of the master node, and the client retransmits the message to the standby node, and the standby node processes the message.

Step S610: After the original primary node fails to recover, the latest data is synchronized from the new primary node (ie, the original standby node) to achieve data consistency.

Through the above embodiment, when the service node in the system fails, the message can be retransmitted and the service can be seamlessly switched. The embodiments of the present invention ensure seamless switching of distributed system services, and unresponsive messages can be retransmitted without causing data errors. To ensure system availability and data consistency.

In the following, the service node in the distributed storage system is divided into a primary server node and a plurality of standby server nodes. The following describes the method for processing the packet according to the embodiment of the present invention in a scenario where multiple failures occur in the primary server node.

In the embodiment of the present invention, a distributed storage system composed of a server node and a client is shown in FIG. 5. Each node in the cluster is connected to each other. Each group consists of one master node and multiple standby nodes. The data of the master node and the standby node are strongly consistent. The client sends a request message to the master node and forwards the message to the master node. The standby node is returned to the client by the master node after all nodes are successfully processed.

7 is a flow chart of message processing in a normal case according to an embodiment of the present invention, FIG. 8 is a flow chart 1 of message processing of a failure of a primary service node according to an embodiment of the present invention, and FIG. 9 is a main service node according to an embodiment of the present invention. Fault message processing flow chart 2, the following describes the entire implementation method in detail with reference to FIG. 7-9, including the following steps:

Pre-step: The client obtains its own ClientID by assisting the server or its own algorithm, and the client has selected the service group to establish a connection with the active and standby nodes.

In step S1, the client sends the data change request to the primary service node by using the client ID and the local unique number as the message unique identifier {clientID, uniqueNUM} (corresponding to S702 in FIG. 7, S802 in FIG. 8, S902 in FIG. 9). );

In step S2, the primary server node receives the request packet. If the master node fails to go to step S7 at this time (equivalent to S804 in Fig. 8);

In step S3, the master node processes the request message, records the message ID and the processing status (equivalent to S706 in FIG. 7), and simultaneously forwards the data to the standby node (corresponding to S704 in FIG. 7). If the master node fails to go to step S10 at this time (equivalent to S906 in Fig. 9);

Step S4, the standby node receives the request message, processes the message, and locally records the message ID and the processing status (corresponding to S708 in FIG. 7);

In step S5, the standby node returns the processing result to the master node (equivalent to S710 in FIG. 7);

Step S6, after receiving the node processing result, the master node returns the final result of the message processing to the client, and jumps to step 14 (equivalent to S712 in FIG. 7);

Step S7, the client waits for the return message to time out, determines that the primary node is faulty, and selects one of the standby nodes as a new primary node (equivalent to S806 in FIG. 8);

Step S8, the client resends the message to the new primary node (ie, the original standby node) (equivalent to S808 in FIG. 8);

Step S9, the standby node processes the data change request, and returns the result to the client, and proceeds to step S14 (equivalent to S810-S812 in FIG. 8);

Step S10, after receiving the request message, the standby node processes the message, and records the processing result of the message (equivalent to S906 in FIG. 9);

Step S11, the client waits for the return message to time out, determines that the primary node is faulty, and selects one of the standby nodes as the new primary node (equivalent to S910 in FIG. 9);

Step S12, the client resends the message to the new primary node (ie, the original standby node) (equivalent to S912 in FIG. 9);

In step S13, the standby node finds that the message has been processed, and will not process the result, and directly returns the result to the client (equivalent to S914-S916 in FIG. 9);

Step S14, the entire message processing flow ends.

The embodiment of the invention is in the distributed storage system of the cloud computing domain. When the fault of the node (mainly the primary service node) is solved, the request message can be seamlessly processed correctly, which increases the robustness and availability of the system.

It should be noted that each of the above modules may be implemented by software or hardware. For the latter, the foregoing may be implemented by, but not limited to, the foregoing modules are all located in the same processor; or, the modules are located in multiple In the processor.

Embodiments of the present invention also provide a storage medium. Optionally, in the embodiment, the foregoing storage medium may be configured to store program code for performing the following steps:

S21. Receive a first request message from a client, where the first request message is used to request processing of predetermined data.

S22. Determine whether a second request message that is the same as the first request message is received before receiving the first request message.

S23. If the result of the determination is that the second request message is received, the first request message is processed according to the processing state of the second request message.

Optionally, in the embodiment, the foregoing storage medium may include, but is not limited to, a USB flash drive, a Read-Only Memory (ROM), and a Random Access Memory (RAM). A variety of media that can store program code, such as a hard disk, a disk, or an optical disk.

Optionally, in the embodiment, the processor executes S21-S23 according to the stored program code in the storage medium.

For example, the specific examples in this embodiment may refer to the examples described in the foregoing embodiments and the optional embodiments, and details are not described herein again.

It will be apparent to those skilled in the art that the various modules or steps of the present invention described above can be implemented by a general-purpose computing device that can be centralized on a single computing device or distributed across a network of multiple computing devices. Alternatively, they may be implemented by program code executable by the computing device such that they may be stored in the storage device by the computing device and, in some cases, may be different from the order herein. The steps shown or described are performed, or they are separately fabricated into individual integrated circuit modules, or a plurality of modules or steps thereof are fabricated as a single integrated circuit module. Thus, the invention is not limited to any specific combination of hardware and software.

The above description is only the preferred embodiment of the present invention, and is not intended to limit the present invention, and various modifications and changes can be made to the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and scope of the present invention are intended to be included within the scope of the present invention.

Industrial applicability

As described above, the method and apparatus for processing a message according to an embodiment of the present invention have the following beneficial effects: solving the problem of repeatedly performing the same processing in the related art, thereby causing data errors, thereby improving execution efficiency. And accuracy, reducing the effect of system overhead.

Claims

A method for processing a message, comprising:

Receiving a first request message from the client, where the first request message is used to request processing of the predetermined data;

Determining whether a second request message that is the same as the first request message is received before receiving the first request message;

If the result of the determination is that the second request message is received, the first request message is processed according to the processing state of the second request message.
The method of claim 1, wherein determining whether the second request message that is the same as the first request message is received before receiving the first request message includes:

Obtaining a first packet identifier of the first request packet;

Determining, by the stored message identifier of the one or more third request messages that are received in advance, whether the same message identifier as the first message identifier exists;

If the determination result is yes, it is determined that the second request message is received; and/or, if the determination result is no, it is determined that the second request message is not received.
The method of claim 2, wherein the message identifier comprises an identifier of the client and a local unique number for identifying the request message.
The method of claim 1, wherein processing the first request message according to a processing status of the second request message comprises:

If the processing status of the second request message is unprocessed, processing the predetermined data according to the first request message; or

When the processing status of the second request message is processed, the first request message is ignored, and the processing result of processing the predetermined data is sent to the client.
The method according to any one of claims 1 to 4, wherein the second request message is sent by an original primary node, wherein the original primary node is receiving the first request message from the client Before the text, a node for receiving and processing the request message sent by the client.
A device for processing a message, comprising:

a receiving module, configured to receive a first request message from a client, where the first request message is used to request processing of predetermined data;

The determining module is configured to determine whether the second request message that is the same as the first request message is received before receiving the first request message;

The processing module is configured to process the first request message according to the processing state of the second request message if the judgment result of the determining module is that the second request message is received.
The apparatus of claim 6, wherein the determining module comprises:

An acquiring unit, configured to obtain a first packet identifier of the first request packet;

a determining unit, configured to determine, in the message identifier of the stored one or more third request messages, whether the same message identifier as the first message identifier exists;

a first determining unit, configured to determine that the second request message is received if the determination result of the determining unit is yes; and/or the second determining unit is configured to be determined by the determining unit If the result is no, it is determined that the second request message has not been received.
The apparatus of claim 7, wherein the message identification comprises an identification of the client and a local unique number for identifying the request message.
The apparatus of claim 6 wherein said processing module comprises:

The first processing unit is configured to process the predetermined data according to the first request message if the processing status of the second request message is unprocessed; or

a second processing unit, configured to ignore the first request message and send a process for processing the predetermined data to the client if the processing status of the second request message is processed result.
The apparatus according to any one of claims 6 to 9, wherein the second request message is sent by an original primary node, wherein the original primary node is receiving the first request message from the client Before the text, a node for receiving and processing the request message sent by the client.