CN107678918A - The OSD heartbeat mechanisms method to set up and device of a kind of distributed file system - Google Patents

Abstract

The invention discloses an OSD heartbeat mechanism setting method and device of a distributed file system, and a computer-readable storage medium. The method includes: a first node assembles a heartbeat message according to state information of all its own OSDs at a preset time interval, and Send the heartbeat message to the corresponding receiving node; each receiving node calls the heartbeat processing function of all its own OSDs according to the received heartbeat message, and updates the heartbeat related information of the OSD corresponding to the PG group information heartbeat message saved by all its own OSDs ; In the present invention, the first node assembles the heartbeat message according to the state information of all OSDs of itself according to the preset time interval, and sends the heartbeat message to the corresponding receiving node, which can be sent between nodes in single-process mode. The heartbeat message containing the status information of all OSDs on the node can reduce the number of OSD heartbeat messages, reduce system resource consumption, and improve system stability.

Description

Method and device for setting OSD heartbeat mechanism of distributed file system

technical field

The invention relates to the field of distributed file systems, in particular to an OSD heartbeat mechanism setting method, device and computer-readable storage medium of a distributed file system.

Background technique

With the development of science and technology in modern society, the application of distributed file system has been paid more and more attention by people. During the operation of the distributed file system, it is necessary to respond to failures in a timely manner, so it is necessary to rely on the OSD heartbeat mechanism to detect the health of the system.

In the prior art, the OSD (Object-based Storage Device, object storage device) heartbeat mechanism is a group of OSDs that send messages to each other for status detection. The sending and receiving of the OSD heartbeat mechanism can be shown in Figure 1. A PG ( The OSD where the data object storage set) is located is a heartbeat detection group, and each node in the group sends heartbeat messages to each other. As the cluster size increases, the number of PG groups to which the OSD belongs increases, and the heartbeat sending scale will increase exponentially. This not only consumes system resources, but also easily causes heartbeat timeout due to lack of system resources, which in turn leads to abnormal cluster status. Therefore, how to reduce the number of OSD heartbeat messages, reduce system resource consumption, and improve system stability is an urgent problem to be solved today.

Contents of the invention

The object of the present invention is to provide an OSD heartbeat mechanism setting method, device and computer-readable storage medium of a distributed file system, to send and receive heartbeat messages after being combined by adopting the mode of sending heartbeat messages between nodes, Greatly reduce the number of heartbeat messages sent, thereby reducing system resource consumption and improving system stability.

In order to solve the above-mentioned technical problems, the present invention provides a method for setting an OSD heartbeat mechanism of a distributed file system, comprising:

The first node assembles a heartbeat message according to the state information of all OSDs of itself according to a preset time interval, and sends the heartbeat message to a corresponding receiving node;

Each receiving node calls the heartbeat processing functions of all its own OSDs according to the received heartbeat message, and updates the heartbeat-related information of the OSD corresponding to the heartbeat message in the PG group information stored by all its own OSDs.

Optionally, the sending the heartbeat message to the corresponding receiving node includes:

The first node sends the heartbeat message to the receiving node where the other OSDs are located according to the information of other OSDs in the PG group information stored by each OSD of the first node.

Optionally, after calling the heartbeat processing functions of all its own OSDs and updating the heartbeat-related information of the OSD corresponding to the heartbeat message in the PG group information stored by all its own OSDs, it includes:

The heartbeat processing function of each OSD extracts the state information of the OSD in the heartbeat message;

Traverse the PG group information saved by itself, and judge whether there is an OSD corresponding to the OSD in the heartbeat message;

If so, update the heartbeat related information of the OSD corresponding to the OSD in the heartbeat message in the PG group information saved by itself.

Optionally, after the heartbeat processing functions of all OSDs of each receiving node are processed, it also includes:

each of the receiving nodes assembles a heartbeat reply message, and sends the heartbeat reply message to the first node;

According to the received heartbeat reply message, the first node invokes the heartbeat reply processing functions of all its own OSDs to update the heartbeat state of its own OSDs corresponding to the heartbeat reply message.

Optionally, calling the heartbeat reply processing functions of all OSDs of the self, and updating the heartbeat state of the OSD corresponding to the heartbeat reply message, including:

The heartbeat reply processing function of each OSD extracts the required reply message from the heartbeat reply message, and updates the heartbeat state.

The present invention also provides an OSD heartbeat mechanism setting device of a distributed file system, comprising:

A sending module, configured to assemble a first heartbeat message according to the status information of all its OSDs at preset time intervals, and send the first heartbeat message to a corresponding node;

The receiving module is used to call the heartbeat processing functions of all its own OSDs according to the received second heartbeat message, and update the heartbeat related information of the OSD corresponding to the second heartbeat message in the PG group information saved by all its own OSDs.

Optionally, the sending module includes:

The sending sub-module is configured to send the first heartbeat message to the node where the other OSDs are located according to the information of other OSDs in the PG group information stored by each OSD of itself.

Optionally, the receiving module includes:

The heartbeat processing submodule is used to extract the state information of the OSD in the second heartbeat message by using the heartbeat processing function of each OSD; traverse the PG group information saved by itself, and judge whether there is an OSD correspondence in the second heartbeat message If so, update the heartbeat related information of the OSD corresponding to the OSD in the second heartbeat message in the PG group information saved by itself.

Optionally, the device also includes:

The second sending module is used to assemble the first heartbeat reply message after the heartbeat processing functions of all OSDs are processed, and send the first heartbeat reply message to the sending node of the heartbeat message;

The second receiving module is used to receive the second heartbeat reply message, call the heartbeat reply processing function of all OSDs of itself, and update the heartbeat state of the OSD corresponding to the second heartbeat reply message; wherein, the second heartbeat The reply message is a heartbeat reply message sent by the node where the other OSD is located.

In addition, the present invention also provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the distributed file system as described in any one of the above is implemented. Steps for setting the OSD heartbeat mechanism.

A method for setting an OSD heartbeat mechanism of a distributed file system provided by the present invention includes: the first node assembles a heartbeat message according to the state information of all its OSDs at preset time intervals, and sends the heartbeat message to the corresponding receiving node Above; each receiving node calls the heartbeat processing functions of all its own OSDs according to the received heartbeat message, and updates the heartbeat related information of the OSDs corresponding to the PG group information heartbeat messages saved by all its own OSDs;

It can be seen that the present invention uses the first node to assemble the heartbeat message according to the state information of all its own OSDs according to the preset time interval, and sends the heartbeat message to the corresponding receiving node. Send heartbeat messages, which contain the status information of all OSDs on the node, which greatly reduces the number of OSD heartbeat messages, reduces system resource consumption, and improves system stability. In addition, the present invention also provides an OSD heartbeat mechanism setting device for a distributed file system and a computer-readable storage medium, which also have the above beneficial effects.

Description of drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are only It is an embodiment of the present invention, and those skilled in the art can also obtain other drawings according to the provided drawings without creative work.

FIG. 1 is a schematic diagram of an OSD heartbeat mechanism in the prior art;

Fig. 2 is the flowchart of the OSD heartbeat mechanism setting method of a kind of distributed file system provided by the embodiment of the present invention;

3 is a schematic diagram of an OSD heartbeat mechanism of an OSD heartbeat mechanism setting method of a distributed file system provided by an embodiment of the present invention;

FIG. 4 is a structural diagram of an OSD heartbeat mechanism setting device for a distributed file system provided by an embodiment of the present invention.

detailed description

In order to make the purpose, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments It is a part of embodiments of the present invention, but not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

Please refer to FIG. 2 , which is a flowchart of a method for setting an OSD heartbeat mechanism of a distributed file system provided by an embodiment of the present invention. The method can include:

Step 101: The first node assembles a heartbeat message according to the status information of all its OSDs at a preset time interval, and sends the heartbeat message to a corresponding receiving node.

Wherein, the first node may be any node in the distributed file system. The selection of the first node for performing this step can be set by the designer according to practical scenarios and user requirements, for example, each node in the distributed file system can be set as the first node.

Specifically, this step can be that when the system is started, the OSDmananger layer of the first node starts a timer thread, traverses the state information of all OSDs on the first node, assembles it into a heartbeat message, and then sends the heartbeat message to the corresponding receiving node .

It can be understood that the setting of the receiving node in this step can be set by the designer according to practical scenarios and user needs, for example, it can be all nodes in the distributed file system including the first node, or it can be the first node itself The node where other OSDs in the PG group information saved by each OSD are located. As long as the receiving node can include nodes where other OSDs in the PG group information saved by each OSD of the first node are located, the specific setting of the receiving node can be set by the designer, and this embodiment does not impose any restrictions on this.

Correspondingly, the process of sending the heartbeat message to the corresponding receiving node in this step may be: the first node sends the heartbeat message to the other OSDs where the other OSDs are located according to the information of other OSDs in the PG group information saved by each OSD of itself. on the receiving node.

It should be noted that the receiving node in this step can include the first node, and the PG group in the OSD heartbeat mechanism shown in Figure 1 can be configured by the first node (node 1) through the OSD heartbeat mechanism shown in Figure 3 ) sends a heartbeat message to the receiving nodes (node 1 and node 2).

Step 102: Each receiving node invokes the heartbeat processing functions of all its own OSDs according to the received heartbeat message, and updates the heartbeat related information of the OSDs corresponding to the PG group information heartbeat messages saved by all its own OSDs.

Wherein, each receiving node calls the heartbeat processing functions of all its own OSDs, and updates the heartbeat related information of the OSDs corresponding to the PG group information heartbeat messages saved by all its own OSDs, which can be called one by one the heartbeat processing functions of all its own OSDs; It can also call the heartbeat processing functions of all its own OSDs at the same time, that is, synchronously update the heartbeat related information of OSDs corresponding to the PG group information heartbeat messages saved by all its own OSDs. This embodiment does not impose any limitation on this.

Specifically, in this step, each receiving node calls the heartbeat processing functions of all its own OSDs, and updates the heartbeat related information of OSDs corresponding to the PG group information heartbeat messages saved by all its own OSDs, which can be the heartbeat of each OSD The processing function extracts the OSD status information in the heartbeat message, and then traverses the PG group information saved by itself, and updates the heartbeat related information in this PG group. For example, the heartbeat processing function of each OSD extracts the OSD status information in the heartbeat message; traverses the PG group information saved by itself, and judges whether there is an OSD corresponding to the OSD in the heartbeat message; if so, updates the PG group information saved by itself. The heartbeat related information of the OSD corresponding to the OSD in the message.

It can be understood that, corresponding to the existing OSD heartbeat mechanism, after this step, each receiving node may also assemble a heartbeat reply message after the heartbeat processing functions of all OSDs are completed, and send the heartbeat reply message to the first A node step.

Correspondingly, the first node may call the heartbeat reply processing functions of all its own OSDs according to the received heartbeat reply message, and update the heartbeat status of its own OSD corresponding to the heartbeat reply message.

It should be noted that the heartbeat reply message can be the reply message corresponding to the heartbeat message sent by the first node, as long as the first node can update the heartbeat status of its own OSD corresponding to the heartbeat reply message according to the heartbeat reply message, for the heartbeat reply message The specific content is not limited in this embodiment.

It can be understood that when the receiving node is the node where other OSDs in the PG group information saved by each OSD of the first node are located, each receiving node can send a heartbeat reply message to the first node; when the receiving node is For all nodes, other receiving nodes other than the node where other OSDs are located in the PG group information saved by each OSD of the first node may not send a heartbeat reply message to the first node, reducing the heartbeat reply processing of the first node The workload of the function. This embodiment does not impose any limitation on this.

In this embodiment, the embodiment of the present invention uses the first node to assemble the heartbeat message according to the state information of all OSDs of itself according to the preset time interval, and sends the heartbeat message to the corresponding receiving node, which can be used in single-process mode. Heartbeat messages are sent between nodes. The heartbeat messages contain the status information of all OSDs on the node, which greatly reduces the number of OSD heartbeat messages, reduces system resource consumption, and improves system stability.

Please refer to FIG. 4 , which is a structural diagram of an OSD heartbeat mechanism setting device for a distributed file system provided by an embodiment of the present invention. The device can include:

The sending module 100 is configured to assemble a first heartbeat message according to the state information of all its own OSDs at a preset time interval, and send the first heartbeat message to a corresponding node;

The receiving module 200 is configured to call the heartbeat processing functions of all its own OSDs according to the received second heartbeat message, and update the heartbeat-related information of the OSD corresponding to the second heartbeat message in the PG group information saved by all its own OSDs.

Optionally, the sending module 100 may include:

The sending sub-module is used to send the first heartbeat message to the node where other OSDs are located according to the information of other OSDs in the PG group information stored by each OSD of itself.

Optionally, the receiving module 200 may include:

The heartbeat processing submodule is used to utilize the heartbeat processing function of each OSD to extract the state information of the OSD in the second heartbeat message; traverse the PG group information saved by itself, and judge whether there is an OSD corresponding to the OSD in the second heartbeat message; if , then update the heartbeat related information of the OSD corresponding to the OSD in the second heartbeat message in the PG group information saved by itself.

Optionally, the device may also include:

The second sending module is used to assemble the first heartbeat reply message after the heartbeat processing functions of all OSDs are processed, and send the first heartbeat reply message to the sending node of the heartbeat message;

The second receiving module is used to receive the second heartbeat reply message, call the heartbeat reply processing function of all OSDs of itself, and update the heartbeat state of the OSD corresponding to the second heartbeat reply message; wherein, the second heartbeat reply message is other The heartbeat reply message sent by the node where the OSD is located.

Optionally, the second receiving module may include:

The heartbeat reply processing sub-module is configured to use the heartbeat reply processing function of each OSD to extract the reply message required in the second heartbeat reply message, and update the heartbeat state.

It can be understood that this embodiment is shown by taking a node in the distributed file system as an example, wherein, if the sending module 100 of the node sends the first heartbeat message to the node, that is, the node itself The OSD of the node exists in other OSDs in the PG group information saved by each OSD, then the receiving module 200 of the node can be used to call the heartbeat processing functions of all OSDs of itself according to the received first heartbeat message, and update all the OSDs of the node. The heartbeat-related information of the OSD corresponding to the first heartbeat message in the PG group information stored by the OSDs. That is to say, the second heartbeat message in this embodiment may include the first heartbeat message.

In this embodiment, the embodiment of the present invention uses the sending module 100 to assemble the first heartbeat message according to the state information of all its own OSDs according to the preset time interval, and sends the first heartbeat message to the corresponding node. Next, heartbeat messages are sent between nodes. The heartbeat messages contain the status information of all OSDs on the node, which greatly reduces the number of OSD heartbeat messages, reduces system resource consumption, and improves system stability.

The embodiment of the present invention also provides a computer-readable storage medium on which a computer program is stored. When the computer program is executed, the steps of the method for setting the OSD heartbeat mechanism of the distributed file system provided in the above-mentioned embodiments can be realized. The storage medium may include various media capable of storing program codes such as a U disk, a removable hard disk, a read-only memory (Read-Only Memory, ROM), a random access memory (Random Access Memory, RAM), a magnetic disk or an optical disk.

Each embodiment in the description is described in a progressive manner, each embodiment focuses on the difference from other embodiments, and the same and similar parts of each embodiment can be referred to each other. As for the device and the computer-readable storage medium disclosed in the embodiments, since they correspond to the methods disclosed in the embodiments, the description is relatively simple, and for the relevant details, please refer to the description of the method part.

Professionals can further realize that the units and algorithm steps of the examples described in conjunction with the embodiments disclosed herein can be implemented by electronic hardware, computer software or a combination of the two. In order to clearly illustrate the possible For interchangeability, in the above description, the composition and steps of each example have been generally described according to their functions. Whether these functions are executed by hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art may use different methods to implement the described functions for each specific application, but such implementation should not be regarded as exceeding the scope of the present invention.

The steps of the methods or algorithms described in conjunction with the embodiments disclosed herein may be directly implemented by hardware, software modules executed by a processor, or a combination of both. Software modules can be placed in random access memory (RAM), internal memory, read-only memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, removable disk, CD-ROM, or any other Any other known storage medium.

The method, device and computer-readable storage medium for setting the OSD heartbeat mechanism of the distributed file system provided by the present invention are described above in detail. In this paper, specific examples are used to illustrate the principle and implementation of the present invention, and the descriptions of the above embodiments are only used to help understand the method and core idea of the present invention. It should be pointed out that for those skilled in the art, without departing from the principle of the present invention, some improvements and modifications can be made to the present invention, and these improvements and modifications also fall within the protection scope of the claims of the present invention.

Claims (10)

1. A kind of OSD heartbeat mechanism setting method of distributed file system, it is characterized in that, comprising: The first node assembles a heartbeat message according to the state information of all OSDs of itself according to a preset time interval, and sends the heartbeat message to a corresponding receiving node; Each receiving node calls the heartbeat processing functions of all its own OSDs according to the received heartbeat message, and updates the heartbeat-related information of the OSD corresponding to the heartbeat message in the PG group information stored by all its own OSDs. 2. the OSD heartbeat mechanism setting method of distributed file system according to claim 1, is characterized in that, described heartbeat message is sent on the corresponding receiving node, comprises: The first node sends the heartbeat message to the receiving node where the other OSDs are located according to the information of other OSDs in the PG group information stored by each OSD of the first node. 3. the OSD heartbeat mechanism setting method of distributed file system according to claim 2, it is characterized in that, the heartbeat processing function of all OSDs of described calling self, update the heartbeat message described in the PG group information that all OSDs of self preserve respectively After the heartbeat related information of the corresponding OSD, it includes: The heartbeat processing function of each OSD extracts the state information of the OSD in the heartbeat message; Traverse the PG group information saved by itself, and judge whether there is an OSD corresponding to the OSD in the heartbeat message; If so, update the heartbeat related information of the OSD corresponding to the OSD in the heartbeat message in the PG group information saved by itself. 4. the OSD heartbeat mechanism setting method of distributed file system according to claim 3 is characterized in that, after the heartbeat processing function processing of all OSDs of each said receiving node is completed, it also includes: each of the receiving nodes assembles a heartbeat reply message, and sends the heartbeat reply message to the first node; According to the received heartbeat reply message, the first node invokes the heartbeat reply processing functions of all its own OSDs to update the heartbeat state of its own OSDs corresponding to the heartbeat reply message. 5. the OSD heartbeat mechanism setting method of distributed file system according to claim 4, it is characterized in that, the heartbeat reply processing function of all OSDs of described calling oneself, carry out the heartbeat state to the OSD of described heartbeat reply message correspondence self Updates, including: The heartbeat reply processing function of each OSD extracts the required reply message from the heartbeat reply message, and updates the heartbeat state. 6. An OSD heartbeat mechanism setting device of a distributed file system, characterized in that, comprising: A sending module, configured to assemble a first heartbeat message according to the status information of all its OSDs at preset time intervals, and send the first heartbeat message to a corresponding node; The receiving module is used to call the heartbeat processing functions of all its own OSDs according to the received second heartbeat message, and update the heartbeat related information of the OSD corresponding to the second heartbeat message in the PG group information saved by all its own OSDs. 7. the OSD heartbeat mechanism setting device of distributed file system according to claim 6, is characterized in that, described sending module comprises: The sending sub-module is configured to send the first heartbeat message to the node where the other OSDs are located according to the information of other OSDs in the PG group information stored by each OSD of itself. 8. the OSD heartbeat mechanism setting device of distributed file system according to claim 7, is characterized in that, described receiving module comprises: The heartbeat processing submodule is used to extract the state information of the OSD in the second heartbeat message by using the heartbeat processing function of each OSD; traverse the PG group information saved by itself, and judge whether there is an OSD correspondence in the second heartbeat message If so, update the heartbeat related information of the OSD corresponding to the OSD in the second heartbeat message in the PG group information saved by itself. 9. The OSD heartbeat mechanism setting device of distributed file system according to claim 8, is characterized in that, also comprises: The second sending module is used to assemble the first heartbeat reply message after the heartbeat processing functions of all OSDs are processed, and send the first heartbeat reply message to the sending node of the heartbeat message; The second receiving module is used to receive the second heartbeat reply message, call the heartbeat reply processing function of all OSDs of itself, and update the heartbeat state of its own OSD corresponding to the second heartbeat reply message; wherein, the second heartbeat The reply message is a heartbeat reply message sent by the node where the other OSD is located. 10. A computer-readable storage medium, wherein a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the distribution according to any one of claims 1 to 5 is realized. The steps of the method for setting the OSD heartbeat mechanism of the file system.