CN115022181A

CN115022181A - Information synchronization method, device, equipment and medium based on ROCE-SAN

Info

Publication number: CN115022181A
Application number: CN202210543104.1A
Authority: CN
Inventors: 何泽兵; 金义
Original assignee: Inspur Cisco Networking Technology Co Ltd
Current assignee: Inspur Network Technology Shandong Co ltd
Priority date: 2022-05-18
Filing date: 2022-05-18
Publication date: 2022-09-06
Anticipated expiration: 2042-05-18

Abstract

The embodiment of the specification discloses an information synchronization method based on ROCE-SAN, which comprises the following steps: configuring monitoring equipment and member equipment in a preset ROCE-SAN network topological graph, wherein the monitoring equipment monitors and broadcasts change information related to the member equipment, and the member equipment subscribes the change information broadcast by the monitoring equipment; if the monitoring equipment monitors the current change information related to the member equipment, the current change information is broadcasted through the monitoring equipment, the member equipment subscribing the change information broadcasted by the monitoring equipment receives the current change information, and the information in the member equipment is synchronized according to the current change information.

Description

Information synchronization method, device, equipment and medium based on ROCE-SAN

Technical Field

The present disclosure relates to the field of communications engineering technologies, and in particular, to a method, an apparatus, a device, and a medium for information synchronization based on an rock-SAN.

Background

As global network digitization has accelerated, user demands for network devices have shifted from focused business processing capabilities to data efficient processing capabilities. In order to improve the data processing performance, the ROCE (RDMA over converted Ethernet) technology uses an RDMA protocol carried by Ethernet, thereby reducing the CPU consumption and the time delay and improving the data processing efficiency. Currently, storage access services are provided to various business systems by industry using primarily FC-SAN and IP-SAN networks. The FC-SAN is applied to a centralized storage service with higher requirements on reliability, has the advantages of zero packet loss and high reliability, but also has the problems of technical closure, single supplier, high purchase and maintenance cost and the like; the IP-SAN is suitable for distributed storage service with low IOPS performance requirement, has the advantages of openness and low cost, but as the bandwidth of a server network card is increased to 25G from ten trillion and a distributed storage medium is evolved from a HDD to an SSD, the IP-SAN network becomes the bottleneck of IOPS improvement of the whole service system. RoCE-SAN is a high-performance storage area network based on RoCE protocol, has the characteristics of zero packet loss, low time delay, plug and play, rapid fault convergence and the like, can have the advantages of FC-SAN and IP-SAN, and realizes the fusion of FC-SAN and IP-SAN.

In the prior art, the switches mostly adopt a TCP connection mode to transmit synchronous information, the efficiency is low, and the requirements of users cannot be met.

Disclosure of Invention

One or more embodiments of the present specification provide a method, an apparatus, a device, and a medium for information synchronization based on rock-SAN, which are used to solve the following technical problems:

One or more embodiments of the present disclosure adopt the following technical solutions:

one or more embodiments of the present specification provide a method for information synchronization based on a rock-SAN, including:

configuring monitoring equipment and member equipment in a preset ROCE-SAN network topological graph, wherein the monitoring equipment monitors and broadcasts change information related to the member equipment, and the member equipment subscribes the change information broadcast by the monitoring equipment;

if the monitoring equipment monitors the current change information related to the member equipment, the current change information is broadcasted through the monitoring equipment, the member equipment subscribing the change information broadcasted by the monitoring equipment receives the current change information, and the information in the member equipment is synchronized according to the current change information.

One or more embodiments of the present specification provide an information synchronization apparatus based on a rock-SAN, including:

the configuration unit is used for configuring monitoring equipment and member equipment in a preset ROCE-SAN network topological graph, wherein the monitoring equipment monitors and broadcasts change information related to the member equipment, and the member equipment subscribes the change information broadcast by the monitoring equipment;

and the information synchronization unit broadcasts the current change information through the monitoring equipment if the monitoring equipment monitors the current change information related to the member equipment, receives the current change information through the member equipment subscribing the change information broadcast by the monitoring equipment, and synchronizes the information in the member equipment according to the current change information.

at least one processor; and the number of the first and second groups,

a memory communicatively coupled to the at least one processor; wherein,

the memory stores instructions executable by the at least one processor to enable the at least one processor to:

One or more embodiments of the present specification provide a non-transitory computer storage medium storing computer-executable instructions configured to:

The embodiment of the specification adopts at least one technical scheme which can achieve the following beneficial effects:

the information synchronization method based on the ROCE-SAN in the embodiment of the description is applied to the ROCE-SAN network, can synchronize important information such as equipment online, configuration change, fault notification and the like in a network topology in real time, so as to quickly respond to network topology change and configuration change and ensure that ROCE-SAN network equipment realizes plug and play and quick convergence.

Drawings

In order to more clearly illustrate the embodiments of the present specification or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly introduced below, it is obvious that the drawings in the following description are only some embodiments described in the present specification, and for those skilled in the art, other drawings can be obtained according to the drawings without any creative effort. In the drawings:

fig. 1 is a schematic structural diagram of a rock information synchronization system according to one or more embodiments of the present disclosure;

FIG. 2 is a schematic flow chart of a ROCE-SAN based information synchronization method according to one or more embodiments of the present disclosure;

FIG. 3 is a diagram of a ROCE-SAN network topology provided by one or more embodiments of the present description;

FIG. 4 is a diagram of a ROCE-SAN information synchronization scheme as provided by one or more embodiments of the present disclosure;

FIG. 5 is a schematic diagram illustrating a structure of an information synchronization apparatus based on ROCE-SAN according to one or more embodiments of the present disclosure;

fig. 6 is a schematic structural diagram of an information synchronization apparatus based on a rock-SAN according to one or more embodiments of the present disclosure.

Detailed Description

The embodiment of the specification provides an information synchronization method, device, equipment and medium based on ROCE-SAN.

Fig. 1 is a schematic structural diagram of an ROCE information synchronization system, which may be composed of a configuration information synchronization server, an equipment information synchronization server, and a plurality of clients. The client registers related configuration information and equipment information in the configuration information synchronization server and the equipment information synchronization server in advance, the configuration information synchronization server and the equipment information synchronization server are used as data transfer stations, and the configuration information synchronization server and the equipment information synchronization server are used for transmitting change information to other clients, so that the configuration information and the equipment information of the client are updated and synchronized in time.

In the synchronization process of the synchronization system, the following problems exist:

1. the configuration information and the equipment information need to start a dedicated server, consume hardware resources and are not beneficial to equipment maintenance;

2. when a link between the client device and the server device is abnormal, both the configuration information and the device information cannot be effectively updated and synchronized to other devices, and the reliability of network topology is poor;

3. the deployment is complex, and the configuration information and the device information need to be registered in software or a server in advance. For unregistered device information or configuration information, rapid expansion and flexible deployment cannot be achieved, and the applicability is poor;

4. the information synchronous transmission lacks safe encryption, and the information effectiveness and safety cannot be ensured;

5. the method has low information transmission efficiency, and the method adopts the traditional TCP end-to-end mode to transmit the synchronous information during information transmission, thereby having low efficiency and complex realization.

In order to make those skilled in the art better understand the technical solutions in the present specification, the technical solutions in the embodiments of the present specification will be clearly and completely described below with reference to the drawings in the embodiments of the present specification, and it is obvious that the described embodiments are only a part of the embodiments of the present specification, and not all of the embodiments. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments of the present specification without any creative effort shall fall within the protection scope of the present specification.

Fig. 2 is a schematic flowchart of an information synchronization method based on an ROCE-SAN according to one or more embodiments of the present disclosure, where the process may be performed by an information synchronization system, and the system may improve efficiency of synchronizing information to meet a user's requirement. Certain input parameters or intermediate results in the flow allow for manual intervention adjustments to help improve accuracy.

The method of the embodiment of the specification comprises the following steps:

s202, configuring monitoring equipment and member equipment in a preset ROCE-SAN network topological graph, wherein the monitoring equipment monitors and broadcasts change information related to the member equipment, and the member equipment subscribes the change information broadcast by the monitoring equipment.

In the embodiment of the present specification, the listening device and the member device are both switches in the ROCE-SAN network topology. When monitoring equipment and member equipment are configured in a preset ROCE-SAN network topology graph, the IP address of each exchanger equipment can be determined in the preset ROCE-SAN network topology graph; detecting whether the IP address of each switch device is the same as a preset monitoring IP address through a spine server IP command; if the IP address of the first switch is the same as the preset monitoring IP address, setting the first switch as the monitoring equipment; and if the IP address of the second switch is different from the preset monitoring IP address, setting the second switch as the member equipment.

S204, if the monitoring equipment monitors the current change information related to the member equipment, the current change information is broadcasted by the monitoring equipment, the current change information is received by the member equipment subscribing the change information broadcasted by the monitoring equipment, and the information in the member equipment is synchronized according to the current change information.

In this embodiment, the change information related to the member device may be one or more of information related to the newly added member device, information related to the additionally configured member device, and information related to the failure of the member device.

In this embodiment, when the change information related to the member device is related to a newly added member device, if the monitoring device monitors current change information related to the member device, the monitoring device broadcasts the current change information, the member device subscribing to the change information broadcast by the monitoring device receives the current change information, and synchronizes information in the member device according to the current change information, specifically, the method may include:

if the ROCE-SAN network topology map newly added member equipment, the related information of the newly added member equipment can be sent to the monitoring equipment; and then broadcasting the related information of the newly added member equipment through the monitoring equipment, receiving the related information of the newly added member equipment through the member equipment subscribing the change information broadcasted by the monitoring equipment, and synchronizing the information in the member equipment according to the related information of the newly added member equipment. In addition, the change information related to the member device may also be information related to the member device going offline.

In this embodiment of the present specification, when the change information related to the member device is added with the configured related information for the member device; if the monitoring device monitors the current change information related to the member device, the current change information is broadcasted by the monitoring device, the current change information is received by the member device subscribing the change information broadcasted by the monitoring device, and the information in the member device is synchronized according to the current change information, which specifically can be:

if the member devices in the ROCE-SAN network topology graph increase configuration, the related information of the member devices increasing configuration can be sent to the monitoring device; and then broadcasting the related information of the increased configuration of the member equipment by the monitoring equipment, receiving the related information of the increased configuration of the member equipment by the member equipment subscribing the change information broadcasted by the monitoring equipment, and synchronizing the information in the member equipment according to the related information of the increased configuration of the member equipment.

In this embodiment of the present specification, when the change information related to the member device is related to a failure of the member device; if the monitoring device monitors the current change information related to the member device, the current change information is broadcasted by the monitoring device, the current change information is received by the member device subscribing the change information broadcasted by the monitoring device, and the information in the member device is synchronized according to the current change information, which specifically can be:

if the member equipment in the ROCE-SAN network topology graph fails, the related information of the failure of the member equipment can be firstly sent to the monitoring equipment; and broadcasting the related information of the member equipment fault through the monitoring equipment, receiving the related information of the member equipment fault through the member equipment subscribing the change information broadcasted by the monitoring equipment, and synchronizing the information in the member equipment according to the related information of the member equipment fault.

In this embodiment, the current change information is broadcasted by the monitoring device, and the member device subscribing to the change information broadcasted by the monitoring device receives the current change information, when the current change information is received, the current change information is broadcasted to a preset information channel by the monitoring device, and then the current change information is received in the information channel by the member device subscribing to the change information broadcasted by the monitoring device.

It should be noted that the information channels may be individually set according to the type of the change information related to the member device, that is, when the change information related to the member device is newly added with the related information of the member device, the configured related information is added to the member device, or the related information of the failure of the member device, the change information may correspond to different information channels, so that different types of information may be synchronized simultaneously, and the efficiency of information synchronization is faster.

Further, the listening devices of the embodiments of the present specification may include a master listening device and a slave listening device. When the master monitoring equipment is not in fault, the slave monitoring equipment does not broadcast the current change information to the information channel so as to avoid the information redundancy caused by the synchronous information of the master monitoring equipment and the slave monitoring equipment; when the main monitoring equipment fails, the current change information is broadcasted to the information channel by the auxiliary monitoring equipment, so that the auxiliary monitoring equipment can still synchronize the information when the main monitoring equipment fails, and the stable operation of an information synchronization system is ensured.

Further, in this embodiment of the present specification, if the monitoring device monitors current change information related to the member device, the current change information may be encrypted, so that the actual content of the current change information is not obtained by the monitoring device, and leakage of the current change information may be effectively prevented. The member device subscribing to the change information broadcast by the monitoring device may determine the encryption mode of the current change information and then decrypt the current change information after receiving the current change information.

In the embodiment of the present specification, information publishing and subscribing may be implemented by deploying an mqtt kernel. The configuration synchronization of the ROCE-SAN network (corresponding to the related information of the mentioned member device for increasing the configuration) and the device information synchronization (corresponding to the related information of the mentioned new member device) can be realized by starting the mqtt-server or the mqtt-client on the switch device in the ROCE-SAN network to transmit the device information or the configuration information.

The technical scheme of the embodiment of the specification is as follows:

1. the configuration part: see figure 3 for a diagram of the ROCE-SAN network topology.

1) In an ROCE-SAN network topology diagram, according to a Spine server ip command, whether a switch ip is a preconfigured server ip is checked, if the switch ip is the same as the server ip, a role of the switch is configured to be a row server device (Spine 1 and Spine2 in FIG. 3), and a process of the row server device is started.

2) If the difference between the ip of the switch and the ip of the server is detected, the role of the switch is configured to be a race client device (Leaf 1, Leaf2, Leaf3 and Leaf4 in fig. 3), and the process of the race client device is started.

3) The information encryption mode is not encrypted by default, and the information encryption type can be configured through a rock encrypt mode ssl/md5 command.

It should be noted that the race server device is a monitoring device in the above-mentioned scheme, and the race client device is a member device in the above-mentioned scheme

2. The realization process comprises the following steps:

1) after the race server equipment is started, three information types of equipment information, configuration information and fault information are monitored, wherein the equipment information corresponds to the related information of the newly added member equipment in the scheme, the configuration information corresponds to the related information of the additionally configured member equipment in the scheme, and the fault information corresponds to the related information of the fault of the member equipment in the scheme;

2) after the race client equipment is started, three information types of equipment information, configuration information and fault information are subscribed to the race server equipment;

3) the method comprises the steps that a race client device starts to send heartbeat information to a race server device, wherein the heartbeat information comprises information such as a self device model, version information and a configuration server ip;

4) after receiving heartbeat information of the line client equipment, the line server equipment maintains network topology information, if the topology of the connected line server equipment is increased, namely the condition that the line client equipment is increased, the newly added line client equipment can send the heartbeat information to the line server equipment and can issue the information to a DEV _ INFO _ MSG channel, and other line client equipment subscribing the DEV _ INFO _ MSG information can receive the information and update local network topology equipment information to realize equipment information updating;

5) when a user adds configuration to any equipment in the ROCE-SAN network, the configured equipment encrypts the added configuration information (if the user configures an encryption mode) and sends the encrypted configuration information to a DEV _ CONF _ MSG channel of the race server equipment;

6) the method comprises the steps that a piece of race client equipment which subscribes DEV-CONF-MSG channel information receives equipment configuration information, decrypts the equipment configuration information according to a corresponding encryption mode, and sends the configuration information to the equipment;

7) when equipment fails, such as port up/down or other failures, failure information is sent to a DEV _ FAULT _ MSG channel of the route server equipment;

8) other subscribing 'DEV _ FAULT _ MSG' channel information devices respond according to logic;

in this embodiment of the present description, a master monitoring device (master server) and a slave monitoring device (slave server) may be set for a monitoring device, and as shown in an ROCE-SAN information synchronization scheme design diagram shown in fig. 4, in an ROCE-SAN network, roles of a line server and a line client exist, and the line server may configure the roles of the master server and the slave server. When the link has no fault, the slave race server does not issue related information to the information channel, so that the information redundancy is avoided and the processing efficiency is reduced; when the link fails, the ROCE-SAN network information synchronization system automatically detects the link failure, and the once server has a master-slave switching function and automatically switches the service to the slave once server equipment to form a high-efficiency and safe redundant backup link, so that the reliability of the network system is improved.

3. Encryption and decryption

1) When a user configures a corresponding encryption mode and sends information, the information body is encrypted by using a corresponding mode, and an information header is ignored;

2) after receiving the information, the race server equipment does not carry out decryption and carries out information distribution according to the type of the information header;

3) and after receiving the information, the pace client equipment selects a corresponding decryption mode to decrypt the information according to the configured encryption mode.

It should be noted that, in the embodiments of the present description, the information synchronization server of the ROCE-SAN network and the client can be integrated, and by configuring the roles of the information synchronization monitoring device and the member devices on the switch, the hardware resource consumption and cost are greatly reduced, and the device maintenance is facilitated; meanwhile, the embodiment of the specification realizes an information publishing and subscribing mechanism, supports a client to subscribe various information at the same time, has high information synchronization efficiency due to a plurality of servers, and reduces the error rate of information transmission; in addition, the deployment of the embodiment of the description is simple, the embodiment of the description can be directly deployed on the switch device, the role switching of the client/server of the network device can be realized through the configuration command, or the client and the server are operated simultaneously, and the deployment is flexible and easy to expand.

It should be noted that, in the embodiments of the present specification, all the synchronization information channels support multiple encryption manners including SSL, md5, and the security of the synchronization information is ensured. The encryption mode is flexibly selected, service butt joint is facilitated, the barrier of the butt joint of an obstructed system is reduced, and the application expansibility is increased. Meanwhile, the mqtt kernel is adopted to realize the publishing and subscribing of the synchronous information, so that the information synchronization efficiency is high, and the upgrading is convenient by using the open-source kernel. In addition, the method has the function of master-slave switching of the race server, when the link fails, the master server is seamlessly switched to the slave server, the service is guaranteed to operate stably by seamless connection, and the stability of the ROCE-SAN network is improved.

It should be noted that an ROCE-SAN network generally comprises a server, a switching device, and a storage device, and an information synchronization method based on an ROCE-SAN in the embodiment of the present specification is applied to an ROCE-SAN network, and can synchronize important information such as device online, offline, configuration change, and fault notification in a network topology in real time, so as to quickly respond to network topology change and configuration change, and ensure that the ROCE-SAN network device realizes plug and play and fast convergence.

Fig. 5 is a schematic structural diagram of an information synchronization apparatus based on rock-SAN, provided in one or more embodiments of the present specification, including: a configuration unit 502 and an information synchronization unit 504.

A configuration unit 502, configured to configure a monitoring device and a member device in a preset ROCE-SAN network topology map, where the monitoring device monitors and broadcasts change information related to the member device, and the member device subscribes to the change information broadcast by the monitoring device;

an information synchronization unit 504, configured to broadcast the current change information through the monitoring device if the monitoring device monitors the current change information related to the member device, receive the current change information through the member device subscribing to the change information broadcast by the monitoring device, and synchronize information in the member device according to the current change information.

Fig. 6 is a schematic structural diagram of an information synchronization apparatus based on a rock-SAN according to one or more embodiments of the present specification, where the structural diagram includes:

at least one processor; and the number of the first and second groups,

a memory communicatively coupled to the at least one processor; wherein,

if the monitoring equipment monitors the current change information related to the member equipment, the current change information is broadcasted through the monitoring equipment, the member equipment which subscribes the change information broadcasted by the monitoring equipment receives the current change information, and the information in the member equipment is synchronized according to the current change information.

The embodiments in the present specification are described in a progressive manner, and the same and similar parts among the embodiments are referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, for the embodiments of the apparatus, the device, and the nonvolatile computer storage medium, since they are substantially similar to the embodiments of the method, the description is simple, and for the relevant points, reference may be made to the partial description of the embodiments of the method.

The foregoing description has been directed to specific embodiments of this disclosure. Other embodiments are within the scope of the following claims. In some cases, the actions or steps recited in the claims may be performed in a different order than in the embodiments and still achieve desirable results. In addition, the processes depicted in the accompanying figures do not necessarily require the particular order shown, or sequential order, to achieve desirable results. In some embodiments, multitasking and parallel processing may also be possible or may be advantageous.

The above description is merely one or more embodiments of the present disclosure and is not intended to limit the present disclosure. Various modifications and alterations to one or more embodiments of the present description will be apparent to those skilled in the art. Any modification, equivalent replacement, improvement or the like made within the spirit and principle of one or more embodiments of the present specification should be included in the scope of the claims of the present specification.

Claims

1. An information synchronization method based on ROCE-SAN is characterized by comprising the following steps:

2. The method of claim 1, wherein the change information related to the member device is one or more of information related to a newly added member device, information related to a member device added configuration, and information related to a member device failure.

3. The method according to claim 1, wherein when the change information related to the member device is related to a new member device, if the monitoring device monitors current change information related to the member device, the monitoring device broadcasts the current change information, the member device subscribing to the change information broadcast by the monitoring device receives the current change information, and synchronizes information in the member device according to the current change information, specifically comprising:

if the ROCE-SAN network topology graph newly-added member equipment exists, sending the related information of the newly-added member equipment to the monitoring equipment;

and broadcasting the related information of the newly added member equipment through the monitoring equipment, receiving the related information of the newly added member equipment through the member equipment subscribing the change information broadcasted by the monitoring equipment, and synchronizing the information in the member equipment according to the related information of the newly added member equipment.

4. The method according to claim 1, wherein the broadcasting the current change information by the listening device, and receiving the current change information by the member device subscribing to the change information broadcast by the listening device, specifically comprises:

broadcasting the current change information to a preset information channel through the monitoring equipment, and receiving the current change information in the information channel through the member equipment subscribing the change information broadcasted by the monitoring equipment.

5. The method of claim 4, wherein the listening devices comprise a master listening device and a slave listening device;

when the master monitoring equipment does not fail, the slave monitoring equipment does not broadcast the current change information to the information channel;

and broadcasting the current change information to the information channel through the slave monitoring equipment when the master monitoring equipment fails.

6. The method of claim 1, wherein before the listening device monitors current change information associated with the member device, the method further comprises:

encrypting the current change information;

after the member device subscribing to the change information broadcast by the monitoring device receives the current change information, the method further includes:

and determining the encryption mode of the current change information, and decrypting the current change information.

7. The method according to claim 1, wherein the configuring listening devices and member devices in a preset rock-SAN network topology map specifically comprises:

determining the IP address of each switch device in a preset ROCE-SAN network topology graph;

detecting whether the IP address of each switch device is the same as a preset monitoring IP address or not through a spine server IP command;

if the IP address of the first switch is the same as the preset monitoring IP address, setting the first switch as the monitoring equipment;

and if the IP address of the second switch is different from the preset monitoring IP address, setting the second switch as the member equipment.

8. An information synchronization apparatus based on ROCE-SAN, comprising:

9. An information synchronization apparatus based on ROCE-SAN, comprising:

at least one processor; and the number of the first and second groups,

a memory communicatively coupled to the at least one processor; wherein,

10. A non-transitory computer storage medium having stored thereon computer-executable instructions configured to: