CN114301926B - Distributed data transmission method, system and storage medium between server nodes - Google Patents

Abstract

The application discloses a distributed data transmission method, a distributed data transmission system and a distributed data transmission storage medium between server nodes, which relate to the technical field of data transmission and comprise the steps of obtaining order numbers in orders, and obtaining server nodes related to the orders from an order information table according to the order numbers, wherein each server node comprises at least one first server node; the first server node sends data requests to other server nodes except the first server node and judges whether at least one second server node meeting preset conditions exists or not; if the second server node exists, the first server node acquires a test data packet from the second server node; if the second server node does not exist, the first server node acquires the test data packet from the main server. The application can realize the mode of mutually transmitting the data packets among a plurality of servers to improve the data transmission efficiency and greatly improve the data transmission efficiency.

Description

Distributed data transmission method, system and storage medium between server nodes

technical field

The invention relates to the technical field of data transmission, in particular to a distributed data transmission method, system and storage medium between server nodes.

Background technique

With the continuous increase of enterprise scale and customer scale, enterprise orders are showing a trend of blowout. Thousands of machines are produced a day, and thousands of machines are aging at the same time. Due to the products and applications of various new research and development functions, various new components are constantly emerging. These components need to undergo various tests in the production line to ensure that their functions are normal before they can be delivered to customers. Some component test packages are very large, with a capacity of dozens of gigabytes. If the previous diag master server is still used to transmit data to multiple server nodes in a centralized manner, in this case, no amount of network speed is enough. , It is easy to cause a large-scale freeze of the network card in the entire workshop, which seriously affects the production and delivery speed of servers.

Contents of the invention

In order to solve at least one of the problems mentioned in the above-mentioned background technology, the present invention provides a distributed data transmission method, system and storage medium between device nodes, which can realize the mutual transmission of data packets between multiple servers to improve data transmission. Transmission efficiency, so that in the state of an overall server node, only one server needs to download the test package from the main server, and other servers can download the test package from other servers that store the test package in turn, which greatly improves data transmission. s efficiency.

The specific technical scheme that the embodiment of the present invention provides is as follows:

In a first aspect, a distributed data transmission method between server nodes, the method comprising:

Obtain the order number in the order, and obtain the server nodes involved in the order from the order information table according to the order number, and the server nodes include at least one first server node;

The first server node sends a data request to other server nodes except the first server node, and determines whether there is at least one second server node that satisfies a preset condition;

If there is a second server node, the first server node obtains a test data packet from the second server node;

If there is no second server node, the first server node obtains the test data packet from the main server.

Further, before obtaining the server nodes involved in the order from the order information table according to the order number, it also includes building an order information table based on the order number, specifically including:

Obtain the order number in the order body;

Acquiring serial numbers of all server nodes corresponding to the order number according to the order number;

Collect the IP information corresponding to the serial numbers of all server nodes;

Combining the order number, serial numbers and IP information of all server nodes, the order information table is constructed.

Further, the acquiring the server nodes involved in the order from the order information table according to the order number includes:

The IP information of the server nodes involved in the order is obtained from the order information table according to the order number, and the server nodes perform data interaction through the IP information.

Further, the preset conditions include: the second server node communicates with the first server node, the second server node includes the test data packet and confirms the test data in the second server node The data in the package is complete.

Further, it is judged whether the second server node and the first server node are pinged through;

If the ping is successful, the second server node and the first server node communicate with each other, then judge whether the second server node has the test data packet and confirm the data in the test data packet in the second server node is complete; if the second server node has the test data packet and confirms that the data in the test data packet in the second server node is complete, then the second server node exists;

If it cannot be pinged and/or the test data packet does not exist in the second server node and/or the data in the test data packet in the second server node is incomplete, then the second server node does not exist .

Further, the confirming that the data in the test data packet is complete includes:

Obtain the first MD5 value in the main server, and store it in the second server node;

Obtaining a second MD5 value in the test data packet in the second server node, and judging whether the first MD5 value is consistent with the second MD5 value;

If they are consistent, it is confirmed that the data in the test data packet in the second server node is complete; otherwise, the data in the test data packet in the second server node is incomplete.

Further, the test data packets are stored in the main server.

Further, an execution script is set on the first server node, and whether there is at least one second server node satisfying the condition is determined through the execution script.

In the second aspect, a distributed data transmission system between server nodes is provided, which includes a memory, a processor, and a computer program stored on the memory and operable on the processor. When the processor executes the program, the above-mentioned The above-mentioned distributed data transmission method between server nodes.

In a third aspect, a computer-readable storage medium is provided, which stores computer-executable instructions, and the computer-executable instructions are used to execute the above-mentioned distributed data transmission method between server nodes.

Embodiments of the present invention have the following beneficial effects:

1. Through the construction of the order information table, and then whether there is a second server node that meets the conditions in other server nodes, if the second server node is found, the first server node downloads and obtains the test data package from the second server node, so that in All server nodes in the same server body can be used as a data source. When other server nodes need to obtain test data packets, they can be downloaded from the second server node. Aging efficiency, reduce power loss, improve delivery efficiency, and improve customer satisfaction;

2. Through the setting of preset conditions, ensure that the second server node can transmit the test data packet to the first server node, the conditions include that the second server node and the first server node can communicate with each other, and the second server node contains test data package, and the data of the test data package is complete, thereby ensuring that the first server node can download the test data package from the second server node;

3. Using the MD5 value of the main server to compare with the MD5 value in the second server node, judge the integrity of the data in the test data packet in the second server node, and ensure that all servers can complete the test.

Description of drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings that need to be used in the description of the embodiments will be briefly introduced below. Obviously, the drawings in the following description are only some embodiments of the present invention. For those skilled in the art, other drawings can also be obtained based on these drawings without creative effort.

FIG. 1 shows a schematic diagram of a distributed data transmission method between server nodes in the present application;

FIG. 2 shows a schematic diagram of judging whether there is at least one second server node satisfying a preset condition in the present application;

FIG. 3 shows an exemplary system diagram that may be used to implement the various embodiments described in this application.

Detailed ways

In order to make the purpose, technical solutions and advantages of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only Some, but not all, embodiments of the invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

At present, with the continuous increase of enterprise scale and customer scale, enterprise orders are showing a trend of blowout. Thousands of machines are produced a day, and thousands of machines are aging at the same time. Due to the products and applications of various new research and development functions, various new components are constantly emerging. These components need to undergo various tests in the production line to ensure that their functions are normal before they can be delivered to customers. Some component test packages are very large, with a capacity of dozens of gigabytes. If the previous diag master server is still used to transmit data to multiple server nodes in a centralized manner, in this case, no amount of network speed is enough. , It is easy to cause a large-scale freeze of the network card in the entire workshop, which seriously affects the production and delivery speed of servers. Based on the above problems, the inventor of the present application proposes a method and system for distributed data transmission between server nodes, which can realize the mutual transmission of data packets between multiple servers to improve the efficiency of data transmission, so that the entire server node In this state, only one server needs to download the test package from the main server, and other servers can download the test package from other servers storing the test package in turn, which greatly improves the efficiency of data transmission.

Embodiment one

Provide a distributed data transmission method between server nodes, as shown in Figure 1, the method specifically includes:

Step S1: Obtain the order number in the order, and obtain the server node involved in the order from the order information table according to the order number. The server node includes at least one first server node, and the first server node is the server node of the data test package to be downloaded .

Specifically, before obtaining the server nodes involved in the order from the order information table according to the order number, it also includes building an order information table based on the order number, specifically including: obtaining the order number in the order; obtaining the order number according to the order number The serial numbers of all server nodes corresponding to the order number; collect the IP information corresponding to the serial numbers of all server nodes; combine the order number, serial numbers and IP information of all server nodes to build an order information table.

Wherein, after the order information table is constructed, it is used to obtain the IP information of the server nodes involved in the order from the order information table according to the order number, and the server nodes perform data interaction through the IP information.

First, establish the aging server order database (testlog) and data table (ping stuts). After each server node is powered on, store all the collected order numbers, serial numbers and IP information; when each server node is powered on, use MYSQL (relational database management system) inserts language and Shell script, inserts the serial number of server and corresponding IP information in this database, inserts the serial number and corresponding IP information of obtaining server into the above-mentioned established database with the inset statement, Thus, an order information table based on the order number is established. Among them, the serial number of the server is obtained through Ipmitoolfru, and the IP address of the server is obtained through the ifconfig-a command, and the IP address is the IP information.

When multiple servers are powered on and start to age, after the server finishes running the above script inserted into the database, through the select query statement, you can query the correspondence table between the serial numbers of multiple servers and their corresponding IP information, and save the stored IP address Search all IP information according to the order number, and then save it in ip.txt, where each IP corresponds to a server node, and then forms an order information table corresponding to the IP information. The order information table is stored in all server nodes including the first server node.

Step S2: As shown in FIG. 1 , the first server node sends a data request to other server nodes except the first server node, and judges whether there is at least one second server node satisfying the preset condition. Wherein, the test data packets are also stored in the main server. Wherein, an execution script is set on the first server node, and it is judged whether there is at least one second server node satisfying the condition by executing the script.

If there is a second server node among other server nodes, the first server node downloads and obtains the test data packet from the second server node. If there is no second server node in other server nodes, then the first server node downloads and obtains the test data packet from the master server,

Specifically, a loop statement is used to perform a ping operation on each server node in ip.txt, and determine whether there is a second server node satisfying the condition among other server nodes except the first server node. Wherein, the conditions that need to be satisfied include, (1) the second server node can communicate with the first server node (ie, ping through); (2) there is a test data packet stored in the second server node; (3) confirm that the first The data in the test data packet in the second server node is complete. Only when the second server node satisfies at least the above three conditions at the same time can it be confirmed as the second server node.

Specifically, at first judge whether the second server node and the first server node are pinged; The data in the test package in the second server node is complete. At this time, if the second server node has the test data packet and confirms that the data in the test data packet in the second server node is complete, then there is the second server node.

If the following three situations: 1) can not be pinged; 2) the second server node does not have the test data packet; 3) or the test data packet in the second server node is incomplete; There is no second server node.

Among them, the data in the test data packet is confirmed to be complete based on the MD5 value. The MD5 value is a hash function. Any data passing through MD5 will generate a 16-bit value or a 32-bit value. MD5 has two important properties. The first is that it cannot be reversed. Only the value generated by the MD5 value cannot be reversed to the original data. The second is that as long as there is a slight change in the original data, the MD5 value will change greatly. Based on this, the MD5 value can be used for file verification.

Specifically comprise the following steps: obtain the first MD5 value in the master server, and store in the second server node; meanwhile, obtain the second MD5 value in the test data packet in the second server node, and then judge the first MD5 Whether the value is consistent with the second MD5 value.

If the first MD5 value is consistent with the second MD5 value, it is confirmed that the data in the test data packet in the second server node is complete. Otherwise, the data in the test data packet in the second server node is incomplete, indicating that there is no second server node in other server nodes. At this time, the first server node obtains the test data packet from the main service.

In the actual operation process, it is easy for the second server node to be shut down due to the completion of the test or the network cannot be connected due to other reasons. At this time, other servers to be tested can download and obtain the test from the first server node that has downloaded the test data package. Data packets, and so on, all servers in the same overall server node can provide test data packet services to other servers to be tested if the conditions are met, so as to realize distributed data transmission between multiple servers .

For example, an order contains 200 servers, and the 200 servers all belong to the same overall server body. Set the No. 1 server to be tested as the first server node, first collect the information of 200 servers to be tested, and build an order information table based on IP information, which is stored in all server nodes. Then, based on the order information table, it is judged whether there is a second server node that satisfies the conditions in other servers except the No. 1 server, and through the verification of the conditions one by one; Obtain the test data packet on the server node; if there is no second server node, at this time, the No. 1 server obtains the test data packet from the main server.

Specifically, when there is a second server node, after the No. 1 server downloads and obtains the test data package from the second server node, both the No. 1 server and the second server store the test data package. At this time, the first server and the second server can be used as a data source to transmit data to other servers to be tested. In this mode, the data source of data transmission is greatly increased, the efficiency of the overall data transmission of the order in the workshop is greatly improved, and the aging efficiency of the entire order is improved; the aging time is reduced, the power consumption is reduced, and the delivery speed is also improved. Customer satisfaction will also increase significantly.

Embodiment two

Corresponding to the above-mentioned embodiments, a distributed data transmission system between server nodes is provided, including a memory, a processor, and a computer program stored on the memory and operable on the processor. When the processor executes the program, it realizes The above-mentioned distributed data transmission method between server nodes.

Specifically, it includes an information collection module, an information construction module, a data request module, a data judgment module and an instruction execution module.

The information collection module is used to collect information of all server nodes, including order number, serial number and IP information.

The information construction module is used to construct an order information table corresponding to the IP information according to the collected order numbers, serial numbers and IP information of all server nodes.

In the data request module, the first server node to be tested sends a data request, and the data request is used to search for the second server node and the test data packets stored on the second server node.

The data judging module, based on the order information table, judges whether there is at least one second server node satisfying the condition among other server nodes except the first server node.

The command execution module executes the corresponding command according to the judgment result of the data judgment module. If there is a second server node, the first server node obtains the test data packet from the second server node; if there is no second server node, the first server node obtains the test data packet from the second server node.

An exemplary system that may be used to implement various embodiments described in this application is shown in FIG. 3 .

In some embodiments, the system can provide the above-mentioned device as a distributed data transmission method between server nodes in any one of the above-mentioned embodiments. In some embodiments, a system may include one or more computer-readable media (e.g., system memory or NVM/storage devices) having instructions and coupled to the one or more computer-readable media and configured to execute the instructions to One or more processors (eg, processor(s)) that implement a module such that the actions described in this application are performed.

For one embodiment, the system control module may include any suitable interface controller to provide any suitable interface.

The system control module may include a memory controller module to provide an interface to the system memory. A memory controller module may be a hardware module, a software module and/or a firmware module.

System memory may be used, for example, to load and store data and/or instructions for the system. For one embodiment, system memory may include any suitable volatile memory, such as suitable DRAM. In some embodiments, the system memory may include Double Data Rate Type Quad Synchronous Dynamic Random Access Memory (DDR4 SDRAM).

For one embodiment, the system control module may include one or more input/output (I/O) controllers to provide interfaces to NVM/storage devices and communication interface(s).

For example, NVM/storage devices may be used to store data and/or instructions. The NVM/storage device may include any suitable non-volatile memory (e.g., flash memory) and/or may include any suitable non-volatile storage device(s) (e.g., one or more hard disk drives (HDD ), one or more compact disc (CD) drives, and/or one or more digital versatile disc (DVD) drives).

NVM/storage devices may include storage resources that are physically part of the device on which the system is installed, or may be accessed by the device without necessarily being part of the device. For example, NVM/storage devices may be accessed over a network via communication interface(s).

The communication interface(s) may provide the system with an interface to communicate over one or more networks and/or with any other suitable device. The system may communicate wirelessly with one or more components of the wireless network according to any of one or more wireless network standards and/or protocols.

In various embodiments, a system may be, but is not limited to, a server, workstation, desktop computing device, or mobile computing device (eg, laptop computing device, handheld computing device, tablet computer, netbook, etc.). In various embodiments, the system may have more or fewer components and/or a different architecture. For example, in some embodiments, a system includes one or more cameras, a keyboard, a liquid crystal display (LCD) screen (including a touchscreen display), a non-volatile memory port, multiple antennas, a graphics chip, an application-specific integrated circuit (ASIC) ) and speakers.

In addition, a part of the present application can be applied as a computer program product, such as a computer program instruction. When it is executed by a computer, the method and/or technical solution according to the present application can be invoked or provided through the operation of the computer. Those skilled in the art should understand that computer program instructions exist in computer-readable media in forms including but not limited to source files, executable files, installation package files, etc. Limited to: the computer directly executes the instruction, or the computer compiles the instruction and then executes the corresponding compiled program, or the computer reads and executes the instruction, or the computer reads and installs the instruction and then executes the corresponding post-installation program program. Here, a computer readable medium may be any available computer readable storage medium or communication medium that can be accessed by a computer.

Communication media includes the media whereby communication signals embodying, for example, computer readable instructions, data structures, program modules or other data are transmitted from one system to another. Communication media can include guided transmission media such as cables and wires (e.g., fiber optics, coaxial, etc.) and wireless (unguided transmission) media capable of propagating waves of energy, such as acoustic, electromagnetic, RF, microwave, and infrared . Computer readable instructions, data structures, program modules or other data may be embodied, for example, as a modulated data signal in a wireless medium such as a carrier wave or similar mechanism such as embodied as part of spread spectrum technology. The term "modulated data signal" means a signal that has one or more of its characteristics changed or set in such a manner as to encode information in the signal. Modulation can be analog, digital or mixed modulation techniques.

Here, an embodiment according to the present application includes an apparatus comprising a memory for storing computer program instructions and a processor for executing the program instructions, wherein when the computer program instructions are executed by the processor, triggering The operation of the device is based on the foregoing methods and/or technical solutions according to multiple embodiments of the present application.

Embodiment three

Corresponding to the above embodiments, the present application further provides a computer-readable storage medium storing computer-executable instructions, and the computer-executable instructions are used to execute the above-mentioned distributed data transmission method between server nodes.

In this embodiment, computer-readable storage media may include volatile and non-volatile, volatile, volatile, or Removable and non-removable media. For example, computer-readable storage media include, but are not limited to, volatile memories such as random access memories (RAM, DRAM, SRAM); and nonvolatile memories such as flash memory, various read-only memories (ROM, PROM, EPROM) , EEPROM), magnetic and ferromagnetic/ferroelectric memory (MRAM, FeRAM); and magnetic and optical storage devices (hard disks, tapes, CDs, DVDs); or other media known now or developed in the future capable of storing data for computer systems Computer readable information/data used.

Having described the preferred ones of the embodiments of the present invention, additional changes and modifications can be made to these embodiments by those skilled in the art once the basic inventive concepts are apprehended. Therefore, the appended claims are intended to be interpreted to cover the preferred embodiment and all changes and modifications that fall within the scope of the embodiments of the present invention.

Obviously, those skilled in the art can make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, if these modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalent technologies, the present invention also intends to include these modifications and variations.

Claims (8)

1. A distributed data transmission method between server nodes, characterized in that the method comprises: Build an order information table based on the order number; Obtain the order number in the order, and obtain the server nodes involved in the order from the order information table according to the order number, and the server nodes include at least one first server node; The first server node sends a data request to other server nodes except the first server node, and determines whether there is at least one second server node that satisfies a preset condition; If there is a second server node, the first server node obtains a test data packet from the second server node; If there is no second server node, the first server node obtains the test data packet from the main server; The construction of the order information table based on the order number specifically includes: obtaining the order number in the order body; obtaining the serial numbers of all server nodes corresponding to the order number according to the order number; collecting the serial numbers of all server nodes No. corresponding IP information; In conjunction with the order number, serial numbers and IP information of all server nodes, build the order information table; The preset conditions include: the second server node communicates with the first server node, the second server node includes the test data packet, and confirms the data in the test data packet in the second server node it `s complete. 2. The method according to claim 1, wherein said obtaining the server node involved in the order from the order information table according to the order number comprises: The IP information of the server nodes involved in the order is obtained from the order information table according to the order number, and the server nodes perform data interaction through the IP information. 3. The method according to claim 1, wherein judging whether the second server node and the first server node are pinged through; If the ping is successful, the second server node and the first server node communicate with each other, then judge whether the second server node has the test data packet and confirm the data in the test data packet in the second server node is complete; if the second server node has the test data packet and confirms that the data in the test data packet in the second server node is complete, then the second server node exists; If it cannot be pinged and/or the test data packet does not exist in the second server node and/or the data in the test data packet in the second server node is incomplete, then the second server node does not exist . 4. The method according to claim 3, wherein the confirming that the data in the test data packet in the second server node is complete includes: Obtain the first MD5 value in the main server, and store it in the second server node; Obtaining a second MD5 value in the test data packet in the second server node, and judging whether the first MD5 value is consistent with the second MD5 value; If they are consistent, it is confirmed that the data in the test data packet in the second server node is complete; otherwise, the data in the test data packet in the second server node is incomplete. 5. The method according to claim 1, characterized in that: said test data packets are stored in said main server. 6 . The method according to claim 1 , wherein an execution script is set on the first server node, and whether there is at least one second server node satisfying the condition is judged through the execution script. 7 . 7. A distributed data transmission system between server nodes, comprising a memory, a processor, and a computer program stored on the memory and operable on the processor, characterized in that: when the processor executes the program, the following The distributed data transmission method between server nodes according to any one of claims 1 to 6. 8. A computer-readable storage medium, storing computer-executable instructions, the computer-executable instructions being used to make a computer execute the distributed data transmission method between server nodes according to any one of claims 1-6.