CN113157611A - Data transmission control method, device, equipment and readable storage medium - Google Patents
Data transmission control method, device, equipment and readable storage medium Download PDFInfo
- Publication number
- CN113157611A CN113157611A CN202110218552.XA CN202110218552A CN113157611A CN 113157611 A CN113157611 A CN 113157611A CN 202110218552 A CN202110218552 A CN 202110218552A CN 113157611 A CN113157611 A CN 113157611A
- Authority
- CN
- China
- Prior art keywords
- data
- identifications
- feedback result
- distributed
- node
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F13/00—Interconnection of, or transfer of information or other signals between, memories, input/output devices or central processing units
- G06F13/14—Handling requests for interconnection or transfer
- G06F13/36—Handling requests for interconnection or transfer for access to common bus or bus system
- G06F13/362—Handling requests for interconnection or transfer for access to common bus or bus system with centralised access control
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Communication Control (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The application discloses a data transmission control method, a data transmission control device, data transmission control equipment and a readable storage medium, wherein data identifications used for marking the sequence of data reading commands are designed, the data identifications which correspond to the data reading commands to be distributed are distributed on a first node in sequence, the data reading commands carrying the data identifications are obtained and sent to a second node, data feedback results which are returned by the second node and also carry the data identifications are received and stored in a first storage space, the data feedback results are processed according to the data identifications, and in the whole process, the quantity of the distributed data identifications does not exceed the total quantity of the preset data identifications. The data transmission control method provided by the application can simultaneously transmit a plurality of data reading commands and a plurality of data feedback results on the basis of ensuring the positive sequence transmission of data, ensures the processing of the plurality of data feedback results through presetting the first storage space, avoids data loss, and improves the data transmission efficiency on the basis of ensuring the positive sequence transmission processing of the data.
Description
Technical Field
The present application relates to the field of data transmission technologies, and in particular, to a data transmission control method, apparatus, device, and readable storage medium.
Background
In the prior art environment scheme, in order to ensure the data forward processing, each time a request end initiates a data reading command, after a destination end feeds back the data reading command, a data processing module receives and processes data returned by the destination end, and then feeds back a signal to the request end, the request end can initiate the next data reading command. Therefore, the existing data transmission scheme wastes a large amount of time on data transmission, and the data transmission efficiency is low.
Disclosure of Invention
The application aims to provide a data transmission control method, a data transmission control device, data transmission control equipment and a readable storage medium, which are used for improving data transmission efficiency on the basis of ensuring data forward sequence transmission processing.
In order to solve the above technical problem, the present application provides a data transmission control method, which includes, based on a first node:
generating a data reading command to be distributed according to the data reading request;
if the number of the distributed data identifications is smaller than the total number of the preset data identifications, distributing the data identifications corresponding to the data reading command to be distributed in sequence to obtain the data reading command carrying the data identifications, and increasing records of the distributed data identifications according to distribution results;
sending the data reading command to a second node;
receiving a data feedback result carrying the data identifier returned by the second node, and storing data in the data feedback result into a preset first storage space;
sequentially processing the data in the first storage space according to the sequence of the corresponding data identification;
deleting the records of the distributed data identifications according to the processed data feedback result;
the sequence among the data identifications is consistent with the sequence of the data reading commands to be distributed, and the number of the distributed data identifications does not exceed the total number of the data identifications.
Optionally, the generating a data read command to be allocated according to the data read request specifically includes:
determining a data unit required to be read by the data reading command to be distributed according to the data processing capacity of the data processing module;
and slicing the data to be read by the data reading request according to the data unit to generate the data reading command to be distributed.
Optionally, the total number of the data identifications is a quotient obtained by dividing the size of the first data storage space by the data unit.
Optionally, the receiving a data feedback result carrying the data identifier and returned by the second node, and storing data in the data feedback result in a preset first storage space specifically includes:
storing the data identifications carried by the data feedback result into a second storage space in sequence;
storing the data in the data feedback result in the first storage space according to the storage sequence of the corresponding data identifier in the second storage space;
correspondingly, the processing of the data in the first storage space in sequence according to the corresponding sequence of the data identifier specifically includes:
sequentially reading and processing corresponding data in the first storage space according to the sequence of the data identification in the second storage space;
and if the next adjacent data feedback result of the currently processed data feedback result is not received, refusing to process the rest of data in the first storage space to wait for the next adjacent data feedback result.
Optionally, the method further includes:
and if the next adjacent data feedback result of the current data feedback result is not received within a first preset time after the current data feedback result is processed, retransmitting the data reading command carrying the data identifier corresponding to the next adjacent data feedback result.
Optionally, the method further includes:
if all the data feedback results corresponding to the data reading request are not received within a second preset time length after a first data reading command corresponding to the data reading request is sent, refusing to process the data feedback results, and generating a first information loss notification;
and returning to the step of sending the data reading command to the second node.
Optionally, the method further includes:
sending a data length value of the data reading request to a second node, so that the second node refuses to send the data feedback result and sends a second information loss notice to the first node when not receiving all the data reading requests corresponding to the data reading request within a third preset time after receiving a first data reading command corresponding to the data reading request;
and after receiving the second information loss notification, returning to the step of sending the data reading command to the second node.
In order to solve the above technical problem, the present application further provides a data transmission control apparatus, including:
the generating unit is used for generating a data reading command to be distributed according to the data reading request;
the distribution unit is used for distributing the data identifications corresponding to the data reading command to be distributed in sequence to obtain the data reading command carrying the data identifications if the number of the distributed data identifications is less than the total number of the preset data identifications, and increasing the records of the distributed data identifications according to the distribution result;
a first sending unit, configured to send the data read command to a second node;
the receiving unit is used for receiving a data feedback result which is returned by the second node and carries the data identifier, and storing data in the data feedback result into a preset first storage space;
the processing unit is used for sequentially processing the data in the first storage space according to the sequence of the corresponding data identification;
the maintenance unit is used for deleting the records of the distributed data identifications according to the processed data feedback result;
the sequence among the data identifications is consistent with the sequence of the data reading commands to be distributed, and the number of the distributed data identifications does not exceed the total number of the data identifications.
In order to solve the above technical problem, the present application further provides a data transmission control device, including:
a memory for storing instructions, the instructions comprising the steps of any one of the above-described data transfer control methods;
a processor to execute the instructions.
To solve the above technical problem, the present application further provides a readable storage medium, on which a computer program is stored, wherein the computer program, when executed by a processor, implements the steps of the data transmission control method according to any one of the above.
The data transmission control method comprises the steps of designing data identification for marking the sequence of data reading commands, distributing data identification corresponding to the data reading commands to be distributed in sequence on a first node, obtaining the data reading commands carrying the data identification, sending the data reading commands to a second node, receiving data feedback results which are returned by the second node and also carry the data identification, storing the data feedback results into a preset first storage space, processing the data feedback results according to the data identification, and ensuring that the number of the distributed data identifications does not exceed the total number of the preset data identifications in the whole process. Therefore, the data transmission control method provided by the application can realize simultaneous transmission of a plurality of data reading commands and a plurality of data feedback results on the basis of ensuring the positive sequence transmission of data by establishing a matching mechanism of the data identification, and ensures the processing of the plurality of data feedback results and avoids data loss by presetting the first storage space, thereby improving the data transmission efficiency on the basis of ensuring the positive sequence transmission processing of the data.
The application also provides a data transmission control method, a data transmission control device, data transmission control equipment and a readable storage medium, which have the beneficial effects and are not described herein again.
Drawings
For a clearer explanation of the embodiments or technical solutions of the prior art of the present application, the drawings needed for the description of the embodiments or prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to these drawings without creative efforts.
Fig. 1 is a flowchart of a data transmission control method according to an embodiment of the present application;
fig. 2 is a schematic structural diagram of a data transmission control apparatus according to an embodiment of the present application;
fig. 3 is a schematic structural diagram of a data transmission control device according to an embodiment of the present application.
Detailed Description
The core of the application is to provide a data transmission control method, a data transmission control device, data transmission control equipment and a readable storage medium, which are used for improving the data transmission efficiency on the basis of ensuring the data forward transmission processing.
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
Fig. 1 is a flowchart of a data transmission control method according to an embodiment of the present application.
As shown in fig. 1, based on a first node, a data transmission control method provided in an embodiment of the present application includes:
s101: and generating a data reading command to be distributed according to the data reading request.
S102: and if the number of the distributed data identifications is less than the total number of the preset data identifications, distributing the data identifications corresponding to the data reading command to be distributed in sequence to obtain the data reading command carrying the data identifications, and increasing records of the distributed data identifications according to the distribution result.
S103: and sending the data reading command to the second node.
S104: and receiving a data feedback result carrying the data identification returned by the second node, and storing data in the data feedback result into a preset first storage space.
S105: and sequentially processing the data in the first storage space according to the sequence of the corresponding data identification.
S106: and deleting the records of the distributed data identifications according to the processed data feedback result.
The sequence among the data identifications is consistent with the sequence of the data reading commands to be distributed, and the number of the distributed data identifications does not exceed the total number of the data identifications.
It should be noted that the "first node" and the "second node" in this application are only a request end and a destination end for distinguishing data reading commands, and may be applied to different types of nodes having data sending and data receiving functions, and the roles may be interchanged.
In practical applications, after data read requests enter a message queue of a first node in sequence, according to the data processing capability of the nodes, the first node generally does not send a data read request requesting data of a certain length directly to a second node, but slices the data to be read in the data read request, for example, slices the data to be read, and generates 10 data read commands for reading 1KB of data. In the prior art, after initiating a data read command requesting 1KB data, a first node needs to wait for a second node to feed back 1KB data, and after processing the first node, the first node can send a next data read command requesting 1KB data. In step S101 of the embodiment of the present application, the partition granularity is determined according to the data processing capability of the data processing module of the first node, and then the data read command to be allocated is generated according to the data read request.
In the embodiment of the application, the first storage space is pre-divided to be used as a space for temporarily storing the data in the data feedback result, so that when the data exceeding the data processing capability of the node is transmitted at one time, the excessive data can be cached, and the data loss is avoided. Meanwhile, the data identification is designed to mark the sequence of the data reading command and the data feedback result, and the positive sequence transmission and processing of the data are guaranteed. It is understood that the size of the first storage space should be no less than the product of the data requested in the data read command to be allocated and the total number of data identifications.
Preferably, in order to maintain the balance between the data processing module and the data reading command generating module, the step S101 generates the data reading command to be distributed according to the data reading request, and specifically includes: determining a data unit required to be read by a data reading command to be distributed according to the data processing capacity of the data processing module; and slicing the data to be read by the data reading request according to the data unit to generate a data reading command to be distributed. On this basis, the total number of data identifications may be a quotient obtained by dividing the size of the first data storage space by the data unit.
For step S102, if the number of allocated data identifiers is less than the preset total number of data identifiers, that is, the feedback result of the received but unprocessed data of the first node is less than the total number of data identifiers, at this time, the unallocated data identifiers may be allocated to the newly generated data read command, and if there are a plurality of unallocated data identifiers, a plurality of data read commands may be generated and sent. The total number of the data identifiers is a preset fixed value, that is, the sum of the number of the allocated data identifiers and the number of the unallocated data identifiers, and the total number of the data identifiers is limited by the size of the first storage space and the length of data requested in the data read command to be allocated, which can be understood as the maximum number of data read commands that can be simultaneously initiated by the first node. However, when the unprocessed data feedback result exists, the number of the data reading commands which can be currently initiated by the first node is smaller than the total number of the data identifiers, the unprocessed data feedback result occupies the allocated data identifiers, and the data reading commands which can be currently initiated by the first node acquire the data identifiers from the unallocated data identifiers. And distributing one-to-one corresponding data identifiers for the data reading commands to be distributed according to the data sequence of the data reading commands to be distributed to obtain the data reading commands carrying the data identifiers, so that the data identifiers are used for indicating the sequence of the data reading commands.
On the premise of ensuring that the data identifiers do not overlap with each other, the data identifiers may be designed in various ways, and may be a set of fixed data identifiers (for example, an integer from 1 to 20, after the data identifier "20" is allocated, allocation is started from "1" again), or may be data identifiers that are deleted after allocation (for example, after the data identifier "20" is allocated, allocation is started from "21"). To facilitate indicating the order, the assignment order of the data identifiers is determined according to the order represented by the meaning of the data identifiers, for example, always assigned from small to large according to the number (e.g., a fixed set of data identifiers is assigned and then reassigned after one round), or always assigned from large to small according to the number (e.g., a fixed set of data identifiers is assigned and then reassigned after one round). For maintenance, a fixed set of data identifiers is preferably used on the first node, and a data identifier database is established to maintain the data identifiers, and when the data identifiers are allocated in step S102, records of the allocated data identifiers are added according to the allocation result, such that the allocated data identifiers are moved out of the data identifier database, or the allocated data identifiers are marked as allocated.
For step S103, how many data read commands are generated, i.e. how many data read commands are transmitted.
For step S104, after receiving the data read command, the second node, which is designed in advance as a destination of the data read command, acquires data required by the data read command, and generates a data feedback result carrying the data identifier according to the data identifier carried in the data read command and the acquired data, where the data feedback result has the same data identifier as the corresponding data read command. The data processing module of the first node can only process one data feedback result at the same time, so that the data in the data feedback result is stored in the first storage space for being used.
For step S105, the processing order is determined according to the order of the data identifier of the data feedback result currently being processed and the data identifier corresponding to the data in the first storage space. It should be emphasized that, in order to ensure the forward data processing, it is not only necessary to process the data in the first storage space in the order identified by the data, but when the next adjacent data feedback result adjacent to the currently processed data feedback result is not received, the rest of the data in the first storage space should be rejected from being processed until the next adjacent data feedback result reaches and processes the next adjacent data feedback result.
The data transmission control method provided by the embodiment of the application designs the data identification used for marking the sequence of the data reading command, allocates the data identification corresponding to the data reading command to be allocated in sequence on the first node, obtains the data reading command carrying the data identification, sends the data reading command carrying the data identification to the second node, receives the data feedback result which is returned by the second node and also carries the data identification, stores the data feedback result into the preset first storage space, processes the data feedback result according to the data identification, and ensures that the number of the allocated data identifications does not exceed the total number of the preset data identifications in the whole process. Therefore, according to the data transmission control method provided by the embodiment of the application, through establishing a matching mechanism of the data identifiers, a plurality of data reading commands and a plurality of data feedback results can be transmitted simultaneously on the basis of ensuring the data forward sequence transmission, and the processing of the plurality of data feedback results and the data loss are ensured through presetting the first storage space, so that the data transmission efficiency is improved on the basis of ensuring the data forward sequence transmission processing.
On the basis of the foregoing embodiment, in the data transmission control method provided in the embodiment of the present application, step S104: receiving a data feedback result carrying a data identifier returned by the second node, and storing data in the data feedback result into a preset first storage space, specifically comprising:
storing the data identifications carried by the data feedback result into a second storage space in sequence;
storing the data in the data feedback result in the first storage space according to the storage sequence of the corresponding data identifier in the second storage space;
accordingly, step S105: sequentially processing the data in the first storage space according to the sequence of the corresponding data identifier, specifically:
sequentially reading and processing corresponding data in the first storage space according to the sequence of the data identification in the second storage space;
and if the next adjacent data feedback result of the currently processed data feedback result is not received, refusing to process the rest data in the first storage space to wait for the next adjacent data feedback result.
In specific implementation, a second storage space is divided in advance to temporarily store data identifiers carried by received but unprocessed data feedback results or record the use states of the data identifiers, and the second storage space can be divided from an RAM space. For example, after receiving the data feedback result, the first node recognizes the data identifier of the obtained data feedback result and the read data, stores the data identifier of the data feedback result in the second storage space in sequence because the sequence of the data identifier is established, and reserves a space for the data identifier that does not arrive if the later data identifier arrives first. And meanwhile, setting the storage sequence of the corresponding data in the first storage space according to the storage sequence of the data identifier in the second storage space, so that when the data processing module performs data processing, reading a data identifier in the second storage space first, judging whether the data identifier is the data identifier of the data feedback result to be processed currently, if so, reading the data at the corresponding position in the first storage space, and if not, keeping waiting. For example, if the data processing module determines that the data identifier 1 is the data feedback result that needs to be processed currently, the data corresponding to the data identifier 1 in the first storage space is acquired, and after the processing is completed, it is checked that the data identifier 2 is not written into the second storage space but the data identifier 3 is written into the second storage space, and at this time, the processing needs to be performed after the data identifier 2 is written into the second storage space.
Because the packet loss phenomenon is inevitable in the data transmission process, in order to avoid that data processing cannot be performed due to data packet loss, the data transmission control method provided by the embodiment of the present application may further include:
and if the next adjacent data feedback result of the current data feedback result is not received within a first preset time after the current data feedback result is processed, retransmitting the data reading command carrying the data identifier corresponding to the next adjacent data feedback result.
In the above embodiment, the first node verifies the data processing sequence through the data identifier consistency after receiving the data feedback result, and the data processing module of the first node can receive the data feedback result and process the data feedback result while ensuring the positive sequence of the data. In addition, according to system requirements, after all data feedback results corresponding to the data reading request are received, the data feedback results can be sequentially processed (under the condition that the first storage space allows the data feedback results).
On the basis of the foregoing embodiment, the data transmission control method provided in the embodiment of the present application may further include:
if all data feedback results corresponding to the data reading request are not received within a second preset time after a first data reading command corresponding to the data reading request is sent, rejecting to process the data feedback results, and generating a first information loss notification;
returning to step S103, the data read command is sent to the second node.
The data reading request comprises a length value of the whole data to be requested, after the data reading command is sent, the first node determines a data feedback result to be processed according to the data length value of the data reading request, namely, the data length value is sent to the data processing module by the data reading command generating module, and the data processing module carries out length consistency verification. In addition to determining the total number of the data feedback results, the data processing module also determines whether to cut the data of the last data feedback result corresponding to the data read request according to the data length value of the data read request, for example, the data read request needs 9.5KB of data, but the data in each data read command is 1KB, and then the data processing module cuts off the last 0.5KB of the data in the last data feedback result.
When all data feedback results corresponding to the data reading request are not received on time, the data processing module generates a first information loss notification to inform the data reading command generation module to regenerate the data reading command (for example, the data reading command is not stored), and then the data reading command is sent to the second node.
On the basis of the foregoing embodiment, the data transmission control method provided in the embodiment of the present application may further include:
sending the data length value of the data reading request to a second node, so that the second node refuses to send a data feedback result and sends a second information loss notice to the first node when not receiving all data reading requests corresponding to the data reading request within a third preset time after receiving a first data reading command corresponding to the data reading request;
and returning to the step of sending the data reading command to the second node after receiving the second information loss notice.
In this embodiment of the present application, the data length value of the data read request may also be used as a second node for performing length consistency verification. The second node may refuse to send the data feedback result and request the first node to resend the data read command when all the data read requests corresponding to the data read request cannot be received on time after receiving the first data read command corresponding to the data read request.
On the basis of the above detailed description of the embodiments corresponding to the data transmission control method, the present application also discloses a data transmission control device, a device and a readable storage medium corresponding to the above method.
Fig. 2 is a schematic structural diagram of a data transmission control device according to an embodiment of the present application.
As shown in fig. 2, the data transmission control apparatus provided in the embodiment of the present application includes:
a generating unit 201, configured to generate a data read command to be distributed according to the data read request;
the allocating unit 202 is configured to, if the number of allocated data identifiers is less than the total number of preset data identifiers, allocate data identifiers corresponding to one another to the data reading command to be allocated in sequence, obtain a data reading command carrying the data identifiers, and add records of the allocated data identifiers according to an allocation result;
a first sending unit 203, configured to send a data read command to the second node;
the receiving unit 204 is configured to receive a data feedback result carrying a data identifier and returned by the second node, and store data in the data feedback result in a preset first storage space;
a processing unit 205, configured to sequentially process the data in the first storage space in the order of the corresponding data identifiers;
a maintenance unit 206, configured to delete the record of the assigned data identifier according to the processed data feedback result;
the sequence among the data identifications is consistent with the sequence of the data reading commands to be distributed, and the number of the distributed data identifications does not exceed the total number of the data identifications.
Optionally, the receiving unit 204 specifically includes:
the second storage subunit is used for sequentially storing the data identifications carried by the data feedback result into a second storage space;
the first storage subunit is used for storing the data in the data feedback result in the first storage space according to the storage sequence of the corresponding data identifier in the second storage space;
correspondingly, the processing unit 205 sequentially processes the data in the first storage space according to the sequence of the corresponding data identifier, specifically:
the processing unit 205 sequentially reads and processes the corresponding data in the first storage space according to the sequence of the data identifiers in the second storage space;
and if the next adjacent data feedback result of the currently processed data feedback result is not received, refusing to process the rest data in the first storage space to wait for the next adjacent data feedback result.
Optionally, the data transmission control apparatus provided in the embodiment of the present application further includes:
and the first restarting unit is used for retransmitting the data reading command carrying the data identifier corresponding to the next adjacent data feedback result if the next adjacent data feedback result of the current data feedback result is not received within a first preset time length after the current data feedback result is processed.
Optionally, the data transmission control apparatus provided in the embodiment of the present application further includes:
the second restarting unit is used for refusing to process the data feedback result and generating a first information loss notice if all the data feedback results corresponding to the data reading request are not received within a second preset time after the first data reading command corresponding to the data reading request is sent out; and returning to the step of sending the data reading command to the second node.
Optionally, the data transmission control apparatus provided in the embodiment of the present application further includes:
the second sending unit is used for sending the data length value of the data reading request to the second node so that the second node refuses to send the data feedback result and sends a second information loss notice to the first node when not receiving all data reading requests corresponding to the data reading request within a third preset time after receiving a first data reading command corresponding to the data reading request;
and the third restarting unit is used for returning to the step of sending the data reading command to the second node after receiving the second information loss notification.
Since the embodiments of the apparatus portion and the method portion correspond to each other, please refer to the description of the embodiments of the method portion for the embodiments of the apparatus portion, which is not repeated here.
Fig. 3 is a schematic structural diagram of a data transmission control device according to an embodiment of the present application.
As shown in fig. 3, the data transmission control device provided in the embodiment of the present application includes:
a memory 310 for storing instructions, the instructions comprising the steps of the data transmission control method according to any one of the above embodiments;
a processor 320 for executing the instructions.
Processor 320 may include one or more processing cores, such as a 3-core processor, an 8-core processor, and so forth. The processor 320 may be implemented in at least one hardware form of a digital Signal processing (dsp), a Field-Programmable Gate Array (FPGA), a Programmable Logic Array (pla), or a digital Signal processing (dsp). The processor 320 may also include a main processor and a coprocessor, where the main processor is a processor for Processing data in an awake state, and is also called a central Processing unit (cpu); a coprocessor is a low power processor for processing data in a standby state. In some embodiments, the processor 320 may be integrated with an image processor GPU (graphics Processing unit), which is responsible for rendering and drawing the content that the display screen needs to display. In some embodiments, processor 320 may also include an Artificial Intelligence (AI) (artificial intelligence) processor for processing computational operations related to machine learning.
Memory 310 may include one or more readable storage media, which may be non-transitory. Memory 310 may also include high speed random access memory, as well as non-volatile memory, such as one or more magnetic disk storage devices, flash memory storage devices. In this embodiment, the memory 310 is at least used for storing a computer program 311, wherein after the computer program 311 is loaded and executed by the processor 320, the relevant steps in the data transmission control method disclosed in any of the foregoing embodiments can be implemented. In addition, the resources stored by the memory 310 may also include an operating system 312, data 313, and the like, and the storage may be transient storage or persistent storage. The operating system 312 may be Windows, among others. Data 313 may include, but is not limited to, data involved in the above-described methods.
In some embodiments, the data transmission control device may further include a display 330, a power source 340, a communication interface 350, an input output interface 360, a sensor 370, and a communication bus 380.
Those skilled in the art will appreciate that the configuration shown in fig. 3 does not constitute a limitation of the data transmission control apparatus and may include more or fewer components than those shown.
The data transmission control device provided by the embodiment of the application comprises the memory and the processor, and the processor can realize the data transmission control method when executing the program stored in the memory, and the effect is the same as the effect.
It should be noted that the above-described embodiments of the apparatus and device are merely illustrative, for example, the division of modules is only one division of logical functions, and there may be other divisions when actually implementing, for example, a plurality of modules or components may be combined or integrated into another system, or some features may be omitted or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or modules, and may be in an electrical, mechanical or other form. Modules described as separate parts may or may not be physically separate, and parts displayed as modules may or may not be physical modules, may be located in one place, or may be distributed on a plurality of network modules. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment.
In addition, functional modules in the embodiments of the present application may be integrated into one processing module, or each of the modules may exist alone physically, or two or more modules are integrated into one module. The integrated module can be realized in a hardware mode, and can also be realized in a software functional module mode.
The integrated module, if implemented in the form of a software functional module and sold or used as a separate product, may be stored in a readable storage medium. Based on such understanding, the technical solutions of the present application may be embodied in the form of a software product, which is stored in a storage medium and executes all or part of the steps of the methods described in the embodiments of the present application, or all or part of the technical solutions.
To this end, an embodiment of the present application further provides a readable storage medium, where a computer program is stored, and when the computer program is executed by a processor, the computer program implements steps such as a data transmission control method.
The readable storage medium may include: various media capable of storing program codes, such as a usb disk, a removable hard disk, a Read-Only Memory ROM (Read-Only Memory), a random Access Memory ram (random Access Memory), a magnetic disk, or an optical disk.
The computer program contained in the readable storage medium provided in this embodiment can implement the steps of the data transmission control method described above when executed by the processor, and the effects are the same as above.
The detailed description is given above on a data transmission control method, apparatus, device and readable storage medium provided by the present application. The embodiments are described in a progressive manner in the specification, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other. The device, the apparatus and the readable storage medium disclosed by the embodiments correspond to the method disclosed by the embodiments, so that the description is simple, and the relevant points can be referred to the method part for description. It should be noted that, for those skilled in the art, it is possible to make several improvements and modifications to the present application without departing from the principle of the present application, and such improvements and modifications also fall within the scope of the claims of the present application.
It is further noted that, in the present specification, relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
Claims (10)
1. A data transmission control method is characterized in that based on a first node, the method comprises the following steps:
generating a data reading command to be distributed according to the data reading request;
if the number of the distributed data identifications is smaller than the total number of the preset data identifications, distributing the data identifications corresponding to the data reading command to be distributed in sequence to obtain the data reading command carrying the data identifications, and increasing records of the distributed data identifications according to distribution results;
sending the data reading command to a second node;
receiving a data feedback result carrying the data identifier returned by the second node, and storing data in the data feedback result into a preset first storage space;
sequentially processing the data in the first storage space according to the sequence of the corresponding data identification;
deleting the records of the distributed data identifications according to the processed data feedback result;
the sequence among the data identifications is consistent with the sequence of the data reading commands to be distributed, and the number of the distributed data identifications does not exceed the total number of the data identifications.
2. The data transmission control method according to claim 1, wherein the generating a data read command to be distributed according to a data read request specifically includes:
determining a data unit required to be read by the data reading command to be distributed according to the data processing capacity of the data processing module;
and slicing the data to be read by the data reading request according to the data unit to generate the data reading command to be distributed.
3. The data transmission control method according to claim 2, wherein the total number of data identifications is a quotient obtained by dividing the size of the first data storage space by the data unit.
4. The data transmission control method according to claim 1, wherein the receiving the data feedback result carrying the data identifier returned by the second node, and storing data in the data feedback result in a preset first storage space specifically includes:
storing the data identifications carried by the data feedback result into a second storage space in sequence;
storing the data in the data feedback result in the first storage space according to the storage sequence of the corresponding data identifier in the second storage space;
correspondingly, the processing of the data in the first storage space in sequence according to the corresponding sequence of the data identifier specifically includes:
sequentially reading and processing corresponding data in the first storage space according to the sequence of the data identification in the second storage space;
and if the next adjacent data feedback result of the currently processed data feedback result is not received, refusing to process the rest of data in the first storage space to wait for the next adjacent data feedback result.
5. The data transmission control method according to claim 4, further comprising:
and if the next adjacent data feedback result of the current data feedback result is not received within a first preset time after the current data feedback result is processed, retransmitting the data reading command carrying the data identifier corresponding to the next adjacent data feedback result.
6. The data transmission control method according to claim 1, further comprising:
if all the data feedback results corresponding to the data reading request are not received within a second preset time length after a first data reading command corresponding to the data reading request is sent, refusing to process the data feedback results, and generating a first information loss notification;
and returning to the step of sending the data reading command to the second node.
7. The data transmission control method according to claim 1, further comprising:
sending a data length value of the data reading request to a second node, so that the second node refuses to send the data feedback result and sends a second information loss notice to the first node when not receiving all the data reading requests corresponding to the data reading request within a third preset time after receiving a first data reading command corresponding to the data reading request;
and after receiving the second information loss notification, returning to the step of sending the data reading command to the second node.
8. A data transmission control apparatus, comprising:
the generating unit is used for generating a data reading command to be distributed according to the data reading request;
the distribution unit is used for distributing the data identifications corresponding to the data reading command to be distributed in sequence to obtain the data reading command carrying the data identifications if the number of the distributed data identifications is less than the total number of the preset data identifications, and increasing the records of the distributed data identifications according to the distribution result;
a first sending unit, configured to send the data read command to a second node;
the receiving unit is used for receiving a data feedback result which is returned by the second node and carries the data identifier, and storing data in the data feedback result into a preset first storage space;
the processing unit is used for sequentially processing the data in the first storage space according to the sequence of the corresponding data identification;
the maintenance unit is used for deleting the records of the distributed data identifications according to the processed data feedback result;
the sequence among the data identifications is consistent with the sequence of the data reading commands to be distributed, and the number of the distributed data identifications does not exceed the total number of the data identifications.
9. A data transmission control apparatus characterized by comprising:
a memory for storing instructions, the instructions comprising the steps of the data transfer control method of any one of claims 1 to 7;
a processor to execute the instructions.
10. A readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the data transmission control method according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110218552.XA CN113157611B (en) | 2021-02-26 | 2021-02-26 | Data transmission control method, device, equipment and readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110218552.XA CN113157611B (en) | 2021-02-26 | 2021-02-26 | Data transmission control method, device, equipment and readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113157611A true CN113157611A (en) | 2021-07-23 |
| CN113157611B CN113157611B (en) | 2023-04-18 |
Family
ID=76883565
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110218552.XA Active CN113157611B (en) | 2021-02-26 | 2021-02-26 | Data transmission control method, device, equipment and readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113157611B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2024001850A1 (en) * | 2022-06-27 | 2024-01-04 | 华为技术有限公司 | Data processing system, method and apparatus, and controller |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5125071A (en) * | 1986-09-10 | 1992-06-23 | Hitachi, Ltd. | Computer command input unit giving priority to frequently selected commands |
| EP1395014A1 (en) * | 2002-08-27 | 2004-03-03 | Matsushita Electric Industrial Co., Ltd. | A method of transmitting data streams with data segments of variable length |
| CN102025712A (en) * | 2009-09-15 | 2011-04-20 | 上海华为技术有限公司 | Data updating method, device and system |
| CN110008062A (en) * | 2019-03-28 | 2019-07-12 | 维沃移动通信有限公司 | A kind of data managing method and mobile terminal |
| CN111181874A (en) * | 2018-11-09 | 2020-05-19 | 深圳市中兴微电子技术有限公司 | Message processing method, device and storage medium |
| CN111930515A (en) * | 2020-09-16 | 2020-11-13 | 北京达佳互联信息技术有限公司 | Data acquisition and distribution method, device, server and storage medium |
-
2021
- 2021-02-26 CN CN202110218552.XA patent/CN113157611B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5125071A (en) * | 1986-09-10 | 1992-06-23 | Hitachi, Ltd. | Computer command input unit giving priority to frequently selected commands |
| EP1395014A1 (en) * | 2002-08-27 | 2004-03-03 | Matsushita Electric Industrial Co., Ltd. | A method of transmitting data streams with data segments of variable length |
| CN102025712A (en) * | 2009-09-15 | 2011-04-20 | 上海华为技术有限公司 | Data updating method, device and system |
| CN111181874A (en) * | 2018-11-09 | 2020-05-19 | 深圳市中兴微电子技术有限公司 | Message processing method, device and storage medium |
| CN110008062A (en) * | 2019-03-28 | 2019-07-12 | 维沃移动通信有限公司 | A kind of data managing method and mobile terminal |
| CN111930515A (en) * | 2020-09-16 | 2020-11-13 | 北京达佳互联信息技术有限公司 | Data acquisition and distribution method, device, server and storage medium |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2024001850A1 (en) * | 2022-06-27 | 2024-01-04 | 华为技术有限公司 | Data processing system, method and apparatus, and controller |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113157611B (en) | 2023-04-18 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11762697B2 (en) | Method and apparatus for scheduling resource for deep learning framework | |
| CN108845877B (en) | Method, device and system for managing memory | |
| CN107689976B (en) | File transmission method and device | |
| CN106302780B (en) | Method, device and system for batch data transmission of cluster equipment and server | |
| CN106657327A (en) | Message pushing method and message pushing device | |
| CN108984266A (en) | A kind of management method of virtual machine, apparatus and system | |
| CN104750690A (en) | Query processing method, device and system | |
| CN110888844A (en) | Data deleting method, system, equipment and computer readable storage medium | |
| CN112099728B (en) | Method and device for executing write operation and read operation | |
| CN111126604A (en) | Model training method, device, server and storage medium | |
| CN113157611B (en) | Data transmission control method, device, equipment and readable storage medium | |
| US20220342579A1 (en) | Memory migration method, apparatus, and computing device | |
| CN112286688A (en) | Memory management and use method, device, equipment and medium | |
| CN109614345B (en) | Memory management method and device for communication between protocol layers | |
| CN112822299B (en) | RDMA (remote direct memory Access) -based data transmission method and device and electronic equipment | |
| CN113391925A (en) | Cloud resource management method, system, medium, and computer device | |
| CN110895517B (en) | Method, equipment and system for transmitting data based on FPGA | |
| CN112463027B (en) | I/O processing method, system, equipment and computer readable storage medium | |
| US12019909B2 (en) | IO request pipeline processing device, method and system, and storage medium | |
| CN112463028B (en) | I/O processing method, system, equipment and computer readable storage medium | |
| CN105519055A (en) | Dynamic equilibrium method and apparatus for QoS of I/O channel | |
| CN112948298A (en) | Message processing method and device | |
| CN114490083A (en) | CPU resource binding method and device, storage medium and electronic device | |
| CN114398410A (en) | Method and device for generating continuous numbers, server cluster and storage medium | |
| CN114780228A (en) | Hybrid cloud resource creation method and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |