CN112202862B - Method and device for synchronizing cluster data and files based on kafka - Google Patents
Method and device for synchronizing cluster data and files based on kafka Download PDFInfo
- Publication number
- CN112202862B CN112202862B CN202011010531.0A CN202011010531A CN112202862B CN 112202862 B CN112202862 B CN 112202862B CN 202011010531 A CN202011010531 A CN 202011010531A CN 112202862 B CN112202862 B CN 112202862B
- Authority
- CN
- China
- Prior art keywords
- file
- data
- kafka
- cluster
- hot spot
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 40
- 238000013500 data storage Methods 0.000 claims abstract description 19
- 230000015654 memory Effects 0.000 claims abstract description 17
- 238000004806 packaging method and process Methods 0.000 claims abstract description 8
- 238000003032 molecular docking Methods 0.000 claims description 3
- 238000012545 processing Methods 0.000 description 7
- 230000001360 synchronised effect Effects 0.000 description 4
- 230000009471 action Effects 0.000 description 3
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 238000010586 diagram Methods 0.000 description 3
- 238000004891 communication Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000002776 aggregation Effects 0.000 description 1
- 238000004220 aggregation Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- ZLIBICFPKPWGIZ-UHFFFAOYSA-N pyrimethanil Chemical compound CC1=CC(C)=NC(NC=2C=CC=CC=2)=N1 ZLIBICFPKPWGIZ-UHFFFAOYSA-N 0.000 description 1
- 239000000126 substance Substances 0.000 description 1
- 230000007704 transition Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1095—Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/06—Protocols specially adapted for file transfer, e.g. file transfer protocol [FTP]
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention provides a method and a device for synchronizing cluster data and files based on kafka, wherein the method comprises the following steps: a certain node in the cluster receives and analyzes the request, and each node in the cluster corresponds to one consumption group; judging an analysis result, sending the hot spot data to a hot spot data storage topic of Kafka or reading file stream information of a corresponding path by adopting a random access file according to the analysis result, packaging file json information, and sending and storing the packaged file json information to the file data storage topic of Kafka; and the rest nodes in the cluster respectively store topic and file data from the hot spot data of Kafka by using the corresponding consumption groups. According to the scheme of the invention, only the Kafka service plug-in is added in the cluster project, so that the complexity of the project is reduced. And the data in Kafka are all read into all nodes of the cluster, and hot spot data are refreshed into the service memory. And hot spot data sharing and file sharing among cluster servers are realized.
Description
Technical Field
The invention relates to the field of data processing, in particular to a kafka-based cluster data and file synchronization method and device.
Background
With the development of a distributed system, the application scenario of completing a common project by a distributed cluster is more and more wide, and the data and files of the project need to be synchronized and shared in the distributed cluster. In the prior art, the method for realizing synchronization and sharing of the data and the files of the project in the clusters comprises the steps of realizing file sharing among the clusters based on NAS service and realizing hot spot data sharing based on Redis.
In a mode of realizing the file sharing among clusters based on the NAS service, all the services in the clusters are linked with the NAS service, files are required to be read and written through the NAS service during file uploading or reading, synchronization of attachments, files and the like is not concerned among the services, and the mode of realizing the file sharing among clusters based on the NAS service is used, so that the method is suitable for large-scale projects. For the projects with smaller project scale, when no NAS shared server exists, a simple and practical solution for realizing file synchronization is lacking among clusters.
And based on the manner of realizing hot spot data sharing by the Redis, all services in the cluster are connected with the Redis cluster, and the hot spot data is read and written through the Redis transition to realize data sharing. However, when a difficult data structure or data with larger data are stored, hot spot data stored in a memory need to be adopted, synchronization among clusters is not suitable for implementation by using Redis.
That is, the existing scheme for realizing file sharing among clusters based on NAS service and hot spot data sharing based on dis is not applicable to projects with small scale and without NAS server in the projects, and needs to realize sharing of files among clusters and hot spot data sharing among memories among cluster nodes.
Disclosure of Invention
In order to solve the technical problems, the invention provides a kafka-based cluster data and file synchronization method and device, which are used for solving the problem that some items of the prior art can not realize data file sharing through a NAS (network attached storage) and other sharing servers; the project size is not large, and no NAS server project exists in the projects or the data files and hot spot data sharing cannot be realized through NAS; the project size is not large, no NAS server project exists in the projects, the sharing of files in clusters is needed, and the synchronization of data and files of the projects sharing hot spot data in memories among cluster nodes is needed.
According to a first aspect of the present invention, there is provided a method for synchronizing kafka-based cluster data and files, the method comprising the steps of:
step S101: a certain node in the cluster receives and analyzes the request, and each node in the cluster corresponds to one consumption group;
step S102: judging an analysis result, if the analysis result is that hot spot data is refreshed into the memory, entering step S103; if the analysis result is file sharing, entering step S104;
step S103: transmitting the hot spot data to a hot spot data storage topic of Kafka, and proceeding to step S105;
step S104: reading file stream information of a corresponding path by adopting a random access file, packaging file json information, sending and storing the packaged file json information to a file data storage topic of Kafka, and entering step S105;
step S105: and the rest nodes in the cluster respectively store topic and file data from the hot spot data of Kafka by using the corresponding consumption groups.
Further, in the step S101: a node in the cluster receives and parses the request, and before each node in the cluster corresponds to a consumption group, the method further includes:
and sending a hot spot data sharing request or a file sharing request through a browser or an external system to service a certain node in the docking cluster.
Further, in the step S104, the json information of the encapsulated file includes a file path, a name, a file stream, and a stream location of the file.
Further, for the file data obtained through consumption, the node analyzes the file path, the file stream position and the file name according to the character string information, then generates a corresponding file, and writes the generated file into a corresponding directory.
According to a second aspect of the present invention, there is provided a kafka-based cluster data and file synchronization apparatus, the apparatus comprising:
request parsing module: the method comprises the steps that a certain node in a cluster receives and analyzes a request, and each node in the cluster corresponds to one consumption group;
and a judging module: the method comprises the steps of configuring to judge an analysis result;
a first storage module: a hotspot data store topic configured to send hotspot data to Kafka;
and a second storage module: the method comprises the steps of using a random Access File to read file stream information of a corresponding path, packaging file json information, and sending and storing the packaged file json information to a file data storage topic of Kafka;
and a data acquisition module: the other nodes in the cluster are configured to respectively consume hot spot data and file data from hot spot data storage topic and file data storage topic of Kafka by utilizing corresponding consumption groups.
Further, the system comprises a receiving request module configured to send a hot spot data sharing request or a file sharing request to a service of a certain node in the cluster through a browser or an external system.
Further, the json information of the encapsulated file includes a file path, a name, a file stream, and a stream location of the file.
Further, for the file data obtained through consumption, the node analyzes the file path, the file stream position and the file name according to the character string information, then generates a corresponding file, and writes the generated file into a corresponding directory.
According to a third aspect of the present invention, there is provided a kafka-based cluster data and file synchronization system, comprising:
a processor for executing a plurality of instructions;
a memory for storing a plurality of instructions;
wherein the plurality of instructions are for storing by the memory and loading and executing by the processor the kafka-based cluster data and file synchronization method as described above.
According to a fourth aspect of the present invention, there is provided a computer-readable storage medium having stored therein a plurality of instructions; the instructions are used for loading and executing the synchronization method of the kafka-based cluster data and the file by the processor.
According to the scheme of the invention, only Kafka service plug-ins are required to be added in the cluster project, service middleware such as Redis and NAS is not required to be added, and the complexity of the project is reduced. The method comprises the steps that service for sending hot spot data and data files to the topic of Kafka is achieved through a data sending program in the cluster service, the program sends the data to the Kafka when the hot spot data or the shared files are needed to be shared, a data receiving program in the cluster service adopts different consumption groups to read the data in the topic of the Kafka, all the data in the Kafka are read into all nodes of the cluster, the hot spot data are refreshed into a service memory, and the data files are read and written into the files through random access files and are stored into corresponding catalogues. And hot spot data sharing and file sharing among cluster servers are realized.
The foregoing description is only an overview of the present invention, and is intended to provide a better understanding of the present invention, as it is embodied in the following description, with reference to the preferred embodiments of the present invention and the accompanying drawings.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention, illustrate the invention and together with the description serve to explain the invention. In the drawings:
FIG. 1 is a flowchart of a method for synchronizing kafka-based cluster data and files according to one embodiment of the invention;
FIG. 2 is a schematic diagram of a method for synchronizing kafka-based cluster data and files according to one embodiment of the present invention;
FIG. 3 is a schematic diagram of an embodiment of a method of kafka-based cluster data and file synchronization of the present invention;
fig. 4 is a block diagram of a synchronization apparatus for kafka-based cluster data and files according to an embodiment of the present invention.
Detailed Description
Definition:
kafka is an open source stream processing platform developed by the Apache software Foundation, written by Scala and Java. Kafka is a high-throughput distributed publish-subscribe messaging system that can handle all action flow data in consumer-scale websites. Such actions (web browsing, searching and other user actions) are a key factor in many social functions on modern networks. These data are typically addressed by processing logs and log aggregations due to throughput requirements. This is a viable solution for log data and offline analysis systems like Hadoop, but with the limitation of requiring real-time processing. The purpose of Kafka is to unify on-line and off-line message processing through the Hadoop parallel loading mechanism, and also to provide real-time messages through the clusters.
Redis: redis is a key-value store system. Like Memcached, it supports relatively more stored value types, including string, list, set, zset (sorted set-ordered set), and hash (hash type). These data types all support push/pop, add/remove, and pick intersection union and difference and richer operations, and these operations are all atomic.
Random Access File: java provides an operation that can randomly access a file, including read and write operations.
A method of kafka-based cluster data and file synchronization, which is one embodiment of the present invention, is first described in connection with fig. 1-2. As shown in fig. 1-2, the method comprises the steps of:
step S101: a certain node in the cluster receives and analyzes the request, and each node in the cluster corresponds to one consumption group;
step S102: judging an analysis result, if the analysis result is that hot spot data is refreshed into the memory, entering step S103; if the analysis result is file sharing, entering step S104;
step S103: transmitting the hot spot data to a hot spot data storage topic of Kafka, and proceeding to step S105;
step S104: reading file stream information of a corresponding path by adopting a random access file, packaging file json information, sending and storing the packaged file json information to a file data storage topic of Kafka, and entering step S105;
step S105: and the rest nodes in the cluster respectively store topic and file data from the hot spot data of Kafka by using the corresponding consumption groups.
In the step S101: a node in the cluster receives and parses the request, and before each node in the cluster corresponds to a consumption group, the method further includes:
and sending a hot spot data sharing request or a file sharing request through a browser or an external system to service a certain node in the docking cluster. The hot spot data sharing request corresponds to refreshing hot spot data to memory.
In the step S104, the json information of the encapsulated file includes a file path, a name, a file stream, and a stream position of the file.
Each node in the cluster can receive and analyze the request, determine a processing mode according to the analysis result, for example, send the hot spot data to a hot spot data storage topic of Kafka, or read file flow information of a corresponding path by adopting a random access file, package the file information, and send and store the packaged file information to the file data storage topic of Kafka.
Each node in the cluster can send and/or receive a file request and a hot spot data request, and the data is acquired from the cluster nodes, so that the hot spot data and the file data sharing among the clusters are realized. And for the read file data, analyzing the file path, the file stream position and the file name according to the character string information, generating a corresponding file, and writing the generated file into a corresponding directory.
After step S105, the subsequent hotspot data request or the file data request may acquire corresponding data from any cluster node, or may access the corresponding data through a browser or an external system, so as to realize sharing of hotspot data and file data between clusters.
The method solves the problem of synchronous sharing of hot spot data in small-scale projects, and solves the problem of synchronous sharing of files in projects without NAS service.
A specific embodiment of kafka-based cluster data and file synchronization is described below in conjunction with fig. 3.
Step S301: the browser or an external system sends hot spot data or file requests to a certain node of the cluster server;
step S302: after receiving the request, the current node analyzes the request, and if the request is a hot spot data request, the current node sends hot spot data to a hot spot data topic; if the file request is a file request, reading file content, packaging file json information and sending the file json information to Kafka;
step S303: 5 nodes in the cluster start to consume the data information in Kafka; refreshing the read hot spot data into a memory;
step S304: for the read file data, analyzing the file path, the file stream position and the file name according to the character string information, then generating a corresponding file, and writing the generated file into a corresponding directory;
step S305: the normal data can be obtained in 5 nodes by the subsequent hot spot data query or file data query request, so that the synchronous sharing of the data and the files among the cluster nodes is realized.
The embodiment of the invention further provides a device for synchronizing the cluster data and the files based on kafka, as shown in fig. 4, the device comprises:
request parsing module: the method comprises the steps that a certain node in a cluster receives and analyzes a request, and each node in the cluster corresponds to one consumption group;
and a judging module: the method comprises the steps of configuring to judge an analysis result;
a first storage module: a hotspot data store topic configured to send hotspot data to Kafka;
and a second storage module: the method comprises the steps of using a random Access File to read file stream information of a corresponding path, packaging file json information, and sending and storing the packaged file json information to a file data storage topic of Kafka;
and a data acquisition module: the other nodes in the cluster are configured to respectively consume hot spot data and file data from hot spot data storage topic and file data storage topic of Kafka by utilizing corresponding consumption groups.
The embodiment of the invention further provides a system for synchronizing the cluster data and the files based on kafka, which comprises the following steps:
a processor for executing a plurality of instructions;
a memory for storing a plurality of instructions;
wherein the instructions are stored by the memory and loaded by the processor and perform a kafka-based method of synchronizing cluster data and files as described above.
The embodiment of the invention further provides a computer readable storage medium, wherein a plurality of instructions are stored in the storage medium; the instructions are used for loading and executing the synchronization method of the kafka-based cluster data and the file by the processor.
It should be noted that, without conflict, the embodiments of the present invention and features of the embodiments may be combined with each other.
In the several embodiments provided in the present invention, it should be understood that the disclosed systems, devices, and methods may be implemented in other manners. For example, the apparatus embodiments described above are merely illustrative, e.g., the division of the elements is merely a logical function division, and there may be additional divisions when actually implemented, e.g., multiple elements or components may be combined or integrated into another system, or some features may be omitted or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed with each other may be an indirect coupling or communication connection via some interfaces, devices or units, which may be in electrical, mechanical or other form.
The units described as separate units may or may not be physically separate, and units shown as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
In addition, each functional unit in the embodiments of the present invention may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit. The integrated units may be implemented in hardware or in hardware plus software functional units.
The integrated units implemented in the form of software functional units described above may be stored in a computer readable storage medium. The software functional unit is stored in a storage medium, and includes several instructions for making a computer device (which may be a personal computer, a physical machine Server, or a network cloud Server, etc., and need to install a Windows or Windows Server operating system) execute part of the steps of the methods described in the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a random access Memory (Random Access Memory, RAM), a magnetic disk, or an optical disk, or other various media capable of storing program codes.
The above description is only of the preferred embodiments of the present invention, and is not intended to limit the present invention in any way, but any simple modification, equivalent variation and modification made to the above embodiments according to the technical substance of the present invention still fall within the scope of the technical solution of the present invention.
Claims (8)
1. A method for synchronizing kafka-based cluster data and files, comprising the steps of:
step S101: a certain node in the cluster receives and analyzes the request, and each node in the cluster corresponds to one consumption group;
step S102: judging an analysis result, if the analysis result is that hot spot data is refreshed into the memory, entering step S103; if the analysis result is file sharing, entering step S104;
step S103: transmitting the hot spot data to a hot spot data storage topic of Kafka, and proceeding to step S105;
step S104: reading file stream information of a corresponding path by adopting a random access file, packaging file json information, sending and storing the packaged file json information to a file data storage topic of Kafka, and entering step S105;
step S105: the other nodes in the cluster respectively store topic and file data from the hot spot data of Kafka by using the corresponding consumption groups;
in the step S101: a node in the cluster receives and parses the request, and before each node in the cluster corresponds to a consumption group, the method further includes:
and sending a hot spot data sharing request or a file sharing request through a browser or an external system to service a certain node in the docking cluster.
2. The kafka-based cluster data and file synchronization method according to claim 1, wherein in the step S104, the encapsulated file json information includes a file path, a name, a file stream, and a stream position of a file.
3. The kafka-based cluster data and file synchronization method according to claim 1, wherein for the file data obtained by consumption, the node parses a file path, a file stream position, a file name according to the character string information, then generates a corresponding file, and writes the generated file into a corresponding directory.
4. A kafka-based cluster data and file synchronization apparatus, the apparatus comprising:
the receiving request module is configured to send a hot spot data sharing request or a file sharing request through a browser or an external system to the service of a certain node in the cluster;
request parsing module: the method comprises the steps that a certain node in a cluster receives and analyzes a request, and each node in the cluster corresponds to one consumption group;
and a judging module: the method comprises the steps of configuring to judge an analysis result;
a first storage module: a hotspot data store topic configured to send hotspot data to Kafka;
and a second storage module: the method comprises the steps of using a random Access File to read file stream information of a corresponding path, packaging file json information, and sending and storing the packaged file json information to a file data storage topic of Kafka;
and a data acquisition module: the other nodes in the cluster are configured to respectively consume hot spot data and file data from hot spot data storage topic and file data storage topic of Kafka by utilizing corresponding consumption groups.
5. The kafka based cluster data and file synchronization device of claim 4, wherein the encapsulated file json information includes file path, name, file stream, stream location of the file.
6. The kafka-based cluster data and file synchronization device according to claim 5, wherein for the file data obtained by consumption, the node parses the file path, the file stream position, the file name according to the character string information, then generates a corresponding file, and writes the generated file into a corresponding directory.
7. A kafka-based cluster data and file synchronization system comprising:
a processor for executing a plurality of instructions;
a memory for storing a plurality of instructions;
wherein the plurality of instructions are for storage by the memory and loading and executing by the processor the kafka based cluster data and file synchronization method according to any of claims 1-3.
8. A computer-readable storage medium having stored therein a plurality of instructions;
the plurality of instructions for loading and executing by a processor the kafka based cluster data and file synchronization method of any one of claims 1-3.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011010531.0A CN112202862B (en) | 2020-09-23 | 2020-09-23 | Method and device for synchronizing cluster data and files based on kafka |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011010531.0A CN112202862B (en) | 2020-09-23 | 2020-09-23 | Method and device for synchronizing cluster data and files based on kafka |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112202862A CN112202862A (en) | 2021-01-08 |
| CN112202862B true CN112202862B (en) | 2023-12-05 |
Family
ID=74016063
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011010531.0A Active CN112202862B (en) | 2020-09-23 | 2020-09-23 | Method and device for synchronizing cluster data and files based on kafka |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112202862B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113485978B (en) * | 2021-06-23 | 2023-07-21 | 华泰证券股份有限公司 | Method, system and memory for improving read-write throughput capacity of file storage NAS |
| CN115174423A (en) * | 2022-07-12 | 2022-10-11 | 中国建设银行股份有限公司 | Kafka query method, device, storage medium and equipment |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110209986A (en) * | 2019-06-06 | 2019-09-06 | 海尔优家智能科技（北京）有限公司 | Internal storage state method of data synchronization and device |
| CN110401724A (en) * | 2019-08-22 | 2019-11-01 | 北京旷视科技有限公司 | File management method, ftp server and storage medium |
| CN110750562A (en) * | 2018-07-20 | 2020-02-04 | 武汉烽火众智智慧之星科技有限公司 | Storm-based real-time data comparison early warning method and system |
| CN111221663A (en) * | 2019-11-21 | 2020-06-02 | 苏州浪潮智能科技有限公司 | Message data processing method, device, equipment and readable storage medium |
-
2020
- 2020-09-23 CN CN202011010531.0A patent/CN112202862B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110750562A (en) * | 2018-07-20 | 2020-02-04 | 武汉烽火众智智慧之星科技有限公司 | Storm-based real-time data comparison early warning method and system |
| CN110209986A (en) * | 2019-06-06 | 2019-09-06 | 海尔优家智能科技（北京）有限公司 | Internal storage state method of data synchronization and device |
| CN110401724A (en) * | 2019-08-22 | 2019-11-01 | 北京旷视科技有限公司 | File management method, ftp server and storage medium |
| CN111221663A (en) * | 2019-11-21 | 2020-06-02 | 苏州浪潮智能科技有限公司 | Message data processing method, device, equipment and readable storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112202862A (en) | 2021-01-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| LU102666B1 (en) | Small-file storage optimization system based on virtual file system in kubernetes user-mode application | |
| CN106021315B (en) | Log management method and system for application program | |
| US20170272499A1 (en) | Method and device for loading webpage | |
| EP3353671A1 (en) | Distributed data processing method and system | |
| CN113452774B (en) | Message pushing method, device, equipment and storage medium | |
| WO2011120791A1 (en) | Transmission of map-reduce data based on a storage network or a storage network file system | |
| CN111010364B (en) | System for offline object-based storage and simulation of REST responses | |
| CN105677251A (en) | Storage system based on Redis cluster | |
| CN112202862B (en) | Method and device for synchronizing cluster data and files based on kafka | |
| CN104657366A (en) | Method and device for writing mass logs in database and log disaster-tolerant system | |
| CN104657435A (en) | Storage management method for application data and network management system | |
| CN110837423A (en) | Method and device for automatically acquiring data of guided transport vehicle | |
| CN115270033A (en) | Data access system, method, equipment and network card | |
| CN104079598A (en) | Method and device for realizing collaborative browsing of webpages | |
| CN116303309A (en) | File mounting method and device and electronic equipment | |
| CN102867029B (en) | A kind of method managing distributive catalogue of document system and distributed file system | |
| EP3349416B1 (en) | Relationship chain processing method and system, and storage medium | |
| CN106790521B (en) | System and method for distributed networking by using node equipment based on FTP | |
| CN111800519A (en) | Communication system, method and device | |
| CN111800511A (en) | Processing method, system, equipment and readable storage medium for synchronous login state | |
| CN115580667B (en) | Data transmission method, device, equipment and storage medium | |
| CN111597157A (en) | Method for improving log processing system architecture | |
| CN108076111B (en) | System and method for distributing data in big data platform | |
| CN113360319B (en) | Data backup method and device | |
| CN112187916B (en) | Cross-system data synchronization method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |