CN111142791A - Data migration method and device - Google Patents
Data migration method and device Download PDFInfo
- Publication number
- CN111142791A CN111142791A CN201911276735.6A CN201911276735A CN111142791A CN 111142791 A CN111142791 A CN 111142791A CN 201911276735 A CN201911276735 A CN 201911276735A CN 111142791 A CN111142791 A CN 111142791A
- Authority
- CN
- China
- Prior art keywords
- transmitted
- file
- files
- data
- transmission
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 44
- 230000005012 migration Effects 0.000 title claims abstract description 14
- 238000013508 migration Methods 0.000 title claims abstract description 14
- 230000005540 biological transmission Effects 0.000 claims abstract description 83
- 230000008569 process Effects 0.000 claims description 8
- 230000001174 ascending effect Effects 0.000 claims description 5
- 230000004048 modification Effects 0.000 claims description 5
- 238000012986 modification Methods 0.000 claims description 5
- 230000006870 function Effects 0.000 description 5
- 230000008676 import Effects 0.000 description 2
- 230000001360 synchronised effect Effects 0.000 description 2
- 230000004075 alteration Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 238000007726 management method Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0646—Horizontal data movement in storage systems, i.e. moving data in between storage devices or systems
- G06F3/0647—Migration mechanisms
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/16—File or folder operations, e.g. details of user interfaces specifically adapted to file systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/0614—Improving the reliability of storage systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/0614—Improving the reliability of storage systems
- G06F3/0619—Improving the reliability of storage systems in relation to data integrity, e.g. data losses, bit errors
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0638—Organizing or formatting or addressing of data
- G06F3/0643—Management of files
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0646—Horizontal data movement in storage systems, i.e. moving data in between storage devices or systems
- G06F3/065—Replication mechanisms
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computer Security & Cryptography (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The application relates to a data migration method and device, wherein the method comprises the following steps: splitting source data into a plurality of files to be transmitted according to a preset data volume threshold; after a transmission task is started, copying a specified number of files to be transmitted to an area to be transmitted according to configuration information of the transmission task; and transmitting the file to be transmitted in the area to be transmitted according to the configuration information of the transmission task. The scheme of the application segments the data to be migrated, and the splitting granularity is small, so that the error rate is lower, and other data files are not affected even if transmission fails; the split minimum unit data is copied to a designated storage area, so that source data are not affected even if problems occur, and the accuracy of the data can be fully ensured; after the data are split, the operability is strong, and the data can be started or stopped at any time.
Description
Technical Field
The application relates to the technical field of basic data accurate transmission, in particular to a data migration method and device.
Background
Due to business needs, basic data with huge inventory needs to be synchronized to other systems from a logistics big data center. The existing solution is that based on a database, an sql file is exported from a source library, and the sql file is executed in a target library and imported; secondly, the data is transmitted point to point through a transmission protocol.
The first scheme is exported in the form of SQL, and when the data volume is too large, the formed SQL file is too large, so that the required import time is too long; if errors occur in the process of importing, the data needs to come again, and data is easily lost. Through the SQL import mode, error information cannot be recorded, control data cannot be imported into the progress, and data storage is realized by continuously modifying an SQL file and continuously importing; because the lead-in time and the progress are difficult to control, the subsequent work arrangement is influenced.
The second scheme is to transmit through a transmission protocol (such as RSF, http and other protocols), when the data volume is huge, the transmission time is too long, so that server resources are continuously occupied for a long time, and great pressure is caused on the server resources.
In the related art, due to the fact that the data volume to be transmitted is too large, taking GB and even TB as units, in the process of transmitting large data volume, situations such as transmission interruption, a single data format not meeting the specification, data loss, etc. can occur, and the solutions commonly used in the industry cannot guarantee the accuracy of the transmitted data. If the file is transmitted through the sql, the data pressure is huge, the error probability is high, and once an error is generated, the file cannot be transmitted continuously, only the imported data can be cleared and then imported again. At present, the security and convenience of large data volume transmission have become one of the current important research directions.
Disclosure of Invention
To overcome, at least to some extent, the problems in the related art, the present application provides a data migration method and apparatus.
According to a first aspect of embodiments of the present application, there is provided a data migration method, including:
splitting source data into a plurality of files to be transmitted according to a preset data volume threshold;
after a transmission task is started, copying a specified number of files to be transmitted to an area to be transmitted according to configuration information of the transmission task;
and transmitting the file to be transmitted in the area to be transmitted according to the configuration information of the transmission task.
Further, the splitting the source data into a plurality of files to be transmitted includes:
arranging the source data in ascending order according to the modification time;
exporting the sequenced source data into files to be transmitted according to a data volume threshold, wherein the data volume contained in each file to be transmitted is not greater than the data volume threshold;
and numbering and naming the exported files to be transmitted in sequence.
Further, the copying a specified number of files to be transmitted to the area to be transmitted includes:
scanning the area to be transmitted;
if no file exists, copying the files to be transmitted in the specified quantity to the area to be transmitted;
after the copy operation is performed, if the region to be transmitted is still empty, the process ends and a notification is sent.
Further, the copying a specified number of files to be transmitted to the area to be transmitted includes:
determining the number N of transmission files and an initial file according to configuration information of a transmission task;
and copying N files to be transmitted to the area to be transmitted, wherein the N files to be transmitted are the N files to be transmitted which are sequentially selected from the initial file.
Further, the method further comprises:
after a transmission task is started, checking whether a file is being transmitted or not;
and if not, assigning a starting file to the file being transmitted, wherein the starting file is determined according to the configuration information of the transmission task.
Further, the method further comprises:
if the transmission is successful, updating the assignment of the initial file, and deleting the file to be transmitted and the corresponding source data in the region to be transmitted;
and transmitting the subsequent file to be transmitted according to the updated initial file.
Further, the updating the assignment of the start file includes:
and assigning the next file to be transmitted of the last file after transmission to the initial file.
Further, the method further comprises:
and if the transmission fails, recording the name of the file which fails to be transmitted, and copying the file to be transmitted which fails to be transmitted to a failure area.
Further, the method further comprises:
starting a transmission task at a specified time point according to the configuration information of the transmission task; or,
and starting the transmission task when the occupancy rate of the server is lower than a starting threshold value according to the running condition of the server.
According to a second aspect of embodiments of the present application, there is provided a data migration apparatus, including:
the splitting module is used for splitting the source data into a plurality of files to be transmitted according to a preset data volume threshold;
the copying module is used for copying the files to be transmitted with the specified quantity to the area to be transmitted according to the configuration information of the transmission task after the transmission task is started;
and the transmission module is used for transmitting the file to be transmitted in the area to be transmitted according to the configuration information of the transmission task.
The technical scheme provided by the embodiment of the application has the following beneficial effects:
the scheme of the application segments the data to be migrated, and the splitting granularity is small, so that the error rate is lower, and other data files are not affected even if transmission fails; the split minimum unit data is copied to a designated storage area, so that source data are not affected even if problems occur, and the accuracy of the data can be fully ensured; after the data are split, the operability is strong, and the data can be started or stopped at any time.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the application.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and together with the description, serve to explain the principles of the application.
FIG. 1 is a flow chart illustrating a method of data migration in accordance with an exemplary embodiment.
FIG. 2 is a flowchart illustrating the execution of a data migration method according to an exemplary embodiment.
Detailed Description
Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present application. Rather, they are merely examples of methods and apparatus consistent with certain aspects of the present application, as detailed in the appended claims.
FIG. 1 is a flow chart illustrating a method of data migration in accordance with an exemplary embodiment. The method can be applied to accurate transmission of the basic data of the enterprise, and comprises the following steps:
step S1: splitting source data into a plurality of files to be transmitted according to a preset data volume threshold;
step S2: after a transmission task is started, copying a specified number of files to be transmitted to an area to be transmitted according to configuration information of the transmission task;
step S3: and transmitting the file to be transmitted in the area to be transmitted according to the configuration information of the transmission task.
The scheme of the application segments the data to be migrated, and the splitting granularity is small, so that the error rate is lower, and other data files are not affected even if transmission fails; the split minimum unit data is copied to a designated storage area, so that source data are not affected even if problems occur, and the accuracy of the data can be fully ensured; after the data are split, the operability is strong, and the data can be started or stopped at any time.
It should be noted that, in the scheme of the present application, the file to be transmitted may be transmitted through a transmission protocol.
Before splitting the source data, the source data needs to be sequenced, so that the split file to be transmitted also has sequentiality, and subsequent management and transmission are facilitated.
In some embodiments, the splitting the source data into a plurality of files to be transmitted includes:
arranging the source data in ascending order according to the modification time;
exporting the sequenced source data into files to be transmitted according to a data volume threshold, wherein the data volume contained in each file to be transmitted is not greater than the data volume threshold;
and numbering and naming the exported files to be transmitted in sequence.
For example, the specific splitting rule may be: the big data centers are arranged according to the ascending order of modification time, and the source files are exported into the csv format according to each hundred thousand. Namely, the file to be transmitted is a file in the csv format.
The naming rule may be: the file names are in order _ prefix plus three (or more) natural numbers and are arranged in ascending order in ASCII code. Wherein the numbers in the file names are numbered in order of export.
Referring to fig. 2, in some embodiments, the copying a specified number of files to be transmitted to the area to be transmitted includes:
scanning the area to be transmitted;
if no file exists, copying the files to be transmitted in the specified quantity to the area to be transmitted;
after the copy operation is performed, if the region to be transmitted is still empty, the process ends and a notification is sent.
The file to be transmitted is copied to the designated storage area, so that source data are not affected even if problems occur, and the accuracy of the data can be fully ensured.
In some embodiments, the copying a specified number of files to be transmitted to the area to be transmitted includes:
determining the number N of transmission files and an initial file according to configuration information of a transmission task;
and copying N files to be transmitted to the area to be transmitted, wherein the N files to be transmitted are the N files to be transmitted which are sequentially selected from the initial file.
In order to enable the data migration process to have stronger operability and controllability, the transmission task is executed according to batches, a batch of N files are transmitted each time, and after the transmission of one batch of files is completed, the next batch of files is transmitted.
In some embodiments, the method further comprises:
after a transmission task is started, checking whether a file is being transmitted or not;
and if not, assigning a starting file to the file being transmitted, wherein the starting file is determined according to the configuration information of the transmission task.
In some embodiments, the method further comprises:
if the transmission is successful, updating the assignment of the initial file, and deleting the file to be transmitted and the corresponding source data in the region to be transmitted;
and transmitting the subsequent file to be transmitted according to the updated initial file.
After the receiving party successfully receives the data, the deleting operation is carried out on the backup file and the data source, so that the accuracy of the data can be better ensured.
In some embodiments, updating the assignment of the start file includes:
and assigning the next file to be transmitted of the last file after transmission to the initial file.
In some embodiments, the method further comprises:
and if the transmission fails, recording the name of the file which fails to be transmitted, and copying the file to be transmitted which fails to be transmitted to a failure area.
In some embodiments, the method further comprises:
starting a transmission task at a specified time point according to the configuration information of the transmission task; or,
and starting the transmission task when the occupancy rate of the server is lower than a starting threshold value according to the running condition of the server.
The method can analyze the running condition of the server, find out the occupation rule of the server resources, and set the time period with low occupation rate as the synchronous running time, thereby fully utilizing the idle resources. The scheme of the application has strong operability, and can be stopped at any time when the pressure of the server is too high.
With reference to fig. 2, the following describes a scheme of the present application in an expanded manner with reference to a specific application scenario.
A. Before starting the transmission task, the transmission task needs to be configured in advance, which includes:
defining a thread number M;
defining a START file NAME START _ NAME;
defining the number N of transmission files;
defining JOB (i.e. transfer task) execution time;
a server startup threshold is defined.
B. The transmission is initiated.
C. Inquiring the file NAME TRANS _ NAME being transmitted, if not, assigning the START _ NAME to the TRANS _ NAME; while recording the file NAME TRANS _ NAME being transferred.
D. Reading a folder to be transmitted, and executing the step E if the folder is empty; if the folder does not exist, the folder is created first, and then step E is executed.
E. Copying N files (including the initial file) after the initial file name is started to a folder to be transmitted; and if the folder is empty at the moment, executing the step I.
F. Transmission is started. This step may be transmitted via a transmission protocol.
G. And D, if the transmission is successful, assigning the last file name to the initial file name, deleting the backup file and the original file, and continuing to execute the steps D and E.
H. And D, if the transmission fails, recording the failed file name and the failed data into the database, copying the file to a failed folder, and continuing to execute the steps D and E.
I. The transmission is finished and the mail sends a summary report.
The scheme of the application also provides a breakpoint resume function, and the execution steps comprise:
manually suspending the transmission task;
the system automatically empties the folder to be transmitted;
the transmission is initiated.
The scheme of the application also provides a fixed point continuous transmission function, and the execution steps comprise:
defining a starting file name;
manually emptying the folder to be transmitted;
the transmission is initiated.
The embodiment of the application provides an accurate transmission scheme of basic data, and this scheme is based on big data volume, can guarantee the accurate transmission of data, and convenient easy operation.
The present application further provides the following embodiments:
a data migration apparatus, comprising:
the splitting module is used for splitting the source data into a plurality of files to be transmitted according to a preset data volume threshold;
the copying module is used for copying the files to be transmitted with the specified quantity to the area to be transmitted according to the configuration information of the transmission task after the transmission task is started;
and the transmission module is used for transmitting the file to be transmitted in the area to be transmitted according to the configuration information of the transmission task.
With regard to the apparatus in the above embodiment, the specific steps in which the respective modules perform operations have been described in detail in the embodiment related to the method, and are not described in detail herein.
It is understood that the same or similar parts in the above embodiments may be mutually referred to, and the same or similar parts in other embodiments may be referred to for the content which is not described in detail in some embodiments.
It should be noted that, in the description of the present application, the terms "first", "second", etc. are used for descriptive purposes only and are not to be construed as indicating or implying relative importance. Further, in the description of the present application, the meaning of "a plurality" means at least two unless otherwise specified.
Any process or method descriptions in flow charts or otherwise described herein may be understood as representing modules, segments, or portions of code which include one or more executable instructions for implementing specific logical functions or steps of the process, and the scope of the preferred embodiments of the present application includes other implementations in which functions may be executed out of order from that shown or discussed, including substantially concurrently or in reverse order, depending on the functionality involved, as would be understood by those reasonably skilled in the art of the present application.
It should be understood that portions of the present application may be implemented in hardware, software, firmware, or a combination thereof. In the above embodiments, the various steps or methods may be implemented in software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, any one or combination of the following techniques, which are known in the art, may be used: a discrete logic circuit having a logic gate circuit for implementing a logic function on a data signal, an application specific integrated circuit having an appropriate combinational logic gate circuit, a Programmable Gate Array (PGA), a Field Programmable Gate Array (FPGA), or the like.
It will be understood by those skilled in the art that all or part of the steps carried by the method for implementing the above embodiments may be implemented by hardware related to instructions of a program, which may be stored in a computer readable storage medium, and when the program is executed, the program includes one or a combination of the steps of the method embodiments.
In addition, functional units in the embodiments of the present application may be integrated into one processing module, or each unit may exist alone physically, or two or more units are integrated into one module. The integrated module can be realized in a hardware mode, and can also be realized in a software functional module mode. The integrated module, if implemented in the form of a software functional module and sold or used as a stand-alone product, may also be stored in a computer readable storage medium.
The storage medium mentioned above may be a read-only memory, a magnetic or optical disk, etc.
In the description herein, reference to the description of the term "one embodiment," "some embodiments," "an example," "a specific example," or "some examples," etc., means that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the application. In this specification, the schematic representations of the terms used above do not necessarily refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.
Although embodiments of the present application have been shown and described above, it is understood that the above embodiments are exemplary and should not be construed as limiting the present application, and that variations, modifications, substitutions and alterations may be made to the above embodiments by those of ordinary skill in the art within the scope of the present application.
Claims (10)
1. A method of data migration, comprising:
splitting source data into a plurality of files to be transmitted according to a preset data volume threshold;
after a transmission task is started, copying a specified number of files to be transmitted to an area to be transmitted according to configuration information of the transmission task;
and transmitting the file to be transmitted in the area to be transmitted according to the configuration information of the transmission task.
2. The method of claim 1, wherein the splitting the source data into a plurality of files to be transmitted comprises:
arranging the source data in ascending order according to the modification time;
exporting the sequenced source data into files to be transmitted according to a data volume threshold, wherein the data volume contained in each file to be transmitted is not greater than the data volume threshold;
and numbering and naming the exported files to be transmitted in sequence.
3. The method of claim 1, wherein copying the specified number of files to be transmitted to the area to be transmitted comprises:
scanning the area to be transmitted;
if no file exists, copying the files to be transmitted in the specified quantity to the area to be transmitted;
after the copy operation is performed, if the region to be transmitted is still empty, the process ends and a notification is sent.
4. The method of claim 3, wherein copying the specified number of files to be transmitted to the area to be transmitted comprises:
determining the number N of transmission files and an initial file according to configuration information of a transmission task;
and copying N files to be transmitted to the area to be transmitted, wherein the N files to be transmitted are the N files to be transmitted which are sequentially selected from the initial file.
5. The method according to any one of claims 1-4, further comprising:
after a transmission task is started, checking whether a file is being transmitted or not;
and if not, assigning a starting file to the file being transmitted, wherein the starting file is determined according to the configuration information of the transmission task.
6. The method according to any one of claims 1-4, further comprising:
if the transmission is successful, updating the assignment of the initial file, and deleting the file to be transmitted and the corresponding source data in the region to be transmitted;
and transmitting the subsequent file to be transmitted according to the updated initial file.
7. The method of claim 6, wherein updating the value assigned to the start file comprises:
and assigning the next file to be transmitted of the last file after transmission to the initial file.
8. The method of claim 6, further comprising:
and if the transmission fails, recording the name of the file which fails to be transmitted, and copying the file to be transmitted which fails to be transmitted to a failure area.
9. The method of any one of claims 1-4 and 7-8, further comprising:
starting a transmission task at a specified time point according to the configuration information of the transmission task; or,
and starting the transmission task when the occupancy rate of the server is lower than a starting threshold value according to the running condition of the server.
10. A data migration apparatus, comprising:
the splitting module is used for splitting the source data into a plurality of files to be transmitted according to a preset data volume threshold;
the copying module is used for copying the files to be transmitted with the specified quantity to the area to be transmitted according to the configuration information of the transmission task after the transmission task is started;
and the transmission module is used for transmitting the file to be transmitted in the area to be transmitted according to the configuration information of the transmission task.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911276735.6A CN111142791A (en) | 2019-12-12 | 2019-12-12 | Data migration method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911276735.6A CN111142791A (en) | 2019-12-12 | 2019-12-12 | Data migration method and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111142791A true CN111142791A (en) | 2020-05-12 |
Family
ID=70518065
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911276735.6A Pending CN111142791A (en) | 2019-12-12 | 2019-12-12 | Data migration method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111142791A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112732175A (en) * | 2020-12-25 | 2021-04-30 | 华录光存储研究院（大连）有限公司 | Data transmission method and system |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101582064A (en) * | 2008-05-15 | 2009-11-18 | 阿里巴巴集团控股有限公司 | Method and system for processing enormous data |
| CN109831481A (en) * | 2018-12-21 | 2019-05-31 | 厦门市美亚柏科信息股份有限公司 | A kind of method, apparatus and storage medium of big file declustering transmission |
-
2019
- 2019-12-12 CN CN201911276735.6A patent/CN111142791A/en active Pending
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101582064A (en) * | 2008-05-15 | 2009-11-18 | 阿里巴巴集团控股有限公司 | Method and system for processing enormous data |
| CN109831481A (en) * | 2018-12-21 | 2019-05-31 | 厦门市美亚柏科信息股份有限公司 | A kind of method, apparatus and storage medium of big file declustering transmission |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112732175A (en) * | 2020-12-25 | 2021-04-30 | 华录光存储研究院（大连）有限公司 | Data transmission method and system |
| CN112732175B (en) * | 2020-12-25 | 2024-05-14 | 华录光存储研究院（大连）有限公司 | Data transmission method and system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11321291B2 (en) | Persistent version control for data transfer between heterogeneous data stores | |
| US11385830B2 (en) | Data storage method, apparatus and system, and server, control node and medium | |
| WO2017049764A1 (en) | Method for reading and writing data and distributed storage system | |
| JP6475304B2 (en) | Transaction processing method and apparatus | |
| CN113111129A (en) | Data synchronization method, device, equipment and storage medium | |
| CN113220660A (en) | Data migration method, device and equipment and readable storage medium | |
| US10983718B2 (en) | Method, device and computer program product for data backup | |
| CN114721881B (en) | Database management method, system, electronic device and storage medium | |
| CN111142791A (en) | Data migration method and device | |
| WO2021082925A1 (en) | Transaction processing method and apparatus | |
| CN109471901B (en) | Data synchronization method and device | |
| CN109992447B (en) | Data copying method, device and storage medium | |
| CN110119389B (en) | Writing operation method of virtual machine block equipment, snapshot creation method and device | |
| CN112860746B (en) | Cache reduction-based method, equipment and system | |
| CN111147226A (en) | Data storage method, device and storage medium | |
| CN104809033B (en) | A kind of backup method and system | |
| CN108345431B (en) | Data reading method and device | |
| CN112181729A (en) | Virtual machine backup control device, system and method | |
| US20240143454A1 (en) | System and techniques for backing up scalable computing objects | |
| CN110677497A (en) | Network medium distribution method and device | |
| CN114900531B (en) | Data synchronization method, device and system | |
| CN112948052B (en) | Virtual machine migration method across data centers, data center and computer medium | |
| CN117407362B (en) | Method and device for file migration among heterogeneous file systems | |
| CN111797062B (en) | Data processing method, device and distributed database system | |
| CN111694887B (en) | Data adaptive storage scheduling system and method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200512 |
|
| RJ01 | Rejection of invention patent application after publication |