CN105700823A - Method and apparatus for transmitting data between IP hard disks - Google Patents
Method and apparatus for transmitting data between IP hard disks Download PDFInfo
- Publication number
- CN105700823A CN105700823A CN201510981553.4A CN201510981553A CN105700823A CN 105700823 A CN105700823 A CN 105700823A CN 201510981553 A CN201510981553 A CN 201510981553A CN 105700823 A CN105700823 A CN 105700823A
- Authority
- CN
- China
- Prior art keywords
- hard disk
- data
- target
- source
- controller
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 38
- 238000013508 migration Methods 0.000 claims abstract description 81
- 230000005012 migration Effects 0.000 claims abstract description 81
- 230000005540 biological transmission Effects 0.000 claims description 41
- 238000012545 processing Methods 0.000 claims description 24
- 238000004891 communication Methods 0.000 claims description 17
- 239000012634 fragment Substances 0.000 abstract description 24
- 230000008569 process Effects 0.000 description 6
- 238000010586 diagram Methods 0.000 description 5
- 230000006870 function Effects 0.000 description 4
- 238000013461 design Methods 0.000 description 3
- 239000003795 chemical substances by application Substances 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000013467 fragmentation Methods 0.000 description 1
- 238000006062 fragmentation reaction Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 230000009897 systematic effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/061—Improving I/O performance
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0646—Horizontal data movement in storage systems, i.e. moving data in between storage devices or systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/067—Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
Embodiments of the present invention disclose a method and an apparatus for transmitting data between IP hard disks. The method comprises: receiving a data migration request, wherein the request comprises an ID of data that needs to be migrated; according to the ID of the data that needs to be migrated, determining a source IP hard disk where fragment data related to the ID of the data is located and a migration target IP hard disk; sending an instruction to the source IP hard disk, wherein the instruction comprises identification information in the target IP hard disk, and sending an instruction to the target IP hard disk, wherein the instruction comprises identification information of the source IP hard disk; and establishing a connection between the source IP hard disk and the target IP hard disk by means of the identification information, so as to implement migration of the fragment data. According to the method and the apparatus disclosed by the embodiments of the present invention, a connection is established between the source IP hard disk and the target IP hard disk, and the fragment data that needs to be migrated is sent from the source IP hard disk to the target IP hard disk by means of the established connection. The problem that data needs to pass through a controller in the prior art is avoided, and resource utilization of the controller is improved.
Description
Technical field
The present invention relates to field of data transmission, particularly relate to the method and apparatus transmitting data between a kind of IP hard disk。
Background technology
Network interconnection agreement (InternetProtocol, IP) hard disk is for providing the hard disk of IP protocol interface。It is a kind of emerging storage hardware state, adopts ICP/IP protocol directly and upper strata carries out network communication and provides object storage service。Owing to IP hard disk directly can be communicated with main frame by IP agreement, not only make between IP hard disk and main frame without distance limit, and can support that large-scale parallel accesses, the speed of data access is greatly improved。
IP hard disk in use, needs under certain situation to carry out data transmission between IP hard disk, and such as when doing Data Migration, data need to move to another IP hard disk from an IP hard disk。
In prior art, data transmission mainly spreads out of through controller。Data stream after controller, is transferred to an other IP hard disk from an IP hard disk。The mode of existing IP hard disk transmission data, can cause data elder generation flow direction controller, then be mail to migration Target IP hard disk by controller, consume the Internet resources of controller。
Summary of the invention
Embodiments provide the method and apparatus transmitting data between a kind of IP hard disk, it is possible to achieve save the purpose of controller resource。
On the one hand, embodiments herein provides a kind of method transmitting data between IP hard disk, and the method includes receiving Data Migration request, the mark according to the data to be migrated that Data Migration request includes。Mark according to data to be migrated, it is determined that the source IP hard disk at this data place, and, determine, by algorithm, the Target IP hard disk that data to be migrated will move to。By sending instruction to source IP hard disk and Target IP hard disk, make source IP hard disk and Target IP hard disk set up and connect, so that source IP hard disk and Target IP hard disk carry out the transmission of data according to the connection set up。Carried out data transmission by the connection set up, without to controlling node transmission data, send data again through controlling node to Target IP hard disk。Thus having saved the resource controlling node, improve the service efficiency of equipment。
In a possible design, send instruction to source IP hard disk and Target IP hard disk and refer to, send the identification information of Target IP hard disk to source IP hard disk and need the identification information of the data migrated。To the identification information of Target IP hard disk transmission source IP hard disk and the identification information needing the data migrated。The identification information of source IP hard disk and Target IP hard disk the other side by obtaining is set up and is connected。By obtaining the identification information of the other side's IP hard disk, it is connected thus setting up with the other side's IP hard disk。Also the transmission of data being made more quick by setting up independent data channel, systematic function is higher。
In a possible design, the identification information sending Target IP hard disk to source IP hard disk is the IP address sending Target IP hard disk to source IP hard disk。Identification information to Target IP hard disk transmission source IP hard disk is the IP address to Target IP hard disk transmission source IP hard disk。In IP hard disk, by ICP/IP protocol, the IP address according to the other side obtained, set up thereby through network, without additionally increasing miscellaneous equipment, make the connection between IP dish more convenient。
On the other hand, embodiments herein provides a kind of controller。Controller includes processor, communication interface and bus。Wherein, processor and communication interface pass through bus communication。Communication interface is for communicating with multiple IP hard disks。When plant running, processor is used for performing said method。
Another further aspect, embodiments herein provides a kind of data transmission device。This device includes any one embodiment included for the method performed on the one hand。
The application provides the method and apparatus of data transmission between a kind of IP hard disk, by sending instruction to source IP hard disk and Target IP hard disk, make to set up between source IP hard disk and Target IP hard disk to connect, make to need through controller thus avoiding transmitting data resources, thus achieve the saving of controller resource, and improve the service efficiency of equipment。
Accompanying drawing explanation
The hardware structure diagram of a kind of data resource storage system that Fig. 1 provides for the embodiment of the present invention；
A kind of IP hard disk that Fig. 2 provides for the embodiment of the present invention and the data resource storage system hardware structure figure that controller is arranged in same equipment；
The controller hardware structure chart that Fig. 3 provides for the embodiment of the present invention；
The IP hard disk hardware structure chart that Fig. 4 provides for the embodiment of the present invention；
The method flow diagram of data transmission between a kind of IP hard disk that Fig. 5 provides for the embodiment of the present invention；
Data Migration flow chart between a kind of IP hard disk that Fig. 6 provides for the embodiment of the present invention；
Data Migration flow chart between a kind of IP hard disk that Fig. 7 provides for the embodiment of the present invention；
Instruction flow graph during transmission data between a kind of IP hard disk that Fig. 8 provides for the embodiment of the present invention；
Instruction flow graph during transmission data between the another kind of IP hard disk that Fig. 9 provides for the embodiment of the present invention；
The data list that a kind of controller that Figure 10 provides for the embodiment of the present invention includes；
A kind of controller for Data Migration that Figure 11 provides for the embodiment of the present invention；
A kind of controller hardware structure chart that Figure 12 provides for the embodiment of the present invention。
Detailed description of the invention
Below by drawings and Examples, the technical scheme of the embodiment of the present invention is described in further detail。
The embodiment of the present invention provides the method and apparatus transmitting data between a kind of IP hard disk。In embodiments of the present invention, device at least includes multiple IP hard disk and at least one controller。Described controller is receiving the request that user sends and the mark (identification needing the data migrated, ID) after, it is determined that need the Target IP hard disk that the source IP hard disk at the burst information that formed of data ID and the fragment data place migrated and fragment data will migrate。Source IP hard disk and/or Target IP hard disk will be sent instruction by controller。Source IP hard disk and Target IP hard disk are according to instruction, it would be desirable to the fragment data of migration is sent to Target IP hard disk from source IP hard disk。Solve data in prior art and need through controller, it is to avoid the problem of the consumption that the resource of controller is unnecessary。
The hardware structure diagram of a kind of data resource storage system that Fig. 1 provides for the embodiment of the present invention。As it is shown in figure 1, resource storage system includes controller and multiple IP hard disk。Fig. 1 signal gives an IP hard disk, the 2nd IP hard disk and the 3rd IP hard disk。
Controller is generally arranged in network, is configured with network communication interface and address, for instance Ethernet interface, and is configured with ICP/IP protocol and IP address。User or miscellaneous equipment are by IP addressing of address to controller, and request controller processes data storage issues。
IP hard disk is a kind of storage hardware state, and it is configured with Ethernet interface, adopts ICP/IP protocol directly and controller carries out network service and provides object storage service。In addition, multiple IP hard disks can have identical internal structure, it is possible to have different internal structures, does not repeat again at this。
IP hard disk includes memorizer and storage control, can be attached between the storage control of each IP dish, and this connection can be through procotol and is attached, it is also possible to be attached by other agreements。When being connected by network, it is need the identification information of the IP hard disk connected to be attached by acquisition。In embodiments of the present invention, the identification information of IP hard disk is the IP address of this IP hard disk。
In FIG, controller and IP hard disk are arranged on different network sites。But, in an embodiment of the present invention, resource controller system memory and IP hard disk can also be arranged in same equipment。A kind of IP hard disk that Fig. 2 provides for the embodiment of the present invention and the data resource storage system hardware structure figure that controller is arranged in same equipment。As in figure 2 it is shown, multiple IP hard disks can be arranged in same hardware configuration, each IP hard disk is connected to controller by Ethernet interface by network, and multiple IP hard disks form a resource storage system。
Under the control of the controller, data transmission each other can directly be initiated by different IP hard disks, carries out data transmission without through controller。For the convenience stated, in a particular embodiment of the present invention for two IP hard disks, it is necessary to the IP hard disk at the resource place of migration is source IP hard disk, the IP hard disk that resource will move to is Target IP hard disk。It is understood by those skilled in the art that the transmission of such data is not limited between two IP hard disks, it is also possible to extension is applicable between arbitrary multiple IP hard disks。
The controller hardware structure chart that Fig. 3 provides for the embodiment of the present invention, as it is shown on figure 3, also include processor, memorizer and internal memory in controller。Storing data list in memorizer, data list includes the segmental identification of the burst corresponding to data ID, data ID and the IP hard disk mark of the stored IP hard disk of burst。Memorizer stores instruction list, for instance include receiver module, processing module and sending module。Processor, by reading in internal memory by instruction list and data list, performs instruction list, carries out the reception of data, process and transmission according to data list。
In one example, user sends an object needing storage to controller。Object is stored to IP hard disk by processor by calling processing module。Burst is to carry out with burst rule and redundancy rule, is not discussed in detail at this。Processor is also by the information write data list after data fragmentation, and the information to data list write includes the identification information of the burst formed after data carry out burst, the ID of storage data and the mark of the stored IP hard disk of burst。
In another example, user have sent a data read request to controller, and this request is received by processor by performing receiver module。This request includes the ID of the data needing reading。Processor obtains the burst corresponding to this data ID by performing the instruction of processing module from data list, obtains the segmental identification of burst and the IP disc identifier of the IP hard disk at each burst place。Processor, by performing the instruction of sending module, sends instruction to the IP hard disk corresponding to each burst, and this instruction includes the segmental identification needing the burst of migration in each IP hard disk, and IP hard disk sends burst by segmental identification to processor。Processor receives the fragment data that each IP hard disk returns, and is sent to user after fragment data aggregates into object。
In another example, user have sent a data migration request to controller, and this request is received by processor by performing receiver module。This request includes the ID of the data needing migration。Processor obtains the segmental identification corresponding to this data ID and the IP disc identifier of this burst place IP hard disk by performing the instruction of processing module from data list。Meanwhile, by performing processing module, processor determines which IP hard disk the burst corresponding to these data will be migrated to。Processor sends instruction by performing the Target IP hard disk of the sending module source IP hard disk to burst place and/or migration, and described instruction includes the segmental identification of the burst that needs migrate and the identification information of source IP hard disk and/or Target IP hard disk。Source IP hard disk and/or Target IP hard disk are set up connection by obtaining the IP hard disk identification information of the other side and carry out Data Migration。
It should be noted that hardware structure here only belongs to citing, present disclosure applies equally to other type of controller architecture。
The IP hard disk hardware structure chart that Fig. 4 provides for the embodiment of the present invention, as shown in Figure 4, including storage medium and storage control, storage control includes Magnetic Disk Controler and independent internal memory。Storage medium, for the data received are stored, meanwhile, also includes the storage of control information in storage medium。Control information includes burst information and control instruction。Control instruction such as includes receiver module, processing module and sending module etc., for calling of Magnetic Disk Controler, thus carrying out associative operation。Burst information includes the segmental identification of each burst and the physical address that burst is in storage medium。Burst information and control instruction are generally transferred internal memory in the course of the work, to facilitate calling of Magnetic Disk Controler。Magnetic Disk Controler, by reading in internal memory by control instruction and burst information, performs control instruction, carries out the reception of fragment data, process and transmission according to burst information。
In one example, the burst that IP hard disk reception controller sends is stored in instruction and needs the fragment data of storage。Fragment data is stored in the storage medium of IP hard disk by controller by performing processing module。Meanwhile, controller is also by the identification information of the burst of each fragment data and burst physical address write burst information on a storage medium。Controller returns operation to controller again and completes instruction。
In another example, IP hard disk (by Ethernet interface and receiver module) receives the burst taking-up instruction that controller sends, and this instruction includes the segmental identification of the burst that needs take out。Controller is by performing processing module and calling burst information and determine the burst physical address on a storage medium needing to take out。Read the data of storage on physical address, and data are sent to controller by sending module and Ethernet interface。
In another example, IP hard disk receives the burst that controller sends and moves out instruction, and the instruction of moving out of described burst is to be migrated to by burst in the different IP hard disks under same controller。Instruction of moving out includes the segmental identification of the burst that needs migrate and is identified by the IP hard disk of the Target IP hard disk moved into。Controller is connected with the foundation of Target IP hard disk by the IP hard disk mark of Target IP hard disk。Controller also performs processing module and calls burst information and determine the burst physical address on a storage medium needing to take out。Read the data of storage on physical address, by the connection with migration Target IP hard disk foundation, it would be desirable to the burst of migration sends to Target IP hard disk。
The method flow diagram of data transmission between a kind of IP hard disk that Fig. 5 provides for the embodiment of the present invention。Described method is applied in storage system, and described storage system includes multiple IP hard disk and controller。The executive agent of the method is controller。As shown in Figure 6, the method includes:
S501, controller receiving data migration request, the request of described Data Migration includes the mark of data to be migrated。
The controller migration message of data by being sent by classmate interface user, thus carrying out the migration of data according to the request message of user。In an embodiment of the present invention, controller receives, also by communication interface, the message that user sends, and controller and user are directly connected to (such as: be attached) by network。
S502, described controller determines source IP hard disk and the Target IP hard disk at described data place to be migrated according to the mark of described data to be migrated and corresponding relation set in advance。Described corresponding relation includes the corresponding relation between mark and the mark of described Target IP hard disk of the mark of described data to be migrated, described source IP hard disk。
Store to IP hard disk in data, the data needing storage are carried out burst。Therefore, before migrating, it is necessary to know the burst that the data of migration are included in IP hard disk。Burst included by data, it is determined that the IP hard disk at the burst place of migration。
In memorizer, storage needs to migrate the mark of data and corresponding relation set in advance, it is determined that the source IP hard disk at described data place to be migrated and Target IP hard disk。Corresponding relation includes the corresponding relation between mark and the mark of described Target IP hard disk of the mark of described data to be migrated, described source IP hard disk。
Determine source IP hard disk and Target IP hard disk according to corresponding relation after, the source IP hard disk needing the data place migrated is sent migration instruction, make migration Target IP hard disk obtain the object needing to migrate。
After IP hard disk obtains the fragment data that controller sends, Magnetic Disk Controler will be stored in fragment data in IP hard disk automatically, and stores the information of burst in this IP hard disk。
When controller obtains the Data Migration request that user sends, this request message will be analyzed, it is determined that need the data migrated。Controller also will inquire about the burst of these data, and determines this burst is in which IP hard disk by the corresponding relation of storage in memorizer。Controller is by according to the algorithm preserved in solicited message and disk, it is determined that the migration target location of this object。
S503, controller sends the mark of described Target IP hard disk to described source IP hard disk, and described controller sends the mark of described source IP hard disk to described Target IP hard disk, sets up for described source IP hard disk and described Target IP hard disk and connects。
In an embodiment of the present invention, including three kinds of transmission modes。Respectively sending Data Migration instruction to former IP hard disk, Data Migration instruction includes the identification information of Target IP hard disk。Sending Data Migration instruction to Target IP hard disk, Data Migration instruction includes the identification information of source IP hard disk。Data Migration instruction to the transmission of source IP hard disk includes the identification information of Target IP hard disk, and the Data Migration instruction to the transmission of Target IP hard disk includes the identification information of source IP hard disk。Instruction to the transmission of Target IP hard disk includes the identification information of source IP hard disk。
Object place IP hard disk and/or migration Target IP hard disk, after obtaining the IP hard disk mark of the other side's IP hard disk, are connected by the IP hard disk mark foundation obtained。When source IP hard disk and the migration destination disk at data place are set up after connecting and also returned to controller respectively through Magnetic Disk Controler, controller sends, to source IP hard disk and Target IP hard disk, the order starting transmission after receiving the information being successfully established connection more respectively。
S504, after described source IP hard disk and described Target IP hard disk are set up and connected, described controller sends Data Migration instruction to described source IP hard disk, and described instruction includes the mark of described data to be migrated。
After Target IP hard disk and source IP hard disk are set up and connected, controller also sends instruction to source IP hard disk and Target IP hard disk respectively。Described send instruction to source IP hard disk, be used for indicating source IP hard disk, read corresponding data, according to the connection set up with Target IP hard disk to Target IP hard disk transmission data。Described send instruction to Target IP hard disk, be used for indicating Target IP hard disk, according to the connection set up with source IP hard disk, read the data of the corresponding burst of source IP hard disk transmission and store。
S505, described source IP hard disk reads described data to be migrated according to the mark of described data to be migrated, and is sent to described Target IP hard disk。
The source IP hard disk segmental identification according to storage, reads corresponding data。Source IP hard disk, according to the connection set up with Target IP hard disk, sends corresponding data to Target IP hard disk。The Target IP hard disk mark according to the mark of source IP hard disk, the data needing to migrate that source IP hard disk is sent are read out。After migration completes, source IP hard disk and Target IP hard disk return to controller respectively。Controller returns the operation being successfully made Data Migration again to user。
The flow chart of Data Migration between a kind of IP hard disk that Fig. 6 provides for the embodiment of the present invention, the executive agent of the method is the source IP hard disk at data resource place needing to migrate。As shown in Figure 6, the method includes:
S601, receives Data Migration instruction, and described instruction includes the relevant burst information of data ID that needs migrate and with migrating target IP hard disk identification information。
Determine the operation that will carry out according to instruction, in embodiments of the present invention, the operation that carry out is Data Migration。By the burst information that data ID is relevant, it is determined that this fragment data corresponding to burst information the storage position of source IP hard disk。By Target IP hard disk identification information, send information to Target IP hard disk。
S602, determines the destination disk of the data needing migration by the Target IP hard disk identification information obtained。
In an embodiment of the present invention, the identification information of Target IP hard disk is the IP address of Target IP hard disk。Source IP hard disk is by obtaining the IP address of Target IP hard disk so that it is determined that the Target IP hard disk that will move to of object。Due to source IP hard disk and the built vertical connection of Target IP hard disk, thus Target IP hard disk and source IP hard disk are made directly communication。
S603, by the connection that source IP hard disk and Target IP hard disk are set up, sends fragment data to Target IP hard disk。
In embodiments of the present invention, built vertical connection between source IP hard disk and Target IP hard disk, after determining migration Target IP hard disk, send information to Target IP hard disk, this information includes the fragment data that needs migrate。
In further example, IP hard disk receives the burst that controller sends and moves into instruction, and burst instruction of moving into is to be moved into from the different IP hard disks same controller by burst。Instruction of moving into includes the IP hard disk mark of the segmental identification of burst and the source IP hard disk at this burst place。Controller is connected with the foundation of source IP hard disk by the IP hard disk mark of source IP hard disk。Controller, also by performing sending module, utilizes the connection set up with former IP hard disk, sends the burst needing to migrate to source IP hard disk。Controller obtains, by performing receiver module, the fragment data that source IP hard disk sends, and stores to storage medium。Also by the segmental identification of the burst of reception and burst, the physical address in storage medium is written in burst information Magnetic Disk Controler, then has processed to controller return。
Data Migration flow chart between a kind of IP hard disk that Fig. 7 provides for the embodiment of the present invention, the execution master map of the method can be Target IP hard disk。As it is shown in fig. 7, the method includes:
S701 receives Data Migration instruction, and described instruction includes the identification information of the source IP hard disk at the relevant burst information of data ID that needs migrate and fragment data place。
The operation that will carry out is determined according to instruction, in embodiments of the present invention, the migration that operation is data that carry out。By the burst information that data ID is relevant, it is determined that need the fragment data obtained。By Target IP hard disk identification information, send information to Target IP hard disk。Described information includes the burst information of the fragment data that needs obtain, and makes source IP hard disk send this fragment data to Target IP hard disk。
By the described source IP hard disk identification information obtained, S702 determines that the data place dish needing to migrate is Target IP hard disk。
In an embodiment of the present invention, the identification information of source IP hard disk is the IP address of source IP hard disk。Target IP hard disk by the IP address of acquisition source IP hard disk so that it is determined that the IP hard disk at object place。Due to source IP hard disk and the built vertical connection of Target IP hard disk, thus Target IP hard disk and source IP hard disk are made directly communication。
The connection that S703 is set up by Target IP hard disk and source IP hard disk, receives the fragment data that source IP hard disk sends。
In embodiments of the present invention, built vertical connection between source IP hard disk and Target IP hard disk, after determining that object place dish is source IP hard disk, send information to Target IP hard disk, make source IP hard disk the fragment data migrated will be needed to send to Target IP hard disk。The data that source IP hard disk is sent are received and stored by Target IP hard disk。
Below, by an example, the Data Migration of the specific embodiment of the invention is made more complete explanation。Embodiments of the invention include controller, source IP dish, Target IP dish。Controller, for the IP hard disk in whole resource storage system is controlled, is sent to each IP hard disk and stores after externally obtained data are carried out burst。Controller is connected to the user of outside also by interface (such as Ethernet interface), thus obtaining the data and acceptance request that need storage, sends the read-write of storage to user。
The burst that controller will determine that these data comprise within the storage system, and determine which IP hard disk this burst is stored in。Behind the storage position determining the data needing migration, controller also will determine which IP hard disk will be the resource needing to migrate will be moved in。Determine that migrating destination disk can be chosen by the selection rule arranged in the controller。In one example, described migration rules is the IP hard disk that residual memory space is maximum, naturally it is also possible to be other any rule, migrates the determination restriction not as range of embodiment of the invention of destination disk。In an embodiment of the present invention, migration destination disk is defined as the 2nd IP hard disk。
After determining that migration data are stored in source IP hard disk and migrate Target IP hard disk, controller will send instruction to source IP hard disk and Target IP hard disk respectively。Transmission includes, to the instruction of source IP hard disk, the burst information that needs migrate, and migrates the identification information of destination disk。Controller transmission includes the burst information that needs migrate and the IP hard disk at object place to the instruction of Target IP hard disk。The Magnetic Disk Controler of source IP hard disk and the Magnetic Disk Controler of Target IP hard disk, after receiving above-mentioned information, will be set up by respective Magnetic Disk Controler and connect。Source IP hard disk and Target IP hard disk are set up the mark connecting the other side's IP hard disk including utilization reception and are verified。And transmission needs the burst of the data migrated mutually, to determine the data needing to migrate。
When source IP hard disk and Target IP hard disk also return to controller respectively through Magnetic Disk Controler after setting up and connecting, controller sends, to source IP hard disk and Target IP hard disk, the order starting transmission after receiving the information being successfully established connection more respectively。After Data Migration completes, source IP hard disk and Target IP hard disk return to controller respectively。Controller returns the operation being successfully made Data Migration again to user。
In an embodiment of the present invention, the situation that a kind of source IP hard disk and Target IP hard disk have completed to connect is also included。Now, it is only necessary to an IP hard disk (such as Target IP hard disk) sends instruction wherein。Instruction flow graph during a kind of IP hard disc data transmission that Fig. 8 provides for the embodiment of the present invention。As shown in Figure 8, if the IP hard disk that source IP hard disk is the data place needing migration, Target IP hard disk is the destination address IP hard disk of Data Migration。Embodiments of the invention directly transmit instruction to Target IP hard disk by controller, make source IP hard disk and Target IP hard disk set up and connect, thus directly by resource from the transmission of source IP hard disk to Target IP hard disk。Reach to be not take up the calculating of controller and Internet resources, make the purpose that data transmission is more efficient。
Data flow shown in Fig. 8 is a kind of detailed description of the invention in the invention process。In embodiments of the present invention, the graph of a relation of a kind of data flow contrary with Fig. 8 is also included。Instruction flow graph during the another kind of IP hard disc data transmission that Fig. 9 provides for the embodiment of the present invention, as it is shown in figure 9, the IP hard disk that source IP hard disk is the resource place needing migration, Target IP hard disk is the destination address IP hard disk of the resource migration needing migration。Controller directly transmits instruction to source IP hard disk, makes Target IP hard disk and source IP hard disk set up and connects, thus directly by resource from the transmission of source IP hard disk to Target IP hard disk。
Below, by a specific example, the Data Migration of the embodiment of the present invention is laid down a definition。User stores system to resource and sends an object migration request。The data ID of this request is " Movie ", is divided into five bursts when storage by burst in data。The data list that a kind of controller that Figure 10 provides for the embodiment of the present invention includes, as shown in Figure 10, data list includes object ID, segmental identification and three information of IP disc identifier。Wherein, the embodiment of the present invention needs the object ID " Movie " migrated to include 5 bursts。The segmental identification of five bursts respectively " 001 ", " 002 ", " 003 ", " 004 ", " 005 ", five bursts are stored in IP disc id information in " 192.168.1.1 ", and in the embodiment of the present invention, IP disc id information is the IP address of this IP dish。Thus, controller obtains the segmental identification of the burst needing the data migrated to include is " 001 ", " 002 ", " 003 ", " 004 ", " 005 "。Source tray is IP address is the dish of " 192.168.1.1 ", in embodiments of the present invention, is in order to express easily designated source IP hard disk。Migrate destination disk to select according to algorithm, in embodiments of the present invention, the IP hard disk selecting IP disc id information to be " 192.168.1.2 ", it is expressed as Target IP hard disk。
Controller sends data to source IP hard disk and moves out instruction, and the segmental identification that instruction includes is " 001 ", " 002 ", " 003 ", " 004 ", " 005 ", including destination disk IP address be " 192.168.1.2 "。Controller sends data to Target IP hard disk and moves into instruction, and the segmental identification that instruction includes is " 001 ", " 002 ", " 003 ", " 004 ", " 005 ", including source tray IP address be " 192.168.1.1 "。
Source IP hard disk and Target IP hard disk are connected with square plate is set up by IP address and the ICP/IP protocol of the other side。Source IP hard disk obtains the burst of storage in physical address corresponding in storage medium by segmental identification, by this burst by the connection transmission set up with Target IP hard disk to Target IP hard disk。Target IP hard disk according to segmental identification by identification information be " 001 ", " 002 ", " 003 ", " 004 ", " 005 " burst store to the storage medium of Target IP hard disk。Source IP hard disk and Target IP hard disk also will return message to controller after sending and finishing receiving, controller is according to the message modification data list returned, the IP disc identifier that data " Movie " are corresponding is revised as " 192.168.1.2 ", then has processed to user's return。
A kind of controller for Data Migration that Figure 11 provides for the embodiment of the present invention, as shown in figure 11, including processing unit 1101, transmitting element 1102 and reception unit 1103。
Receiving unit 1103, for controller receiving data migration request, the request of described Data Migration includes the mark of data to be migrated。
Processing unit 1101, determines source IP hard disk and the Target IP hard disk at described data place to be migrated for the mark according to described data to be migrated and corresponding relation set in advance。Described corresponding relation includes the corresponding relation between mark and the mark of described Target IP hard disk of the mark of described data to be migrated, described source IP hard disk。
Transmitting element 1102, for sending the mark of described Target IP hard disk to described source IP hard disk, described controller sends the mark of described source IP hard disk to described Target IP hard disk, sets up for described source IP hard disk and described Target IP hard disk and connects。
And, after setting up connect at described source IP hard disk and described Target IP hard disk, sending Data Migration instruction to described source IP hard disk, described instruction includes the mark of described data to be migrated。
Reach described source IP hard disk and read described data to be migrated according to the mark of described data to be migrated, and be sent to described Target IP hard disk。
Below, by an example, the invention process csr controller is illustrated in conjunction with the operating process of other parts。In order to the explanation of controller is more clear, following example further comprises other structure being connected with processor, including the user sending request to controller, and receive the source memory and target memory that control operation。
Controller is connected to user by interface, thus accepting the request that user sends, and the instruction such as the migration of complete paired data or duplication。Connection between controller and user can be any form or method, in an embodiment of the present invention, is attached by Ethernet interface。After user and controller, send data to the reception unit of controller。It is connected by network between controller with each IP hard disk。Also being attached between each IP hard disk, this connection can be through procotol and is attached, it is also possible to be attached by other agreements。So that the transmission of data can be carried out between each IP hard disk。
Receive unit and connected the instruction getting the Data Migration that user sends by network, receive unit and the instruction received is transmitted to processing unit, resolved by processing unit。Instruction is resolved and includes obtaining the data that the needs comprised in this information migrate by processing unit。Processing unit determines which IP hard disk is these data be stored in。In an example of the present invention, it is necessary to the data of migration are stored in the IP hard disk of source。
Behind the storage position determining the data needing migration, the IP at the resource migrated as required and this resource place is also determined resource to be moved in which Target IP hard disk by processing unit firmly。In an embodiment of the present invention, owing to only having two IP hard disks, therefore in an example of the present invention, it is necessary to the data of migration are migrated to Target IP hard disk。Determine that the algorithm migrating Target IP hard disk can be chosen by the rule arranged in the controller, migrate the determination restriction not as range of embodiment of the invention of Target IP hard disk。
After determining the Target IP hard disk migrating resource stored source IP hard disk and migration, processing unit will send the message of the identification information migrating instruction and migration destination disk of data, and transmitting element will send the source IP hard disk to resource place this message。Meanwhile, controller also will send Data Migration instruction and the identification information of source, resource place IP hard disk, and transmitting element will send this message to migrating in Target IP hard disk。The source IP at resource place is hard and migrates Target IP hard disk after receiving above-mentioned information, connects being set up by above-mentioned identification information。Migrate Target IP hard disk and also will set up corresponding memory space。Source IP hard disk and Target IP hard disk are set up the connection mark included by processing unit sends and are verified。
Setting up between source IP hard disk and Target IP hard disk after connecting, source IP hard disk and Target IP hard disk also return, to processing unit, the information being successfully established connection respectively。Processing unit, after receiving the information being successfully established connection, sends to source IP hard disk and Target IP hard disk respectively and starts to transmit the instruction of data。Source IP hard disk sends the resource needing to migrate according to instruction to Target IP hard disk。The resource of reception is stored to newly-established memory space by Target IP hard disk。After source IP hard disk and Target IP hard disk send and finish receiving, also return the instruction successfully carrying out Data Migration to processing unit respectively through transmitting element。Processing unit, after receiving the instruction of source IP hard disk and Target IP hard disk, will return result to user。
A kind of resources balance equipment schematic diagram that Fig. 8 provides for the embodiment of the present invention。
As shown in figure 12, described equipment includes: processor 1201, memorizer 1202, communication interface 1203 and bus 1204。Wherein, processor 1201, memorizer 1202 and communication interface 1203 realize communication connection each other by bus 1204。
Processor 1201 can adopt general central processing unit (CentralProcessingUnit, CPU), microprocessor, application specific integrated circuit (ApplicationSpecificIntegratedCircuit, ASIC), or one or more integrated circuits, are used for performing relative program, to realize the technical scheme that aforementioned the inventive method embodiment provides。
Memorizer 1202 can be read only memory (ReadOnlyMemory, ROM), static storage device, dynamic memory or random access memory (RandomAccessMemory, RAM)。Memorizer 1202 can store operating system and other application programs。When realizing, by software or firmware, the technical scheme that the embodiment of the present invention provides, the program code for realizing the arbitrary optional technical scheme that preceding method embodiment of the present invention provides is saved in memorizer 1202, and is performed by processor 1201。Communication interface 1203 in order to other switches or control server communication。
Bus 1204 can include a path, transmits information between equipment all parts (such as processor 1201, memorizer 1202 and communication interface 1203)。
Professional should further appreciate that, the unit of each example described in conjunction with the embodiments described herein and algorithm steps, can with electronic hardware, computer software or the two be implemented in combination in, in order to clearly demonstrate the interchangeability of hardware and software, generally describe composition and the step of each example in the above description according to function。These functions perform with hardware or software mode actually, depend on application-specific and the design constraint of technical scheme。Professional and technical personnel specifically can should be used for using different methods to realize described function to each, but this realization is it is not considered that beyond the scope of this invention。
The method described in conjunction with the embodiments described herein or the step of algorithm can use the software module that hardware, processor perform, or the combination of the two is implemented。Software module can be placed in any other form of storage medium known in random access memory (RAM), internal memory, read only memory (ROM), electrically programmable ROM, electrically erasable ROM, depositor, hard disk, moveable magnetic disc, CD-ROM or technical field。
Above-described detailed description of the invention; the purpose of the present invention, technical scheme and beneficial effect have been further described; it is it should be understood that; the foregoing is only the specific embodiment of the present invention; the protection domain being not intended to limit the present invention; all within the spirit and principles in the present invention, any amendment of making, equivalent replacement, improvement etc., should be included within protection scope of the present invention。
Claims (5)
1. the method transmitting data between an IP hard disk, it is characterised in that described method is applied in storage system, described storage system includes multiple IP hard disk and controller, and method includes:
Described controller receiving data migration request, the request of described Data Migration includes the mark of data to be migrated；
Described controller determines source IP hard disk and the Target IP hard disk at described data place to be migrated according to the mark of described data to be migrated and corresponding relation set in advance, and described corresponding relation includes the corresponding relation between mark and the mark of described Target IP hard disk of the mark of described data to be migrated, described source IP hard disk；
Described controller sends the mark of described Target IP hard disk to described source IP hard disk, and described controller sends the mark of described source IP hard disk to described Target IP hard disk, sets up for described source IP hard disk and described Target IP hard disk and connects；
After described source IP hard disk and described Target IP hard disk are set up and connected, described controller sends Data Migration instruction to described source IP hard disk, and described instruction includes the mark of described data to be migrated；
Described source IP hard disk reads described data to be migrated according to the mark of described data to be migrated, and is sent to described Target IP hard disk。
2. method according to claim 1, it is characterised in that the IP address that identification information is an IP hard disk of a described IP hard disk；The IP address that identification information is the 2nd IP hard disk of described 2nd IP hard disk。
3. a controller, described controller is applied in storage system, and described storage system includes multiple IP hard disk and controller, it is characterised in that described controller includes: processor and communication interface；
Described communication interface is for communicating with multiple IP hard disks；
During described plant running, processor is for performing the method described in any one of claim 1 to 2。
4. a data transmission device, described device is applied to storage system, and described storage system includes multiple IP hard disk and controller, it is characterised in that described controller includes:
Receiving unit, for controller receiving data migration request, the request of described Data Migration includes the mark of data to be migrated；
Processing unit, determines source IP hard disk and the Target IP hard disk at described data place to be migrated for the mark according to described data to be migrated and corresponding relation set in advance。Described corresponding relation includes the corresponding relation between mark and the mark of described Target IP hard disk of the mark of described data to be migrated, described source IP hard disk；
Transmitting element, for sending the mark of described Target IP hard disk to described source IP hard disk, described controller sends the mark of described source IP hard disk to described Target IP hard disk, sets up for described source IP hard disk and described Target IP hard disk and connects；And, after setting up connect at described source IP hard disk and described Target IP hard disk, sending Data Migration instruction to described source IP hard disk, described instruction includes the mark of described data to be migrated；So that described source IP hard disk reads described data to be migrated according to the mark of described data to be migrated, and it is sent to described Target IP hard disk。
5. device according to claim 4, it is characterised in that the IP address that identification information is an IP hard disk of a described IP hard disk；The IP address that identification information is the 2nd IP hard disk of described 2nd IP hard disk。
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510981553.4A CN105700823A (en) | 2015-12-23 | 2015-12-23 | Method and apparatus for transmitting data between IP hard disks |
| PCT/CN2016/110794 WO2017107886A1 (en) | 2015-12-23 | 2016-12-19 | Method and device for transmitting data between ip hard disks |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510981553.4A CN105700823A (en) | 2015-12-23 | 2015-12-23 | Method and apparatus for transmitting data between IP hard disks |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN105700823A true CN105700823A (en) | 2016-06-22 |
Family
ID=56228300
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510981553.4A Pending CN105700823A (en) | 2015-12-23 | 2015-12-23 | Method and apparatus for transmitting data between IP hard disks |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN105700823A (en) |
| WO (1) | WO2017107886A1 (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2017107886A1 (en) * | 2015-12-23 | 2017-06-29 | 华为技术有限公司 | Method and device for transmitting data between ip hard disks |
| CN109246198A (en) * | 2018-08-16 | 2019-01-18 | 杭州数梦工场科技有限公司 | A kind of cloud host-initiated control method and system based on distributed storage cluster |
| CN109901786A (en) * | 2017-12-08 | 2019-06-18 | 腾讯科技（深圳）有限公司 | Data migration method, system, device and computer readable storage medium |
| CN113468140A (en) * | 2021-06-30 | 2021-10-01 | 上海掌门科技有限公司 | Data migration processing method, electronic device and computer-readable storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5953744A (en) * | 1997-01-02 | 1999-09-14 | Exabyte Corporation | Replication of contents of hard disk to hard disk of greater storage capacity through adjustment of address fields in sectors |
| CN1624670A (en) * | 2003-12-03 | 2005-06-08 | 华为技术有限公司 | Method of local data migration |
| CN103995745A (en) * | 2014-05-22 | 2014-08-20 | 华为技术有限公司 | IP hard disk task execution method and IP hard disk |
| CN104077239A (en) * | 2014-06-24 | 2014-10-01 | 华为技术有限公司 | IP hard disk, and memory system and data operation method thereof |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102215268A (en) * | 2011-07-14 | 2011-10-12 | 北京飞杰信息技术有限公司 | Method and device for transferring file data |
| CN103516755B (en) * | 2012-06-27 | 2017-07-14 | 华为技术有限公司 | Virtual memory method and equipment |
| CN105700823A (en) * | 2015-12-23 | 2016-06-22 | 华为技术有限公司 | Method and apparatus for transmitting data between IP hard disks |
-
2015
- 2015-12-23 CN CN201510981553.4A patent/CN105700823A/en active Pending
-
2016
- 2016-12-19 WO PCT/CN2016/110794 patent/WO2017107886A1/en active Application Filing
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5953744A (en) * | 1997-01-02 | 1999-09-14 | Exabyte Corporation | Replication of contents of hard disk to hard disk of greater storage capacity through adjustment of address fields in sectors |
| CN1624670A (en) * | 2003-12-03 | 2005-06-08 | 华为技术有限公司 | Method of local data migration |
| CN103995745A (en) * | 2014-05-22 | 2014-08-20 | 华为技术有限公司 | IP hard disk task execution method and IP hard disk |
| CN104077239A (en) * | 2014-06-24 | 2014-10-01 | 华为技术有限公司 | IP hard disk, and memory system and data operation method thereof |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2017107886A1 (en) * | 2015-12-23 | 2017-06-29 | 华为技术有限公司 | Method and device for transmitting data between ip hard disks |
| CN109901786A (en) * | 2017-12-08 | 2019-06-18 | 腾讯科技（深圳）有限公司 | Data migration method, system, device and computer readable storage medium |
| CN109901786B (en) * | 2017-12-08 | 2021-07-16 | 腾讯科技（深圳）有限公司 | Data migration method, system, device and computer readable storage medium |
| CN109246198A (en) * | 2018-08-16 | 2019-01-18 | 杭州数梦工场科技有限公司 | A kind of cloud host-initiated control method and system based on distributed storage cluster |
| CN109246198B (en) * | 2018-08-16 | 2022-01-07 | 杭州数梦工场科技有限公司 | Cloud host startup control method and system based on distributed storage cluster |
| CN113468140A (en) * | 2021-06-30 | 2021-10-01 | 上海掌门科技有限公司 | Data migration processing method, electronic device and computer-readable storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2017107886A1 (en) | 2017-06-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9678918B2 (en) | Data processing system and data processing method | |
| CN102316043B (en) | Port virtualization method, switch and communication system | |
| US9525648B2 (en) | Method for acquiring physical address of virtual machine | |
| CN104243301A (en) | Method, device and system for generating service path | |
| CN104243265A (en) | Gateway control method, device and system based on virtual machine migration | |
| CN105577723B (en) | Virtualize the method and apparatus that load balancing is realized in network | |
| US9965213B2 (en) | IP hard disk and storage system, and data operation methods therefor | |
| CN108737271B (en) | Message routing method, device and system | |
| KR20150091843A (en) | Distributed processing system and method of operating the same | |
| CN103475682A (en) | File transfer method and file transfer equipment | |
| CN103152200B (en) | Virtual machine migration method, switch, network management device and network system | |
| CN110830574B (en) | Method for realizing intranet load balance based on docker container | |
| CN105700823A (en) | Method and apparatus for transmitting data between IP hard disks | |
| CN104468368A (en) | Method and device for allocating BGP neighbors | |
| WO2014101145A1 (en) | Method and apparatus for transmitting network information | |
| CN111654559A (en) | Container data transmission method and device | |
| US9860171B2 (en) | Large scale message routing in a distributed network | |
| CN104717312A (en) | Method and device for determining network resource access interfaces | |
| CN106130765B (en) | Virtual desktop distribution method and device | |
| WO2015180539A1 (en) | Packet processing method and device | |
| CN108023774B (en) | Cross-gateway migration method and device | |
| WO2015062390A1 (en) | Virtual machine migration method, device and system | |
| KR102023115B1 (en) | Communication method based on integrated flat id and system | |
| CN108023837B (en) | Virtual network switch system and establishing method thereof | |
| US20240154894A1 (en) | Systems and methods for cloud-native network slicing and testing-as-a-service with continuous integration and continuous delivery (ci/cd) capabilities |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20160622 |
|
| RJ01 | Rejection of invention patent application after publication |