CN111443872A - Distributed storage system construction method, device, equipment and medium - Google Patents
Distributed storage system construction method, device, equipment and medium Download PDFInfo
- Publication number
- CN111443872A CN111443872A CN202010224544.1A CN202010224544A CN111443872A CN 111443872 A CN111443872 A CN 111443872A CN 202010224544 A CN202010224544 A CN 202010224544A CN 111443872 A CN111443872 A CN 111443872A
- Authority
- CN
- China
- Prior art keywords
- distributed storage
- storage system
- virtual machine
- physical server
- nodes
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000010276 construction Methods 0.000 title claims description 13
- 238000000034 method Methods 0.000 claims abstract description 48
- 238000004422 calculation algorithm Methods 0.000 claims abstract description 44
- 238000004590 computer program Methods 0.000 claims description 12
- 238000010586 diagram Methods 0.000 description 6
- 238000004364 calculation method Methods 0.000 description 4
- 238000013500 data storage Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/0604—Improving or facilitating administration, e.g. storage management
- G06F3/0607—Improving or facilitating administration, e.g. storage management by facilitating the process of upgrading existing storage systems, e.g. for improving compatibility between host and storage device
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0662—Virtualisation aspects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/067—Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The application discloses a method, a device, equipment and a medium for constructing a distributed storage system, wherein the method comprises the following steps: constructing a virtual machine in a target area; dividing a first target physical server, a second target physical server and the virtual machine into different distributed storage system nodes; and establishing a scheduling algorithm among the nodes of the distributed storage system to obtain the distributed storage system, so that the distributed storage system is used for performing distributed storage on the data received by the distributed storage nodes in the distributed storage system. Therefore, the distributed storage system can be constructed by using fewer servers to store data in a distributed manner, and the cost is reduced.
Description
Technical Field
The present application relates to the field of cloud computing technologies, and in particular, to a method, an apparatus, a device, and a medium for constructing a distributed storage system.
Background
In order to ensure high reliability of services, exclusive computing and exclusive storage are required to be provided for users, in this case, the exclusive computing needs to be more than or equal to two exclusive computing devices, the distributed storage needs to be more than or equal to three exclusive computing devices, or independent external storage can be used; secondly, purchasing two exclusive computing units and storing three exclusive computing units in a distributed mode; and thirdly, three servers for combining calculation and storage are purchased. However, in all of the three schemes, the tenant needs to directly purchase a plurality of devices at one time, which is too high in cost.
Disclosure of Invention
In view of this, an object of the present application is to provide a method, an apparatus, a device, and a medium for constructing a distributed storage system, which can use fewer servers to construct the distributed storage system, perform distributed storage of data, and reduce cost. The specific scheme is as follows:
in a first aspect, the present application discloses a method for constructing a distributed storage system, including:
constructing a virtual machine in a target area;
dividing a first target physical server, a second target physical server and the virtual machine into different distributed storage system nodes;
and establishing a scheduling algorithm among the nodes of the distributed storage system to obtain the distributed storage system, so that the distributed storage system is used for performing distributed storage on the data received by the distributed storage nodes in the distributed storage system.
Optionally, the building a virtual machine in the target area includes:
constructing a virtual machine in a target area;
and distributing a corresponding virtual disk for the virtual machine.
Optionally, the establishing a scheduling algorithm between the nodes of the distributed storage system to obtain the distributed storage system includes:
and establishing a scheduling algorithm among the nodes of the distributed storage system so as to determine a first disk in the first target physical server and a second disk in the second target physical server as a copy group to store user data, determine the virtual machine as an arbitration node, and store metadata corresponding to the user data by the corresponding virtual disk to obtain the distributed storage system.
Optionally, the method for constructing a distributed storage system further includes:
the storage capacity of the current distributed storage system is enlarged by adding a new physical server.
Optionally, the expanding the storage capacity of the current distributed storage system by adding a new physical server includes:
when the number of the new physical servers is 1, migrating the virtual machine to the new physical servers;
and transmitting the address of the disk of the new physical server to the virtual machine so that the virtual machine can directly use the corresponding disk.
Optionally, after the passing through the address of the disk of the new physical server to the virtual machine, the method further includes:
and reconstructing the copy relationship in the scheduling algorithm in the distributed storage system.
In a second aspect, the present application discloses a data distributed storage method applied to a distributed storage system constructed by the construction method as disclosed in the foregoing, including:
receiving target data through the distributed storage system nodes;
and storing the target data to corresponding disks in a distributed manner by utilizing a scheduling algorithm among the nodes of the distributed storage system.
In a third aspect, the present application discloses a distributed storage system constructing apparatus, including:
the virtual machine building module is used for building a virtual machine in a target area and distributing a corresponding virtual disk for the virtual machine;
the node dividing module is used for dividing the first target physical server, the second target physical server and the virtual machine into different distributed storage system nodes;
and the scheduling algorithm establishing module is used for establishing a scheduling algorithm among the nodes of the distributed storage system to obtain the distributed storage system so as to perform distributed storage on the data received by the distributed storage nodes in the distributed storage system by using the distributed storage system.
In a fourth aspect, the present application discloses an electronic device, comprising:
a memory and a processor;
wherein the memory is used for storing a computer program;
the processor is configured to execute the computer program to implement the method for constructing a distributed storage system disclosed in the foregoing.
In a fifth aspect, the present application discloses a computer readable storage medium for storing a computer program, wherein the computer program, when executed by a processor, implements the distributed storage system construction method disclosed in the foregoing.
Therefore, according to the method, a virtual machine is firstly established in a target area, then a first target physical server, a second target physical server and the virtual machine are divided into different distributed storage system nodes, and a scheduling algorithm among the distributed storage system nodes is established to obtain the distributed storage system, so that the distributed storage system is used for performing distributed storage on data received by the distributed storage nodes in the distributed storage system. Therefore, according to the method, the virtual machine is firstly built in the target area, the predetermined first target physical server, the predetermined second target physical server and the predetermined virtual machine are divided into different distributed storage nodes, and the scheduling algorithm among the distributed storage nodes is built, so that the distributed storage system is obtained, the distributed storage system is convenient to use for carrying out distributed storage on corresponding data, the distributed storage system can be built by using fewer servers, the distributed storage of the data is carried out, and the cost is reduced.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly introduced below, it is obvious that the drawings in the following description are only embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the provided drawings without creative efforts.
FIG. 1 is a flow chart of a method for constructing a distributed storage system disclosed in the present application;
FIG. 2 is a flow chart of a specific method for constructing a distributed storage system disclosed herein;
FIG. 3 is a schematic diagram of a distributed storage system disclosed herein;
FIG. 4 is a capacity expansion diagram of a distributed storage system according to the disclosure;
FIG. 5 is a flow chart of a data distributed storage method disclosed herein;
FIG. 6 is a schematic structural diagram of a distributed storage system building apparatus disclosed in the present application;
fig. 7 is a block diagram of an electronic device disclosed in the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
At present, in order to ensure high reliability of services in a managed private cloud scene, dedicated computing must be greater than or equal to two, distributed storage must be greater than or equal to three, or independent external storage can be used; secondly, purchasing two exclusive computing units and storing three exclusive computing units in a distributed mode; and thirdly, three servers for combining calculation and storage are purchased. However, in all of the three schemes, the tenant needs to directly purchase a plurality of devices at one time, which is too high in cost. In view of this, the present application provides a method for constructing a distributed storage system, which can use fewer servers to construct the distributed storage system for distributed storage of data, thereby reducing the cost.
Referring to fig. 1, an embodiment of the present application discloses a method for constructing a distributed storage system, where the method includes:
step S11: and building a virtual machine in the target area.
In a specific implementation process, after a user purchases a physical server from a cloud service provider, a target area needs to be determined on a public server, and a virtual machine is built in the target area. Specifically, the constructing a virtual machine in a target area includes: constructing a virtual machine in the target area; and allocating corresponding virtual disks for the virtual machines so as to store corresponding metadata.
Step S12: the first target physical server, the second target physical server and the virtual machine are divided into different distributed storage system nodes.
It is understood that after the virtual machine is built in the target area, the first target physical server, the second target physical server and the virtual machine need to be divided into different distributed storage system nodes. The first target physical server and the second target physical server are both physical servers with the combination of calculation and storage, that is, the first target physical server and the second target physical server both need to be capable of performing data calculation and data storage. Thus, the first target physical server, the second target physical server and the virtual machine are divided into different distributed storage system nodes to form 3 distributed storage system nodes, so that when the first target physical server or the second target physical server fails, which server is normal and which server is failed are determined, and data in the failed server is recovered.
Step S13: and establishing a scheduling algorithm among the nodes of the distributed storage system to obtain the distributed storage system, so that the distributed storage system is used for performing distributed storage on the data received by the distributed storage nodes in the distributed storage system.
After the first target physical server, the second target physical server and the virtual machine are divided into different distributed storage system nodes, a scheduling algorithm among the distributed storage system nodes needs to be established to obtain the distributed storage system, so that the distributed storage system is used for performing distributed storage on data received by the distributed storage nodes in the distributed storage system. Wherein the scheduling algorithm comprises a copy relationship construction algorithm. Specifically, the establishing a scheduling algorithm between the nodes of the distributed storage system to obtain the distributed storage system includes: and establishing a scheduling algorithm among the nodes of the distributed storage system so as to determine a first disk in the first target physical server and a second disk in the second target physical server as a copy group to store user data, determine the virtual machine as an arbitration node, and store metadata corresponding to the user data by the corresponding virtual disk to obtain the distributed storage system. That is, the first disk of the first target physical server and the second disk of the second physical server are copy groups for storing user data, the virtual machine serves as an arbitration node, and the virtual disk corresponding to the virtual machine is used for storing metadata corresponding to the user data and does not store the user data.
When the first target physical server or the second target physical server fails, the virtual machine and the physical server in the normal state can be normally used, and after the failed physical server is recovered to be normal, the data in the physical server recovered to be normal can be recovered according to the data in the virtual machine and the physical server in the normal state.
Therefore, according to the method, a virtual machine is firstly established in a target area, then a first target physical server, a second target physical server and the virtual machine are divided into different distributed storage system nodes, and a scheduling algorithm among the distributed storage system nodes is established to obtain the distributed storage system, so that the distributed storage system is used for performing distributed storage on data received by the distributed storage nodes in the distributed storage system. Therefore, according to the method, the virtual machine is firstly built in the target area, the predetermined first target physical server, the predetermined second target physical server and the predetermined virtual machine are divided into different distributed storage nodes, and the scheduling algorithm among the distributed storage nodes is built, so that the distributed storage system is obtained, the distributed storage system is convenient to use for carrying out distributed storage on corresponding data, the distributed storage system can be built by using fewer servers, the distributed storage of the data is carried out, and the cost is reduced.
Referring to fig. 2, an embodiment of the present application discloses a specific distributed storage system construction method, including:
step S21: and building a virtual machine in the target area.
Step S22: and distributing a corresponding virtual disk for the virtual machine.
Step S23: the first target physical server, the second target physical server and the virtual machine are divided into different distributed storage system nodes.
Step S24: and establishing a scheduling algorithm among the nodes of the distributed storage system to obtain the distributed storage system, so that the distributed storage system is used for performing distributed storage on the data received by the distributed storage nodes in the distributed storage system.
The specific implementation process of step S23 to step S24 may refer to the corresponding content disclosed in the foregoing embodiments, and will not be described herein again.
Step S25: the storage capacity of the current distributed storage system is enlarged by adding a new physical server.
After the distributed storage system is obtained, the storage capacity of the current distributed storage system can be enlarged by adding a new physical server.
In a first specific embodiment, the expanding the storage capacity of the current distributed storage system by adding a new physical server includes: when the number of the new physical servers is 1, migrating the virtual machine to the new physical servers; and transmitting the address of the disk of the new physical server to the virtual machine so that the virtual machine can directly use the corresponding disk. After the passing through the address of the disk of the new physical server to the virtual machine, the method further includes: and reconstructing the copy relationship in the scheduling algorithm in the distributed storage system. Specifically, when a new physical server is added to the current distributed storage system, the virtual machine is migrated to the new physical server, and the address of the disk of the new physical server is transmitted to the virtual machine, so that the virtual machine directly uses the disk of the new physical server, then the copy relationship in the scheduling algorithm inside the distributed storage system is reconstructed, data in the distributed storage system is balanced, and the like, so that three physical servers uniformly load data and form data groups, and the capacity expansion of the distributed storage system is completed.
In a second specific embodiment, the expanding the storage capacity of the current distributed storage system by adding a new physical server includes: and dividing the new physical server into new distributed storage system nodes of the current distributed storage system. After the dividing the new physical server into the new distributed storage system nodes of the current distributed storage system, the method further includes: and reconstructing the copy relationship in the scheduling algorithm in the distributed storage system. Specifically, when a new physical server is added to the current distributed storage system, the new physical server is used as a new node of the current distributed storage system, a copy relationship in the scheduling algorithm inside the distributed storage system is reconstructed, data in the distributed storage system is balanced, and the like, so that the three physical servers uniformly load the data and form data groups, and the capacity expansion of the distributed storage system is completed.
Referring to fig. 3, a schematic diagram of a distributed storage system is shown. The distributed storage system of the exclusive cloud user 1 and the exclusive cloud user 1 comprises two physical servers and a virtual machine constructed in a target area on a public server, wherein the virtual machine is used as an arbitration node and forms the distributed storage system with the two corresponding physical servers. Referring to fig. 4, a capacity expansion diagram of a distributed storage system is shown. After a physical server is newly added to the distributed storage system of the exclusive cloud user 1, the corresponding virtual machine is migrated to the new physical server, the address of the disk of the new physical server is transmitted to the virtual machine, and then the copy relationship reconstruction and the data equalization inside the distributed storage system are performed, so that the distributed storage system formed by 3 physical servers is obtained.
Referring to fig. 5, an embodiment of the present application discloses a specific data distributed storage method, which is applied to a distributed storage system constructed by the construction method disclosed in the foregoing disclosure, and the method includes:
step S31: target data is received by the distributed storage system node.
After the distributed storage system is constructed in the foregoing embodiment, the distributed storage system may be used to perform data distributed storage. When the distributed storage system is used for data distributed storage, target data needs to be received through the distributed storage system nodes. The target data is data needing to be written into the distributed storage system.
Step S32: and storing the target data to corresponding disks in a distributed manner by utilizing a scheduling algorithm among the nodes of the distributed storage system.
It can be understood that, after the target data is received, the target data also needs to be distributively stored onto the corresponding disk by using a scheduling algorithm between the distributed storage nodes. Specifically, if the distributed storage system node that receives the target data is the virtual machine, the metadata corresponding to the target data is destaged, and the target data is sent to the first target physical server and the second target physical server, so that the first target physical server and the second target physical server destage the target data according to the scheduling algorithm, and if the distributed storage system node that receives the target data is the first target physical server or the second target physical server, the target data is sent to the second target physical server or the first target physical server, so that the second target physical server or the first target physical server destages the target data according to the scheduling algorithm, and sending the metadata of the target data to the virtual machine so that the virtual machine can perform disk dropping on the metadata.
Referring to fig. 6, an embodiment of the present application discloses a distributed storage system building apparatus, including:
the virtual machine building module 11 is configured to build a virtual machine in a target area, and allocate a corresponding virtual disk to the virtual machine;
a node dividing module 12, configured to divide the first target physical server, the second target physical server, and the virtual machine into different distributed storage system nodes;
and the scheduling algorithm establishing module 13 is configured to establish a scheduling algorithm between the nodes of the distributed storage system to obtain the distributed storage system, so that the distributed storage system is used to perform distributed storage on data received by the distributed storage nodes in the distributed storage system.
Therefore, according to the method, a virtual machine is firstly established in a target area, then a first target physical server, a second target physical server and the virtual machine are divided into different distributed storage system nodes, and a scheduling algorithm among the distributed storage system nodes is established to obtain the distributed storage system, so that the distributed storage system is used for performing distributed storage on data received by the distributed storage nodes in the distributed storage system. Therefore, according to the method, the virtual machine is firstly built in the target area, the predetermined first target physical server, the predetermined second target physical server and the predetermined virtual machine are divided into different distributed storage nodes, and the scheduling algorithm among the distributed storage nodes is built, so that the distributed storage system is obtained, the distributed storage system is convenient to use for carrying out distributed storage on corresponding data, the distributed storage system can be built by using fewer servers, the distributed storage of the data is carried out, and the cost is reduced.
Further, referring to fig. 7, an embodiment of the present application further discloses an electronic device, including: a processor 21 and a memory 22.
Wherein the memory 22 is used for storing a computer program; the processor 21 is configured to execute the computer program to implement the distributed storage system construction method disclosed in the foregoing embodiment.
For a specific process of the above method for constructing a distributed storage system, reference may be made to corresponding contents disclosed in the foregoing embodiments, and details are not described here.
Further, an embodiment of the present application also discloses a computer readable storage medium for storing a computer program, wherein the computer program, when executed by a processor, implements the following steps:
constructing a virtual machine in a target area; dividing a first target physical server, a second target physical server and the virtual machine into different distributed storage system nodes; and establishing a scheduling algorithm among the nodes of the distributed storage system to obtain the distributed storage system, so that the distributed storage system is used for performing distributed storage on the data received by the distributed storage nodes in the distributed storage system.
Therefore, according to the method, a virtual machine is firstly established in a target area, then a first target physical server, a second target physical server and the virtual machine are divided into different distributed storage system nodes, and a scheduling algorithm among the distributed storage system nodes is established to obtain the distributed storage system, so that the distributed storage system is used for performing distributed storage on data received by the distributed storage nodes in the distributed storage system. Therefore, according to the method, the virtual machine is firstly built in the target area, the predetermined first target physical server, the predetermined second target physical server and the predetermined virtual machine are divided into different distributed storage nodes, and the scheduling algorithm among the distributed storage nodes is built, so that the distributed storage system is obtained, the distributed storage system is convenient to use for carrying out distributed storage on corresponding data, the distributed storage system can be built by using fewer servers, the distributed storage of the data is carried out, and the cost is reduced.
In this embodiment, when the computer subprogram stored in the computer-readable storage medium is executed by the processor, the following steps may be specifically implemented: constructing a virtual machine in a target area; and distributing a corresponding virtual disk for the virtual machine.
In this embodiment, when the computer subprogram stored in the computer-readable storage medium is executed by the processor, the following steps may be specifically implemented: and establishing a scheduling algorithm among the nodes of the distributed storage system so as to determine a first disk in the first target physical server and a second disk in the second target physical server as a copy group to store user data, determine the virtual machine as an arbitration node, and store metadata corresponding to the user data by the corresponding virtual disk to obtain the distributed storage system.
In this embodiment, when the computer subprogram stored in the computer-readable storage medium is executed by the processor, the following steps may be specifically implemented: the storage capacity of the current distributed storage system is enlarged by adding a new physical server.
In this embodiment, when the computer subprogram stored in the computer-readable storage medium is executed by the processor, the following steps may be specifically implemented: when the number of the new physical servers is 1, migrating the virtual machine to the new physical servers; and transmitting the address of the disk of the new physical server to the virtual machine so that the virtual machine can directly use the corresponding disk.
In this embodiment, when the computer subprogram stored in the computer-readable storage medium is executed by the processor, the following steps may be specifically implemented: and reconstructing the copy relationship in the scheduling algorithm in the distributed storage system.
The embodiments are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same or similar parts among the embodiments are referred to each other. The device disclosed by the embodiment corresponds to the method disclosed by the embodiment, so that the description is simple, and the relevant points can be referred to the method part for description.
The steps of a method or algorithm described in connection with the embodiments disclosed herein may be embodied directly in hardware, in a software module executed by a processor, or in a combination of the two. A software module may reside in Random Access Memory (RAM), memory, Read Only Memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.
Finally, it is further noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of other elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
The above detailed description is given to a method, an apparatus, a device, and a medium for constructing a distributed storage system provided by the present application, and a specific example is applied in the present application to explain the principle and the implementation of the present application, and the description of the above embodiment is only used to help understanding the method and the core idea of the present application; meanwhile, for a person skilled in the art, according to the idea of the present application, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present application.
Claims (10)
1. A distributed storage system construction method is characterized by comprising the following steps:
constructing a virtual machine in a target area;
dividing a first target physical server, a second target physical server and the virtual machine into different distributed storage system nodes;
and establishing a scheduling algorithm among the nodes of the distributed storage system to obtain the distributed storage system, so that the distributed storage system is used for performing distributed storage on the data received by the distributed storage nodes in the distributed storage system.
2. The distributed storage system building method according to claim 1, wherein the building of the virtual machine in the target area includes:
constructing a virtual machine in a target area;
and distributing a corresponding virtual disk for the virtual machine.
3. The method for constructing a distributed storage system according to claim 2, wherein the establishing a scheduling algorithm between nodes of the distributed storage system to obtain the distributed storage system comprises:
and establishing a scheduling algorithm among the nodes of the distributed storage system so as to determine a first disk in the first target physical server and a second disk in the second target physical server as a copy group to store user data, determine the virtual machine as an arbitration node, and store metadata corresponding to the user data by the corresponding virtual disk to obtain the distributed storage system.
4. The distributed storage system building method according to any one of claims 1 to 3, further comprising:
the storage capacity of the current distributed storage system is enlarged by adding a new physical server.
5. The method for building the distributed storage system according to claim 4, wherein the expanding the storage capacity of the current distributed storage system by adding a new physical server comprises:
when the number of the new physical servers is 1, migrating the virtual machine to the new physical servers;
and transmitting the address of the disk of the new physical server to the virtual machine so that the virtual machine can directly use the corresponding disk.
6. The distributed storage system building method according to claim 5, wherein after the passing through the address of the disk of the new physical server to the virtual machine, further comprising:
and reconstructing the copy relationship in the scheduling algorithm in the distributed storage system.
7. A data distributed storage method applied to a distributed storage system constructed by the construction method according to any one of claims 1 to 6, comprising:
receiving target data through the distributed storage system nodes;
and storing the target data to corresponding disks in a distributed manner by utilizing a scheduling algorithm among the nodes of the distributed storage system.
8. A distributed storage system construction apparatus, comprising:
the virtual machine building module is used for building a virtual machine in a target area and distributing a corresponding virtual disk for the virtual machine;
the node dividing module is used for dividing the first target physical server, the second target physical server and the virtual machine into different distributed storage system nodes;
and the scheduling algorithm establishing module is used for establishing a scheduling algorithm among the nodes of the distributed storage system to obtain the distributed storage system so as to perform distributed storage on the data received by the distributed storage nodes in the distributed storage system by using the distributed storage system.
9. An electronic device, comprising:
a memory and a processor;
wherein the memory is used for storing a computer program;
the processor is configured to execute the computer program to implement the distributed storage system construction method according to any one of claims 1 to 6.
10. A computer-readable storage medium for storing a computer program, wherein the computer program, when executed by a processor, implements the distributed storage system construction method of any of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010224544.1A CN111443872A (en) | 2020-03-26 | 2020-03-26 | Distributed storage system construction method, device, equipment and medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010224544.1A CN111443872A (en) | 2020-03-26 | 2020-03-26 | Distributed storage system construction method, device, equipment and medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111443872A true CN111443872A (en) | 2020-07-24 |
Family
ID=71654636
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010224544.1A Pending CN111443872A (en) | 2020-03-26 | 2020-03-26 | Distributed storage system construction method, device, equipment and medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111443872A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112083892A (en) * | 2020-09-25 | 2020-12-15 | 上海依图网络科技有限公司 | Data storage method, device, equipment and medium |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104052820A (en) * | 2014-06-27 | 2014-09-17 | 国家计算机网络与信息安全管理中心 | Dynamic energy-saving resource scheduling system and method for distributed cloud computing platform |
| US9378067B1 (en) * | 2014-05-08 | 2016-06-28 | Springpath, Inc. | Automated load balancing across the distributed system of hybrid storage and compute nodes |
| CN106850315A (en) * | 2017-03-16 | 2017-06-13 | 郑州云海信息技术有限公司 | One kind automation disaster tolerance system |
| US20170371707A1 (en) * | 2016-06-22 | 2017-12-28 | EMC IP Holding Company LLC | Data analysis in storage system |
| WO2018054079A1 (en) * | 2016-09-23 | 2018-03-29 | 华为技术有限公司 | Method for storing file, first virtual machine and namenode |
| CN109302494A (en) * | 2018-11-20 | 2019-02-01 | 郑州云海信息技术有限公司 | A kind of configuration method of network store system, device, equipment and medium |
| CN110088733A (en) * | 2016-12-21 | 2019-08-02 | Netapp股份有限公司 | The layout based on accumulation layer of virtual machine (vm) migration |
-
2020
- 2020-03-26 CN CN202010224544.1A patent/CN111443872A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9378067B1 (en) * | 2014-05-08 | 2016-06-28 | Springpath, Inc. | Automated load balancing across the distributed system of hybrid storage and compute nodes |
| CN104052820A (en) * | 2014-06-27 | 2014-09-17 | 国家计算机网络与信息安全管理中心 | Dynamic energy-saving resource scheduling system and method for distributed cloud computing platform |
| US20170371707A1 (en) * | 2016-06-22 | 2017-12-28 | EMC IP Holding Company LLC | Data analysis in storage system |
| WO2018054079A1 (en) * | 2016-09-23 | 2018-03-29 | 华为技术有限公司 | Method for storing file, first virtual machine and namenode |
| CN110088733A (en) * | 2016-12-21 | 2019-08-02 | Netapp股份有限公司 | The layout based on accumulation layer of virtual machine (vm) migration |
| CN106850315A (en) * | 2017-03-16 | 2017-06-13 | 郑州云海信息技术有限公司 | One kind automation disaster tolerance system |
| CN109302494A (en) * | 2018-11-20 | 2019-02-01 | 郑州云海信息技术有限公司 | A kind of configuration method of network store system, device, equipment and medium |
Non-Patent Citations (3)
| Title |
|---|
| 卢建军等: "时空大数据的技术与方法", 31 May 2012, 中国铁道出版社, pages: 123 - 127 * |
| 李梅等: "物联网科技导论", 31 August 2015, 北京邮电大学出版社, pages: 159 - 162 * |
| 独笔孤行: "oVirt+SSAN超融合架构", pages 3 * |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112083892A (en) * | 2020-09-25 | 2020-12-15 | 上海依图网络科技有限公司 | Data storage method, device, equipment and medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11169723B2 (en) | Data storage system with metadata check-pointing | |
| US10154086B1 (en) | Distributed consumer cloud storage system | |
| US6928459B1 (en) | Plurality of file systems using weighted allocation to allocate space on one or more storage devices | |
| CN106210147B (en) | Load balancing method and device based on polling | |
| US10601680B2 (en) | Application resiliency using APIs | |
| US20180067963A1 (en) | File management in thin provisioning storage environments | |
| JP6388339B2 (en) | Distributed caching and cache analysis | |
| CN111212134A (en) | Request message processing method and device, edge computing system and electronic equipment | |
| CN112261135A (en) | Node election method, system, device and equipment based on consistency protocol | |
| CN107391033B (en) | Data migration method and device, computing equipment and computer storage medium | |
| US20220138046A1 (en) | Data reconstruction method and apparatus, computer device, and storage medium and system | |
| CN107920101B (en) | File access method, device and system and electronic equipment | |
| CN112099991A (en) | Method, device, system and storage medium for data backup and source data access | |
| CN102521163B (en) | Method and device for replacing directory | |
| CN111930315A (en) | Data access method, data access device and storage medium | |
| CN111443872A (en) | Distributed storage system construction method, device, equipment and medium | |
| CN111225003B (en) | NFS node configuration method and device | |
| CN114879907A (en) | Data distribution determination method, device, equipment and storage medium | |
| CN109587185B (en) | Cloud storage system and object processing method in cloud storage system | |
| CN112422611B (en) | Virtual bucket storage processing method and system based on distributed object storage | |
| CN105278877A (en) | Object storage method and device | |
| CN112804366B (en) | Method and device for resolving domain name | |
| CN108769123B (en) | Data system and data processing method | |
| CN108829340B (en) | Storage processing method, device, storage medium and processor | |
| US20230015979A1 (en) | Storage System, Data Processing Method, Apparatus, Node, and Storage Medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200724 |