WO2016065613A1

WO2016065613A1 - File access method, distributed storage system and network device

Info

Publication number: WO2016065613A1
Application number: PCT/CN2014/090023
Authority: WO
Inventors: 徐君; 赵俊峰; 王元钢
Original assignee: 华为技术有限公司
Priority date: 2014-10-31
Filing date: 2014-10-31
Publication date: 2016-05-06
Also published as: CN105745900A; CN105745900B

Abstract

Disclosed are a file access method, distributed storage system and network device, the method comprising: a network device receives an access request transmitted by a host, the access request being used to access a first virtual space of a target file, the first virtual space being a space allocated by a management node for the target file in a global virtual address space, the destination address of the access request containing information of a first storage node and the address of the target file in a local virtual address space in the first storage node, and the first storage node representing the storage node for storing the target file; the network device parses the destination address of the access request to acquire device information of the first storage node; and the network device transmits the access request to the first storage node according to the information of the first storage node to access the target file according to the address in the local virtual address space in the destination address. The file access method increases a file access efficiency.

Description

Method of accessing files, distributed storage systems, and network devices

Technical field

The present invention relates to the field of storage technologies, and in particular, to a method for accessing files, a distributed storage system, and a network device.

Background technique

New non-violate memory (NVM) media, such as Phase Change Memory (PCM), Resistive RAM (ReRAM), Magnetic Random Access Memory (Magnetic Random Access Memory) , MRAM), etc., with similar dynamic random access memory (DRAM) read and write characteristics, can be hung on the memory bus for access. At present, storage systems based on non-volatile storage media are hotspots in the industry.

Existing methods for remotely accessing a file system include using a Network File System (NFS) or a Common Internet File System (CIFS) protocol. These traditional methods of accessing files are essentially based on Remote Procedure Call (RPC) and are based on the Transmission Control Protocol/Internet Protocol (TCP/IP). For NVM-based storage systems, these access methods still need to be processed by the host's kernel TCP/IP protocol stack, resulting in poor access efficiency.

Summary of the invention

The embodiment of the invention provides a method for accessing a file, a distributed storage system and a network device, which can improve the efficiency of file access.

In a first aspect, a method for accessing a file is provided, the method being applied to a distributed storage system, the distributed storage system comprising a management node, a plurality of storage nodes, and a network device, each storage node in the distributed storage system The local virtual address space corresponds to a portion of the global virtual address space of the distributed storage system, and the method includes:

Receiving, by the network device, an access request sent by the host, where the access request is used to access a first virtual space of the target file, where the first virtual space is a space allocated by the management node for the target file in the global virtual address space, the access The destination address of the request contains the first save of the target file. The device information of the storage node and the address of the local virtual address space of the target file in the first storage node, the first storage node indicating a storage node of the plurality of storage nodes for storing the target file;

The network device parses the destination address of the access request to obtain device information of the first storage node;

The network device sends the access request to the first storage node according to the device information of the first storage node to access the target file according to an address of a local virtual address space in the destination address.

In conjunction with the first aspect, in a first possible implementation, before the network device receives the access request sent by the host, the method further includes:

The network device allocates device information for the host and the first storage node.

With reference to the first possible implementation manner of the first aspect, in a second possible implementation, the device information of the first storage node includes an identifier of the first storage node, and the device information of the host includes the host ID.

With reference to the first possible implementation manner of the first aspect, in a third possible implementation, the device information of the first storage node includes an ID and a node type of the first storage node, where the device information of the host includes the Host ID and node type.

With reference to the first aspect or any one of the first to third possible implementation manners of the first aspect, in a fourth possible implementation, the address of the local virtual address space of the first storage node The number of digits is N digits;

The number of bits of the destination address of the access request is 2N bits, wherein the upper N bits of the destination address of the access request include device information of the first storage node, and the lower N bits of the destination address of the access request are the target file. The address of the local virtual address space in the first storage node.

With reference to the first aspect, or any one of the first to fourth possible implementation manners of the first aspect, in a fifth possible implementation, the source address of the access request includes device information of the host ;

The method also includes:

Receiving, by the network device, a response message sent by the first storage node, where a destination address of the response message is a source address of the access request;

The network device parses the destination address of the response message to obtain device information of the host;

The network device sends the response message to the host according to the device information of the host.

In a second aspect, a distributed storage system is provided, including: a management node, a plurality of storage nodes, and a network device;

A local virtual address space of each of the plurality of storage nodes corresponds to a portion of a global virtual address space of the distributed storage system;

The management node is configured to allocate a first virtual space to the target file in the global virtual address space;

The network device is configured to receive an access request sent by the host, where the access request is used to access the first virtual space, where the destination address of the access request includes device information of the first storage node that stores the target file, and the target file is in the first An address of a local virtual address space in a storage node, the first storage node represents a storage node of the plurality of storage nodes for storing the target file, and parsing a destination address of the access request to obtain a device of the first storage node And sending, by the device information of the first storage node, the access request to the first storage node to access the target file according to an address of a local virtual address space in the destination address.

In conjunction with the second aspect, in a first possible implementation, the network device is further configured to allocate device information for the host and the first storage node.

With reference to the first possible implementation of the second aspect, in a second possible implementation, the device information of the first storage node includes an identifier ID of the first storage node, and the device information of the host includes the host ID.

With reference to the first possible implementation of the second aspect, in a third possible implementation, the device information of the first storage node includes an ID and a node type of the first storage node, where the device information of the host includes the Host ID and node type.

With reference to the second aspect or any one of the first to the third possible implementation manners of the second aspect, in a fourth possible implementation, the address of the local virtual address space of the first storage node The number of digits is N digits;

With reference to the second aspect or any one of the first to fourth possible implementation manners of the second aspect, in a fifth possible implementation, the source address of the access request includes device information of the host ;

The network device is further configured to receive a response message sent by the first storage node, where the response message is The destination address is the source address of the access request, and the destination address of the response message is parsed to obtain device information of the host, and the response message is sent to the host according to the device information of the host.

In a third aspect, a network device is provided, including:

a receiving module, configured to receive an access request sent by the host, where the access request is used to access a first virtual space of the target file, where the first virtual space is a global virtual address of the management node in the distributed storage system in the distributed storage system The space allocated for the target file in the space, the local virtual address space of each storage node in the distributed storage system corresponds to a part of the global virtual address space of the distributed storage system, and the destination address of the access request includes storing the target file. Device information of the first storage node and an address of the local virtual address space of the target file in the first storage node, the first storage node indicating storage for storing the target file in the storage node of the distributed storage system node;

a routing module, configured to parse the destination address of the access request to obtain device information of the first storage node, and send the access request to the first storage node according to the device information of the first storage node, according to the destination address The address of the local virtual address space accesses the target file.

With reference to the third aspect, in a first possible implementation manner, the network device further includes:

And an allocation module, configured to allocate device information for the host and the first storage node.

With reference to the first possible implementation manner of the third aspect, in a second possible implementation, the device information of the first storage node includes an identifier ID of the first storage node, and the device information of the host includes the host ID.

With reference to the first possible implementation manner of the third aspect, in a third possible implementation manner, the device information of the first storage node includes an ID and a node type of the first storage node, where the device information of the host includes the Host ID and node type.

With reference to the third aspect or any one of the first to third possible implementation manners of the third aspect, in a fourth possible implementation, the address of the local virtual address space of the first storage node The number of digits is N digits;

The destination address of the access request has a bit number of 2N, wherein the high N bit of the destination address of the access request includes device information of the first storage node, and the lower N bits of the destination address of the access request are the target file. The address of the local virtual address space in the first storage node.

With reference to the third aspect, or any one of the first to fourth possible implementation manners of the third aspect, in a fifth possible implementation, the source address of the access request includes device information of the host ;

The receiving module is further configured to receive a response message sent by the first storage node, where a destination address of the response message is a source address of the access request;

The routing module is further configured to parse the destination address of the response message to obtain device information of the host, and send the response message to the host according to the device information of the host.

In a fourth aspect, a computer program product is provided, comprising a computer readable storage medium storing program code, the program code comprising instructions for performing the method of the first aspect described above.

Based on the foregoing technical solution, the method for accessing a file, the distributed storage system, and the network device in the embodiment of the present invention include the device information of the storage node in the destination address of the access request, and perform routing based on the device information of the storage node, and can directly access the distribution. Storage of files in the system to improve the efficiency of file access.

DRAWINGS

In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings to be used in the embodiments of the present invention will be briefly described below. It is obvious that the drawings in the following description are only attached to some embodiments of the present invention. Figure.

FIG. 1 is a schematic diagram of an application scenario of an embodiment of the present invention.

2 is a schematic flow chart of a method for accessing a file according to an embodiment of the present invention.

3 is a schematic diagram of a format of an access request according to an embodiment of the present invention.

FIG. 4 is a schematic flowchart of a method for accessing a file according to another embodiment of the present invention.

FIG. 5 is a schematic block diagram of a distributed storage system according to an embodiment of the present invention.

Figure 6 is a schematic block diagram of a network device in accordance with one embodiment of the present invention.

FIG. 7 is a schematic structural diagram of a network device according to another embodiment of the present invention.

detailed description

The technical solutions in the embodiments of the present invention are clearly and completely described in the following with reference to the accompanying drawings in the embodiments of the present invention. It is obvious that the described embodiments are a part of the embodiments of the present invention, but not all embodiments.

It should be understood that the technical solutions of the embodiments of the present invention can be applied to various storage systems, especially distributed storage systems based on non-volatile storage media.

It should also be understood that in the embodiment of the present invention, the term "virtual address space" may also be expressed as "virtual" "Pseudospace", that is, "virtual address space" and "virtual space" are common; similarly, "local physical storage space" and "local physical space" are common.

FIG. 1 is a schematic diagram of an application scenario of an embodiment of the present invention. In FIG. 1, host 130, storage node 120, and management node 110 are interconnected by network 140. Storage node 120, management node 110, and network 140 form a distributed storage system.

The host 130 can be a computer or other user device, and the host 130 can communicate with the distributed storage system through a network. Host 130 may include any computing device known in the art, such as a server, desktop computer, etc., with an operating system and other applications installed in host 130, and there may be multiple hosts 130. Host 130 can access files of the distributed storage system. For example, host 130 can provide a file access interface to an application on the host through a file interface module.

The storage node 120 is configured to store file data and process access requests to the file. Storage node 120 may include at least one non-volatile memory, for example, a new type of NVM having the capability of byte addressing and access, such as PCM, ReRAM, MRAM, and the like. In the embodiment of the present invention, the file is stored in the NVM memory, and the storage node 120 can implement access to the new NVM through the memory bus.

The management node 110 is configured to manage metadata of the file, process metadata query, update request, and the like of the host to the file. The metadata of the file may include information such as the starting address of the file, the size of the allocated space, and the actual size of the file. The management node 110 can also be used to manage the global virtual address space of the distributed storage system.

The management node 110 and the storage node 120 may also be combined, that is, one node may have the functions of both the management node and the storage node.

In the embodiment of the present invention, the management node may be independent (for example, the management node 110 in FIG. 1), or may be a node having both the management node and the storage node. For convenience of description, the following is an example of a management node.

The physical layer and link layer of the network 140 may be based on an Ethernet, a PCIE switching network, an InfiniBand network, and an optical network. The network 140 is used to route access requests and access responses. Specifically, the routes may be performed by network devices (such as routers or switches) in the network 140. For convenience of description, the following describes a network device as an example.

FIG. 2 shows a schematic flow diagram of a method 200 of accessing a file in accordance with an embodiment of the present invention.

The method 200 is applied to a distributed storage system including a management node, a plurality of storage nodes, and a network device. Local virtualization of each storage node in the distributed storage system The address space corresponds to a portion of the global virtual address space of the distributed storage system. The method 200 is performed by a network device.

S210, the network device receives an access request sent by the host, where the access request is used to access a first virtual space of the target file, where the first virtual space is a space allocated by the management node for the target file in the global virtual address space, where The destination address of the access request includes device information of the first storage node storing the target file and an address of the local virtual address space of the target file in the first storage node, the first storage node indicating the plurality of storage nodes The storage node used to store the target file.

The global virtual address space of a distributed storage system is the space that is virtualized for managing file systems in the distributed storage system. The local virtual address space of the different storage nodes in the distributed storage system corresponds to different portions of the global virtual address space of the distributed storage system. For example, a first portion of the global virtual address space is spatially mapped to a local virtual address space of the first storage node in the distributed storage system, and a second portion of the global virtual address space is spatially mapped to the first of the distributed storage systems The local virtual address space of the storage node, wherein the first partial space is different from the second partial space. In the embodiment of the present invention, the management node may allocate a continuous space (represented as the first virtual space) from the global virtual address space of the distributed storage system to the target file. Since the local virtual address space of each storage node in the distributed storage system corresponds to a portion of the global virtual address space of the distributed storage system, the first virtual space can be mapped to the local virtual address space of the storage node. Further, the storage node may access the physical address space of the storage node according to the mapping relationship between the local virtual address space of the storage node and the physical address space of the storage file for access.

The local virtual address space may use an unused interval of the virtual address space of an operating system (OS) OS. For example, the 64-bit OS has a virtual address space size of 2 to the 64th power. In addition to the user-state virtual address space and the kernel virtual address space, there is also a reserved virtual address space. The local virtual address space can use the virtual address reserved by the OS. space. You can also re-divide the virtual address space of the operating system as needed, and divide a virtual address space into a local virtual address space.

The number of address bits in the local virtual address space is the number of bits in the OS. For example, for a 64-bit OS, the address space of the local virtual space is 64 bits. The address space of the global virtual space can be 128 bits.

When the host accesses the target file in the distributed storage system, the host sends an access request to the network to access the first virtual space of the target file. The destination address of the access request includes the setting of the first storage node Information. Optionally, the source address of the access request may include device information of the host. The first storage node represents a storage node for storing the target file, and the device information of the first storage node is used by the network device to route the access request to the first storage node. The device information of the host is used by the network device to route the returned response message to the host.

Optionally, in an embodiment of the present invention, the device information of the first storage node includes an identity (ID) of the first storage node, and the device information of the host includes an ID of the host. That is to say, the device information of the storage node or the host can adopt the node ID, in which case different nodes have different IDs.

Optionally, in another embodiment of the present invention, the device information of the first storage node includes an identifier ID and a node type of the first storage node, and the device information of the host includes an ID and a node type of the host. That is to say, the device information of the storage node or the host may adopt the node ID+node type. In this case, different nodes of the same node type have different IDs, and nodes of different node types may have the same ID. Node types can include storage nodes, management nodes, and hosts. For example, a 2-bit identification node type can be utilized.

In the embodiment of the present invention, optionally, the device information of the node may be pre-allocated by the network device. That is, before the network device receives the access request sent by the host, the method 200 may further include:

For example, the network can assign an ID to a node when it registers. Optionally, the IDs of the storage node and the management node may be dynamically fixed, that is, the initial allocation dynamics, and the allocation is fixed later; the ID of the host may be dynamically allocated.

The address in the access request can take the global virtual address (that is, the address of the global virtual space). The number of bits in the global virtual address is greater than the number of bits in the local virtual address (that is, the address of the local virtual address space), so that the device information of the storage node or host can be included in the global virtual address.

In an embodiment of the invention, optionally, the number of bits of the address of the local virtual address space is N bits. That is, the number of bits of the address of the local virtual address space of the host and the address of the address of the local virtual address space of the first storage node are N bits.

In this case, the number of bits of the destination address of the access request may be 2N bits, wherein the high N bits of the destination address of the access request include device information of the first storage node, and the destination address of the access request is low. The N bit is the address of the local virtual address space of the target file in the first storage node.

Optionally, the number of bits of the source address of the access request may also be 2N bits, where a high N bit of the source address of the access request includes device information of the host, and a low N bit of the source address of the access request corresponds to The address of the local virtual address space allocated by the host for this object file.

In this embodiment, the number of bits of the global virtual address is 2N, wherein the lower N bits correspond to the local virtual address, and the high N bits may include device information of the storage node or the host. For example, when the local virtual address is 64 bits, the global virtual address may be 128 bits, wherein the lower 64 bits of the global virtual address correspond to the local virtual address, and the upper 64 bits of the global virtual address contain device information of the storage node or the host. It should be understood that device information of the storage node or host may be carried with only a portion of the high N bits, and the remaining bits may be reserved or reserved for other purposes. For example, if the local virtual address is 64 bits, the destination address of the access request may be 128 bits, wherein the lower 64 bits of the destination address of the access request are the address of the local virtual address space of the target file in the first storage node, accessing The upper 64 bits of the requested destination address contain the device information of the first storage node (eg, the upper 8 bits are the ID of the first storage node, and the remaining bits are reserved).

The lower N bits of the destination address of the access request are the addresses of the local virtual address space of the target file in the first storage node, and the first storage node can access the target file according to the address. Alternatively, the lower N bits of the source address of the access request may correspond to the address of the local virtual address space allocated by the host for the target file. The host allocates a virtual address space in the local virtual address space for the target file to be accessed when accessing the target file, and the lower N bits of the source address of the access request may correspond to the address of the allocated local virtual address space, so as to receive the returned response. .

3 is a schematic diagram of a format of an access request in accordance with one embodiment of the present invention.

As shown in FIG. 3, the access request includes a destination address, a source address, a request serial number, a length, a command ID, a command type, and a message body.

The destination address is the receiving address. For the access request, the exact address of the global virtual address space can be specified, for example, the node ID + the virtual address space address in the node.

The source address is the sending address. For read requests, the returned data needs to be mapped to the host's local virtual address space.

Alternatively, for device addresses that do not require an exact address, only node device information, such as a node ID, may be used.

The command type and command ID are used to determine specific operations. The command types include file access operations, metadata access operations, and configuration management operations.

The request serial number indicates the order and uniqueness of the message.

The length is the length of the data contained in the message body; for read requests, the length of the request can be read The degree is directly put in, and the message body is empty.

For write requests, the message body contains the data to be written; for the read request message body can be empty.

S220. The network device parses the destination address of the access request to obtain device information of the first storage node.

After receiving the access request sent by the host, the network device parses the destination address of the access request, and obtains the device information of the first storage node included in the destination address. For example, when the destination address of the access request is 2N bits, the network device obtains the device information of the first storage node from the upper N bits of the destination address of the access request.

S230. The network device sends the access request to the first storage node according to the device information of the first storage node, to access the target file according to an address of a local virtual address space in the destination address.

The network device routes the access request to the first storage node according to the device information of the first storage node included in the destination address of the access request. For example, if the destination address adopts the node ID + the virtual address space address in the node, the access request is routed to the node of the ID according to the node ID; if the destination address adopts the node type + node ID + the virtual address space address in the node, then The access request is routed to the node with the ID in the node of the node type according to the node type and the node ID. Optionally, the mapping relationship between the node ID and the port, or the mapping relationship between the node type and the node ID to the port may be adopted.

After receiving the access request sent by the network device, the first storage node accesses the target file according to the access request. Specifically, the mapping relationship between the local virtual address space and the local physical storage space of the storage file is saved in the first storage node, and the first storage node may determine, according to the address of the local virtual address space in the destination address of the access request, for storage. The address of the local physical storage space of the target file. Further, the first storage node may access the local physical storage space according to the determined address of the local physical storage space, so as to achieve the purpose of accessing the target file stored in the local physical storage space.

The method for accessing a file in the embodiment of the present invention includes the device information of the storage node in the destination address of the access request, and performs routing based on the device information of the storage node, and can directly access files in the distributed storage system, thereby improving file access. effectiveness.

In the embodiment of the present invention, optionally, as shown in FIG. 4, in a case where the source address of the access request includes device information of the host, the method 200 further includes S240, S250, and S260.

S240. The network device receives a response message sent by the first storage node, where the response message is The destination address is the source address of the access request.

After accessing the target file, the first storage node sends a response message to the network device in response to the access request. The destination address of the response message is the source address of the access request, that is, the first storage node uses the source address of the access request as the destination address of the response message, and therefore the destination address of the response message includes the device information of the host. The source address of the response message can be the destination address of the access request. The format of the response message is similar to the access request and will not be described here.

S250. The network device parses a destination address of the response message to obtain device information of the host.

For example, when the destination address of the response message is 2N bits, the network device obtains the device information of the host from the high N bits of the destination address of the response message.

S260. The network device sends the response message to the host according to the device information of the host.

After obtaining the device information of the host, the network device routes the access response to the host according to the device information of the host. The routing method is similar to the access request and will not be described here.

It is to be understood that the specific embodiments of the present invention are not intended to limit the scope of the embodiments of the invention.

It should also be understood that in various embodiments of the present invention, the size of the sequence numbers of the above processes does not imply a sequence of executions, and the order of execution of the processes should be determined by its function and internal logic, and should not be implemented by the present invention. The implementation of the examples constitutes any limitation.

The method of accessing a file according to an embodiment of the present invention is described in detail above, and a distributed storage system and a network device according to an embodiment of the present invention will be described below.

FIG. 5 shows a schematic block diagram of a distributed storage system 500 in accordance with an embodiment of the present invention. As shown in FIG. 5, the distributed storage system 500 includes a management node 510, a plurality of storage nodes 520, and a network device 530.

The local virtual address space of each of the plurality of storage nodes 520 corresponds to a portion of the global virtual address space of the distributed storage system 500.

The management node 510 is configured to allocate a first virtual space for the target file in the global virtual address space.

The network device 530 is configured to receive an access request sent by the host, where the access request is used to access the first virtual space, where the destination address of the access request includes device information of the first storage node that stores the target file, and the target file is in the An address of a local virtual address space in the first storage node, the first storage node indicating a storage in the plurality of storage nodes 520 for storing the target file a node, parsing the destination address of the access request to obtain device information of the first storage node, and sending the access request to the first storage node according to the device information of the first storage node, according to the local virtual in the destination address The address of the address space accesses the target file.

The distributed storage system of the embodiment of the present invention performs routing based on the device information of the storage node included in the destination address of the access request, so that the host can directly access files in the distributed storage system, thereby improving the efficiency of file access.

In the embodiment of the present invention, the network device 530 is further configured to allocate device information for the host and the first storage node.

In the embodiment of the present invention, optionally, the device information of the first storage node includes an identifier ID of the first storage node, and the device information of the host includes an ID of the host.

In the embodiment of the present invention, optionally, the device information of the first storage node includes an identifier ID and a node type of the first storage node, and the device information of the host includes an ID and a node type of the host.

In the embodiment of the present invention, optionally, the number of bits of the address of the local virtual address space of the first storage node is N bits;

In the embodiment of the present invention, optionally, the source address of the access request includes device information of the host;

The network device 530 is further configured to receive a response message sent by the first storage node, where a destination address of the response message is a source address of the access request, and a destination address of the response message is parsed to obtain device information of the host, according to the host Device information, the response message is sent to the host.

Optionally, the source address of the access request has a bit number of 2N bits, where a high N bit of the source address of the access request includes device information of the host, and a low N bit of the source address of the access request corresponds to the host The address of the local virtual address space allocated by this object file.

The distributed storage system 500 according to the embodiment of the present invention may correspond to the distributed storage system in the foregoing method embodiments, and the network device 530 may perform the corresponding processes of the foregoing various methods. For brevity, no further details are provided herein.

FIG. 6 shows a schematic block diagram of a network device 600 in accordance with an embodiment of the present invention. As shown in FIG. 6, the network device 600 includes:

The receiving module 610 is configured to receive an access request sent by the host, where the access request is used to access a first virtual space of the target file, where the first virtual space is a global virtual node of the distributed storage system The space allocated for the target file in the address space, the local virtual address space of each storage node in the distributed storage system is corresponding to a part of the global virtual address space of the distributed storage system, and the destination address of the access request includes storing the target Device information of the first storage node of the file and an address of the local virtual address space of the target file in the first storage node, the first storage node indicating a storage node of the distributed storage system for storing the target file Storage node

The routing module 620 is configured to parse the destination address of the access request to obtain device information of the first storage node, and send the access request to the first storage node according to the device information of the first storage node, according to the destination address. The address of the local virtual address space in the access to the target file.

The routing device of the embodiment of the present invention performs routing based on the device information of the storage node included in the destination address of the access request, so that the host can directly access files in the distributed storage system, thereby improving the efficiency of file access.

In the embodiment of the present invention, optionally, the network device 600 further includes:

The receiving module 610 is further configured to receive a response message sent by the first storage node, where a destination address of the response message is a source address of the access request;

The routing module 620 is further configured to parse the destination address of the response message to obtain the device of the host. The information is sent to the host according to the device information of the host.

The network device 600 according to an embodiment of the present invention may perform the method 200 of accessing files according to an embodiment of the present invention, and the foregoing and other operations and/or functions of the respective modules in the network device 600 are respectively implemented in order to implement respective processes of the foregoing respective methods. For the sake of brevity, it will not be repeated here.

FIG. 7 illustrates a structure of a network device provided by another embodiment of the present invention, including at least one processor 702 (eg, a CPU), at least one network interface 705 or other communication interface, memory 706, and at least one communication bus 703. among them:

Communication bus 703 is used to implement connection communication between these devices.

The processor 702 is configured to execute executable modules, such as computer programs, stored in the memory 706.

The memory 706 may include a high speed random access memory (RAM: Random Access Memory) and may also include an NVM, such as at least one disk storage.

The network device implements a communication connection with other nodes through at least one network interface 705 (which may be wired or wireless).

In some embodiments, the memory 706 stores a program 7061 that is used by the processor 702 to implement the various methods of the foregoing method embodiments.

Those of ordinary skill in the art will appreciate that the elements and algorithm steps of the various examples described in connection with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of both, for clarity of hardware and software. Interchangeability, the composition and steps of the various examples have been generally described in terms of function in the above description. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the solution. A person skilled in the art can use different methods for implementing the described functions for each particular application, but such implementation should not be considered to be beyond the scope of the present invention.

A person skilled in the art can clearly understand that, for the convenience and brevity of the description, the specific working process of the system, the device and the unit described above can refer to the corresponding process in the foregoing method embodiment, and details are not described herein again.

In the several embodiments provided by the present application, it should be understood that the disclosed systems, devices, and methods may be implemented in other manners. For example, the device embodiments described above are merely illustrative. For example, the division of the unit is only a logical function division. In actual implementation, there may be another division manner, for example, multiple units or components may be combined or Can be integrated into another system, or some features can be ignored or not executed. In addition, the mutual coupling or direct coupling or communication connection shown or discussed may be indirect coupling through some interfaces, devices or units or Communication connections can also be electrical, mechanical or other forms of connection.

The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the objectives of the embodiments of the present invention.

In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above integrated unit can be implemented in the form of hardware or in the form of a software functional unit.

The integrated unit, if implemented in the form of a software functional unit and sold or used as a standalone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention contributes in essence or to the prior art, or all or part of the technical solution may be embodied in the form of a software product stored in a storage medium. A number of instructions are included to cause a computer device (which may be a personal computer, server, or network device, etc.) to perform all or part of the steps of the methods described in various embodiments of the present invention. The foregoing storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk, and the like. .

Claims

A method for accessing a file, the method being applied to a distributed storage system, the distributed storage system comprising a management node, a plurality of storage nodes, and a network device, each of the storage devices in the distributed storage system The local virtual address space of the node corresponds to a part of the global virtual address space of the distributed storage system, and the method includes:

Receiving, by the network device, an access request sent by the host, where the access request is used to access a first virtual space of the target file, where the first virtual space is the target node in the global virtual address space The allocated space, the destination address of the access request includes device information of a first storage node storing the target file and an address of a local virtual address space of the target file in the first storage node, the first The storage node represents a storage node of the plurality of storage nodes for storing the target file;

Determining, by the network device, a destination address of the access request to obtain device information of the first storage node;

The network device sends the access request to the first storage node according to device information of the first storage node to access the target file according to an address of a local virtual address space in the destination address.
The method according to claim 1, wherein before the network device receives the access request sent by the host, the method further includes:

The network device allocates device information to the host and the first storage node.
The method according to claim 2, wherein the device information of the first storage node comprises an identifier ID of the first storage node, and the device information of the host comprises an ID of the host.
The method according to claim 2, wherein the device information of the first storage node comprises an ID and a node type of the first storage node, and the device information of the host includes an ID and a node type of the host .
The method according to any one of claims 1 to 4, wherein the number of bits of the address of the local virtual address space of the first storage node is N bits;

The number of bits of the destination address of the access request is 2N bits, wherein the high N bits of the destination address of the access request include device information of the first storage node, and the lower N bits of the destination address of the access request are The address of the local virtual address space of the target file in the first storage node.
The method according to any one of claims 1 to 5, wherein the source address of the access request includes device information of the host;

The method further includes:

Receiving, by the network device, a response message sent by the first storage node, where a destination address of the response message is a source address of the access request;

The network device parses a destination address of the response message to obtain device information of the host;

The network device sends the response message to the host according to device information of the host.
A distributed storage system, comprising: a management node, a plurality of storage nodes, and a network device;

A local virtual address space of each of the plurality of storage nodes corresponds to a portion of a global virtual address space of the distributed storage system;

The management node is configured to allocate a first virtual space to the target file in the global virtual address space;

The network device is configured to receive an access request sent by a host, where the access request is used to access the first virtual space, and the destination address of the access request includes device information and a location of a first storage node that stores the target file. An address of a local virtual address space of the target file in the first storage node, where the first storage node represents a storage node of the plurality of storage nodes for storing the target file, and parsing the access request Determining the device information of the first storage node, and sending the access request to the first storage node according to the device information of the first storage node, according to the local virtual address space in the destination address The address of the access to the target file.
The distributed storage system according to claim 7, wherein the network device is further configured to allocate device information to the host and the first storage node.
The distributed storage system according to claim 8, wherein the device information of the first storage node includes an identifier ID of the first storage node, and the device information of the host includes an ID of the host.
The distributed storage system according to claim 8, wherein the device information of the first storage node includes an ID and a node type of the first storage node, and the device information of the host includes an ID of the host. And node type.
The distributed storage system according to any one of claims 7 to 10, wherein the number of bits of the address of the local virtual address space of the first storage node is N bits;

The number of bits of the destination address of the access request is 2N bits, wherein the high N bits of the destination address of the access request include device information of the first storage node, and the lower N bits of the destination address of the access request are The address of the local virtual address space of the target file in the first storage node.
The distributed storage system according to any one of claims 7 to 11, wherein the source address of the access request includes device information of the host;

The network device is further configured to receive a response message sent by the first storage node, where a destination address of the response message is a source address of the access request, and a destination address of the response message is parsed to obtain a device of the host The information is sent to the host according to the device information of the host.
A network device, comprising:

a receiving module, configured to receive an access request sent by the host, where the access request is used to access a first virtual space of the target file, where the first virtual space is a management node in the distributed storage system in the distributed storage system a space allocated to the target file in the global virtual address space, where a local virtual address space of each storage node in the distributed storage system corresponds to a part of a global virtual address space of the distributed storage system, where the access request is The destination address includes device information of a first storage node storing the target file and an address of a local virtual address space of the target file in the first storage node, the first storage node representing the distributed storage system a storage node for storing the target file in the storage node;

a routing module, configured to parse the destination address of the access request to obtain device information of the first storage node, and send the access request to the first storage node according to device information of the first storage node, to Accessing the target file according to an address of a local virtual address space in the destination address.
The network device according to claim 13, wherein the network device further comprises:

And an allocation module, configured to allocate device information to the host and the first storage node.
The network device according to claim 14, wherein the device information of the first storage node includes an identifier ID of the first storage node, and the device information of the host includes an ID of the host.
The network device according to claim 14, wherein the device information of the first storage node includes an ID and a node type of the first storage node, and the device information of the host includes an ID and a node of the host. Types of.
The network device according to any one of claims 13 to 16, wherein the number of bits of the address of the local virtual address space of the first storage node is N bits;

The number of bits of the destination address of the access request is 2N, wherein the high N bits of the destination address of the access request include device information of the first storage node, and the lower N bits of the destination address of the access request are The address of the local virtual address space of the target file in the first storage node.
The network device according to any one of claims 13 to 17, wherein the source address of the access request includes device information of the host;

The receiving module is further configured to receive a response message sent by the first storage node, where a destination address of the response message is a source address of the access request;

The routing module is further configured to parse a destination address of the response message to obtain device information of the host, and send the response message to the host according to device information of the host.