CN112699093A - File storage method and equipment supporting hybrid multi-cloud - Google Patents
File storage method and equipment supporting hybrid multi-cloud Download PDFInfo
- Publication number
- CN112699093A CN112699093A CN202110099850.1A CN202110099850A CN112699093A CN 112699093 A CN112699093 A CN 112699093A CN 202110099850 A CN202110099850 A CN 202110099850A CN 112699093 A CN112699093 A CN 112699093A
- Authority
- CN
- China
- Prior art keywords
- file
- application
- cloud
- management
- cloud storage
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000003860 storage Methods 0.000 title claims abstract description 255
- 238000000034 method Methods 0.000 title claims abstract description 38
- 238000012217 deletion Methods 0.000 claims description 18
- 230000037430 deletion Effects 0.000 claims description 18
- 238000012795 verification Methods 0.000 claims description 10
- 238000011161 development Methods 0.000 abstract description 4
- 238000012423 maintenance Methods 0.000 abstract description 2
- 239000002699 waste material Substances 0.000 abstract description 2
- 230000000875 corresponding effect Effects 0.000 description 47
- 238000010586 diagram Methods 0.000 description 7
- 210000001503 joint Anatomy 0.000 description 5
- 230000006870 function Effects 0.000 description 4
- 238000002955 isolation Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000008520 organization Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 230000014759 maintenance of location Effects 0.000 description 1
- 238000003032 molecular docking Methods 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/18—File system types
- G06F16/182—Distributed file systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/16—File or folder operations, e.g. details of user interfaces specifically adapted to file systems
- G06F16/162—Delete operations
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0638—Organizing or formatting or addressing of data
- G06F3/0643—Management of files
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/067—Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/0671—In-line storage system
- G06F3/0683—Plurality of storage devices
- G06F3/0685—Hybrid storage combining heterogeneous device types, e.g. hierarchical storage, hybrid arrays
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/455—Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
- G06F9/45533—Hypervisors; Virtual machine monitors
- G06F9/45558—Hypervisor-specific management and integration aspects
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/455—Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
- G06F9/45533—Hypervisors; Virtual machine monitors
- G06F9/45558—Hypervisor-specific management and integration aspects
- G06F2009/45579—I/O management, e.g. providing access to device drivers or storage
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Software Systems (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a file storage method and equipment supporting mixed multiple clouds, wherein the scheme comprises the following steps: determining a cloud storage resource corresponding to a file storage request based on the file storage request from a corresponding application; sending a request for applying for a certificate to the cloud storage resource to obtain a corresponding temporary access certificate; the cloud storage resources comprise a public cloud and a private cloud; and sending the temporary access certificate to the application so that the application accesses and uploads files to the cloud storage resource for file storage based on the temporary access certificate. Therefore, when facing various cloud storage, the government and enterprise units can conveniently and uniformly manage the cloud storage resources, a large amount of development and maintenance workload is reduced, and unnecessary resource waste is avoided.
Description
Technical Field
The application relates to the technical field of cloud computing, in particular to a file storage method and equipment supporting hybrid multiple clouds.
Background
With the arrival of new wave of cloud computing technology in recent years, paperless office work of governments and digitalized transformation and upgrading of enterprises are in the way, industrial internet is in the spotlight, and enterprises and government agencies increasingly attach importance to digitalization and clouding of industries and work, and storage is used as an essential basic component for digitalization and is an important component for information construction of government and enterprise units.
At present, all public cloud manufacturers have abundant cloud storage products, such as S3 of AWS, OSS of Ali cloud, OSS of Langchao cloud, and the like. The government and enterprise units can have various choices, and some government and enterprise units can select to build an environment by themselves and store file data on a local private cloud for safety; some government and enterprise units use a hybrid cloud architecture to store key data and sensitive files on a private cloud and other data on a public cloud. When the upper-layer business is applied to a complex field environment of a government and enterprise unit, an integrated familiar file storage scheme cannot be freely selected, different cloud storage needs to be supported, so that a large amount of development and maintenance workload exists, and the government and enterprise unit cannot conveniently and uniformly manage own cloud storage resources when facing various cloud storage.
Based on this, how to provide a file storage method and device supporting hybrid multiple clouds becomes a technical problem which needs to be solved urgently.
Disclosure of Invention
The embodiment of the specification provides a file storage method and device supporting hybrid multiple clouds, which are used for solving the following technical problems in the prior art:
on one hand, a large amount of data of the government and enterprise units need to be stored, but when various cloud storage is faced, the cloud storage resources of the government and enterprise units cannot be conveniently and uniformly managed; on the other hand, for the business application of informatization, various storages need to be integrated and docked, which wastes resources and has low docking efficiency.
To solve the above technical problem, one or more embodiments of the present specification are implemented as follows:
in one aspect, an embodiment of the present specification provides a file storage method supporting hybrid multiple clouds, including:
determining a cloud storage resource corresponding to a file storage request based on the file storage request from a corresponding application;
sending a request for applying for a certificate to the cloud storage resource to obtain a corresponding temporary access certificate; the cloud storage resources comprise a public cloud and a private cloud;
and sending the temporary access certificate to the application so that the application accesses and uploads files to the cloud storage resource for file storage based on the temporary access certificate.
The embodiment of the specification supports mixed multiple clouds by using a unified file storage service, so that a government and enterprise unit can uniformly manage the cloud storage resources of the government and enterprise unit; through the temporary voucher mode, the cloud storage resources are directly connected in a butt joint mode, on one hand, the bandwidth and the memory pressure of file storage services are reduced, on the other hand, network resources can be better utilized, and the file uploading performance is improved.
In one embodiment, the method further comprises:
adding a cloud storage resource purchased and/or built by a management user based on the received first operation request;
and acquiring state information of the cloud storage resource corresponding to the management user based on the received second operation request, and sending the state information to the application so that the application displays the state information to the management user.
Based on the method, the state information of the cloud storage resources is displayed, so that the management of the cloud storage resources by a user is more convenient.
In one embodiment, the method further comprises:
creating at least one sub-user corresponding to the management user, and distributing corresponding viewing authority and management authority to each sub-user;
the viewing authority and the management authority have dimensions including, but not limited to, cloud storage resources, applications and tenants.
By providing authority management, cloud storage resources can be selected according to tenants, applications and users, the cloud storage resources can be managed more conveniently, tenant management is supported, each tenant can manage own cloud storage resources, own applications and own users, and the storage service or the storage mode has richer authority management dimensionality, so that service support is provided for a plurality of tenants.
In one embodiment, prior to sending the temporary access credential to the application, the method further comprises:
receiving an application access certificate sent by the application;
verifying according to the application access certificate and a pre-stored verification access certificate to determine whether the application is legal or not;
wherein the verification access credential is an access credential generated at the time of creation of the application.
By verifying the application access certificate and the pre-stored verification access certificate, data isolation and safety can be guaranteed, and trust of a user is enhanced.
In one embodiment, the sending the temporary access credential to the application to enable the application to access and upload a file to the cloud storage resource based on the temporary access credential specifically includes:
integrating Software Development Kit (SDK) of different programming language versions;
sending the temporary access credential to the application so that the application accesses the cloud storage resource based on the temporary access credential and uploads a file to the cloud storage resource through the called SDK.
In one embodiment, the method further comprises:
creating a management storage volume, and creating a corresponding management folder in the management storage volume based on the received third operation request;
acquiring a storage result of the file storage and metadata of the file; the metadata is used to characterize the file;
and generating a corresponding management file according to the storage result of the file storage and the metadata of the file, and adding the management file to a corresponding management folder.
In one embodiment, the method further comprises:
sending the management folder to the application so that the application displays the management folder to a user, and generating a corresponding file downloading request according to the operation of the user on the management folder;
and acquiring the file downloading request generated by the application, and determining the corresponding cloud storage resource according to the file downloading request.
In one embodiment, the method further comprises:
sending the management folder to the application so that the application displays the management folder to a user, and generating a corresponding file deletion request according to the operation of the user on the management folder;
acquiring the file deletion request generated by the application, performing logic deletion according to the file deletion request, and modifying the reference count of the corresponding file;
and when the reference count is 0, determining the corresponding cloud storage resource according to the file deletion request, and deleting the file.
In one embodiment, the method further comprises:
and uploading the file to the cloud storage resource through a calling interface provided externally based on the received fourth operation request, and storing the file.
In another aspect, an embodiment of the present specification provides a file storage device supporting hybrid multiple clouds, including:
at least one processor, and,
a memory communicatively coupled to the at least one processor; wherein,
the memory stores instructions executable by the at least one processor to enable the at least one processor to:
determining a cloud storage resource corresponding to a file storage request based on the file storage request from a corresponding application;
sending a request for applying for a certificate to the cloud storage resource to obtain a corresponding temporary access certificate; the cloud storage resources comprise a public cloud and a private cloud;
and sending the temporary access certificate to the application so that the application accesses and uploads files to the cloud storage resource for file storage based on the temporary access certificate.
The embodiment of the specification can achieve the following beneficial effects by adopting at least one technical scheme: the method supports mixed multi-cloud storage, so that the government and enterprise units can conveniently and uniformly manage own cloud storage resources when facing various cloud storage; meanwhile, the time consumed by the application of the informatization service in the butt joint storage can be saved, and the butt joint efficiency is improved.
Drawings
The accompanying drawings, which are included to provide a further understanding of the embodiments of the disclosure and are incorporated in and constitute a part of this disclosure, illustrate embodiments of the disclosure and together with the description serve to explain the disclosure and not to limit the disclosure in any way. In the drawings:
fig. 1 is a schematic flowchart of a file storage method supporting hybrid multiple clouds according to an embodiment of the present application;
fig. 2 is a schematic application diagram of file storage supporting hybrid multiple clouds according to an embodiment of the present application;
fig. 3 is a flowchart of file uploading provided in an embodiment of the present application;
fig. 4 is a schematic architecture diagram of a file storage method supporting hybrid multiple clouds according to an embodiment of the present application;
fig. 5 is a schematic view in an application scenario provided in the embodiment of the present application;
fig. 6 is a schematic structural diagram of a file storage device supporting hybrid multiple clouds according to an embodiment of the present application.
Detailed Description
In order to make the objects, technical solutions and advantages of the present disclosure more clear, the following description of the present disclosure will be made in detail and completely with reference to the embodiments of the present disclosure and the accompanying drawings. It is to be understood that the embodiments described are only a few embodiments of the present application and not all embodiments. All other embodiments obtained by a person skilled in the art without making any inventive step based on the embodiments in the description belong to the protection scope of the present application.
The embodiment of the application provides a file storage method supporting hybrid multi-cloud, which is specifically described as follows:
fig. 1 is a schematic flowchart of a file storage method supporting hybrid multiple clouds according to an embodiment of the present application, where the flowchart in fig. 1 includes the following steps:
s101: determining a cloud storage resource corresponding to a file storage request based on the file storage request from a corresponding application;
s102: sending a request for applying for a certificate to the cloud storage resource to obtain a corresponding temporary access certificate; the cloud storage resources comprise a public cloud and a private cloud;
s103: and sending the temporary access certificate to the application so that the application accesses and uploads files to the cloud storage resource for file storage based on the temporary access certificate.
Firstly, an application sends a file storage request, a file storage service receives the file storage request, and cloud storage resources corresponding to the file storage request are determined. The cloud storage resources comprise a public cloud and a private cloud. For example, if the application a needs to request to use the ali cloud OSS storage resource and the application B needs to request to use the private cloud storage resource, the application a and the application B respectively send file storage requests to the respective corresponding cloud storage resources to request the application of the corresponding cloud storage resources.
It should be noted that the file storage request sent by the application may include some related information, such as an application name, a size of the file, a file name, a cloud storage resource to be accessed, and the like. Therefore, which cloud storage resource is used can be managed and configured through the console, when the application sends a file storage request, the application does not need to sense which resource is used, and the file storage service can identify which cloud storage resource is used by the application according to the management configuration.
And sending a request for applying for a certificate to the cloud storage resource to acquire a corresponding temporary access certificate, wherein the temporary access certificate can contain related information in the file storage request, and sending the temporary access certificate to the application, so that the application accesses and uploads the file to the cloud storage resource based on the temporary access certificate to store the file.
It should be noted that the temporary access credential may be preset, so that the temporary access credential is time-efficient, and the use range of the temporary access credential may be limited, such as a specific name of an uploaded file, a file format, a file size, and the like.
In consideration of the fact that a management user needs to manage cloud storage resources, the application provides that: adding a cloud storage resource purchased and/or built by a management user based on the received first operation request; and acquiring the state information of the cloud storage resource corresponding to the management user based on the received second operation request, and sending the state information to the application so that the application can show the state information to the management user.
After cloud storage resources purchased and/or built by a management user are added, the related information of the cloud storage resources can be registered to a file storage service, and the related information of the cloud storage resources includes but is not limited to information of storage sources (such as S3 of AWS, ari cloud OSS, private cloud S3 storage, and the like), access credentials, access addresses, data center areas, capacity sizes, and the like. Different storage sources may have different configurations, and the file storage service may integrate and provide configuration support for different storage sources, facilitating configuration by a user.
The management user can manage the added cloud storage resources, and view real-time information of the cloud storage resources through a unified management interface provided by the file storage service, wherein the real-time information includes but is not limited to resource states, available space, used space and the like. Therefore, real-time management and control of the cloud storage resources by the management user can be achieved.
In order to manage the cloud storage resources more conveniently, the application further provides that: and creating at least one sub-user corresponding to the management user, and distributing corresponding viewing authority and management authority to each sub-user. The viewing right and the management right are all dimensions including but not limited to cloud storage resources, applications and tenants.
By providing authority management, tenant-based, application-based and user-based cloud storage resource selection can be achieved, a management user can manage applications with authority management, and operations include but are not limited to viewing application use states, viewing space quota limits, viewing used spaces and available spaces, deactivating applications, recovering application use, increasing and reducing storage resources and the like.
The file storage service supports tenant management, each tenant can manage own cloud storage resources, manage own applications and manage own users, and the file storage service or the file storage mode has richer authority management dimensionality and provides service support for a plurality of tenants.
In consideration of the security problem of the stored data, the application provides that the authority verification is performed on the file storage request, and the specific operations are as follows: before sending the temporary access credential to the application, receiving an application access credential sent by the application; verifying according to the application access certificate and a pre-stored verification access certificate to determine whether the application is legal or not; wherein the verification access credential is an access credential generated at the time of application creation. The application access certificate represents the identity of the user, and can ensure data isolation and safety. The credential means includes, but is not limited to, API-KEY, etc.
The management user may create an application, generally, one application corresponds to an upper-layer service application, and during creation, a storage resource configuration in a right may be selected, for example, which existing storage resource (e.g., an arilocos) is used, a storage quota (e.g., the maximum 10TB) available to the application is configured, and the like.
Therefore, the file storage service can verify the request sent by the application, and the application can carry the application access certificate received by the file storage service when sending the related operation request. The file storage service firstly identifies whether an application access certificate is valid; if not, the request fails; if yes, identifying whether the application access certificate has a storage volume, a folder or a file and the like specified in the authority management related operation request; if so, the request is successful; if so, the request fails. That is, if the application access credential is invalid or the application access credential is inconsistent with the target permissions for the specified operation, the request fails. The related operation request includes, but is not limited to, a file storage request, a file download request, a file deletion request, and the like.
The present application further proposes: sending the temporary access credential to the application so that the application accesses and uploads the file to the cloud storage resource based on the temporary access credential, specifically comprising: integrating SDKs of different programming language versions; and sending the temporary access voucher to the application so that the application accesses the cloud storage resource based on the temporary access voucher, and uploading the file to the cloud storage resource through the called SDK. Among them, the SDK is generally a set of development tools used by some software engineers to build application software for a specific software package, software framework, hardware platform, operating system, and the like.
The file storage service provides SDKs of various programming language versions, and the upper-layer service system and the application can integrate the SDKs of different languages, so that related file operation can be conveniently carried out.
Fig. 2 is an application schematic diagram of file storage supporting hybrid multiple clouds according to an embodiment of the present application, and as shown in fig. 2, two cloud storage resources, namely, an ali os and private cloud storage, are added in file storage service registration, two applications, namely, an application a and an application B, are created, the application a specifies to use the ali cloud OSS storage resource, the application B specifies to use the private cloud storage resource, the application a and the application B do not need to sense a bottom resource used by themselves, and may interact with the file storage service and the storage resource through an SDK, where interaction with the storage resource may be completed through the SDK without additional development according to different storage resources.
The file storage service provides virtual file management, and the application accesses the file storage service by virtue of the certificate to perform file operation. The file storage service supports the creation of a management storage volume, and creates a corresponding management folder in the management storage volume based on the received third operation request; acquiring a storage result of file storage and metadata of a file; the metadata is used to characterize the file; and generating a corresponding management file according to the storage result of the file storage and the metadata of the file, and adding the management file to a corresponding management folder. Specific file operations include, but are not limited to, creating a storage volume, deleting a storage volume, creating a folder, modifying a folder name, deleting a folder, copying a folder, moving a folder, uploading a file, modifying a file name, copying a file, moving a file, deleting a file, and the like.
To more clearly illustrate the process of uploading a file, fig. 3 is a flowchart of uploading a file provided in an embodiment of the present application, and as shown in fig. 3, the uploading a file includes 7 steps: step 1: an application initiates a file uploading request to a file storage service; step 2: the file storage service applies for a temporary access certificate to the cloud storage resource corresponding to the application; and step 3: the cloud storage resource returns a temporary access certificate to the file storage service; and 4, step 4: the file storage service returns a temporary access certificate to the application; and 5: the application uploads the file to the cloud storage resource by using the returned temporary access certificate; step 6: the cloud storage resource returns an uploading result and related metadata; and 7: the application informs the file storage service of the upload results and the associated metadata.
It should be noted that the metadata, also called intermediary data and relay data, is data describing data, mainly information describing data attributes, and is used to support functions such as indicating storage locations, history data, resource searching, file recording, and the like. Metadata is information about the organization of data, data fields, and their relationships, and in short, metadata is data about data.
Therefore, specific files are stored in the cloud storage resources, and the file storage service only records relevant metadata, so that virtual file management is realized.
Based on the method, the upper-layer business application uses the application access certificate distributed during application creation to access the file storage service, and realizes own logic and calls related interface request operation by combining own business scene and rich interfaces of a virtual file management system provided by the file storage service.
In order to more clearly understand the technical solution of the present application, the present application provides an architecture diagram of a file storage method supporting mixed multiple clouds, as shown in fig. 4. The administrative user of the government and enterprise organization can manage the storage resources, the application and the user through the storage resource management and management console, and the application A and the application B respectively integrate the client-SDK to perform related storage operation. The file storage service integrates various cloud storage services, provides a uniform management interface, and provides other rich management functions and new system functions of virtual files.
The application also provides a file downloading method, which specifically comprises the following steps: sending the management folder to an application so that the application can display the management folder to a user, and generating a corresponding file downloading request according to the operation of the user on the management folder; and acquiring a file downloading request generated by the application, determining a corresponding cloud storage resource according to the file downloading request, and downloading the file. Here, the user may perform the related operation by presenting the management folder to the user; or the upper layer service application can perform related operations at the server according to the service requirements of the upper layer service application. Generally, if the file is requested to be downloaded, the file storage service may also apply for a signature from a specific cloud storage resource, return the signature to an upper-layer business application, or directly redirect the download.
It should be noted that, uploading and downloading of files can be directly interfaced with cloud storage resources in a temporary credential manner, so that on one hand, bandwidth and memory pressure of file storage services are reduced, on the other hand, network resources can be better utilized, and file uploading and downloading performance is improved.
Meanwhile, the application also provides a file deleting method, which specifically comprises the following steps: sending the management folder to an application so that the application can display the management folder to a user, and generating a corresponding file deletion request according to the operation of the user on the management folder; acquiring a file deletion request generated by an application, performing logic deletion according to the file deletion request, and modifying the reference count of a corresponding file; and when the reference count is 0, determining the corresponding cloud storage resource according to the file deletion request, and deleting the file.
It should be noted that the file storage service executes the application-related operation request. And if the request sent by the application passes the permission verification, the file storage service executes related operation. If the operation itself does not involve the addition or subtraction of a specific file, such as management of a storage volume, a folder (not including copying, deleting a folder because such an operation would involve subfiles or subfolders within a folder), moving a file, etc., the file storage service completes the local operation, implements a corresponding effect through the virtual file management system, and returns the execution result. If the operation is the operation of copying the files or folders, the file storage service can add new files in an index counting mode, real cloud storage resources cannot be operated, and the two virtual files point to the same real file for storage in a mode similar to a soft connection mode and the like. If the operation is to delete the file, generally, the corresponding cloud storage resource is not directly accessed to delete the file, but the logical deletion is performed, meanwhile, the reference count of the file is modified, and when the reference count of the file is 0, the real deletion of the file is performed.
The present application further proposes: and uploading the file to the cloud storage resource through a calling interface provided externally based on the received fourth operation request, and storing the file. The file storage service provides external REST and other calling interfaces, the upper-layer service system can directly call the file storage service without integrating the SDK, and corresponding operations are performed on files, wherein the operations include file uploading, file deleting, file downloading and the like.
Fig. 5 is a schematic diagram of an application scenario provided in the embodiment of the present application, where as shown in fig. 5, cloud storage resources include AWS, a ali OSS, and private cloud storage, and an application includes, but is not limited to, an archive, an invoice, a travel, a finance, and the like, and an upper business system directly calls a file storage service to perform corresponding operations on a file.
An embodiment of the present application further provides a schematic structural diagram of a file storage device supporting hybrid multiple clouds, as shown in fig. 6, a file storage device supporting hybrid multiple clouds includes:
at least one processor; and the number of the first and second groups,
a memory communicatively coupled to the at least one processor; wherein,
the memory stores instructions executable by the at least one processor to enable the at least one processor to:
determining a cloud storage resource corresponding to a file storage request based on the file storage request from a corresponding application;
sending a request for applying for a certificate to the cloud storage resource to obtain a corresponding temporary access certificate; the cloud storage resources comprise a public cloud and a private cloud;
and sending the temporary access certificate to the application so that the application accesses and uploads files to the cloud storage resource for file storage based on the temporary access certificate.
The processor and the memory may communicate via a bus, and the device may further include an input/output interface for communicating with other devices.
Based on the same idea, one or more embodiments of the present specification further provide a non-volatile computer storage medium corresponding to the above method, and storing computer-executable instructions configured to:
determining a cloud storage resource corresponding to a file storage request based on the file storage request from a corresponding application;
sending a request for applying for a certificate to the cloud storage resource to obtain a corresponding temporary access certificate; the cloud storage resources comprise a public cloud and a private cloud;
and sending the temporary access certificate to the application so that the application accesses and uploads files to the cloud storage resource for file storage based on the temporary access certificate.
In summary, the file storage method and device supporting hybrid multiple clouds provided by the application support hybrid multiple cloud storage, provide authority management for verification, ensure the security of stored data, and provide functions such as application management, quota management, storage resource management, user management and the like, so that a government and enterprise unit can conveniently and uniformly manage own cloud storage resources when facing various cloud storage; moreover, the time consumed by the application of the informatization service in the butt joint storage can be saved, and the butt joint efficiency is improved.
The above description is only an example of the present application and is not intended to limit the present application. Various modifications and changes may occur to those skilled in the art. Any modifications, equivalents, improvements, etc. that come within the spirit of the disclosure are intended to be included within the scope of the claims of this disclosure.
Claims (10)
1. A file storage method supporting hybrid multi-cloud, the method comprising:
determining a cloud storage resource corresponding to a file storage request based on the file storage request from a corresponding application;
sending a request for applying for a certificate to the cloud storage resource to obtain a corresponding temporary access certificate; the cloud storage resources comprise a public cloud and a private cloud;
and sending the temporary access certificate to the application so that the application accesses and uploads files to the cloud storage resource for file storage based on the temporary access certificate.
2. The method of claim 1, further comprising:
adding a cloud storage resource purchased and/or built by a management user based on the received first operation request;
and acquiring state information of the cloud storage resource corresponding to the management user based on the received second operation request, and sending the state information to the application so that the application displays the state information to the management user.
3. The method of claim 2, further comprising:
creating at least one sub-user corresponding to the management user, and distributing corresponding viewing authority and management authority to each sub-user;
the viewing authority and the management authority have dimensions including, but not limited to, cloud storage resources, applications and tenants.
4. The method of claim 1, wherein prior to sending the temporary access credential to the application, the method further comprises:
receiving an application access certificate sent by the application;
verifying according to the application access certificate and a pre-stored verification access certificate to determine whether the application is legal or not;
wherein the verification access credential is an access credential generated at the time of creation of the application.
5. The method according to claim 1, wherein sending the temporary access credential to the application to enable the application to access and upload a file to the cloud storage resource based on the temporary access credential specifically comprises:
integrating Software Development Kits (SDKs) of different programming language versions;
sending the temporary access credential to the application so that the application accesses the cloud storage resource based on the temporary access credential and uploads a file to the cloud storage resource through the called SDK.
6. The method of claim 1, further comprising:
creating a management storage volume, and creating a corresponding management folder in the management storage volume based on the received third operation request;
acquiring a storage result of the file storage and metadata of the file; the metadata is used to characterize the file;
and generating a corresponding management file according to the storage result of the file storage and the metadata of the file, and adding the management file to a corresponding management folder.
7. The method of claim 6, further comprising:
sending the management folder to the application so that the application displays the management folder to a user, and generating a corresponding file downloading request according to the operation of the user on the management folder;
and acquiring the file downloading request generated by the application, and determining the corresponding cloud storage resource according to the file downloading request.
8. The method of claim 6, further comprising:
sending the management folder to the application so that the application displays the management folder to a user, and generating a corresponding file deletion request according to the operation of the user on the management folder;
acquiring the file deletion request generated by the application, performing logic deletion according to the file deletion request, and modifying the reference count of the corresponding file;
and when the reference count is 0, determining the corresponding cloud storage resource according to the file deletion request, and deleting the file.
9. The method of claim 1, further comprising:
and uploading the file to the cloud storage resource through a calling interface provided externally based on the received fourth operation request, and storing the file.
10. A file storage device supporting hybrid multi-clouds, comprising:
at least one processor, and,
a memory communicatively coupled to the at least one processor; wherein,
the memory stores instructions executable by the at least one processor to enable the at least one processor to:
determining a cloud storage resource corresponding to a file storage request based on the file storage request from a corresponding application;
sending a request for applying for a certificate to the cloud storage resource to obtain a corresponding temporary access certificate; the cloud storage resources comprise a public cloud and a private cloud;
and sending the temporary access certificate to the application so that the application accesses and uploads files to the cloud storage resource for file storage based on the temporary access certificate.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110099850.1A CN112699093A (en) | 2021-01-25 | 2021-01-25 | File storage method and equipment supporting hybrid multi-cloud |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110099850.1A CN112699093A (en) | 2021-01-25 | 2021-01-25 | File storage method and equipment supporting hybrid multi-cloud |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112699093A true CN112699093A (en) | 2021-04-23 |
Family
ID=75516122
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110099850.1A Pending CN112699093A (en) | 2021-01-25 | 2021-01-25 | File storage method and equipment supporting hybrid multi-cloud |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112699093A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114567567A (en) * | 2022-02-24 | 2022-05-31 | 特赞（上海）信息科技有限公司 | Self-adaptive multi-cloud storage resource management method and system |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106127064A (en) * | 2016-06-14 | 2016-11-16 | 成都镜杰科技有限责任公司 | Date storage method for enterprise supply chain |
| CN107908360A (en) * | 2017-11-09 | 2018-04-13 | 郑州云海信息技术有限公司 | A kind of data-storage system and date storage method based on mixing cloud storage |
| CN110007862A (en) * | 2019-04-01 | 2019-07-12 | 北京猫盘技术有限公司 | Mixing cloud storage system and its data processing method based on network storage equipment |
| US10445296B1 (en) * | 2014-12-05 | 2019-10-15 | EMC IP Holding Company LLC | Reading from a site cache in a distributed file system |
| CN111083243A (en) * | 2019-12-31 | 2020-04-28 | 北京奇艺世纪科技有限公司 | File uploading method and device, computer equipment and storage medium |
| CN111797414A (en) * | 2020-06-24 | 2020-10-20 | 北京青云科技股份有限公司 | Hybrid cloud management method and system and cloud service platform |
-
2021
- 2021-01-25 CN CN202110099850.1A patent/CN112699093A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10445296B1 (en) * | 2014-12-05 | 2019-10-15 | EMC IP Holding Company LLC | Reading from a site cache in a distributed file system |
| CN106127064A (en) * | 2016-06-14 | 2016-11-16 | 成都镜杰科技有限责任公司 | Date storage method for enterprise supply chain |
| CN107908360A (en) * | 2017-11-09 | 2018-04-13 | 郑州云海信息技术有限公司 | A kind of data-storage system and date storage method based on mixing cloud storage |
| CN110007862A (en) * | 2019-04-01 | 2019-07-12 | 北京猫盘技术有限公司 | Mixing cloud storage system and its data processing method based on network storage equipment |
| CN111083243A (en) * | 2019-12-31 | 2020-04-28 | 北京奇艺世纪科技有限公司 | File uploading method and device, computer equipment and storage medium |
| CN111797414A (en) * | 2020-06-24 | 2020-10-20 | 北京青云科技股份有限公司 | Hybrid cloud management method and system and cloud service platform |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114567567A (en) * | 2022-02-24 | 2022-05-31 | 特赞（上海）信息科技有限公司 | Self-adaptive multi-cloud storage resource management method and system |
| CN114567567B (en) * | 2022-02-24 | 2024-03-01 | 特赞（上海）信息科技有限公司 | Resource management method and system for self-adaptive multi-cloud storage |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9460147B1 (en) | Partition-based index management in hadoop-like data stores | |
| US9251183B2 (en) | Managing tenant-specific data sets in a multi-tenant environment | |
| US20220114150A1 (en) | Blockchain implemented data migration audit trail | |
| US11188499B2 (en) | Storing and retrieving restricted datasets to and from a cloud network with non-restricted datasets | |
| JP2020503598A (en) | Container based operating system and method | |
| US20200210381A1 (en) | Optimized content object storage service for large scale content | |
| US11080041B1 (en) | Operating system management for virtual workspaces | |
| US9256613B2 (en) | Systems, methods, and computer program products for secure multi-enterprise storage | |
| JP2022530440A (en) | Debugging on-premises and off-premises | |
| CN115039100B (en) | Reserving one or more security modules for secure guests | |
| US10783073B2 (en) | Chronologically ordered out-of-place update key-value storage system | |
| US11093477B1 (en) | Multiple source database system consolidation | |
| US11586470B2 (en) | Scalable workflow engine with a stateless orchestrator | |
| US20190114081A1 (en) | Scale-out container volume service for multiple frameworks | |
| CN118056394A (en) | Managing proprietary structured objects | |
| US11968210B2 (en) | Management of access control in multi-cloud environments | |
| US11481232B2 (en) | Registry image management | |
| CN112699093A (en) | File storage method and equipment supporting hybrid multi-cloud | |
| CN115774661A (en) | Multi-user debugging with user data isolation | |
| CN115485677A (en) | Secure data replication in a distributed data storage environment | |
| US12143280B1 (en) | Constraint management for network-based service actions | |
| US20240330308A1 (en) | System state adaptive workload placement and request routing using search technology | |
| CN117668811A (en) | Offline feature management platform, offline feature management method, electronic equipment and storage medium | |
| CN118540315A (en) | Communication method based on cloud computing technology and related equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210423 |