CN113132489A

CN113132489A - Method, device, computing equipment and medium for downloading file

Info

Publication number: CN113132489A
Application number: CN202110438877.9A
Authority: CN
Inventors: 沈晓煌; 孙刚; 张煜; 马辉
Original assignee: Industrial and Commercial Bank of China Ltd ICBC
Current assignee: Industrial and Commercial Bank of China Ltd ICBC
Priority date: 2021-04-22
Filing date: 2021-04-22
Publication date: 2021-07-16

Abstract

The present disclosure provides a method for downloading files, which is applied to a client and can be used in the financial field or other fields. The method comprises the following steps: sending a downloading task request to a server; receiving a connection instruction from a server; sending a connection request to the server according to the connection instruction so as to establish long connection for connecting the server; receiving file identifications and storage addresses of a plurality of fragmented files from a server through long connection, wherein the fragmented files are obtained by performing fragmentation operation on a target file; according to the file identification and the storage address, downloading a plurality of fragment files in parallel; and synthesizing the plurality of slicing files into a target file. The disclosure also provides a device for downloading the file, a computing device and a computer storage medium.

Description

Method, device, computing equipment and medium for downloading file

Technical Field

The present disclosure relates to the field of computer technologies, and in particular, to a method and an apparatus for downloading a file, a computing device, and a computer storage medium.

Background

In the application scenario of online transaction, the related art downloads a large-capacity file by using two processing methods, namely online real-time downloading and asynchronous polling downloading. For the online real-time downloading mode, the server needs to process the file downloading in real time, the phenomenon that the instantaneous CPU utilization rate reaches the peak value may occur, the processing of normal transaction is influenced, and when the file downloading is not performed, the phenomenon that the CPU utilization rate has a trough may occur, so that the utilization rate of the whole resources of the CPU is low. For the asynchronous polling downloading mode, the server can utilize the idle window of the server CPU to perform asynchronous processing file downloading logic, and utilize the effective CPU resource of the server as much as possible, but the asynchronous downloading creates a large amount of invalid connections between the client and the server, and consumes the resources of the client and the server.

Disclosure of Invention

One aspect of the present disclosure provides a method for downloading a file, which is applied to a client, wherein the method includes: sending a downloading task request to a server; receiving a connection instruction from the server; sending a connection request to the server according to the connection instruction so as to establish long connection for connecting the server; receiving file identifications and storage addresses of a plurality of fragmented files from the server through the long connection, wherein the fragmented files are obtained by performing fragmentation operation on a target file; according to the file identification and the storage address, downloading the plurality of fragment files in parallel; and synthesizing the plurality of fragmented files into the target file.

Optionally, the downloading the plurality of fragmented files according to the file identifier and the storage address includes: generating a downloading request according to the file identifier and the storage address, wherein the downloading request is based on HTTP/2; and downloading the plurality of slicing files in parallel through the downloading request.

Optionally, the method further comprises: and in response to receiving a preset state code from the server through the long connection, re-initiating a connection request to the server.

Another aspect of the present disclosure provides a method for downloading a file, which is applied to a first service, wherein the method includes: in response to receiving a download task request from a client, creating a download task; pushing the downloading task to a message queue, and sending a connection instruction to the client; establishing a long connection to the client in response to receiving a connection request from the client; acquiring file identifiers and storage addresses of a plurality of fragmented files through a message queue, wherein the fragmented files are obtained by fragmenting a target file; and sending the file identifications and the storage addresses of the plurality of fragmented files to the client through the long connection.

Optionally, the method further comprises: and under the condition that the file identifiers and the storage addresses of the plurality of fragmented files are not acquired, suspending the long connection.

Optionally, the method further comprises: and sending a preset state code to the client under the condition that the file identifiers and the storage addresses of the plurality of fragmented files are not acquired within a preset time after the long connection is established.

Optionally, the method further comprises: acquiring performance parameters and/or load parameters of a server; and dynamically determining the preset time according to the performance parameter and/or the load parameter of the server.

Optionally, the creating a download task includes: scheduling a first server to create the download task; and the establishing of the long connection with the client comprises: scheduling a second server to establish a long connection between the second server and the client.

Another aspect of the present disclosure provides a method for downloading a file, which is applied to a second server, wherein the method includes: acquiring a downloading task through a message queue; downloading a target file according to the downloading task; fragmenting the target file to obtain a plurality of fragmented files; storing the plurality of fragmented files, and acquiring a file identifier and a storage address of each fragmented file in the plurality of fragmented files; and sending the file identifications and the storage addresses of the plurality of fragmented files to a message queue.

Another aspect of the present disclosure provides an apparatus for downloading a file, which is applied to a client, wherein the apparatus includes: the first sending module is used for sending a downloading task request to the server; the first receiving module is used for receiving a connection instruction from the server; the first connection module is used for sending a connection request to the server according to the connection instruction so as to establish long connection for connecting the server; the second receiving module is used for receiving file identifiers and storage addresses of a plurality of fragmented files from the server through the long connection, wherein the fragmented files are obtained by performing fragmentation operation on a target file; the first downloading module is used for downloading the plurality of fragment files in parallel according to the file identification and the storage address; and the synthesis module is used for synthesizing the plurality of fragment files into the target file.

Another aspect of the present disclosure provides an apparatus for downloading a file, which is applied to a first service, wherein the apparatus includes: the creating module is used for responding to a download task request received from a client and creating a download task; the first pushing module is used for pushing the downloading task to a message queue and sending a connection instruction to the client; the second connection module is used for responding to the connection request received from the client and establishing long connection for connecting the client; the device comprises a first acquisition module, a second acquisition module and a first storage module, wherein the first acquisition module is used for acquiring file identifiers and storage addresses of a plurality of fragmented files through a message queue, and the fragmented files are obtained by performing fragmentation operation on a target file; and the second sending module is used for sending the file identifications and the storage addresses of the plurality of fragmented files to the client through the long connection.

Another aspect of the present disclosure provides an apparatus for downloading a file, which is applied to a second server, wherein the apparatus includes: the second acquisition module is used for acquiring the downloading task through the message queue; the second downloading module is used for downloading the target file according to the downloading task; the fragmentation module is used for fragmenting the target file to obtain a plurality of fragmented files; the storage module is used for storing the plurality of fragmented files and acquiring a file identifier and a storage address of each fragmented file in the plurality of fragmented files; and the third sending module is used for sending the file identifications and the storage addresses of the plurality of fragmented files to a message queue.

Another aspect of the disclosure provides a computing device comprising: one or more processors; storage means for storing one or more programs, wherein the one or more programs, when executed by the one or more processors, cause the one or more processors to implement the method as described above.

Another aspect of the present disclosure provides a computer-readable storage medium storing computer-executable instructions for implementing the method as described above when executed.

Another aspect of the disclosure provides a computer program comprising computer executable instructions for implementing the method as described above when executed.

According to the embodiment of the disclosure, by establishing a long connection for connecting a server, receiving file identifiers and storage addresses of a plurality of fragment files from the server through the long connection, downloading the plurality of fragment files in parallel according to the file identifiers and the storage addresses, and synthesizing the plurality of fragment files into the target file, a large number of invalid connections can be prevented from being established between a client and the server, so that the resource consumption of the client and the server is reduced, and in addition, the server does not need to process file downloading in real time, so that the utilization rate of a server CPU is improved.

Drawings

For a more complete understanding of the present disclosure and the advantages thereof, reference is now made to the following descriptions taken in conjunction with the accompanying drawings, in which:

fig. 1 schematically illustrates an application scenario of a method of downloading a file and an apparatus for downloading a file according to an embodiment of the present disclosure;

FIG. 2 schematically shows a flow diagram of a method of downloading a file according to an embodiment of the present disclosure;

FIG. 3 schematically illustrates a flow diagram of a method of downloading a file according to another embodiment of the present disclosure;

FIG. 4 schematically illustrates a flow diagram of a method of downloading a file according to another embodiment of the present disclosure;

FIG. 5 schematically illustrates a method of downloading a file according to an embodiment of the present disclosure;

FIG. 6 schematically shows a block diagram of an apparatus for downloading a file according to an embodiment of the present disclosure;

FIG. 7 schematically illustrates a block diagram of an apparatus for downloading a file according to another embodiment of the present disclosure;

FIG. 8 schematically illustrates a block diagram of an apparatus for downloading a file according to another embodiment of the present disclosure; and

FIG. 9 schematically illustrates a block diagram of a computer system suitable for implementing the above-described method according to an embodiment of the present disclosure.

Detailed Description

Hereinafter, embodiments of the present disclosure will be described with reference to the accompanying drawings. It should be understood that the description is illustrative only and is not intended to limit the scope of the present disclosure. In the following detailed description, for purposes of explanation, numerous specific details are set forth in order to provide a thorough understanding of the embodiments of the disclosure. It may be evident, however, that one or more embodiments may be practiced without these specific details. Moreover, in the following description, descriptions of well-known structures and techniques are omitted so as to not unnecessarily obscure the concepts of the present disclosure.

The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the disclosure. The terms "comprises," "comprising," and the like, as used herein, specify the presence of stated features, steps, operations, and/or components, but do not preclude the presence or addition of one or more other features, steps, operations, or components.

All terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art unless otherwise defined. It is noted that the terms used herein should be interpreted as having a meaning that is consistent with the context of this specification and should not be interpreted in an idealized or overly formal sense.

Where a convention analogous to "at least one of A, B and C, etc." is used, in general such a construction is intended in the sense one having skill in the art would understand the convention (e.g., "a system having at least one of A, B and C" would include but not be limited to systems that have a alone, B alone, C alone, a and B together, a and C together, B and C together, and/or A, B, C together, etc.).

Some block diagrams and/or flow diagrams are shown in the figures. It will be understood that some blocks of the block diagrams and/or flowchart illustrations, or combinations thereof, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus, such that the instructions, which execute via the processor, create means for implementing the functions/acts specified in the block diagrams and/or flowchart block or blocks. The techniques of this disclosure may be implemented in hardware and/or software (including firmware, microcode, etc.). In addition, the techniques of this disclosure may take the form of a computer program product on a computer-readable storage medium having instructions stored thereon for use by or in connection with an instruction execution system.

Embodiments of the present disclosure provide a method of downloading a file and a method of downloading a file to which the method can be applied. The method comprises the steps of sending a downloading task request to a server; receiving a connection instruction from a server; sending a connection request to the server according to the connection instruction so as to establish long connection for connecting the server; receiving file identifications and storage addresses of a plurality of fragmented files from the server through the long connection, wherein the fragmented files are obtained by performing fragmentation operation on a target file; according to the file identification and the storage address, downloading the plurality of fragment files in parallel; and synthesizing the plurality of fragmented files into the target file.

It should be noted that the method and apparatus for downloading a file according to the embodiments of the present disclosure may be used in the financial field, and may also be used in any field other than the financial field.

Fig. 1 schematically illustrates an application scenario of a method of downloading a file and an apparatus for downloading a file according to an embodiment of the present disclosure. It should be noted that fig. 1 is only an example of a scenario in which the embodiments of the present disclosure may be applied to help those skilled in the art understand the technical content of the present disclosure, but does not mean that the embodiments of the present disclosure may not be applied to other devices, systems, environments or scenarios.

As shown in fig. 1, the application scenario 100 according to this embodiment may include a client 110, a server 120, and a network 130. Network 130 serves as a medium for providing communication links between clients 110 and servers 120. Network 130 may include various connection types, such as wired, wireless communication links, or fiber optic cables, to name a few.

A user may use client 110 to interact with server 120 over network 130 to receive or send messages, etc. Various messaging client applications may be installed on client 110, such as a shopping-like application, a web browser application, a search-like application, an instant messaging tool, a mailbox client, social platform software, and so forth (by way of example only).

The client 110 may be a variety of electronic devices having a display screen and supporting web browsing, including but not limited to smart phones, tablets, laptop portable computers, desktop computers, and the like.

The server 120 may include a first server 121, a distributed message center 122, a second server 123, and a distributed storage 124.

The first server 121 may be configured to receive a download task request from the client 110, and create a corresponding download task. Then, as a producer of the download task, a message corresponding to the download task is produced and pushed to the message queue of the distributed message center 122. And returns a long connection initiation instruction to the client 110 to instruct the client 110 to initiate an HTTP long connection request to the first server 121.

The first server 121 may also be configured to receive an HTTP long connection request from the client 110 to establish a long connection with the client 110.

The second server 123 may be a consumer of the download task message, subscribe to the consumption download task from the message center, and process the download task. After the server of the download task processes the download task, the server fragments the data downloaded by the download task to obtain a plurality of fragment files, and then stores the fragment files in the distributed storage device 124, and generates fragment file identifiers and storage addresses. And after the fragmented file is successfully stored, the downloading task result containing the file identifier and the storage address is used as a message to be generated to a message center.

The first service end 121 may be a consumer of the download task result, and after consuming the download task result, returns the file identifiers and the storage addresses of the multiple fragmented files to the download queue of the client 110 through the HTTP long connection, so that the client 110 initiates a file download request according to the multiple fragmented file names.

According to another embodiment of the present disclosure, the first server and the second server may also be the same server.

Fig. 2 schematically shows a flowchart of a method of downloading a file according to an embodiment of the present disclosure.

As shown in fig. 2, the method includes operations S210 to S260. The method may be applied to a client as shown in fig. 1, for example.

In operation S210, a download task request is transmitted to the server.

According to the embodiment of the disclosure, the download task request can be used for requesting to download the target file from the server. The target file may include, for example, a text file, a video file, an audio file, an image, and so forth. In this embodiment, the target file may include, for example, a large-capacity file that needs to be downloaded for an online transaction.

In operation S220, a connection instruction from the server is received.

According to the embodiment of the disclosure, the server may include a plurality of servers, and after receiving the download task request of the client, the server may schedule the corresponding server to process the download task, and then send a connection instruction to the client. The connection instruction may be used to instruct the client to initiate a connection request to the server.

In operation S230, a connection request is sent to the server according to the connection instruction to establish a long connection to the server.

According to an embodiment of the present disclosure, the long connection may be a long connection between the client and the server. The server may schedule a designated server to establish the long connection with the client. Illustratively, in this embodiment, the connection request may be an HTTP request, which may be configured for a longer lifetime. Performance loss for both the client and the server can be reduced by employing HTTP requests.

In operation S240, file identifiers and storage addresses of a plurality of fragmented files from the server are received through the long connection.

It should be noted that the server receiving the download task request and the server establishing the long connection with the client may be the same server or different servers.

According to the embodiment of the disclosure, a plurality of fragmented files correspond to the target file, and the fragmented files can be obtained by performing a fragmentation operation on the target file.

According to an embodiment of the present disclosure, the file identifier may be used to identify each sharded file. The file identification may include, for example, a hash value, a file name, and so on. For example, in this embodiment, a unique hash code may be generated for each fragmented file as the file identifier of the fragmented file. The storage address may be used to indicate a storage location of the allocation file. The storage address may be a domain name address, an IP address, or a path location of the fragmented file in the storage server, etc.

In operation S250, a plurality of fragmented files are downloaded in parallel according to the file identifier and the storage address.

According to the embodiment of the disclosure, the download request may be generated according to the file identifier and the storage address, where the download request may include, for example, the file identifier and the storage address of each fragmented file. And then requesting the storage server to transmit the fragment file corresponding to the file identifier to the client through a downloading request, so as to download a plurality of fragment files.

According to an embodiment of the present disclosure, the download process may be based on HTTP/2 (Hypertext transfer protocol 2.0). For example, the multiplexing function of HTTP/2 can be utilized, the limitation that the same domain name can only initiate 6-8 HTTP requests is avoided, a plurality of files are simultaneously downloaded in the same link, the bandwidth of the client and the bandwidth of the server are efficiently utilized, in addition, the request number of the client which can be received by the server can be increased, and the utilization efficiency of the server is improved.

In operation S260, the plurality of sliced files are synthesized into a target file.

According to the embodiment of the disclosure, after the plurality of fragment files are downloaded, the fragment files can be synthesized to obtain the target file, so that the target file is downloaded.

Fig. 3 schematically shows a flowchart of a method of downloading a file according to another embodiment of the present disclosure.

As shown in fig. 3, the method includes operations S310 to S350. The method may be applied to, for example, the first server shown in fig. 1.

In operation S310, a download task is created in response to receiving a download task request from a client.

According to an embodiment of the present disclosure, the server may include a plurality of servers. The server may schedule a first of the servers to receive a download task request from the client and then create a download task based on the download task request.

In operation S320, the download task is pushed to the message queue, and a connection instruction is sent to the client.

According to the embodiment of the disclosure, the first server can be used as a producer to push the downloading task to the message queue. And other servers of the server can be used as consumers to acquire the downloading task from the message queue and execute corresponding downloading operation so as to download the target file corresponding to the downloading task to the designated position of the server.

According to embodiments of the present disclosure, message queues may be located in a distributed message center, for example.

In operation S330, a long connection connecting the clients is established in response to receiving a connection request from the client.

According to an embodiment of the present disclosure, after receiving a connection request from a client, a server may schedule a second server to establish a long connection between the client and the second server. It should be noted that the second server and the first server may be the same server, or may be different servers in the server from the first server.

In operation S340, file identifiers and storage addresses of a plurality of fragmented files are obtained through a message queue.

According to the embodiment of the disclosure, the plurality of fragmented files can be obtained by performing a fragmentation operation on the target file.

According to the embodiment of the disclosure, a server (hereinafter referred to as a download task server) as a download task consumer segments a target file after downloading the target file to obtain a plurality of segment files, and then stores the segment files respectively to obtain file identifiers and storage addresses of the segment files. Next, the download task server may push the file identifiers and storage addresses of the plurality of fragmented files as messages to the message queue, so that the second server may obtain the file identifiers and storage addresses of the plurality of fragmented files from the message queue.

In operation S350, the file identifiers and the storage addresses of the plurality of fragmented files are sent to the client through the long connection.

According to the embodiment of the disclosure, after the file identifier and the storage address are obtained, the second server can send the file identifier and the storage address to the client through the established long connection.

Fig. 4 schematically shows a flowchart of a method of downloading a file according to another embodiment of the present disclosure.

As shown in fig. 4, the method includes operations S410 to S450. The method may be applied to a second server, for example, as shown in fig. 1. It should be noted that the second service end may be the same service end as the first service end, or may be a different service end.

In operation S410, a download task is acquired through a message queue.

According to the embodiment of the disclosure, the second server may schedule a third server of the second server as a consumer to acquire a download task from the message queue.

In operation S420, the target file is downloaded according to the download task.

According to the embodiment of the disclosure, the target file may be located in another system or storage device besides the second server, so that, in order to provide the target file to the client, the third server may first download the target file to a specified location. The designated location may be located, for example, in a distributed storage device.

In operation S430, the target file is fragmented to obtain a plurality of fragmented files.

According to the embodiment of the disclosure, the target file is fragmented to obtain a plurality of fragmented files, so that the size of a single file is reduced, and meanwhile, the plurality of fragmented files can be downloaded in parallel, thereby improving the downloading efficiency.

In operation S440, the plurality of fragmented files are stored, and a file identifier and a storage address of each of the plurality of fragmented files are obtained.

According to the embodiment of the disclosure, the third server may store a plurality of fragmented files obtained by fragmentation into the distributed storage apparatus, respectively, and obtain a file identifier of each fragmented file and a storage address in the distributed storage apparatus. The file identifier may include, for example, a file name, a hash value, and the like.

In operation S450, file identifications and storage addresses of the plurality of fragmented files are sent to a message queue.

According to the embodiment of the disclosure, after obtaining the file identifier and the storage address in the distributed storage device of each fragmented file, the third server may push the file identifier and the storage address to the message queue as a message, so as to transmit the message queue to the second server.

According to another embodiment of the disclosure, the server may suspend the long connection without acquiring the file identifiers and storage addresses of the plurality of fragmented files. In addition, in order to prevent the resource occupation from being too high due to the fact that the HTTP connection is not released, if the file identifiers and the storage addresses of the plurality of fragmented files are not obtained within a preset time after the long connection is established, the preset state code may be sent to the client.

For example, in this embodiment, the preset status code may be 304, for example. For example, in this embodiment, the performance parameter and/or the load parameter of the server may be obtained, and the preset time is dynamically determined according to the performance parameter and/or the load parameter of the server. The performance parameters may include, for example, QPS, TPS, concurrency amount, and the like of the server, and the load parameters may include, for example, CPU usage amount, memory usage amount, IO consumption amount, and the like.

And the client side responds to the preset state code received from the server side through the long connection and initiates a connection request to the server side again.

The method illustrated in fig. 2-4 is further described with reference to fig. 5 in conjunction with specific embodiments.

Those skilled in the art will appreciate that the following example embodiments are only for the understanding of the present disclosure, and the present disclosure is not limited thereto.

Fig. 5 schematically illustrates a method of downloading a file according to an embodiment of the present disclosure.

As shown in fig. 5, the client initiates a create download task request to the first server, which may be an HTTP (hypertext transfer protocol) based request.

And after receiving the download task request from the client, the first service end creates a corresponding download task. Then, the first server receiving the client request is used as a producer of the downloading task, a message corresponding to the downloading task is produced, and the message is pushed to the message center. And after the message of the produced downloading task is pushed to the message center, a long connection initiating instruction is returned to the client, and the instruction is used for indicating the client to initiate HTTP long connection to the second server. The first server and the second server may be the same server or different servers.

After receiving the long connection initiating instruction from the first server, the client initiates an HTTP long connection request to the second server to establish an HTTP long connection with the second server.

And after receiving the HTTP long connection request from the client, the second server temporarily suspends the HTTP long connection with the client under the condition that the downloading task is not successful. In order to prevent the over-high resource occupation caused by the non-release of the HTTP connection, the state code 304 is returned to the client side when the server side does not receive a success instruction within the set HTTP connection time.

The client re-initiates the HTTP long connection request after receiving 304 the status code.

The server (also called third server) of the download task is used as a consumer of the download task message, subscribes to the consumption download task from the message center, and processes the download task. After the server of the download task processes the download task, the server fragments the data downloaded by the download task to obtain a plurality of fragment files, and then stores the fragment files in the distributed storage device, and generates a file identifier (such as a hash value) and a storage address. And after the server of the download task successfully stores the fragment file, the download task result containing the fragment file identifier and the storage address is used as a message to be generated to a message center.

And the second server is used as a consumer of the downloading task result, and after the downloading task result is consumed, the file identifications and the storage addresses of the plurality of fragment files are returned to the client downloading queue through HTTP long connection.

And the client initiates a file downloading request according to the file identifiers and the storage addresses of the plurality of fragmented files. The file download request may be based on HTTP/2. The client can use the multiplexing function of HTTP/2 to pull the download queue to a multiplexing task so as to avoid the limitation that the same domain name can only initiate 6-8 HTTP requests, and the bandwidth of the client and the bandwidth of the server can be efficiently used by initiating simultaneous downloading of a plurality of files in the same link, and meanwhile, the number of requests of the client which can be received by the server is increased, and the utilization efficiency of the server is improved.

Fig. 6 schematically shows a block diagram of an apparatus for downloading a file according to an embodiment of the present disclosure.

As shown in fig. 6, the apparatus 600 for downloading a file includes a first transmitting module 610, a first receiving module 620, a first connecting module 630, a second receiving module 640, a first downloading module 650, and a synthesizing module 660. The apparatus for downloading a file 600 may perform the method described above with reference to fig. 2. The apparatus for downloading a file 600 may be applied to a client as shown in fig. 1, for example.

Specifically, the first sending module 610 may be configured to send a request for a download task to the server.

The first receiving module 620 may be configured to receive a connection instruction from the server.

The first connection module 630 may be configured to send a connection request to the server according to the connection instruction, so as to establish a long connection connecting the server.

The second receiving module 640 may be configured to receive, through the long connection, file identifiers and storage addresses of a plurality of fragmented files from the server, where the plurality of fragmented files are obtained by performing a fragmentation operation on a target file.

The first downloading module 650 may be configured to download the plurality of fragmented files in parallel according to the file identifier and the storage address.

The synthesizing module 660 may be configured to synthesize the plurality of fragmented files into the target file.

Fig. 7 schematically shows a block diagram of an apparatus for downloading a file according to another embodiment of the present disclosure.

As shown in fig. 7, the apparatus 700 for downloading a file includes a creating module 710, a first pushing module 720, a second connecting module 730, a first obtaining module 740, and a second sending module 750. The apparatus for downloading a file 700 may perform the method described above with reference to fig. 3. The apparatus 700 for downloading a file can be applied to, for example, the first server shown in fig. 1.

Specifically, the creating module 710 may be configured to create a download task in response to receiving a download task request from a client.

The first pushing module 720 may be configured to push the downloading task to a message queue, and send a connection instruction to the client.

A second connection module 730, which may be configured to establish a long connection to the client in response to receiving a connection request from the client.

The first obtaining module 740 may be configured to obtain file identifiers and storage addresses of multiple fragmented files through a message queue, where the multiple fragmented files are obtained by performing a fragmentation operation on a target file.

The second sending module 750 may be configured to send the file identifiers and the storage addresses of the multiple fragmented files to the client through the long connection.

Fig. 8 schematically shows a block diagram of an apparatus for downloading a file according to another embodiment of the present disclosure.

As shown in fig. 8, the apparatus 800 for downloading a file includes a second obtaining module 810, a second downloading module 820, a fragmentation module 830, a storage module 840, and a third sending module 850. The apparatus for downloading a file 800 may perform the method described above with reference to fig. 4. The file downloading apparatus 800 may be applied to, for example, the second server shown in fig. 1.

Specifically, the second obtaining module 810 may be configured to obtain the download task through the message queue.

The second downloading module 820 may be configured to download the target file according to the downloading task.

The fragmenting module 830 may be configured to fragment the target file to obtain a plurality of fragmented files.

The storage module 840 may be configured to store the plurality of fragmented files, and obtain a file identifier and a storage address of each fragmented file in the plurality of fragmented files.

The third sending module 850 may be configured to send the file identifiers and the storage addresses of the plurality of fragmented files to the message queue.

Any number of modules, sub-modules, units, sub-units, or at least part of the functionality of any number thereof according to embodiments of the present disclosure may be implemented in one module. Any one or more of the modules, sub-modules, units, and sub-units according to the embodiments of the present disclosure may be implemented by being split into a plurality of modules. Any one or more of the modules, sub-modules, units, sub-units according to embodiments of the present disclosure may be implemented at least in part as a hardware circuit, such as a Field Programmable Gate Array (FPGA), a Programmable Logic Array (PLA), a system on a chip, a system on a substrate, a system on a package, an Application Specific Integrated Circuit (ASIC), or may be implemented in any other reasonable manner of hardware or firmware by integrating or packaging a circuit, or in any one of or a suitable combination of software, hardware, and firmware implementations. Alternatively, one or more of the modules, sub-modules, units, sub-units according to embodiments of the disclosure may be at least partially implemented as a computer program module, which when executed may perform the corresponding functions.

For example, any plurality of the first transmitting module 610, the first receiving module 620, the first connecting module 630, the second receiving module 640, the first downloading module 650, and the synthesizing module 660 may be combined in one module to be implemented, or any one of them may be split into a plurality of modules. Alternatively, at least part of the functionality of one or more of these modules may be combined with at least part of the functionality of the other modules and implemented in one module. According to the embodiment of the present disclosure, at least one of the first sending module 610, the first receiving module 620, the first connecting module 630, the second receiving module 640, the first downloading module 650, and the synthesizing module 660 may be at least partially implemented as a hardware circuit, such as a Field Programmable Gate Array (FPGA), a Programmable Logic Array (PLA), a system on a chip, a system on a substrate, a system on a package, an Application Specific Integrated Circuit (ASIC), or may be implemented by hardware or firmware in any other reasonable manner of integrating or packaging a circuit, or implemented by any one of three implementations of software, hardware, and firmware, or an appropriate combination of any several of them. Alternatively, at least one of the first transmitting module 610, the first receiving module 620, the first connecting module 630, the second receiving module 640, the first downloading module 650 and the synthesizing module 660 may be at least partially implemented as a computer program module, which may perform a corresponding function when executed.

FIG. 9 schematically illustrates a block diagram of a computer system suitable for implementing the above-described method according to an embodiment of the present disclosure. The computer system illustrated in FIG. 9 is only one example and should not impose any limitations on the scope of use or functionality of embodiments of the disclosure.

As shown in fig. 9, a computer system 900 according to an embodiment of the present disclosure includes a processor 901 which can perform various appropriate actions and processes according to a program stored in a Read Only Memory (ROM)902 or a program loaded from a storage section 908 into a Random Access Memory (RAM) 903. Processor 901 may comprise, for example, a general purpose microprocessor (e.g., a CPU), an instruction set processor and/or associated chipset, and/or a special purpose microprocessor (e.g., an Application Specific Integrated Circuit (ASIC)), among others. The processor 901 may also include on-board memory for caching purposes. The processor 901 may comprise a single processing unit or a plurality of processing units for performing the different actions of the method flows according to embodiments of the present disclosure.

In the RAM 903, various programs and data necessary for the operation of the system 900 are stored. The processor 901, the ROM 902, and the RAM 903 are connected to each other through a bus 904. The processor 901 performs various operations of the method flows according to the embodiments of the present disclosure by executing programs in the ROM 902 and/or the RAM 903. Note that the program may also be stored in one or more memories other than the ROM 902 and the RAM 903. The processor 901 may also perform various operations of the method flows according to embodiments of the present disclosure by executing programs stored in the one or more memories.

System 900 may also include an input/output (I/O) interface 905, input/output (I/O) interface 905 also connected to bus 904, according to an embodiment of the present disclosure. The system 900 may also include one or more of the following components connected to the I/O interface 905: an input portion 906 including a keyboard, a mouse, and the like; an output section 907 including components such as a Cathode Ray Tube (CRT), a Liquid Crystal Display (LCD), and the like, and a speaker; a storage portion 908 including a hard disk and the like; and a communication section 909 including a network interface card such as a LAN card, a modem, or the like. The communication section 909 performs communication processing via a network such as the internet. The drive 910 is also connected to the I/O interface 905 as necessary. A removable medium 911 such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like is mounted on the drive 910 as necessary, so that a computer program read out therefrom is mounted into the storage section 908 as necessary.

Embodiments of the present disclosure also include a computer program product comprising a computer program containing program code for performing the method provided by the embodiments of the present disclosure, when the computer program product is run on an electronic device, the program code being adapted to cause the electronic device to carry out the method of downloading a file provided by the embodiments of the present disclosure.

The computer program, when executed by the processor 901, performs the above-described functions defined in the system/apparatus of the embodiments of the present disclosure. The systems, apparatuses, modules, units, etc. described above may be implemented by computer program modules according to embodiments of the present disclosure. In one embodiment, the computer program may be hosted on a tangible storage medium such as an optical storage device, a magnetic storage device, or the like. In another embodiment, the computer program may also be transmitted, distributed in the form of a signal on a network medium, and downloaded and installed through the communication section 909 and/or installed from the removable medium 911. The computer program containing program code may be transmitted using any suitable network medium, including but not limited to: wireless, wired, etc., or any suitable combination of the foregoing.

In accordance with embodiments of the present disclosure, program code for executing computer programs provided by embodiments of the present disclosure may be written in any combination of one or more programming languages, and in particular, these computer programs may be implemented using high level procedural and/or object oriented programming languages, and/or assembly/machine languages. The programming language includes, but is not limited to, programming languages such as Java, C + +, python, the "C" language, or the like. The program code may execute entirely on the user computing device, partly on the user device, partly on a remote computing device, or entirely on the remote computing device or server. In the case of a remote computing device, the remote computing device may be connected to the user computing device through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computing device (e.g., through the internet using an internet service provider).

The present disclosure also provides a computer-readable storage medium, which may be contained in the apparatus/device/system described in the above embodiments; or may exist separately and not be assembled into the device/apparatus/system. The computer-readable storage medium carries one or more programs which, when executed, implement a method of downloading a file according to an embodiment of the present disclosure.

According to embodiments of the present disclosure, the computer-readable storage medium may be a non-volatile computer-readable storage medium, which may include, for example but is not limited to: a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the present disclosure, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. For example, according to embodiments of the present disclosure, a computer-readable storage medium may include the ROM 902 and/or the RAM 903 described above and/or one or more memories other than the ROM 902 and the RAM 903.

The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams or flowchart illustration, and combinations of blocks in the block diagrams or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.

Those skilled in the art will appreciate that various combinations and/or combinations of features recited in the various embodiments and/or claims of the present disclosure can be made, even if such combinations or combinations are not expressly recited in the present disclosure. In particular, various combinations and/or combinations of the features recited in the various embodiments and/or claims of the present disclosure may be made without departing from the spirit or teaching of the present disclosure. All such combinations and/or associations are within the scope of the present disclosure.

The embodiments of the present disclosure have been described above. However, these examples are for illustrative purposes only and are not intended to limit the scope of the present disclosure. Although the embodiments are described separately above, this does not mean that the measures in the embodiments cannot be used in advantageous combination. The scope of the disclosure is defined by the appended claims and equivalents thereof. Various alternatives and modifications can be devised by those skilled in the art without departing from the scope of the present disclosure, and such alternatives and modifications are intended to be within the scope of the present disclosure.

Claims

1. A method for downloading a file is applied to a client, wherein the method comprises the following steps:

sending a downloading task request to a server;

receiving a connection instruction from the server;

sending a connection request to the server according to the connection instruction so as to establish long connection for connecting the server;

receiving file identifications and storage addresses of a plurality of fragmented files from the server through the long connection, wherein the fragmented files are obtained by performing fragmentation operation on a target file;

according to the file identification and the storage address, downloading the plurality of fragment files in parallel; and

and synthesizing the plurality of fragment files into the target file.

2. The method of claim 1, wherein the downloading the plurality of fragmented files according to the file identification and storage address comprises:

generating a downloading request according to the file identifier and the storage address, wherein the downloading request is based on HTTP/2; and

and downloading the plurality of fragment files in parallel through the downloading request.

3. The method of claim 1, further comprising:

and in response to receiving a preset state code from the server through the long connection, re-initiating a connection request to the server.

4. A method for downloading a file is applied to a first service terminal, wherein the method comprises the following steps:

in response to receiving a download task request from a client, creating a download task;

pushing the downloading task to a message queue, and sending a connection instruction to the client;

establishing a long connection to the client in response to receiving a connection request from the client;

acquiring file identifiers and storage addresses of a plurality of fragmented files through a message queue, wherein the fragmented files are obtained by fragmenting a target file; and

and sending the file identifications and the storage addresses of the plurality of fragmented files to the client through the long connection.

5. The method of claim 4, further comprising:

and under the condition that the file identifiers and the storage addresses of the plurality of fragmented files are not acquired, suspending the long connection.

6. The method of claim 4, further comprising:

and sending a preset state code to the client under the condition that the file identifiers and the storage addresses of the plurality of fragmented files are not acquired within a preset time after the long connection is established.

7. The method of claim 6, further comprising:

acquiring performance parameters and/or load parameters of a server; and

and dynamically determining the preset time according to the performance parameters and/or the load parameters of the server.

8. The method of claim 4, wherein the creating a download task comprises:

scheduling a first server to create the download task; and

the establishing of the long connection with the client comprises the following steps: scheduling a second server to establish a long connection between the second server and the client.

9. A method for downloading a file is applied to a second server, wherein the method comprises the following steps:

acquiring a downloading task through a message queue;

downloading a target file according to the downloading task;

fragmenting the target file to obtain a plurality of fragmented files;

storing the plurality of fragmented files, and acquiring a file identifier and a storage address of each fragmented file in the plurality of fragmented files; and

and sending the file identifications and the storage addresses of the plurality of fragmented files to a message queue.

10. An apparatus for downloading a file, applied to a client, wherein the apparatus comprises:

the first sending module is used for sending a downloading task request to the server;

the first receiving module is used for receiving a connection instruction from the server;

the first connection module is used for sending a connection request to the server according to the connection instruction so as to establish long connection for connecting the server;

the second receiving module is used for receiving file identifiers and storage addresses of a plurality of fragmented files from the server through the long connection, wherein the fragmented files are obtained by performing fragmentation operation on a target file;

the first downloading module is used for downloading the plurality of fragment files in parallel according to the file identification and the storage address; and

and the synthesis module is used for synthesizing the plurality of fragment files into the target file.

11. An apparatus for downloading a file, applied to a first service end, wherein the apparatus comprises:

the creating module is used for responding to a download task request received from a client and creating a download task;

the first pushing module is used for pushing the downloading task to a message queue and sending a connection instruction to the client;

the second connection module is used for responding to the connection request received from the client and establishing long connection for connecting the client;

the device comprises a first acquisition module, a second acquisition module and a first storage module, wherein the first acquisition module is used for acquiring file identifiers and storage addresses of a plurality of fragmented files through a message queue, and the fragmented files are obtained by performing fragmentation operation on a target file; and

and the second sending module is used for sending the file identifications and the storage addresses of the plurality of fragmented files to the client through the long connection.

12. An apparatus for downloading a file, applied to a second server, wherein the apparatus comprises:

the second acquisition module is used for acquiring the downloading task through the message queue;

the second downloading module is used for downloading the target file according to the downloading task;

the fragmentation module is used for fragmenting the target file to obtain a plurality of fragmented files;

the storage module is used for storing the plurality of fragmented files and acquiring a file identifier and a storage address of each fragmented file in the plurality of fragmented files; and

and the third sending module is used for sending the file identifications and the storage addresses of the plurality of fragmented files to a message queue.

13. A computing device, comprising:

one or more processors;

a memory for storing one or more computer programs,

wherein the one or more computer programs, when executed by the one or more processors, cause the one or more processors to implement the method of any of claims 1 to 9.

14. A computer readable storage medium having stored thereon executable instructions which, when executed by a processor, cause the processor to carry out the method of any one of claims 1 to 9.

15. A computer program product comprising computer executable instructions for implementing the method of any one of claims 1 to 9 when executed.