CN111949438B

CN111949438B - Multimedia data backup method, device, server and medium

Info

Publication number: CN111949438B
Application number: CN201910398984.6A
Authority: CN
Inventors: 尤晓明; 丁强
Original assignee: Zhejiang Uniview Technologies Co Ltd
Current assignee: Zhejiang Uniview Technologies Co Ltd
Priority date: 2019-05-14
Filing date: 2019-05-14
Publication date: 2024-02-13
Anticipated expiration: 2039-05-14
Also published as: CN111949438A

Abstract

The embodiment of the invention discloses a multimedia data backup method, a device, a server and a medium, wherein the method comprises the steps of receiving a data backup task of at least one source end domain; distributing the current target write flow of the server in at least one source domain according to the backup priority of each source domain; determining the backup flow of each source end domain according to the allocated flow of each source end domain and the current target transmission flow of each source end domain; determining the backup rate of the current multimedia data in each source end domain according to the backup flow of each source end domain, the number of data acquisition devices in each source end domain and the target data transmission speed of each source end domain; and executing the data backup task according to the backup rate. The embodiment of the invention realizes that the data backup capability of the server is maximized by considering network diversity, and prevents the situation that multimedia data is covered because the multimedia data is not backed up in time.

Description

Multimedia data backup method, device, server and medium

Technical Field

The embodiment of the invention relates to the technical field of data processing, in particular to a multimedia data backup method, a device, a server and a medium.

Background

With the increasing amount of data, more and more enterprises choose to employ network backups to store historical data. Network backup is typically implemented through specialized data storage management software in combination with corresponding hardware and storage devices.

In the current data backup method, a backup management server (BM, backup Management Server) generally adjusts the backup rate of data collected by each data collection device through a network packet loss test, for example, adjusts the backup rate of video data collected by each camera through the packet loss test, so as to realize the backup of data. However, the network data transmission has diversity, and the backup rate is adjusted only according to the packet loss test result of each data acquisition device, so that the backup rate adjustment has larger randomness, and the timely backup effect of the data is poor.

Disclosure of Invention

The embodiment of the invention provides a multimedia data backup method, a device, a server and a medium, which aim to maximize the data backup capacity of the server by considering network diversity and prevent multimedia data from being covered due to not being backed up in time.

In a first aspect, an embodiment of the present invention provides a method for backing up multimedia data, where the method includes:

Receiving a data backup task of at least one source end domain;

distributing the current target write flow of the server in the at least one source domain according to the backup priority of each source domain;

determining the backup flow of each source end domain according to the allocated flow of each source end domain and the current target transmission flow of each source end domain;

determining the backup rate of the current multimedia data in each source end domain according to the backup flow of each source end domain, the number of data acquisition devices in each source end domain and the target data transmission speed of each source end domain;

and executing the data backup task according to the backup rate.

In a second aspect, an embodiment of the present invention further provides a multimedia data backup apparatus, where the apparatus includes:

the data backup task receiving module is used for receiving the data backup task of at least one source end domain;

the flow distribution module is used for distributing the current target write flow of the server in the at least one source end domain according to the backup priority of each source end domain;

the backup flow determining module is used for determining the backup flow of each source end domain according to the allocated flow of each source end domain and the current target transmission flow of each source end domain;

The backup rate determining module is used for determining the backup rate of the current multimedia data in each source end domain according to the backup flow of each source end domain, the number of the data acquisition devices in each source end domain and the target data transmission speed of each source end domain, wherein the backup rates of the multimedia data acquired by the data acquisition devices in the same source end domain are the same;

and the data backup task execution module is used for executing the data backup task according to the backup rate.

In a third aspect, an embodiment of the present invention further provides a server, including:

one or more processors;

storage means for storing one or more programs,

the one or more programs, when executed by the one or more processors, cause the one or more processors to implement a multimedia data backup method according to any of the embodiments of the present invention.

In a fourth aspect, an embodiment of the present invention further provides a computer readable storage medium, on which a computer program is stored, where the program when executed by a processor implements a multimedia data backup method according to any embodiment of the present invention.

According to the embodiment of the invention, the current target write flow of the server is distributed in at least one source domain according to the backup priority of each source domain, then the backup rate of the current multimedia data in each source domain is determined according to the distributed flow of each source domain, the current target transmission flow of each source domain, the number of data acquisition devices in each source domain and the target data transmission speed of each source domain, so that the effect of dynamically adjusting the backup rate of the multimedia data in each source domain by taking the source domain as a unit by considering network diversity is realized, the problem that the data backup effect is poor due to randomness in the backup rate adjustment process based on packet loss test in the prior art is solved, the network bandwidth is fully utilized, the data backup capability of the server is maximized, the multimedia data backup efficiency is improved, and the situation that the multimedia data is covered due to the fact that the multimedia data is not backed up in time is effectively prevented; in addition, in the dynamic regulation of the backup rate, the consideration of the current target write flow of the server and the current target transmission flow of the source end domain is equivalent to the consideration of the overall performance of the backup source end and the server, so that the rationality of the backup rate regulation is ensured.

Drawings

Fig. 1 is a flowchart of a multimedia data backup method according to a first embodiment of the present invention;

fig. 2 is a flowchart of a multimedia data backup method according to a second embodiment of the present invention;

fig. 3 is a flowchart of a multimedia data backup method according to a third embodiment of the present invention;

fig. 4 is a schematic structural diagram of a multimedia data backup device according to a fourth embodiment of the present invention;

fig. 5 is a schematic structural diagram of a server according to a fifth embodiment of the present invention.

Detailed Description

The invention is described in further detail below with reference to the drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the invention and are not limiting thereof. It should be further noted that, for convenience of description, only some, but not all of the structures related to the present invention are shown in the drawings.

Example 1

Fig. 1 is a flowchart of a multimedia data backup method according to an embodiment of the present invention, where the embodiment is applicable to a situation that a backup rate of multimedia data is dynamically adjusted in a domain unit according to a source domain to which a multimedia data acquisition device belongs, so as to implement timely backup of multimedia data.

As shown in fig. 1, the method for backing up multimedia data provided in this embodiment may include:

s110, receiving a data backup task of at least one source end domain.

In this embodiment, a user may collect multimedia data by using a data collection device, for example, shoot a picture or record a video by using an internet protocol CAMERA (IPC, IP CAMERA), and then send the collected multimedia data to a storage device for storage after encoding, and specifically, may use a data management server (DM, data Management Server) to store and manage the multimedia data collected by the collection device, where a main function of the data management server is to manage video data stored in an IPSAN (storage local area network) device. When a large number of data acquisition devices exist, a user can group the data acquisition devices according to attribute information of the data acquisition devices, and one group corresponds to one source end domain. The attribute information of the data acquisition devices in the same source end domain is the same or basically close to the same, so that the difference between the attribute information of the data acquisition devices in each source end domain is reduced as much as possible, and the effectiveness and convenience of unified backup management are improved. Multiple data management servers may be included in the same source domain.

When a data backup requirement exists, a data backup task is generated based on multimedia data to be backed up in a source domain by taking the source domain as a unit, and then the data backup task is issued to a server (or called a destination) for execution.

S120, distributing the current target write flow of the server in at least one source domain according to the backup priority of each source domain.

The backup priority of each source end domain is determined according to the data retention period corresponding to the data acquisition devices in each source end domain and the number of the data acquisition devices. The data retention period refers to a time that can be retained after multimedia data is generated before being covered. For example, if the data retention period corresponding to the data acquisition device in each source end domain is shorter, the probability that the multimedia data in the source end domain is covered is considered to be larger, and the backup priority of the source end domain is higher; if the number of the data acquisition devices included in each source end domain is larger, the more the multimedia data in the source end domain needs to be backed up, the higher the backup priority of the source end domain is. The source domain has higher backup priority, which means that when multimedia data is backed up, conditions are preferentially provided so that the multimedia data of the source domain is backed up in time.

The current target write flow of the server is used for measuring the current performance of the server in the process of backing up the multimedia data, and specifically may refer to the maximum network flow actually adopted by the server when the server writes the multimedia data currently, or the actual adopted flow exceeding a first flow threshold, where the first flow threshold may be adaptively set according to specific situations. For example, assuming that the standard maximum write traffic supported by the server is D (belongs to a constant value), and determining that the actual maximum traffic currently supported by the server is E according to the service currently executed by the server, the current target write traffic G of the server is the minimum value of the standard maximum write traffic D and the actual maximum traffic E currently supported, i.e., g=min (D, E). In the process of multimedia data backup, the actual maximum flow E currently supported by the server belongs to a dynamic variable quantity, and relates to services executed by the server, such as data playback, data downloading and the like currently executed by the server.

After the server receives the data backup tasks of the source end domains, the backup priority of each source end domain can be determined according to the data retention period and the number of the data acquisition devices corresponding to the data acquisition devices in each source end domain, and then the current target write traffic of the server is sequentially distributed to each source end domain from high to low according to the backup priority, for example, the more the source end domain with higher backup priority is distributed, the less the source end domain with lower backup priority is distributed, wherein the specific distributed traffic quota of each source end domain can be set according to the actual situation. By considering the backup priority of the source end domain, the effect of differentially treating the multimedia data to be backed up can be realized, and timely backup is ensured before the multimedia data is covered.

S130, determining the backup flow of each source end domain according to the allocated flow of each source end domain and the current target transmission flow of each source end domain.

The current target transmission flow of each source end domain is used for measuring the current performance of each source end domain in the process of multimedia data backup, and specifically may refer to an actual maximum flow that each source end domain can bear when currently transmitting multimedia data, or an actual transmission flow exceeding a second flow threshold, where the second flow threshold may be adaptively set according to specific situations. In the process of multimedia data transmission, the current target transmission flow of each source end domain belongs to a dynamic variable quantity, and is related to the currently executed services such as data playback, data downloading and the like of each source end.

Assuming that the current target transmission traffic of each source domain is B, and the traffic allocated to each source domain by the server is a, the backup traffic C that each source domain can currently employ is the minimum value of the current target transmission traffic B and the allocation traffic a, i.e., c=min (a, B).

And S140, determining the backup rate of the current multimedia data in each source end domain according to the backup flow of each source end domain, the number of the data acquisition devices in each source end domain and the target data transmission speed of each source end domain.

The target data transmission double speed of each source end domain can be the maximum data transmission double speed supported by each source end domain or the preset transmission double speed set according to the current requirement, and the maximum data transmission double speed can be used as the optimal choice. And determining the backup rate of the current multimedia data in each source end domain, namely determining the backup rate of the multimedia data acquired by each data acquisition device in each source end domain. The backup rate of the multimedia data acquired by the data acquisition devices in the same source end domain is the same. And the domain is used as a unit, the backup rate of the multimedia data corresponding to the plurality of data acquisition devices is integrally adjusted, compared with the adjustment of the backup rate of the multimedia data aiming at a single data acquisition device one by one, the adjustment of the backup rate is more stable and reasonable, the adjustment randomness introduced in the one-by-one adjustment process can be avoided, the timeliness of the multimedia data backup is further ensured, and the backup effect is ensured.

Specifically, determining the backup rate of the current multimedia data in each source end domain according to the backup flow of each source end domain, the number of data acquisition devices included in each source end domain and the target data transmission speed of each source end domain includes:

If the backup flow of each source end domain is greater than or equal to the product of the number of the data acquisition devices included in each source end domain and the target data transmission double speed of each source end domain, determining the target data transmission double speed of each source end domain as the backup rate of the current multimedia data in each source end domain;

if the backup flow of each source end domain is smaller than the product of the number of the data acquisition devices included in each source end domain and the target data transmission double speed of each source end domain, determining the backup rate of the current multimedia data in each source end domain according to the ratio of the current target transmission flow of each source end domain to the target data transmission double speed of each source end domain.

For example, assuming that the number of data acquisition devices in a source domain that need to perform data backup is N, the target data transmission double speed when the source domain performs data transmission is F times speed, and the target data transmission double speed F is usually fixed when the target data transmission double speed is the maximum data transmission double speed, for example, the source domain can support 16 times speed transmission code streams at maximum, and the current backup traffic of the source domain is C, and the current target transmission traffic of the source domain is B.

If C > =nx (F times speed), backing up the multimedia data corresponding to each data acquisition device in the source end domain according to the F times speed;

If C<Nx (F-time speed), the multimedia data corresponding to each data acquisition device in the source end domain is backed up according to B/(F-time speed), and the integer ratio corresponding to B/(F-time speed) satisfies the multiple speed value requirement supported by the source end domain, for example, the multiple speed of data transmission supported by the source end domain includes 2 ⁿ The multiple speed (n is an integer value), such as 1 multiple speed, 2 multiple speeds, 4 multiple speeds, 8 multiple speeds, 16 multiple speeds, 32 multiple speeds, etc., the corresponding integer ratio of B/(F multiple speed) needs to be one of the multiple speeds.

And S150, executing a data backup task according to the backup rate. I.e. storing the multimedia data to be backed up in each source domain into a server.

On the basis of the above technical solution, optionally, if the ratio of the current target transmission flow rate of each source end domain to the target data transmission multiple speed of each source end domain belongs to a non-integer, determining the backup rate of the current multimedia data in each source end domain according to the ratio of the current target transmission flow rate of each source end domain to the target data transmission multiple speed of each source end domain includes:

determining the backup rate of the current multimedia data in each source end domain according to the integer part of the ratio, so as to realize the balanced distribution of transmission flow among the data acquisition devices of each source end domain when the multimedia data is backed up;

Correspondingly, the method further comprises the steps of: and distributing the flow corresponding to the remainder part of the ratio in other source end domains according to the backup progress of the multimedia data in the source end domains except the current source end domain.

For example, assuming that the current target transmission flow B of one source domain is 100M, the target data transmission speed of the source domain when transmitting data is 6 times speed, the flow of the remainder part corresponding to 100M/6 is 4M, and the flow of 4M is distributed in other source domains, so that the network flow is fully utilized, the backup rate of the multimedia data in each source domain is adjusted in real time, and the backup effect of the multimedia data is ensured.

Further, according to the backup progress of the multimedia data in other source end domains except the current source end domain, the flow corresponding to the remainder part of the ratio is distributed in the other source end domains, which comprises:

if the backup progress of the multimedia data in other source end domains is the same, distributing the flow corresponding to the remainder part of the ratio in other source end domains according to a preset distribution rule, wherein the preset distribution rule comprises random distribution of the flow or distribution of the flow according to the backup priority of the source end domains;

If the backup progress of the multimedia data in other source end domains is different, distributing the flow corresponding to the remainder part of the ratio in other source end domains according to the sequencing result of the backup progress.

The data backup task of each source domain is a continuous generation and execution process. According to the preset data backup period, the multimedia data quantity to be backed up and other factors, each source end domain can correspond to a plurality of data backup tasks. The data backup progress is used for measuring the amount of multimedia data which is already backed up according to the data backup requirement. If in the process of multimedia data backup, the backup progress of multimedia data in other source end domains except the current source end domain is the same, i.e. the data backup efficiency of the data acquisition devices in other source end domains is basically the same, at this time, the flow corresponding to the remainder part of the ratio can be distributed in other source end domains according to a preset distribution rule, for example, the flow is randomly distributed or distributed according to the backup priority of the source end domain, and can be determined according to specific requirements; if the backup progress of the multimedia data in the source end domains other than the current source end domain is different, the data backup efficiency corresponding to the data acquisition device in the source end domain with the fast backup progress of the multimedia data is high, and the data backup effect corresponding to the data acquisition device in the source end domain with the slow backup progress of the multimedia data is low, the flow corresponding to the remainder part of the ratio can be preferentially distributed to the source end domain with the slower backup progress of the multimedia data, so that the source end domain with the slower backup progress of the multimedia data can utilize more network flow to improve the backup progress of the multimedia data, and the multimedia data in the source end domain is prevented from being covered before the backup is completed.

According to the technical scheme of the embodiment, firstly, the current target write flow of the server is distributed in at least one source domain according to the backup priority of each source domain, then the backup rate of the current multimedia data in each source domain is determined according to the distributed flow of each source domain, the current target transmission flow of each source domain, the number of data acquisition devices included in each source domain and the target data transmission speed of each source domain, the effect of dynamically adjusting the backup rate of the multimedia data in each source domain by taking the source domain as a unit through considering network diversity is realized, the problem that the data backup effect is poor due to randomness in the backup rate adjustment process based on packet loss test in the prior art is solved, the network bandwidth is fully utilized, the data backup capability of the server is maximized, the multimedia data backup efficiency is improved, and the situation that the multimedia data is covered due to the fact that the multimedia data is not backed up in time is effectively prevented; in addition, in the dynamic regulation of the backup rate, the consideration of the current target write flow of the server and the current target transmission flow of the source end domain is equivalent to the consideration of the overall performance of the backup source end and the server, so that the rationality of the backup rate regulation is ensured.

Example two

Fig. 2 is a flowchart of a multimedia data backup method according to a second embodiment of the present invention, where the method further performs optimization and expansion based on the foregoing embodiment. As shown in fig. 2, the method may include:

s210, receiving a data backup task of at least one source end domain.

S220, distributing the current target write flow of the server in at least one source domain according to the backup priority of each source domain.

Optionally, the distributing the current target write traffic of the server in at least one source domain according to the backup priority of each source domain includes: and distributing the current target write flow of the server in at least one source end domain according to the backup priority of each source end domain and the weight coefficient corresponding to each priority.

The weight coefficient can be adaptively set according to the division of the backup priority, and the higher the backup priority is, the larger the corresponding weight coefficient is. Illustratively, the server assigns traffic to each source domain = (current target write traffic of server) x (the weight coefficient corresponding to source domain backup priority).

S230, determining the backup traffic of each source end domain according to the allocated traffic of each source end domain and the current target transmission traffic of each source end domain.

S240, determining the backup rate of the current multimedia data in each source end domain according to the backup flow of each source end domain, the number of the data acquisition devices in each source end domain and the target data transmission speed of each source end domain.

S250, detecting the multimedia data in each source end domain according to a preset detection strategy.

The preset detection strategy is used for defining rules for detecting multimedia data to be backed up, and comprises setting conditions such as detection sequence, detection times, detection period and the like aiming at the data acquisition device. The purpose of the multimedia data detection is to determine whether the state of the source domain is normal or not, and whether the backup operation of the multimedia data can be performed or not. The detection operation includes a retrieval of multimedia data in each source domain and a signaling negotiation in the process of retrieving the codestream from the data acquisition device. The purpose of the search is to confirm that multimedia data to be backed up exists in each data acquisition device of each source domain.

And S260, stopping the data backup task of the source domain aiming at the source domain with failed detection, and reassigning the traffic already assigned to the source domain with successful detection according to the backup priority of each source domain.

And S270, aiming at the source end domain which is successfully detected, executing the data backup task of the source end domain according to the backup rate determined after the traffic is redistributed.

It should be noted that, for the source domain that is successfully detected, after the server redistributes the traffic for the source domain, a new backup rate is determined, and the detection operation of the multimedia data in the source domain is not required to be repeatedly executed, that is, after the operation S260 jumps to the operation S230 as shown in fig. 2, the operation S250 may be skipped, and the operation S240 jumps directly to the operation S270.

For example, one or more data acquisition devices are randomly selected from each source domain as a target data acquisition device, multimedia data in the target data acquisition device is detected, if the detection is successful, the state of the current source domain is considered to be normal, the multimedia data in the current source domain can be backed up according to the determined backup rate, and the successful detection comprises successful multimedia data retrieval and successful signaling negotiation in the code acquisition flow. If the detection of the multimedia data in the target data acquisition device fails, the detection failure comprises multimedia data retrieval failure and signaling negotiation failure in the process of acquiring the code stream, the current source end domain is primarily considered to have abnormality, the target data acquisition device is continuously repeatedly executed for a plurality of times, for example, 3 times of repeated detection, if the detection result is still failure, the state abnormality of the current source end domain is determined, the data backup task of the current source end domain is stopped, the traffic already allocated to the current source end domain is redistributed to the source end domain with successful detection according to the backup priority of each source end domain, and the effective utilization rate of the network traffic is improved.

In this embodiment, by using one source end domain as a whole to perform exception handling, compared with the case of performing error retry according to an exponential backoff algorithm only for a single data acquisition device, the performance of the source end domain can be considered as a whole, the randomness of the backup rate adjustment is reduced, the stability of the backup rate adjustment is ensured, the efficiency of the backup rate adjustment is improved, and further the backup effect is ensured.

On the basis of the above technical solution, optionally, the method further includes:

if the source end domain with failure detection is recovered from the abnormal state, the current target write flow of the server is distributed to the source end domain with failure detection according to the current target transmission flow of the source end domain with state recovery until the backup progress of the source end domain multimedia data with state recovery reaches the average backup progress of the current source end domains.

After receiving the data backup task, the server may detect the multimedia data in a real-time process. After the source end domain which fails to detect is recovered from the abnormal state, the multimedia data backup progress of the source end domain has a certain lag relative to other source end domains, at the moment, more flow is distributed to the source end domain which is recovered according to the current target transmission flow of the source end domain in the state as far as possible from the current target write flow of the server until the multimedia data backup progress of the source end domain reaches the average backup progress of the current source end domains, so that the multimedia data backup efficiency of the source end domain recovered in the state is improved, the multimedia data backup progress of the source end domain is improved in a short time, and the multimedia data is prevented from being covered due to untimely backup.

Further, if the source domain of state recovery includes at least two, distributing the current target write traffic of the server to the source domain of state recovery according to the current target transport traffic of the source domain of state recovery, including: and distributing the current target write flow of the server to the source end domains restored by at least two states according to the backup priorities of the source end domains restored by at least two states.

If a plurality of source end domains exist at present and recover from the abnormality, the backup priority of the source end domains is determined, and the current target write flow of the server is distributed to the source end domains in sequence according to the backup priority from high to low, so that the source end domains can utilize higher flow to improve the backup progress of the multimedia data in a short time.

According to the technical scheme, before the data backup task is executed according to the backup rate of each source end domain, the multimedia data in each source end domain is detected according to a preset detection strategy, the data backup task of the source end domain is stopped aiming at the source end domain with failed detection, the traffic which is already allocated to the source end domain is reallocated to the source end domain with successful detection according to the backup priority of each source end domain; aiming at a source end domain which is successfully detected, according to the backup rate determined after flow redistribution, executing the data backup task of the source end domain, realizing the effective management of the multimedia data backup task by taking the domain as a unit, fully utilizing the network bandwidth, maximizing the data backup capability of a server, and effectively preventing the situation that the multimedia data is covered due to not being timely backed up; and when the source end domain is recovered from the abnormal state, more flow is preferentially allocated to the source end domain in the state recovery, so that the multimedia data backup progress is improved, and the risk of covering the multimedia data is reduced.

Example III

Fig. 3 is a flowchart of a multimedia data backup method provided by the third embodiment of the present invention, where the present embodiment is further expanded based on the foregoing embodiment, and specifically, an exemplary explanation is made by taking a current target write flow of a server as a maximum network flow actually adopted when the server writes multimedia data currently, a current target transmission flow of each source domain as an actual maximum flow that can be borne when each source domain currently performs multimedia data transmission, and a target data transmission double speed of each source domain is exemplified as a maximum data transmission double speed. As shown in fig. 3, the method may include:

s301, determining the standard maximum write flow of the server.

For example, when the server starts to operate, since there is no execution of a service such as data playback, data download, or the like, a standard maximum write flow (or referred to as standard maximum write performance) of the server may be determined by randomly writing a piece of data in a storage area of the server, and recording is performed.

S302, determining the target data transmission speed of each source end domain.

When each source end domain is just started, a preset number of data acquisition devices are randomly selected in the source end domain to perform data transmission test, so that the target data transmission speed of each source end domain is determined, and the preset number can be adaptively set. For example, the data acquisition devices in each source end domain may be randomly numbered, and data transmission test may be performed one by one according to the number until a stream is taken and reported error occurs or all the data acquisition devices participate in the test, and according to the data transmission multiple speed obtained by each data acquisition device participating in the data transmission test, the target data transmission multiple speed (i.e. the maximum data transmission multiple speed) of each source end domain is determined and recorded, so that the target data transmission multiple speed is used as the reference for subsequent multiple speed adjustment.

For example, when data transmission test is performed on each selected data acquisition device, 2 may be performed sequentially ⁿ And (3) performing data transmission test of multiple speed (n is an integer), such as 1 time speed, 2 time speed, 4 time speed, 8 time speed, 16 time speed, 32 time speed and the like, until a stream is taken and reported in the process of a certain data transmission test or the data transmission test is tried to reach 32 time speed, and recording the multiple speed which can be supported by each source end domain after the data transmission test is finished.

S303, determining the current supported actual maximum flow of the server according to the current executed service condition of the server, and determining the current target write flow of the server by combining the standard maximum write flow of the server.

S304, receiving the data backup task of each source end domain.

For example, when the user selects to backup multimedia data generated between 1 st and 5 th 6 th of 2019, a data backup task is generated for each source domain divided in advance by the user according to the multimedia data within the selected period.

S305, distributing the current target write flow of the server in each source domain according to the backup priority of each source domain.

S306, determining the current target transmission flow currently supported by each source end domain according to the current service condition executed by each source end domain.

In the process of carrying out data transmission test on each source end domain, simultaneously carrying out multimedia data backup of a plurality of data acquisition devices on each source end domain, and when stream taking and reporting errors occur or the flow of the source end domain is not increased any more, the current flow is used as the target transmission flow supported by the current source end domain (namely the actual maximum transmission flow which can be born currently).

S307, determining the backup flow of each source end domain according to the allocated flow of each source end domain and the current target transmission flow of each source end domain.

In addition, the preset proportion, for example 80%, of the current target transmission flow of each source domain can be used as the maximum backup flow of each source domain in the current round of multimedia data backup process. Subsequently, if an abnormal state occurs in the source domain, the backup traffic of the source domain is reduced according to the occurrence times of the abnormal state, for example, the reduced backup traffic can be determined according to one half of the product of the backup rate of the current data acquisition device and the code rate (for example, IPC code rate) of the data acquisition device in each source domain, and the reduced backup traffic in the source domain is distributed to other source domains. If the backup flow is reduced, each source domain is successfully backed up within a preset time (for example, within half an hour), and no backup abnormality occurs, then the current backup flow of the source domain is attempted to be adjusted upwards, for example, the lowest code rate of a data acquisition device in the source domain is increased, so that the repeated adjustment of the backup flow in each source domain is realized.

S308, determining the backup rate of the current multimedia data in each source end domain according to the backup flow of each source end domain, the number of the data acquisition devices in each source end domain and the target data transmission speed of each source end domain.

And S309, searching the multimedia data in each source end domain. The purpose of the search is to confirm that multimedia data to be backed up exists in each data acquisition device of each source domain.

S310, stopping the data backup task of the source domain aiming at the source domain with failed retrieval, and reassigning the traffic already assigned to the source domain with successful retrieval according to the backup priority of each source domain.

It should be noted that, for the source domain that is successfully retrieved, after the server redistributes the traffic for the source domain, a new backup rate is determined, and the retrieval operation of the multimedia data in the source domain is not required to be repeatedly executed, that is, as shown in fig. 3, after the operation S310 jumps to the operation S307, the operation S309 may be skipped, and the operation S308 jumps to the operation S311 directly.

S311, aiming at the source end domain which is successfully searched, if the signaling negotiation fails in the negotiation process of obtaining the code stream, the source end domain is considered to have abnormality, the data backup task of the source end domain is stopped, the traffic which is already allocated to the source end domain is reallocated to the source end domain which is successfully negotiated in the negotiation process of obtaining the code stream according to the backup priority of each source end domain.

Illustratively, there is currently a need to perform multimedia data backup for 10 source domains, with 10 data acquisition devices in each source domain. If the source end domain with the abnormality is preliminarily determined after the multimedia data searching and the stream taking signaling negotiation are executed on the data acquisition device in each source end domain, the abnormality condition comprises searching failure and stream taking signaling negotiation failure, then the abnormality detection is continuously executed on one or more data acquisition devices in the source end domain with the abnormality, for example, the abnormality detection is repeatedly executed for a plurality of times according to a preset time period (for example, 5 minutes), if the detection result is still abnormal, the flow distributed to the source end domain by the server is redistributed to other source end domains without the abnormality, namely, the source end domain with the successful searching and stream taking signaling negotiation is carried out, so that the multimedia data backup is carried out on the source end domain without the abnormality.

When an abnormal source end domain is recovered from an abnormal state, the abnormal limit of the source end domain is released, the average backup progress of multimedia data in other source end domains is determined, more flow is distributed for the source end domain recovered abnormally, the backup progress of the multimedia data is improved in a short time, the average backup progress is achieved in the latest backup time, and the multimedia data is prevented from being covered due to untimely backup.

S312, aiming at the source end domain successfully negotiated by signaling in the negotiation process of obtaining the code stream, executing the data backup task of the source end domain according to the backup rate determined after the flow is redistributed.

According to the technical scheme, the server distributes flow for each source domain according to the backup priority of each source domain, then determines the backup rate of the current multimedia data in each source domain by combining the current target transmission flow of each source domain, the number of data acquisition devices in each source domain and the target data transmission double speed of each source domain, and when the source domain is abnormal, the flow distributed to the abnormal source domain is distributed to other source domains without abnormality, so that the effect of dynamically regulating the backup rate of the multimedia data in each source domain by taking the source domain as a unit through considering network diversity is realized, the problem that the data backup effect is poor due to randomness in the backup rate regulating process based on packet loss test in the prior art is solved, network bandwidth is fully utilized, the data backup capacity of the server is maximized, and the situation that the multimedia data is covered due to the fact that the multimedia data is not backed up in time is effectively prevented; in addition, in the dynamic regulation of the backup rate, the consideration of the current target write flow of the server and the current target transmission flow of the source end domain is equivalent to the consideration of the overall performance of the backup source end and the server, so that the rationality of the backup rate regulation is ensured.

Example IV

Fig. 4 is a schematic structural diagram of a multimedia data backup device according to a fourth embodiment of the present invention, where the present embodiment is applicable to a situation of timely backup of multimedia data by dynamically adjusting a backup rate of multimedia data in a domain unit according to a source domain to which a multimedia data acquisition device belongs. The apparatus may be implemented in software and/or hardware and may be integrated on a server, such as a backup management server.

As shown in fig. 4, the multimedia data backup apparatus provided in this embodiment may include a data backup task receiving module 410, a target write traffic allocation module 420, a backup traffic determining module 430, a backup rate determining module 440, and a data backup task executing module 450, where:

a data backup task receiving module 410, configured to receive a data backup task of at least one source domain;

the target write traffic allocation module 420 is configured to allocate, in at least one source domain, a current target write traffic of the server according to the backup priority of each source domain;

a backup traffic determining module 430, configured to determine a backup traffic of each source domain according to the allocated traffic of each source domain and the current target transmission traffic of each source domain;

The backup rate determining module 440 is configured to determine a backup rate of current multimedia data in each source domain according to the backup traffic of each source domain, the number of data acquisition devices included in each source domain, and the target data transmission multiple speed of each source domain, where the backup rates of the multimedia data acquired by the data acquisition devices in the same source domain are the same;

the data backup task execution module 450 is configured to execute a data backup task according to the backup rate.

Optionally, the backup priority of each source domain is determined according to the data retention period corresponding to the data acquisition devices in each source domain and the number of the data acquisition devices.

Optionally, the backup rate determining module 440 includes a first backup rate determining unit and a second backup rate determining unit, where:

a first backup rate determining unit, configured to determine, if the backup traffic of each source domain is greater than or equal to a product of the number of data acquisition devices included in each source domain and the target data transmission multiple rate of each source domain, the target data transmission multiple rate of each source domain as the backup rate of the current multimedia data in each source domain;

and the second backup rate determining unit is used for determining the backup rate of the current multimedia data in each source end domain according to the ratio of the current target transmission flow of each source end domain to the target data transmission speed of each source end domain if the backup flow of each source end domain is smaller than the product of the number of the data acquisition devices included in each source end domain and the target data transmission speed of each source end domain.

Optionally, if the ratio of the current target transmission traffic of each source domain to the target data transmission multiple speed of each source domain is a non-integer, the second backup rate determining unit is specifically configured to:

determining the backup rate of the current multimedia data in each source end domain according to the integer part of the ratio;

correspondingly, the device also comprises:

and the remainder flow distribution module is used for distributing flows corresponding to remainder parts of the ratio in other source end domains according to the backup progress of the multimedia data in the source end domains except the current source end domain.

Optionally, the remainder flow distribution module includes:

the first remainder flow distribution unit is used for distributing flows corresponding to remainder parts of the ratio in other source end domains according to a preset distribution rule if the backup progress of the multimedia data in the other source end domains is the same;

and the second remainder flow distribution unit is used for distributing the flows corresponding to the remainder parts of the ratio in other source end domains according to the sequencing result of the backup progress if the backup progress of the multimedia data in other source end domains is different.

Optionally, the target write traffic allocation module 420 is specifically configured to:

and distributing the current target write flow of the server in at least one source end domain according to the backup priority of each source end domain and the weight coefficient corresponding to each priority.

Optionally, before the data backup task execution module performs the operation of executing the data backup task according to the backup rate, the apparatus further includes:

the multimedia data detection module is used for detecting the multimedia data in each source end domain according to a preset detection strategy in the backup process of the multimedia data;

and the data backup task stopping module is used for stopping the data backup task of the source end domain aiming at the source end domain with failed detection, and reallocating the flow allocated to the source end domain with successful detection according to the backup priority of each source end domain, so that the data backup task is executed according to the backup rate determined after the flow is reallocated aiming at the source end domain with successful detection.

Optionally, the apparatus further comprises:

and the source domain exception recovery module is used for distributing the current target write flow of the server to the source domain according to the current target transmission flow of the source domain in the state recovery if the source domain in the state recovery is recovered from the exception state until the backup progress of the source domain multimedia data in the state recovery reaches the average backup progress of the current source domains.

Optionally, if the source domain of state recovery includes at least two source domain exception recovery modules are specifically configured to:

And distributing the current target write flow of the server to the source end domains restored by at least two states according to the backup priorities of the source end domains restored by at least two states.

The multimedia data backup device provided by the embodiment of the invention can execute the multimedia data backup method provided by any embodiment of the invention, and has the corresponding functional modules and beneficial effects of the execution method. Reference is made to the description of any method embodiment of the invention for details not described in this embodiment.

Example five

Fig. 5 is a schematic structural diagram of a server according to a fifth embodiment of the present invention. Fig. 5 illustrates a block diagram of an exemplary server 512 suitable for use in implementing embodiments of the present invention. The server 512 shown in fig. 5 is only an example and should not be construed as limiting the functionality and scope of use of the embodiments of the present invention. Server 512 may be, in particular, a backup management server.

As shown in fig. 5, the server 512 is in the form of a general purpose server. Components of server 512 may include, but are not limited to: one or more processors 516, a memory device 528, a bus 518 that connects the various system components (including the memory device 528 and the processor 516).

Bus 518 represents one or more of several types of bus structures, including a memory device bus or memory device controller, a peripheral bus, an accelerated graphics port, a processor, or a local bus using any of a variety of bus architectures. By way of example, and not limitation, such architectures include industry standard architecture (Industry Subversive Alliance, ISA) bus, micro channel architecture (Micro Channel Architecture, MAC) bus, enhanced ISA bus, video electronics standards association (Video Electronics Standards Association, VESA) local bus, and peripheral component interconnect (Peripheral Component Interconnect, PCI) bus.

Server 512 typically includes a variety of computer system readable media. Such media can be any available media that is accessible by server 512 and includes both volatile and nonvolatile media, removable and non-removable media.

The storage 528 may include computer system readable media in the form of volatile memory, such as random access memory (Random Access Memory, RAM) 530 and/or cache memory 532. The server 512 may further include other removable/non-removable, volatile/nonvolatile computer system storage media. By way of example only, storage system 534 may be used to read from or write to non-removable, nonvolatile magnetic media (not shown in FIG. 5, commonly referred to as a "hard disk drive"). Although not shown in fig. 5, a magnetic disk drive for reading from and writing to a removable nonvolatile magnetic disk (e.g., a "floppy disk"), and an optical disk drive for reading from or writing to a removable nonvolatile optical disk such as a Read Only Memory (CD-ROM), digital versatile disk (Digital Video Disc-Read Only Memory, DVD-ROM), or other optical media, may be provided. In such cases, each drive may be coupled to bus 518 through one or more data media interfaces. The storage 528 may include at least one program product having a set (e.g., at least one) of program modules configured to carry out the functions of the embodiments of the invention.

A program/utility 540 having a set (at least one) of program modules 542 may be stored in, for example, storage 528, such program modules 542 including, but not limited to, an operating system, one or more application programs, other program modules, and program data, each or some combination of which may include an implementation of a network environment. Program modules 542 generally perform the functions and/or methods in the described embodiments of the invention.

The server 512 may also communicate with one or more external devices 514 (e.g., keyboard, pointing terminal, display 524, etc.), with one or more terminals that enable a user to interact with the server 512, and/or with any terminals (e.g., network card, modem, etc.) that enable the server 512 to communicate with one or more other computing terminals. Such communication may occur through an input/output (I/O) interface 522. Also, the server 512 may communicate with one or more networks (e.g., local area network (Local Area Network, LAN), wide area network (Wide Area Network, WAN) and/or public network, such as the internet) via the network adapter 520. As shown in fig. 5, network adapter 520 communicates with the other modules of server 512 via bus 518. It should be appreciated that although not shown, other hardware and/or software modules may be used in connection with server 512, including, but not limited to: microcode, end drives, redundant processors, external disk drive arrays, disk array (Redundant Arrays of Independent Disks, RAID) systems, tape drives, data backup storage systems, and the like.

Processor 516 executes programs stored in storage 528 to perform various functional applications and data processing, such as implementing a multimedia data backup method provided by any embodiment of the present invention, which may include:

receiving a data backup task of at least one source end domain;

and executing the data backup task according to the backup rate.

Example six

The sixth embodiment of the present invention further provides a computer readable storage medium having a computer program stored thereon, where the program when executed by a processor implements the multimedia data backup method as provided in any embodiment of the present invention, and the method may include:

Receiving a data backup task of at least one source end domain;

and executing the data backup task according to the backup rate.

The computer storage media of embodiments of the invention may take the form of any combination of one or more computer-readable media. The computer readable medium may be a computer readable signal medium or a computer readable storage medium. The computer readable storage medium can be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples (a non-exhaustive list) of the computer-readable storage medium would include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In this document, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.

The computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, either in baseband or as part of a carrier wave. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination of the foregoing. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.

Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.

Computer program code for carrying out operations of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, smalltalk, C ++ and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or terminal. In the case of a remote computer, the remote computer may be connected to the user's computer through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computer (for example, through the Internet using an Internet service provider).

Note that the above is only a preferred embodiment of the present invention and the technical principle applied. It will be understood by those skilled in the art that the present invention is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, while the invention has been described in connection with the above embodiments, the invention is not limited to the embodiments, but may be embodied in many other equivalent forms without departing from the spirit or scope of the invention, which is set forth in the following claims.

Claims

1. A method for backing up multimedia data, comprising:

receiving a data backup task of at least one source end domain;

Executing the data backup task according to the backup rate;

the backup rate of the current multimedia data in each source end domain is determined according to the backup flow of each source end domain, the number of the data acquisition devices in each source end domain and the target data transmission speed of each source end domain, specifically:

and comparing the backup flow of each source end domain with the product of the number of the data acquisition devices included in each source end domain and the target data transmission double speed of each source end domain, and determining the backup rate of the current multimedia data in each source end domain according to the comparison result.

2. The method of claim 1, wherein the backup priority of each source domain is determined based on a data retention period and a number of data acquisition devices corresponding to the data acquisition devices in each source domain.

3. The method of claim 1, wherein determining the backup rate of the current multimedia data in each source domain according to the backup traffic of each source domain, the number of data acquisition devices included in each source domain, and the target data transmission speed of each source domain, comprises:

4. A method according to claim 3, wherein if the ratio of the current target transmission traffic of each source domain to the target data transmission multiple speed of each source domain is a non-integer, determining the backup rate of the current multimedia data in each source domain according to the ratio of the current target transmission traffic of each source domain to the target data transmission multiple speed of each source domain comprises:

correspondingly, the method further comprises the steps of:

and distributing the flow corresponding to the remainder part of the ratio in the other source end domains according to the backup progress of the multimedia data in the other source end domains except the current source end domain.

5. The method according to claim 4, wherein the allocating the traffic corresponding to the remainder part of the ratio in the other source domain according to the backup progress of the multimedia data in the other source domain except the current source domain includes:

If the backup progress of the multimedia data in the other source end domains is the same, distributing the flow corresponding to the remainder part of the ratio in the other source end domains according to a preset distribution rule;

and if the backup progress of the multimedia data in the other source end domains is different, distributing the flow corresponding to the remainder part of the ratio in the other source end domains according to the sequencing result of the backup progress.

6. The method of claim 1, wherein the allocating the current target write traffic of the server in the at least one source domain according to the backup priority of each source domain comprises:

and distributing the current target write flow of the server in the at least one source end domain according to the backup priority of each source end domain and the weight coefficient corresponding to each priority.

7. The method of claim 1, wherein prior to performing the data backup task according to the backup rate, the method further comprises:

detecting the multimedia data in each source end domain according to a preset detection strategy;

and stopping the data backup task of the source end domain aiming at the source end domain with failed detection, and reassigning the traffic already assigned to the source end domain with successful detection according to the backup priority of each source end domain, so that the data backup task is executed according to the backup rate determined after the traffic is reassigned aiming at the source end domain with successful detection.

8. The method of claim 7, wherein the method further comprises:

if the source end domain with failed detection is recovered from the abnormal state, the current target write flow of the server is distributed to the source end domain with failed detection according to the current target transmission flow of the source end domain with failed detection until the backup progress of the source end domain multimedia data with failed detection reaches the average backup progress of the current source end domains.

9. The method of claim 8, wherein if the source domain of state recovery includes at least two, the allocating the current target write traffic of the server to the current target transport traffic of the source domain of state recovery according to the state comprises:

and distributing the current target write flow of the server to the source end domains restored by the at least two states according to the backup priorities of the source end domains restored by the at least two states.

10. A multimedia data backup apparatus, comprising:

the target write flow distribution module is used for distributing the current target write flow of the server in the at least one source end domain according to the backup priority of each source end domain;

the data backup task execution module is used for executing the data backup task according to the backup rate;

the backup rate determining module is specifically configured to compare a backup flow of each source domain with a product of a number of data acquisition devices included in each source domain and a target data transmission multiple speed of each source domain, and determine a backup rate of current multimedia data in each source domain according to a comparison result.

11. A server, comprising:

one or more processors;

storage means for storing one or more programs,

the one or more programs, when executed by the one or more processors, cause the one or more processors to implement the method of multimedia data backup as recited in any of claims 1-9.

12. A computer readable storage medium having stored thereon a computer program, which when executed by a processor implements a method of multimedia data backup according to any of claims 1-9.