[go: up one dir, main page]
More Web Proxy on the site http://driver.im/

CN110263099A - Data synchronous flow method of adjustment, device, equipment and storage medium - Google Patents

Data synchronous flow method of adjustment, device, equipment and storage medium Download PDF

Info

Publication number
CN110263099A
CN110263099A CN201910541359.2A CN201910541359A CN110263099A CN 110263099 A CN110263099 A CN 110263099A CN 201910541359 A CN201910541359 A CN 201910541359A CN 110263099 A CN110263099 A CN 110263099A
Authority
CN
China
Prior art keywords
storage cluster
backup storage
main memory
cluster
upper limit
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201910541359.2A
Other languages
Chinese (zh)
Other versions
CN110263099B (en
Inventor
周应超
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Xiaomi Mobile Software Co Ltd
Original Assignee
Beijing Xiaomi Mobile Software Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Xiaomi Mobile Software Co Ltd filed Critical Beijing Xiaomi Mobile Software Co Ltd
Priority to CN201910541359.2A priority Critical patent/CN110263099B/en
Publication of CN110263099A publication Critical patent/CN110263099A/en
Application granted granted Critical
Publication of CN110263099B publication Critical patent/CN110263099B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/30Monitoring
    • G06F11/3003Monitoring arrangements specially adapted to the computing system or computing system component being monitored
    • G06F11/3006Monitoring arrangements specially adapted to the computing system or computing system component being monitored where the computing system is distributed, e.g. networked systems, clusters, multiprocessor systems
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/27Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2201/00Indexing scheme relating to error detection, to error correction, and to monitoring
    • G06F2201/80Database-specific techniques
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2201/00Indexing scheme relating to error detection, to error correction, and to monitoring
    • G06F2201/875Monitoring of systems including the internet

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Computing Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Databases & Information Systems (AREA)
  • Mathematical Physics (AREA)
  • Quality & Reliability (AREA)
  • Data Mining & Analysis (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The disclosure is directed to a kind of data synchronous flow method of adjustment, device, equipment and storage mediums, this method is suitable for distributed data base, the distributed data base includes main memory accumulation and backup storage cluster, the main memory accumulation is for obtaining data from the storage log of the distributed data base, and the data are synchronized to the backup storage cluster and are backed up, which comprises monitors the macro ratio between the main memory accumulation and the backup storage cluster;When the macro ratio changes, based on the macro ratio between preset main memory accumulation and backup storage cluster and the corresponding relationship between flow rate upper limit value, the upper limit value of data flow used in from the primary storage cluster synchronization to the backup storage cluster is adjusted, so that the upper limit value matches with the macro ratio after variation.Technical solution provided by the present disclosure can realize the synchronous flow adjust automatically of data in distributed data base, reduce manual operation.

Description

Data synchronous flow method of adjustment, device, equipment and storage medium
Technical field
This disclosure relates to the synchronous flow method of adjustment of technical field of distributed memory more particularly to a kind of data, device, Equipment and storage medium.
Background technique
Distributed data base often has the demand of more cluster synchronization data.Usually main cluster is asynchronous to be read from log Access evidence is write in standby cluster.But usually the scale of main cluster and standby cluster is inconsistent, or the data transformation one of service Sample, being synchronized to standby cluster according to the flow of main cluster completely, to may cause standby cluster pressure excessive.Current solution is logical Often current limliting is done to synchronizing.But the rank of artificial customization current limliting is needed, the popularization of standby cluster or reduction are also required to artificial tune The current limliting of whole synchronization, it is inconvenient.
Summary of the invention
The disclosure provides a kind of flow method of adjustment, device, equipment and storage medium that data are synchronous, in distribution The synchronous flow adjust automatically of data is realized in database, reduces manual operation.
According to the first aspect of the embodiments of the present disclosure, a kind of flow method of adjustment that data are synchronous is provided, this method is applicable in In distributed data base, the distributed data base includes main memory accumulation and backup storage cluster, and the main memory accumulation is used Obtain data in the storage log from the distributed data base, and by the data be synchronized to the backup storage cluster into Row backup, this method comprises:
Monitor the macro ratio between the main memory accumulation and the backup storage cluster;When the macro ratio occurs When variation, based on the macro ratio between preset main memory accumulation and backup storage cluster and corresponding between flow rate upper limit value Relationship adjusts the upper limit value of data flow used in from the primary storage cluster synchronization to the backup storage cluster, so that The upper limit value matches with the macro ratio after variation.
Optionally, the macro ratio monitored between the main memory accumulation and the backup storage cluster, comprising:
Whether the scale for monitoring the backup storage cluster expands or shrinks.
Optionally, the macro ratio monitored between the main memory accumulation and the backup storage cluster, comprising:
Monitor the quantity that residual memory space in the backup storage cluster is greater than the storage medium of the first preset threshold.
Optionally, the macro ratio monitored between the main memory accumulation and the backup storage cluster, comprising:
Monitor the quantity that process resource occupancy in the backup storage cluster is lower than the storage medium of the second preset threshold.
According to the second aspect of an embodiment of the present disclosure, a kind of flow adjusting device that data are synchronous is provided, which is applicable in In distributed data base, the distributed data base further includes main memory accumulation and backup storage cluster, the main memory accumulation It is configured as obtaining data from the storage log of the distributed data base, and the data is synchronized to the backup and are stored Cluster is backed up, which includes:
Cluster scale monitoring modular is configured as monitoring the rule between the main memory accumulation and the backup storage cluster Mould ratio.
Flow adjustment module is configured as when the macro ratio changes, based on preset main memory accumulation and Corresponding relationship between macro ratio between backup storage cluster and flow rate upper limit value adjusts the data from the primary storage The upper limit value of flow used in cluster synchronization to the backup storage cluster, so that the upper limit value and the macro ratio phase after variation Matching.
Optionally, the cluster scale monitoring modular, comprising:
Whether the first monitoring submodule, the scale for being configured as monitoring the backup storage cluster expand or shrink.
Optionally, the cluster scale monitoring modular, comprising:
Second monitoring submodule, it is default greater than first to be configured as monitoring residual memory space in the backup storage cluster The quantity of the storage medium of threshold value.
Optionally, the cluster scale monitoring modular, comprising:
Third monitors submodule, and it is pre- lower than second to be configured as monitoring process resource occupancy in the backup storage cluster If the quantity of the storage medium of threshold value.
According to the third aspect of an embodiment of the present disclosure, a kind of computer equipment is provided, comprising:
Processor;
It is configured as the memory of storage processor executable instruction;
Wherein, the processor is configured to:
Monitor the macro ratio between the main memory accumulation and the backup storage cluster;When the macro ratio occurs When variation, based on the macro ratio between preset main memory accumulation and backup storage cluster and corresponding between flow rate upper limit value Relationship adjusts the upper limit value of data flow used in from the primary storage cluster synchronization to the backup storage cluster, so that The upper limit value matches with the macro ratio after variation.
According to a fourth aspect of embodiments of the present disclosure, a kind of computer readable storage medium is provided, it is described computer-readable Instruction is stored in storage medium, when run on a computer, so that computer executes following method:
Monitor the macro ratio between the main memory accumulation and the backup storage cluster;When the macro ratio occurs When variation, based on the macro ratio between preset main memory accumulation and backup storage cluster and corresponding between flow rate upper limit value Relationship adjusts the upper limit value of data flow used in from the primary storage cluster synchronization to the backup storage cluster, so that The upper limit value matches with the macro ratio after variation.
The technical scheme provided by this disclosed embodiment can include the following benefits:
By aspects above as it can be seen that the embodiment of the present disclosure passes through the rule between monitoring main memory accumulation and backup storage cluster Mould ratio, and when monitoring that the macro ratio between main memory accumulation and backup storage cluster changes, based on preset Corresponding relationship between macro ratio between main memory accumulation and backup storage cluster and flow rate upper limit value adjusts data from master Storage cluster is synchronized to the upper limit value of flow used in backup storage cluster, so that the upper limit value and the macro ratio phase after variation Matching.The embodiment of the present disclosure can be based on the macro ratio between main memory accumulation and backup storage cluster, adjust automatically data Synchronous flow rate upper limit, meanwhile, and can be avoided because that backup storage cluster and primary storage cluster scale are inconsistent is same in data Excessive pressure is caused to backup storage cluster when step.
It should be understood that above general description and following detailed description be only it is exemplary and explanatory, not The disclosure can be limited.
Detailed description of the invention
The drawings herein are incorporated into the specification and forms part of this specification, and shows the implementation for meeting the disclosure Example, and together with specification for explaining the principles of this disclosure.
Fig. 1 is a kind of data synchronization scenarios schematic diagram of distributed data base shown according to an exemplary embodiment;
Fig. 2 is a kind of process of the synchronous flow method of adjustment embodiment one of data shown according to an exemplary embodiment Figure;
Fig. 3 is a kind of process of the synchronous flow method of adjustment embodiment two of data shown according to an exemplary embodiment Figure;
Fig. 4 is a kind of process of the synchronous flow method of adjustment embodiment three of data shown according to an exemplary embodiment Figure;
Fig. 5 is a kind of frame of the synchronous flow adjusting device embodiment one of data shown according to an exemplary embodiment Figure;
Fig. 6 is a kind of block diagram of terminal device shown according to an exemplary embodiment.
Through the above attached drawings, it has been shown that the specific embodiment of the disclosure will be hereinafter described in more detail.These attached drawings It is not intended to limit the scope of this disclosure concept by any means with verbal description, but is by referring to specific embodiments Those skilled in the art illustrate the concept of the disclosure.
Specific embodiment
Example embodiments are described in detail here, and the example is illustrated in the accompanying drawings.Following description is related to When attached drawing, unless otherwise indicated, the same numbers in different drawings indicate the same or similar elements.Following exemplary embodiment Described in embodiment do not represent all implementations consistent with this disclosure.On the contrary, they be only with it is such as appended The example of the consistent device and method of some aspects be described in detail in claims, the disclosure.
Fig. 1 is a kind of data synchronization scenarios schematic diagram of distributed data base shown according to an exemplary embodiment, It include log 10, main memory accumulation 11 and backup storage cluster 12, wherein main memory accumulation in the distributed data base that Fig. 1 is provided Include multiple primary storage mediums in 11, includes multiple backup storage mediums in backup storage cluster 12, wrapped in main memory accumulation 11 The primary storage medium number included can be different from the number in backup storage cluster 12 including backup storage medium.Main memory accumulation 11 from log 10 for obtaining data and the data being synchronized to backup storage cluster 12.Wherein, main memory in the prior art The flow rate upper limit transmitted between storage media 11 and backup storage cluster 12 is to be configured by artificial mode, but work as When the popularization of backup storage cluster 12 or diminution, need manually to reconfigure above-mentioned flow rate upper limit.Human configuration Mode low efficiency, high labor cost.
In view of the above-mentioned problems existing in the prior art, the embodiment of the present disclosure provides a kind of flow adjustment side that data are synchronous Case, the program, by being monitored to the macro ratio between main memory accumulation and backup storage cluster, when monitoring primary storage When macro ratio between cluster and backup storage cluster changes, based on preset main memory accumulation and backup storage cluster Between macro ratio and flow rate upper limit value between corresponding relationship, adjustment data from primary storage cluster synchronization to backup storage collection The upper limit value of flow used in group, so that the upper limit value matches with the macro ratio after variation.The embodiment of the present disclosure being capable of base Macro ratio between main memory accumulation and backup storage cluster, the synchronous flow rate upper limit of adjust automatically data, compared to existing There is artificial adjustment mode, has regulated efficiency high, save the beneficial effect of cost of labor
Fig. 2 is a kind of process of the synchronous flow method of adjustment embodiment one of data shown according to an exemplary embodiment Figure, this method are suitable for distributed data base, which includes main memory accumulation and backup storage cluster, wherein leading Data are synchronized to backup storage cluster and carried out by storage cluster for obtaining data from the storage log of distributed data base Backup, wherein main memory accumulation and backup storage cluster may each comprise multiple storage mediums, and the storage that the two respectively includes is situated between The number of matter can be different.As shown in Fig. 2, method includes:
In a step 101, the macro ratio between the main memory accumulation and the backup storage cluster is monitored.
The scale of so-called main memory accumulation and backup storage cluster refers to main memory accumulation and standby in the present embodiment The quantity for the storage medium for including in part storage cluster.In the present embodiment between so-called main memory accumulation and backup storage cluster Macro ratio can illustratively be interpreted as, wrapped in the quantity of the storage medium for including in main memory accumulation and backup storage cluster The ratio of the quantity of the storage medium contained.
Wherein, in a kind of way of example, due to influencing data transmission between main memory accumulation and backup storage cluster The factor of ability be mainly backup storage cluster in storage medium quantity, when storage medium in backup storage cluster quantity compared with When more, can by between main memory accumulation and backup storage cluster data transmit flow rate upper limit value setting it is relatively higher, Otherwise when the negligible amounts of storage medium in backup storage cluster, then by data between main memory accumulation and backup storage cluster The flow rate upper limit value of transmission is arranged relatively lower, thus can mainly pass through the rule of monitoring backup storage cluster in the present embodiment Mould situation of change (popularization or diminution) realizes the monitoring to macro ratio between main memory accumulation and backup storage cluster, When the scale of backup storage cluster changes, then the macro ratio hair between main memory accumulation and backup storage cluster is defaulted Changing.
In another implementation, the scale of main memory accumulation He backup storage cluster can also be supervised simultaneously Survey, when a scale in the two changes or the two scale simultaneously occur inequality proportion change when, it is determined that two Macro ratio before person changes.
In a step 102, when the macro ratio changes, based on preset main memory accumulation and backup storage collection Group between macro ratio and flow rate upper limit value between corresponding relationship, adjust the data from the primary storage cluster synchronization to The upper limit value of flow used in the backup storage cluster, so that the upper limit value matches with the macro ratio after variation.
Macro ratio in the present embodiment between so-called main memory accumulation and backup storage cluster and flow rate upper limit value it Between corresponding relationship can according to need and set, without being confined to a certain specific corresponding relationship.Such as at one In illustrative embodiment, corresponding flow rate upper limit can be set for each preset macro ratio, in adjustment primary storage It, can be according to the scale between main memory accumulation and backup storage cluster when flow rate upper limit between cluster and backup storage cluster Flow rate upper limit between main memory accumulation and backup storage cluster is adjusted to corresponding numerical value by ratio.Alternatively, another real It applies in mode, can also be tied using the scale for backing up storage cluster as a Consideration for each preset macro ratio The scale situation for closing backup storage cluster, is arranged corresponding flow rate upper limit value, for example, in main memory accumulation and backup storage cluster Between macro ratio be 2 to 1, back up storage cluster scale be 50, then in the macro ratio and backup storage cluster scale Under conditions of, flow rate upper limit can be set to the half of the scale of backup storage cluster.Certainly it is only for examples to say Bright rather than unique restriction to the disclosure.
The present embodiment by when detecting that the macro ratio between main memory accumulation and backup storage cluster changes, Based on the macro ratio between preset main memory accumulation and backup storage cluster and the corresponding relationship between flow rate upper limit value, adjust The upper limit value of entire data flow used in from primary storage cluster synchronization to backup storage cluster, so that the scale after upper limit value and variation Ratio matches.The present embodiment can be based on the macro ratio between main memory accumulation and backup storage cluster, adjust automatically number According to synchronous flow rate upper limit, meanwhile, and can be avoided due to backup storage cluster and primary storage cluster scale are inconsistent in data Excessive pressure is caused to backup storage cluster when synchronous.
Fig. 2 embodiment is further optimized and extended below.
Fig. 3 is a kind of process of the synchronous flow method of adjustment embodiment two of data shown according to an exemplary embodiment Figure.As shown in figure 3, this method comprises the following steps on the basis of Fig. 2 embodiment:
In step 201, the storage that residual memory space in the backup storage cluster is greater than the first preset threshold is monitored The quantity of medium.
In step 202, if the storage that residual memory space is greater than the first preset threshold in the backup storage cluster is situated between The quantity of matter changes, then the macro ratio defaulted between the main memory accumulation and the backup storage cluster becomes Change, the corresponding pass based on the macro ratio between preset main memory accumulation and backup storage cluster and between flow rate upper limit value System, the upper limit value of adjustment data flow used in the primary storage cluster synchronization to backup storage cluster, so that the upper limit value Match with the macro ratio after variation.
In the scene of the present embodiment, the data that main memory accumulation is got from log will be synchronized to backup storage cluster Middle residual memory space is greater than in the storage medium of the first preset threshold.Thus, it in the present embodiment will be in backup storage cluster Residual memory space is greater than the quantity of the storage medium of the first preset threshold as adjustment main memory accumulation and backup storage cluster Between flow rate upper limit foundation.
The present embodiment is real-time or the storage condition of each storage medium is regularly obtained from backup storage cluster, and according to The storage condition of each storage medium judges that residual memory space is greater than the storage medium of the first preset threshold in backup storage cluster Quantity, when the quantity of storage medium that the residual memory space for including in backup storage cluster is greater than the first preset threshold increases Or when reducing, the corresponding flow rate upper limit adjusted between main memory accumulation and backup storage cluster.
It is exemplary, in the present embodiment, the macro ratio property of can be exemplified between main memory accumulation and backup storage cluster Understanding are as follows: in primary storage cluster in the number of storage medium and backup storage cluster residual memory space greater than the first default threshold The ratio of the number of the storage medium of value.
Wherein, the present embodiment is based on the macro ratio and flow between preset main memory accumulation and backup storage cluster Corresponding relationship between limit value adjusts the side of the upper limit value of data flow used in from primary storage cluster synchronization to backup storage cluster Method is similar with Fig. 2 embodiment, repeats no more herein.
The present embodiment is by being greater than the storage medium of the first preset threshold to residual memory space in backup storage cluster Quantity is monitored, and residual memory space is greater than the quantity hair of the storage medium of the first preset threshold in backup storage cluster The flow rate upper limit between main memory accumulation and backup storage cluster is adjusted when changing, so that primary storage cluster transmission Data are stored in residual memory space in backup storage cluster and are greater than in the storage medium of the first preset threshold, thus realizing While flow adjust automatically, the pressure to the lesser storage medium of remaining space in backup storage cluster is reduced.
Fig. 4 is a kind of process of the synchronous flow method of adjustment embodiment three of data shown according to an exemplary embodiment Figure.As shown in figure 4, this method comprises the following steps on the basis of Fig. 2 embodiment:
In step 301, process resource occupancy depositing lower than the second preset threshold in the backup storage cluster is monitored The quantity of storage media.
In step 302, if process resource occupancy is lower than the storage of the second preset threshold in the backup storage cluster The quantity of medium changes, then the macro ratio defaulted between the main memory accumulation and the backup storage cluster becomes Change, the corresponding pass based on the macro ratio between preset main memory accumulation and backup storage cluster and between flow rate upper limit value System, adjusts the upper limit value of data flow used in from the primary storage cluster synchronization to the backup storage cluster, so that institute Upper limit value is stated to match with the macro ratio after variation.
In scene provided in this embodiment, the data that main memory accumulation is got from log are transferred to backup storage collection Process resource occupancy, which is lower than on the storage medium of the second preset threshold, in group carries out backup preservation.
The present embodiment is real-time or the occupancy of the process resource of each storage medium is regularly obtained from backup storage cluster Situation, and according to the process resource occupancy situation of each storage medium, judge which storage medium is relatively idle, which storage is situated between Matter is quite busy to handing over, when the process resource occupancy for including in backup storage cluster is lower than the storage medium of the second preset threshold It is corresponding to adjust between main memory accumulation and backup storage cluster when the quantity of (i.e. more idle storage medium) increases or reduces Flow rate upper limit.
It is exemplary, in the present embodiment, the macro ratio property of can be exemplified between main memory accumulation and backup storage cluster Understanding are as follows: process resource occupancy is preset lower than second in the number of storage medium and backup storage cluster in primary storage cluster The ratio of the number of the storage medium of threshold value.
Wherein, the present embodiment is based on the macro ratio and flow between preset main memory accumulation and backup storage cluster Corresponding relationship between limit value adjusts the side of the upper limit value of data flow used in from primary storage cluster synchronization to backup storage cluster Method is similar with Fig. 2 embodiment, repeats no more herein.
The present embodiment passes through the storage medium to process resource occupancy in backup storage cluster lower than the second preset threshold Quantity be monitored, and in backup storage cluster process resource occupancy lower than the second preset threshold storage medium number Amount is adjusted the flow rate upper limit between main memory accumulation and backup storage cluster when changing, so that main memory accumulation passes Defeated data are stored in storage medium more idle in backup storage cluster, thus realizing the same of flow adjust automatically When, improve processing speed of the data in backup storage cluster.
Fig. 5 is a kind of frame of the synchronous flow adjusting device embodiment one of data shown according to an exemplary embodiment Figure, the device 50 are suitable for distributed data base, and the distributed data base further includes main memory accumulation and backup storage cluster, The main memory accumulation is configured as obtaining data from the storage log of the distributed data base, and the data are synchronous It is backed up to the backup storage cluster, as shown in figure 5, the device 50 includes:
Cluster scale monitoring modular 51 is configured as monitoring between the main memory accumulation and the backup storage cluster Macro ratio;
Flow adjustment module 52 is configured as when the macro ratio changes, and is based on preset main memory accumulation Corresponding relationship between macro ratio between backup storage cluster and flow rate upper limit value adjusts the data from the main memory Accumulation is synchronized to the upper limit value of flow used in the backup storage cluster, so that the macro ratio after the upper limit value and variation Match.
Optionally, the cluster scale monitoring modular 51, comprising:
Whether the first monitoring submodule, the scale for being configured as monitoring the backup storage cluster expand or shrink.
Optionally, the cluster scale monitoring modular 51, comprising:
Second monitoring submodule, it is default greater than first to be configured as monitoring residual memory space in the backup storage cluster The quantity of the storage medium of threshold value.
Optionally, the cluster scale monitoring modular 51, comprising:
Third monitors submodule, and it is pre- lower than second to be configured as monitoring process resource occupancy in the backup storage cluster If the quantity of the storage medium of threshold value.
Device provided in this embodiment is able to carry out the method as shown in any embodiment in Fig. 2-Fig. 4, executive mode It is similar with beneficial effect, it repeats no more herein.
About the flow adjusting device in above-described embodiment, wherein modules, submodule execute the concrete mode of operation It is described in detail in the embodiment of the method, no detailed explanation will be given here.
The foregoing describe the built-in function of flow adjusting device and structures, and in practice, which, which can realize, is The computer equipments such as mobile phone, comprising:
Processor;
It is configured as the memory of storage processor executable instruction;
Wherein, the processor is configured to:
Monitor the macro ratio between the main memory accumulation and the backup storage cluster;
When the macro ratio changes, based on the scale between preset main memory accumulation and backup storage cluster Corresponding relationship between ratio and flow rate upper limit value adjusts the data and stores from the primary storage cluster synchronization to the backup The upper limit value of flow used in cluster, so that the upper limit value matches with the macro ratio after variation.
Fig. 6 is a kind of block diagram of terminal device shown according to an exemplary embodiment.For example, terminal device 800 can be with It is mobile phone, computer, digital broadcasting terminal, messaging device, game console, tablet device, Medical Devices, body-building Equipment, personal digital assistant etc..
Referring to Fig. 6, terminal device 800 may include following one or more components: processing component 802, memory 804, Power supply module 806, multimedia component 808, audio component 810, the interface 812 of input/output (I/O), sensor module 814, And communication component 816.
The integrated operation of the usual controlling terminal equipment 800 of processing component 802, such as with display, call, data are logical Letter, camera operation and record operate associated operation.Processing component 802 may include one or more processors 820 to hold Row instruction, to perform all or part of the steps of the methods described above.In addition, processing component 802 may include one or more moulds Block, convenient for the interaction between processing component 802 and other assemblies.For example, processing component 802 may include multi-media module, with Facilitate the interaction between multimedia component 808 and processing component 802.
Memory 804 is configured as storing various types of data to support the operation in equipment 800.These data are shown Example includes the instruction of any application or method for operating on terminal device 800, contact data, telephone directory number According to, message, picture, video etc..Memory 804 can by any kind of volatibility or non-volatile memory device or they Combination realize, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM) is erasable Programmable read only memory (EPROM), programmable read only memory (PROM), read-only memory (ROM), magnetic memory, quick flashing Memory, disk or CD.
Power supply module 806 provides electric power for the various assemblies of terminal device 800.Power supply module 806 may include power supply pipe Reason system, one or more power supplys and other with for terminal device 800 generate, manage, and distribute the associated component of electric power.
Multimedia component 808 includes the screen of one output interface of offer between the terminal device 800 and user. In some embodiments, screen may include liquid crystal display (LCD) and touch panel (TP).If screen includes touch surface Plate, screen may be implemented as touch screen, to receive input signal from the user.Touch panel includes one or more touches Sensor is to sense the gesture on touch, slide, and touch panel.The touch sensor can not only sense touch or sliding The boundary of movement, but also detect duration and pressure associated with the touch or slide operation.In some embodiments, Multimedia component 808 includes a front camera and/or rear camera.When equipment 800 is in operation mode, as shot mould When formula or video mode, front camera and/or rear camera can receive external multi-medium data.Each preposition camera shooting Head and rear camera can be a fixed optical lens system or have focusing and optical zoom capabilities.
Audio component 810 is configured as output and/or input audio signal.For example, audio component 810 includes a Mike Wind (MIC), when terminal device 800 is in operation mode, when such as call mode, recording mode, and voice recognition mode, microphone It is configured as receiving external audio signal.The received audio signal can be further stored in memory 804 or via logical Believe that component 816 is sent.In some embodiments, audio component 810 further includes a loudspeaker, is used for output audio signal.
I/O interface 812 provides interface between processing component 802 and peripheral interface module, and above-mentioned peripheral interface module can To be keyboard, click wheel, button etc..These buttons may include, but are not limited to: home button, volume button, start button and lock Determine button.
Sensor module 814 includes one or more sensors, for providing the state of various aspects for terminal device 800 Assessment.For example, sensor module 814 can detecte the state that opens/closes of equipment 800, the relative positioning of component, such as institute The display and keypad that component is terminal device 800 are stated, sensor module 814 can also detect terminal device 800 or terminal The position change of 800 1 components of equipment, the existence or non-existence that user contacts with terminal device 800,800 orientation of terminal device Or the temperature change of acceleration/deceleration and terminal device 800.Sensor module 814 may include proximity sensor, be configured to It detects the presence of nearby objects without any physical contact.Sensor module 814 can also include optical sensor, such as CMOS or ccd image sensor, for being used in imaging applications.In some embodiments, which can be with Including acceleration transducer, gyro sensor, Magnetic Sensor, pressure sensor or temperature sensor.
Communication component 816 is configured to facilitate the communication of wired or wireless way between terminal device 800 and other equipment. Terminal device 800 can access the wireless network based on communication standard, such as WiFi, 2G or 3G or their combination.Show at one In example property embodiment, communication component 816 receives broadcast singal or broadcast from external broadcasting management system via broadcast channel Relevant information.In one exemplary embodiment, the communication component 816 further includes near-field communication (NFC) module, short to promote Cheng Tongxin.For example, radio frequency identification (RFID) technology, Infrared Data Association (IrDA) technology, ultra wide band can be based in NFC module (UWB) technology, bluetooth (BT) technology and other technologies are realized.
In the exemplary embodiment, terminal device 800 can be by one or more application specific integrated circuit (ASIC), number Word signal processor (DSP), digital signal processing appts (DSPD), programmable logic device (PLD), field programmable gate array (FPGA), controller, microcontroller, microprocessor or other electronic components are realized, for executing the above method.
In the exemplary embodiment, a kind of non-transitorycomputer readable storage medium including instruction, example are additionally provided It such as include the memory 804 of instruction, above-metioned instruction can be executed by the processor 820 of terminal device 800 to complete the above method.Example Such as, the non-transitorycomputer readable storage medium can be ROM, random access memory (RAM), CD-ROM, tape, soft Disk and optical data storage devices etc..
A kind of non-transitorycomputer readable storage medium, when the instruction in the storage medium is by the processing of mobile terminal When device executes, so that mobile terminal is able to carry out a kind of flow method of adjustment that data are synchronous, which comprises
Monitor the macro ratio between the main memory accumulation and the backup storage cluster;
When the macro ratio changes, based on the scale between preset main memory accumulation and backup storage cluster Corresponding relationship between ratio and flow rate upper limit value adjusts the data and stores from the primary storage cluster synchronization to the backup The upper limit value of flow used in cluster, so that the upper limit value matches with the macro ratio after variation.
Those skilled in the art after considering the specification and implementing the invention disclosed here, will readily occur to its of the disclosure Its embodiment.This application is intended to cover any variations, uses, or adaptations of the disclosure, these modifications, purposes or Person's adaptive change follows the general principles of this disclosure and including the undocumented common knowledge in the art of the disclosure Or conventional techniques.The description and examples are only to be considered as illustrative, and the true scope and spirit of the disclosure are by following Claim is pointed out.
It should be understood that the present disclosure is not limited to the precise structures that have been described above and shown in the drawings, and And various modifications and changes may be made without departing from the scope thereof.The scope of the present disclosure is only limited by the accompanying claims.

Claims (10)

1. a kind of synchronous flow method of adjustment of data, is applied to distributed data base, the distributed data base includes: main memory Accumulation and backup storage cluster, the main memory accumulation is for obtaining number from the storage log of the distributed data base According to, and the data are synchronized to the backup storage cluster and are backed up, which is characterized in that the described method includes:
Monitor the macro ratio between the main memory accumulation and the backup storage cluster;
When the macro ratio changes, based on the macro ratio between preset main memory accumulation and backup storage cluster With the corresponding relationship between flow rate upper limit value, the data are adjusted from the primary storage cluster synchronization to the backup storage cluster The upper limit value of flow used, so that the upper limit value matches with the macro ratio after variation.
2. the method according to claim 1, wherein the monitoring main memory accumulation and backup storage Macro ratio between cluster, comprising:
Whether the scale for monitoring the backup storage cluster expands or shrinks.
3. the method according to claim 1, wherein the monitoring main memory accumulation and backup storage Macro ratio between cluster, comprising:
Monitor the quantity that residual memory space in the backup storage cluster is greater than the storage medium of the first preset threshold.
4. the method according to claim 1, wherein the monitoring main memory accumulation and backup storage Macro ratio between cluster, comprising:
Monitor the quantity that process resource occupancy in the backup storage cluster is lower than the storage medium of the second preset threshold.
5. a kind of synchronous flow adjusting device of data, the device are suitable for distributed data base, the distributed data base is also It include: main memory accumulation and backup storage cluster, the main memory accumulation is configured as the storage from the distributed data base Data are obtained in log, and the data are synchronized to the backup storage cluster and are backed up, which is characterized in that described device Include:
Cluster scale monitoring modular is configured as monitoring the scale ratio between the main memory accumulation and the backup storage cluster Example;
Flow adjustment module is configured as when the macro ratio changes, and is based on preset main memory accumulation and backup Corresponding relationship between macro ratio between storage cluster and flow rate upper limit value adjusts the data from the main memory accumulation It is synchronized to the upper limit value of flow used in the backup storage cluster, so that the upper limit value and the macro ratio phase after variation Match.
6. device according to claim 5, which is characterized in that the cluster scale monitoring modular, comprising:
Whether the first monitoring submodule, the scale for being configured as monitoring the backup storage cluster expand or shrink.
7. device according to claim 5, which is characterized in that the cluster scale monitoring modular, comprising:
Second monitoring submodule is configured as monitoring residual memory space in the backup storage cluster and is greater than the first preset threshold Storage medium quantity.
8. device according to claim 5, which is characterized in that the cluster scale monitoring modular, comprising:
Third monitors submodule, is configured as monitoring process resource occupancy in the backup storage cluster and is lower than the second default threshold The quantity of the storage medium of value.
9. a kind of computer equipment characterized by comprising
Processor;
It is configured as the memory of storage processor executable instruction;
Wherein, the processor is configured to:
Monitor the macro ratio between main memory accumulation and backup storage cluster;
When the macro ratio changes, based on the macro ratio between preset main memory accumulation and backup storage cluster With the corresponding relationship between flow rate upper limit value, data are adjusted used in from the primary storage cluster synchronization to the backup storage cluster The upper limit value of flow, so that the upper limit value matches with the macro ratio after variation.
10. a kind of computer readable storage medium, which is characterized in that instruction is stored in the computer readable storage medium, When run on a computer, so that computer executes following method:
Monitor the macro ratio between main memory accumulation and backup storage cluster;
When the macro ratio changes, based on the macro ratio between preset main memory accumulation and backup storage cluster With the corresponding relationship between flow rate upper limit value, data are adjusted used in from the primary storage cluster synchronization to the backup storage cluster The upper limit value of flow, so that the upper limit value matches with the macro ratio after variation.
CN201910541359.2A 2019-06-21 2019-06-21 Data synchronization flow adjustment method, device, equipment and storage medium Active CN110263099B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910541359.2A CN110263099B (en) 2019-06-21 2019-06-21 Data synchronization flow adjustment method, device, equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910541359.2A CN110263099B (en) 2019-06-21 2019-06-21 Data synchronization flow adjustment method, device, equipment and storage medium

Publications (2)

Publication Number Publication Date
CN110263099A true CN110263099A (en) 2019-09-20
CN110263099B CN110263099B (en) 2021-07-13

Family

ID=67920221

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910541359.2A Active CN110263099B (en) 2019-06-21 2019-06-21 Data synchronization flow adjustment method, device, equipment and storage medium

Country Status (1)

Country Link
CN (1) CN110263099B (en)

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102750283A (en) * 2011-04-20 2012-10-24 阿里巴巴集团控股有限公司 Massive data synchronization system and method
CN103186536A (en) * 2011-12-27 2013-07-03 中兴通讯股份有限公司 Method and system for scheduling data shearing devices
CN106357764A (en) * 2016-09-14 2017-01-25 广东欧珀移动通信有限公司 Data synchronization method and sever of mobile terminal
CN106570074A (en) * 2016-10-14 2017-04-19 深圳前海微众银行股份有限公司 Distributed database system and implementation method thereof
CN107015972A (en) * 2016-01-27 2017-08-04 五八同城信息技术有限公司 A kind of computer room business migration methods, devices and systems
CN107809362A (en) * 2017-11-15 2018-03-16 深圳四方精创资讯股份有限公司 The collocation method and its system of ESB
CN108259221A (en) * 2017-12-04 2018-07-06 山石网科通信技术有限公司 Flow control methods, device, system, storage medium and processor
CN108319618A (en) * 2017-01-17 2018-07-24 阿里巴巴集团控股有限公司 A kind of data distribution control method, system and the device of distributed memory system
US20180365308A1 (en) * 2017-06-15 2018-12-20 International Business Machines Corporation Performance adjuster for web application server and relational database system

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102750283A (en) * 2011-04-20 2012-10-24 阿里巴巴集团控股有限公司 Massive data synchronization system and method
CN103186536A (en) * 2011-12-27 2013-07-03 中兴通讯股份有限公司 Method and system for scheduling data shearing devices
CN107015972A (en) * 2016-01-27 2017-08-04 五八同城信息技术有限公司 A kind of computer room business migration methods, devices and systems
CN106357764A (en) * 2016-09-14 2017-01-25 广东欧珀移动通信有限公司 Data synchronization method and sever of mobile terminal
CN106570074A (en) * 2016-10-14 2017-04-19 深圳前海微众银行股份有限公司 Distributed database system and implementation method thereof
CN108319618A (en) * 2017-01-17 2018-07-24 阿里巴巴集团控股有限公司 A kind of data distribution control method, system and the device of distributed memory system
US20180365308A1 (en) * 2017-06-15 2018-12-20 International Business Machines Corporation Performance adjuster for web application server and relational database system
CN107809362A (en) * 2017-11-15 2018-03-16 深圳四方精创资讯股份有限公司 The collocation method and its system of ESB
CN108259221A (en) * 2017-12-04 2018-07-06 山石网科通信技术有限公司 Flow control methods, device, system, storage medium and processor

Also Published As

Publication number Publication date
CN110263099B (en) 2021-07-13

Similar Documents

Publication Publication Date Title
EP3110188A1 (en) Method and device for accessing operator network
CN104376239B (en) The unlocking method and a device of terminal
CN109658927A (en) Wake-up processing method, device and the management equipment of smart machine
CN107040591B (en) Method and device for controlling client
CN105487680B (en) Method, apparatus and terminal for terminal screenshotss
US11546749B2 (en) Method and device for communication processing, and storage medium
CN109451880A (en) Method for connecting network and device
CN104703255B (en) Method of adjustment in net and device, electronic equipment
US20220225192A1 (en) Cell handover method and apparatus, handover configuration method and apparatus, and user equipment
CN104869169B (en) The update method and device of cloud business card
CN105530363A (en) Method and device for controlling do not disturb mode
CN105892984A (en) Terminal controlling method and device
CN109522058A (en) Awakening method, device, terminal and storage medium
CN106201738A (en) System broadcasts call method and device
CN109474744B (en) Alarm clock processing method, device and storage medium
CN110263099A (en) Data synchronous flow method of adjustment, device, equipment and storage medium
CN105516466B (en) Call the method and device at interface
CN109558175A (en) Schedule creation method and device
CN105100254A (en) Data synchronization method and device
CN109245992A (en) Request processing method, device, electronic equipment and storage medium
CN104066210A (en) Dual-card dual-standby mobile communication terminal management system and mobile communication terminal
CN115579003A (en) Voice wake-up method, device and storage medium
CN105959357B (en) Cloud service management method and device
CN109246322A (en) A kind of information processing method and system
CN109785607A (en) Determine the method and device of ultra-red order response results

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant