CN117806556A - Low-energy-consumption full flash memory method and system - Google Patents
Low-energy-consumption full flash memory method and system Download PDFInfo
- Publication number
- CN117806556A CN117806556A CN202311854643.8A CN202311854643A CN117806556A CN 117806556 A CN117806556 A CN 117806556A CN 202311854643 A CN202311854643 A CN 202311854643A CN 117806556 A CN117806556 A CN 117806556A
- Authority
- CN
- China
- Prior art keywords
- data
- copy
- flash memory
- importance
- full
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 70
- 238000005265 energy consumption Methods 0.000 title claims abstract description 17
- 230000014759 maintenance of location Effects 0.000 claims abstract description 32
- 230000006870 function Effects 0.000 claims description 14
- 238000004458 analytical method Methods 0.000 claims description 9
- 238000004146 energy storage Methods 0.000 abstract description 11
- 238000004590 computer program Methods 0.000 description 8
- 238000010586 diagram Methods 0.000 description 6
- 238000007726 management method Methods 0.000 description 6
- 238000012545 processing Methods 0.000 description 4
- 238000011084 recovery Methods 0.000 description 4
- 238000004364 calculation method Methods 0.000 description 3
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 238000013500 data storage Methods 0.000 description 3
- 238000013508 migration Methods 0.000 description 3
- 230000005012 migration Effects 0.000 description 3
- 238000004891 communication Methods 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 239000004065 semiconductor Substances 0.000 description 2
- 238000012360 testing method Methods 0.000 description 2
- 239000002699 waste material Substances 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 1
- 238000004422 calculation algorithm Methods 0.000 description 1
- 230000006835 compression Effects 0.000 description 1
- 238000007906 compression Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000012217 deletion Methods 0.000 description 1
- 230000037430 deletion Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000002035 prolonged effect Effects 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 238000012216 screening Methods 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/0671—In-line storage system
- G06F3/0673—Single storage device
- G06F3/0679—Non-volatile semiconductor memory device, e.g. flash memory, one time programmable memory [OTP]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/0608—Saving storage space on storage systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/0625—Power saving in storage systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0638—Organizing or formatting or addressing of data
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0646—Horizontal data movement in storage systems, i.e. moving data in between storage devices or systems
- G06F3/0647—Migration mechanisms
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0646—Horizontal data movement in storage systems, i.e. moving data in between storage devices or systems
- G06F3/0652—Erasing, e.g. deleting, data cleaning, moving of data to a wastebasket
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Techniques For Improving Reliability Of Storages (AREA)
Abstract
The invention belongs to the technical field of full flash memory, and discloses a low-energy-consumption full flash memory method and a system; collecting m data in a full flash memory system, and constructing a data set; identifying the data set to obtain attribute parameters corresponding to m data; calculating importance values corresponding to the m data, and judging the corresponding importance level; making a copy strategy according to the importance value and the importance level corresponding to the m data; according to the formulated copy strategy, intelligent management is carried out on the copies in the full flash memory system, and the copies which reach the copy retention period are deleted; the writing operation of the full-flash memory system is effectively reduced, and excessive redundant copies are prevented from occupying the space of the full-flash memory system, so that the energy storage consumption of the full-flash memory is reduced.
Description
Technical Field
The invention relates to the technical field of full flash memory, in particular to a low-energy-consumption full flash memory method and a low-energy-consumption full flash memory system.
Background
With the rapid development of information technology, the data storage requirement is continuously increased, and the traditional mechanical hard disk has some limitations in high-speed reading and writing, large-capacity storage and energy efficiency; in order to meet the requirements of applications such as high-performance computing, big data processing, cloud computing, mobile equipment and the like, an all-flash memory system is gradually becoming an important memory solution; the full flash memory system is a storage system using a flash memory chip as a storage medium, can keep data storage after power failure, and has faster read-write speed, smaller noise and higher reliability compared with the traditional mechanical hard disk, so that the reduction of energy consumption becomes an urgent problem to be solved in order to further improve the performance and the reliability of the full flash memory system;
in the prior art, data deduplication and compression or data migration and layering are mostly adopted for reducing energy consumption, and there are few methods for managing copies, and of course, an intelligent copy management method exists, for example, a method and a device for storing data are disclosed in the patent with the publication number of CN 109783018A; through the blue light storage and the multi-level storage of the bottom layer, the copy is automatically deleted according to the storage time length; the storage life is effectively prolonged, and the energy consumption is reduced;
however, the above technology does not consider the importance of different data, the time length required to be stored is different, and the deletion logics of the copies are consistent, so that the application range is smaller; because the importance of different data is different, the corresponding copy retention period is also different, and the importance of the copy is required to be determined according to various parameters of different data, so that the copy is automatically deleted in a targeted manner;
in view of the above, the present invention provides a low-power-consumption full flash memory method and system for solving the above problems.
Disclosure of Invention
In order to overcome the defects in the prior art, the invention provides the following technical scheme for achieving the purposes: the low-energy-consumption full flash memory method comprises the following steps:
collecting m data in a full flash memory system, and constructing a data set;
identifying the data set to obtain attribute parameters corresponding to m data;
calculating importance values corresponding to the m data, and judging the corresponding importance level;
making a copy strategy according to the importance value and the importance level corresponding to the m data;
and carrying out intelligent management on the copies in the full-flash memory system according to the formulated copy strategy, and deleting the copies which reach the copy retention period.
Further, the method for obtaining the corresponding attribute parameters of the m data comprises the following steps:
s1: formulating a catalog of data sets to be scanned;
s2: creating a function to obtain attribute parameters;
s3: identifying each catalog in the data set and acquiring attribute parameters;
the attribute parameters include access frequency, update frequency, and type.
Further, the method for calculating the importance value corresponding to the m data comprises the following steps:
ZYi＝ω1×ln(FPi+GPi)+ω2×LXi；
wherein ZYi is an importance value, FPi is an access frequency, GPi is an update frequency, LXi is a type value, ω 1 、ω 2 Is of preset weight and omega 1 ＞0、ω 2 And (3) the data with the value of i being greater than 0, wherein i is the ith data, and i is m.
Further, the method for judging the importance level corresponding to the m data comprises the following steps:
presetting a first threshold Th 1 And a second threshold Th 2 Wherein Th is 1 >Th 2 The method comprises the steps of carrying out a first treatment on the surface of the Sequentially associating the importance values corresponding to the m data with a first threshold Th 1 And a second threshold Th 2 Comparing;
if the importance value corresponding to the data is greater than or equal to the first threshold Th 1 Marking the data as important data; the importance value corresponding to the data is larger, and the importance of the data is larger;
if the importance value corresponding to the data is smaller than the first threshold Th 1 And is greater than or equal to a second threshold Th 2 Marking the data as secondary data;
if the importance value corresponding to the data is smaller than the second threshold Th 2 Marking the data as general data; indicating that the data has smaller importance value and the data has smaller importance。
Further, the method for making the copy policy comprises the following steps:
a: calculating the number of copies corresponding to the m data;
b: analyzing each copy to obtain copy analysis parameters, wherein the copy analysis parameters comprise copy types and copy redundancy levels;
c: and calculating a copy retention period corresponding to each copy, and automatically deleting or retaining the copy according to the copy retention period.
Further, the method for calculating the number of copies corresponding to the m data in the step a includes:
where FSi is the number of copies, ω 3 Is of preset weight and omega 3 ＞0，A j J is [1,2,3 ] e]，A 1 A is a preset constant corresponding to important data 2 For the preset constant corresponding to the secondary data, A 3 A preset constant corresponding to general data;
and rounding the calculated m data corresponding copy numbers.
Further, the rounding method comprises:
rounding the calculated number of copies corresponding to the m data by using a floor function;
the floor function is:wherein (1)>Is less than or equal to FS i Max represents the maximum value of the set, Z is the integer set, and P is less than or equal to FS i Is an integer of (a).
Further, the method for calculating the retention period of each copy corresponding to each copy in the step c includes:
where BXn is the copy retention period, FLn is the copy type value, FHn is the copy redundancy level value, ω 4 、ω 5 Is of preset weight and omega 4 ＞0、ω 5 FSZ is the total number of copies, n is the nth copy, n ε FSZ.
Further, a frequency threshold is preset, the frequency threshold is compared with the access frequency, whether the copy corresponding to the data is migrated is judged, and the copy to be migrated is migrated to a flash memory device with lower power consumption;
the method for judging whether to migrate the corresponding copy of the data comprises the following steps:
if the access frequency is greater than or equal to the frequency threshold, not migrating the corresponding copy of the data;
and if the access frequency is smaller than the frequency threshold value, migrating the corresponding copy of the data.
The low-energy-consumption full-flash memory system implements the low-energy-consumption full-flash memory method, which comprises the following steps:
the data acquisition module acquires m data in the full-flash memory system and constructs a data set;
the data identification module is used for identifying the data set and acquiring attribute parameters corresponding to the m data, wherein the attribute parameters comprise access frequency, update frequency and type;
the importance judging module is used for calculating importance values corresponding to the m data and judging the corresponding importance level;
the strategy making module makes a copy strategy according to the importance value and the importance level corresponding to the m data;
and the copy management module is used for intelligently managing the copies in the full-flash memory system according to the formulated copy strategy and deleting the copies which reach the copy retention period.
The low-energy-consumption full flash memory method and the system have the technical effects and advantages that:
1. the method comprises the steps of judging the importance of each data by identifying the data stored in the full flash memory system, setting different copy numbers for each data according to the importance, calculating corresponding copy retention deadlines for each copy, and deleting the copy which has reached the copy retention deadline; the write operation of the full flash memory system can be reduced, and the consumption of the flash memory can be reduced, so that the energy storage consumption of the full flash memory can be reduced; meanwhile, the redundant copies are prevented from occupying the space of the full-flash memory system, the resources of the full-flash memory system are fully utilized, and the space waste is reduced, so that the energy storage consumption of the full-flash memory is reduced.
2. And according to the access frequency corresponding to the data, transferring the copy corresponding to the data with lower access frequency to a flash memory device with lower power consumption so as to reduce the energy storage consumption of the whole flash memory.
Drawings
FIG. 1 is a diagram of a low power consumption full flash memory system according to embodiment 1 of the present invention;
FIG. 2 is a schematic diagram of a duplicate policy making process according to embodiment 1 of the present invention;
FIG. 3 is a diagram of a low power consumption full flash memory system according to embodiment 2 of the present invention;
FIG. 4 is a diagram illustrating a low-power-consumption full-flash memory method according to embodiment 3 of the present invention;
fig. 5 is a schematic structural diagram of an electronic device according to embodiment 4 of the present invention.
Detailed Description
The following description of the embodiments of the present invention will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present invention, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
Example 1
Referring to fig. 1, the low-power-consumption full-flash memory system of the present embodiment includes a data acquisition module, a data identification module, an importance judgment module, a policy making module, and a copy management module; each module is connected in a wired and/or wireless mode, so that data transmission among the modules is realized;
the data acquisition module acquires m data in the full-flash memory system and constructs a data set; the m data are all data in the full flash memory system; data in a full flash memory system is for example: documents, multimedia files, application data, archive data, and the like;
the data identification module is used for identifying the data set and acquiring attribute parameters corresponding to the m data, wherein the attribute parameters comprise access frequency, update frequency and type;
the method for obtaining the corresponding attribute parameters of the m data comprises the following steps:
s1: formulating a catalog of data sets to be scanned;
scan_directory＝"/path/to/your/directory"
s2: creating a function to obtain attribute parameters;
s3: identifying each catalog in the data set and acquiring attribute parameters;
the access frequency is the frequency of the data to be accessed, the access frequency can reflect the importance of the data, and the higher the access frequency is, the higher the probability of indicating the importance of the data is, and the opposite is the case; the types are types of data, such as core business data, such as customer information, product information, inventory data, and the like, sensitive data, such as personal identity information, financial data, medical records, and the like, transaction data, such as transaction records, payment information, order processing data, and the like, and user-generated data, such as social media posts, comments, and the like; the importance of the data of different types is different; the update frequency is the frequency of updating the data, and the higher the update frequency is, the higher the real-time performance of the data is, and the importance of the data can be influenced by the real-time performance of the data, so that the importance of the data can be influenced by the update frequency of the data;
the importance judging module is used for calculating importance values corresponding to the m data and judging the corresponding importance level;
the calculation method of the importance value corresponding to the m data comprises the following steps:
ZYi＝ω1×ln(FPi+GPi)+ω2×LXi；
wherein ZYi is an importance value, FPi is an access frequency, GPi is an update frequency, LXi is a type value, ω 1 、ω 2 Is of preset weight and omega 1 ＞0、ω 2 > 0, i is the ith data, i ε m;
wherein the preset weight is acquired by a person skilled in the art, corresponding weights are set for each group of comprehensive parameters, the preset weight and the acquired comprehensive parameters are substituted into a formula, any two formulas form a binary one-time equation set, the calculated weights are filtered and averaged to obtain omega 1 、ω 2 Is a value of (2);
it should be noted that, the type value is a value obtained by assigning a type of data in advance, and a larger value is assigned to important data, such as core business data, sensitive data and transaction data; assigning smaller values to less important data, such as temporary data, test data, and user-generated data; sequentially giving different values for different types of data; illustratively, core business data is assigned a value of 6, sensitive data is assigned a value of 5, transaction data is assigned a value of 4, user generated data is assigned a value of 3, test data is assigned a value of 2, and temporary data is assigned a value of 1;
the method for judging the importance level corresponding to the m data comprises the following steps:
presetting a first threshold Th 1 And a second threshold Th 2 Wherein Th is 1 >Th 2 The method comprises the steps of carrying out a first treatment on the surface of the Sequentially associating the importance values corresponding to the m data with a first threshold Th 1 And a second threshold Th 2 Comparing;
if the importance value corresponding to the data is greater than or equal to the first threshold Th 1 Marking the data as important data; the importance value corresponding to the data is larger, and the importance of the data is larger;
if the importance value corresponding to the data is smaller than the first threshold Th 1 And is greater than or equal to a second threshold Th 2 Marking the data as secondary data;
if the importance value corresponding to the data is smaller than the second threshold Th 2 Marking the data as general data; the importance value corresponding to the data is smaller, and the importance of the data is smaller;
the strategy making module makes a copy strategy according to the importance value and the importance level corresponding to the m data;
referring to fig. 2, the method for making the copy policy includes:
a: calculating the number of copies corresponding to the m data;
b: analyzing each copy to obtain copy analysis parameters, wherein the copy analysis parameters comprise copy types and copy redundancy levels;
c: calculating a copy retention period corresponding to each copy, and automatically deleting or retaining the copy according to the copy retention period;
specifically, the method for calculating the number of copies corresponding to the m data in the step a includes:
where FSi is the number of copies, ω 3 Is of preset weight and omega 3 ＞0，A j J is [1,2,3 ] e]，A 1 Preset routine corresponding to important dataNumber A 2 For the preset constant corresponding to the secondary data, A 3 A preset constant corresponding to general data;
wherein the preset weight is obtained by the person skilled in the art to collect a plurality of groups of comprehensive parameters, substituting the collected comprehensive parameters into a formula, screening the calculated weight and taking the average value to obtain omega 3 Is a value of (2);
wherein the preset constant is preset by a person skilled in the art according to the importance levels corresponding to different data, the preset constant corresponding to the different importance levels is different, and the higher the importance level is, the larger the corresponding preset constant is, namely A 1 ＞A 2 ＞A 3 ；
Rounding the calculated number of copies corresponding to the m data by using a floor function;
the floor function is:wherein (1)>Is less than or equal to FS i Max represents the maximum value of the set, Z is the integer set, and P is less than or equal to FS i Is an integer of (2);
the purpose of rounding the number of copies corresponding to the calculated m data by using a floor function is that, since the cube root of the importance value is calculated in the formula, the calculation result of the cube root is not an integer, but the number of copies is an integer, the calculated number of copies needs to be rounded to ensure that the calculated number of copies is an integer;
specifically, the method for acquiring the duplicate analysis parameters in the step b includes:
the copy type is obtained through the full flash memory system document and comprises a main copy and a backup copy, wherein the main copy is used for providing real-time access and processing, and the backup copy is used for backup and disaster recovery; the primary copy is accessed and updated more frequently, so that the corresponding copy has a longer retention period, the backup copy may be updated or replaced periodically, and the corresponding copy is shorter;
the duplicate redundancy level is obtained through the position of the duplicate, and the duplicate redundancy level comprises local redundancy, cross-regional redundancy and global redundancy; global redundancy provides the highest level of reliability and disaster recovery, so that the corresponding copy retention period is the longest, cross-regional redundancy is lower in reliability and disaster recovery than global redundancy, the corresponding copy retention period is shorter, the reliability and disaster recovery provided by local redundancy is the lowest, and the corresponding copy retention period is the shortest; the position of the copy is obtained according to the architecture diagram of the full flash memory system;
specifically, the method for calculating the retention period of each copy corresponding to each copy in the step c includes:
where BXn is the copy retention period, FLn is the copy type value, FHn is the copy redundancy level value, ω 4 、ω 5 Is of preset weight and omega 4 ＞0、ω 5 FSZ is the total number of copies, n is the nth copy, n is E FSZ;
wherein the preset weight is acquired by a person skilled in the art, corresponding weights are set for each group of comprehensive parameters, the preset weight and the acquired comprehensive parameters are substituted into a formula, any two formulas form a binary one-time equation set, the calculated weights are filtered and averaged to obtain omega 4 、ω 5 Is a value of (2);
it should be noted that, the value of the copy type and the value of the copy redundancy level are assigned in advance by a person skilled in the art according to experience, and different values are assigned to the data with different copy types and copy redundancy levels; the copy type value is given a larger value to the main copy and a smaller value to the backup copy; in the duplicate redundancy level values, global redundancy values > cross-regional redundancy values > local redundancy values;
the copy management module intelligently manages the copies in the full-flash memory system according to the formulated copy strategy, deletes the copies which reach the copy retention period, and avoids storing too many unnecessary copies in the full-flash memory system, thereby reducing the energy consumption of the full-flash memory;
according to the embodiment, the importance of each data is judged by identifying the data stored in the full flash memory system, different copy numbers are set for each data according to the importance, corresponding copy retention deadlines are calculated for each copy, and the copy which has reached the copy retention deadline is deleted; the write operation of the full flash memory system can be reduced, and the consumption of the flash memory can be reduced, so that the energy storage consumption of the full flash memory can be reduced; meanwhile, the redundant copies are prevented from occupying the space of the full-flash memory system, the resources of the full-flash memory system are fully utilized, and the space waste is reduced, so that the energy storage consumption of the full-flash memory is reduced.
Example 2
Referring to fig. 3, the present embodiment further improves the design based on embodiment 1, in the all-flash memory system, the data with lower access frequency does not need to be quickly called, and the energy storage consumption of the all-flash memory is increased when the data is stored in the flash memory device with higher power consumption, so the present embodiment provides the low-energy-consumption all-flash memory system, and further includes a copy migration module for migrating the copy corresponding to the data with lower access frequency to the flash memory device with lower power consumption, so as to reduce the energy storage consumption of the all-flash memory;
the copy migration module is used for presetting a frequency threshold, comparing the frequency threshold with the access frequency, judging whether to migrate the copy corresponding to the data, and migrating the copy to be migrated to the flash memory device with lower power consumption, so that the energy storage consumption of the whole flash memory is reduced;
the method for judging whether to migrate the corresponding copy of the data comprises the following steps:
if the access frequency is greater than or equal to the frequency threshold, the corresponding copy of the data is not migrated, which means that the data is hot data, namely the frequently accessed data is not required to be migrated to a flash memory device with lower power consumption;
if the access frequency is smaller than the frequency threshold value, migrating the corresponding copy of the data, namely the data which is cold data, namely the data which is not frequently accessed, is required to be migrated to a flash memory device with lower power consumption, and the flash memory device only consumes a small amount of energy sources in an idle state because the data is not frequently accessed so as to reduce the energy storage consumption of the whole flash memory;
it should be noted that, the frequency threshold is preset according to experience by a person skilled in the art, and the person skilled in the art obtains multiple groups of access frequencies in the historical working stage of the full flash memory system and sets the frequency threshold according to the multiple groups of access frequencies; the access frequency is greater than or equal to the frequency threshold, namely hot data, and the access frequency is smaller than the frequency threshold, namely cold data;
according to the embodiment, according to the access frequency corresponding to the data, the copy corresponding to the data with lower access frequency is migrated to the flash memory device with lower power consumption, so that the energy storage consumption of the whole flash memory is reduced.
Example 3
Referring to fig. 4, the details of embodiments 1 and 2 are not described in detail in this embodiment, and a low-power-consumption full flash memory method is provided, which includes:
collecting m data in a full flash memory system, and constructing a data set;
identifying the data set to obtain attribute parameters corresponding to m data;
calculating importance values corresponding to the m data, and judging the corresponding importance level;
making a copy strategy according to the importance value and the importance level corresponding to the m data;
and carrying out intelligent management on the copies in the full-flash memory system according to the formulated copy strategy, and deleting the copies which reach the copy retention period.
The method for obtaining the corresponding attribute parameters of the m data comprises the following steps:
s1: formulating a catalog of data sets to be scanned;
s2: creating a function to obtain attribute parameters;
s3: identifying each catalog in the data set and acquiring attribute parameters;
the attribute parameters include access frequency, update frequency, and type.
The calculation method of the importance value corresponding to the m data comprises the following steps:
ZYi＝ω1×ln(FPi+GPi)+ω2×LXi；
wherein ZYi is an importance value, FPi is an access frequency, GPi is an update frequency, LXi is a type value, ω 1 、ω 2 Is of preset weight and omega 1 ＞0、ω 2 And (3) the data with the value of i being greater than 0, wherein i is the ith data, and i is m.
The method for judging the importance level corresponding to the m data comprises the following steps:
presetting a first threshold Th1 and a second threshold Th2, wherein Th1> Th2; sequentially comparing the importance values corresponding to the m data with a first threshold Th1 and a second threshold Th2;
if the importance value corresponding to the data is greater than or equal to a first threshold Th1, marking the data as important data; the importance value corresponding to the data is larger, and the importance of the data is larger;
if the importance value corresponding to the data is smaller than the first threshold Th1 and larger than or equal to the second threshold Th2, marking the data as secondary data;
if the importance value corresponding to the data is smaller than the second threshold Th2, marking the data as general data; the importance value corresponding to the data is smaller, and the importance of the data is smaller.
The method for making the copy policy comprises the following steps:
a: calculating the number of copies corresponding to the m data;
b: analyzing each copy to obtain copy analysis parameters, wherein the copy analysis parameters comprise copy types and copy redundancy levels;
c: and calculating a copy retention period corresponding to each copy, and automatically deleting or retaining the copy according to the copy retention period.
The method for calculating the number of the m data corresponding copies in the step a comprises the following steps:
where FSi is the number of copies, ω 3 Is of preset weight and omega 3 ＞0，A j J is [1,2,3 ] e]，A 1 A is a preset constant corresponding to important data 2 For the preset constant corresponding to the secondary data, A 3 A preset constant corresponding to general data;
and rounding the calculated m data corresponding copy numbers.
The rounding method comprises the following steps:
rounding the calculated number of copies corresponding to the m data by using a floor function;
the floor function is:wherein (1)>Is less than or equal to FS i Max represents the maximum value of the set, Z is the integer set, and P is less than or equal to FS i Is an integer of (a).
The method for calculating the retention period of each copy corresponding to each copy in the step c comprises the following steps:
where BXn is the copy retention period, FLn is the copy type value, FHn is the copy redundancy level value, ω 4 、ω 5 Is of preset weight and omega 4 ＞0、ω 5 FSZ is the total number of copies, n is the nth copy, n ε FSZ.
Presetting a frequency threshold, comparing the frequency threshold with the access frequency, judging whether to migrate the copy corresponding to the data, and migrating the copy to be migrated to a flash memory device with lower power consumption;
the method for judging whether to migrate the corresponding copy of the data comprises the following steps:
if the access frequency is greater than or equal to the frequency threshold, not migrating the corresponding copy of the data;
and if the access frequency is smaller than the frequency threshold value, migrating the corresponding copy of the data.
Example 4
Referring to fig. 5, the disclosure provides an electronic device, which includes a memory, a processor, and a computer program stored in the memory and capable of running on the processor, where the processor implements any one of the low-power-consumption full flash memory methods provided by the above methods when executing the computer program.
Since the electronic device described in this embodiment is an electronic device used to implement the low-power-consumption full-flash memory method in this embodiment, based on the low-power-consumption full-flash memory method described in this embodiment, those skilled in the art can understand the specific implementation of the electronic device and various modifications thereof, so how the method in this embodiment is implemented in this electronic device will not be described in detail herein. Electronic devices used by those skilled in the art to implement the low-power-consumption full flash memory method in the embodiments of the present application are all within the scope of protection intended in the present application.
Example 5
The embodiment discloses a computer readable storage medium, which comprises a memory, a processor and a computer program stored on the memory and capable of running on the processor, wherein the processor realizes the low-energy-consumption full-flash memory method provided by any one of the above methods when executing the computer program.
The above embodiments may be implemented in whole or in part by software, hardware, firmware, or any other combination. When implemented in software, the above-described embodiments may be implemented in whole or in part in the form of a computer program product. The computer program product comprises one or more computer instructions or computer programs. When the computer instructions or computer program are loaded or executed on a computer, the processes or functions described in accordance with embodiments of the present invention are produced in whole or in part. The computer may be a general purpose computer, a special purpose computer, a computer network, or other programmable apparatus. The computer instructions may be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer instructions may be transmitted from one website site, computer, server, or data center to another website site, computer, server, or data center over a wired network or a wireless network. The computer readable storage medium may be any available medium that can be accessed by a computer or a data storage device such as a server, data center, etc. that contains one or more sets of available media. The usable medium may be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium. The semiconductor medium may be a solid state disk.
Those of ordinary skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
It will be clear to those skilled in the art that, for convenience and brevity of description, specific working procedures of the above-described systems, apparatuses and units may refer to corresponding procedures in the foregoing method embodiments, and are not repeated herein.
In the several embodiments provided by the present invention, it should be understood that the disclosed systems, devices, and methods may be implemented in other manners. For example, the apparatus embodiments described above are merely illustrative, e.g., the division of the units is merely one, and there may be additional divisions in actual implementation, e.g., multiple units or components may be combined or integrated into another system, or some features may be omitted, or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed with each other may be an indirect coupling or communication connection via some interfaces, devices or units, which may be in electrical, mechanical or other form.
The units described as separate units may or may not be physically separate, and units shown as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
In addition, each functional unit in the embodiments of the present invention may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit.
The foregoing is merely illustrative of the present invention, and the present invention is not limited thereto, and any person skilled in the art will readily recognize that variations or substitutions are within the scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.
Finally: the foregoing description of the preferred embodiments of the invention is not intended to limit the invention to the precise form disclosed, and any such modifications, equivalents, and alternatives falling within the spirit and principles of the invention are intended to be included within the scope of the invention.
Claims (10)
1. The low-energy-consumption full-flash memory method is characterized by comprising the following steps of:
collecting m data in a full flash memory system, and constructing a data set;
identifying the data set to obtain attribute parameters corresponding to m data;
calculating importance values corresponding to the m data, and judging the corresponding importance level;
making a copy strategy according to the importance value and the importance level corresponding to the m data;
and carrying out intelligent management on the copies in the full-flash memory system according to the formulated copy strategy, and deleting the copies which reach the copy retention period.
2. The low-power-consumption full flash memory method according to claim 1, wherein the method for obtaining the m data corresponding attribute parameters comprises:
s1: formulating a catalog of data sets to be scanned;
s2: creating a function to obtain attribute parameters;
s3: identifying each catalog in the data set and acquiring attribute parameters;
the attribute parameters include access frequency, update frequency, and type.
3. The low-power-consumption full flash memory method according to claim 2, wherein the calculating method of the m data corresponding importance values comprises:
ZYi＝ω1×ln(FPi+GPi)+ω2×LXi；
wherein ZYi is an importance value, FPi is an access frequency, GPi is an update frequency, LXi is a type value, ω 1 、ω 2 Is of preset weight and omega 1 ＞0、ω 2 And (3) the data with the value of i being greater than 0, wherein i is the ith data, and i is m.
4. The low-power-consumption full flash memory method as claimed in claim 3, wherein the method for determining the importance level corresponding to the m data comprises:
presetting a first threshold Th 1 And a second threshold Th 2 Wherein Th is 1 >Th 2 The method comprises the steps of carrying out a first treatment on the surface of the Sequentially associating the importance values corresponding to the m data with a first threshold Th 1 And a second threshold Th 2 Comparing;
if the importance value corresponding to the data is greater than or equal to the first threshold Th 1 Marking the data as important data;
if the importance value corresponding to the data is smaller than the first threshold Th 1 And is greater than or equal to a second threshold Th2, the data is marked as secondary data;
if the importance value corresponding to the data is smaller than the second threshold Th 2 The data is marked as general data.
5. The low-power consumption full flash memory method according to claim 4, wherein the method for making the copy policy comprises:
a: calculating the number of copies corresponding to the m data;
b: analyzing each copy to obtain copy analysis parameters, wherein the copy analysis parameters comprise copy types and copy redundancy levels;
c: and calculating a copy retention period corresponding to each copy, and automatically deleting or retaining the copy according to the copy retention period.
6. The low-power consumption full flash memory method according to claim 5, wherein the calculating method of the number of copies corresponding to the m data in the step a comprises:
where FSi is the number of copies, ω 3 Is of preset weight and omega 3 ＞0，A j J is [1,2,3 ] e]，A 1 A is a preset constant corresponding to important data 2 For the preset constant corresponding to the secondary data, A 3 A preset constant corresponding to general data;
and rounding the calculated m data corresponding copy numbers.
7. The low power consumption full flash memory method of claim 6, wherein the rounding method comprises:
rounding the calculated number of copies corresponding to the m data by using a floor function;
the floor function is:wherein (1)>Is less than or equal to FS i Max represents the maximum value of the set, Z is the integer set, and P is less than or equal to FS i Is an integer of (a).
8. The low-power full flash memory method according to claim 7, wherein the method for calculating the retention period of each copy in step c comprises:
where BXn is the copy retention period, FLn is the copy type value, FHn is the copy redundancy level value, ω 4 、ω 5 Is of preset weight and omega 4 ＞0、ω 5 FSZ is the total number of copies, n is the nth copy, n ε FSZ.
9. The method for storing the low-energy-consumption full flash memory according to claim 8, wherein a frequency threshold is preset, the frequency threshold is compared with an access frequency, whether the copy corresponding to the data is migrated is judged, and the copy to be migrated is migrated to a flash memory device with lower power consumption;
the method for judging whether to migrate the corresponding copy of the data comprises the following steps:
if the access frequency is greater than or equal to the frequency threshold, not migrating the corresponding copy of the data;
and if the access frequency is smaller than the frequency threshold value, migrating the corresponding copy of the data.
10. A low power consumption all-flash memory system implementing the low power consumption all-flash memory method of any one of claims 1-9, comprising:
the data acquisition module acquires m data in the full-flash memory system and constructs a data set;
the data identification module is used for identifying the data set and acquiring attribute parameters corresponding to m data;
the importance judging module is used for calculating importance values corresponding to the m data and judging the corresponding importance level;
the strategy making module makes a copy strategy according to the importance value and the importance level corresponding to the m data;
and the copy management module is used for intelligently managing the copies in the full-flash memory system according to the formulated copy strategy and deleting the copies which reach the copy retention period.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311854643.8A CN117806556A (en) | 2023-12-29 | 2023-12-29 | Low-energy-consumption full flash memory method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311854643.8A CN117806556A (en) | 2023-12-29 | 2023-12-29 | Low-energy-consumption full flash memory method and system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN117806556A true CN117806556A (en) | 2024-04-02 |
Family
ID=90434464
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202311854643.8A Pending CN117806556A (en) | 2023-12-29 | 2023-12-29 | Low-energy-consumption full flash memory method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN117806556A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN118964516A (en) * | 2024-10-17 | 2024-11-15 | 济南高品伟业信息科技有限公司 | A smart campus community data storage method and system |
-
2023
- 2023-12-29 CN CN202311854643.8A patent/CN117806556A/en active Pending
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN118964516A (en) * | 2024-10-17 | 2024-11-15 | 济南高品伟业信息科技有限公司 | A smart campus community data storage method and system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104025054B (en) | Dynamic memory layering in virtual environment | |
| US8914412B2 (en) | Determining file ownership of active and inactive files based on file access history | |
| CN110865992B (en) | A search library management method, search method, device and medium | |
| CN104462389B (en) | Distributed file system implementation method based on classification storage | |
| US20090228669A1 (en) | Storage Device Optimization Using File Characteristics | |
| US11880302B2 (en) | Optimized record placement in defragmenting graph database | |
| US12038967B2 (en) | Optimized record placement in graph database | |
| CN113608670B (en) | Blockchain data storage method based on fairness and access popularity | |
| WO2022257615A1 (en) | Information processing method and apparatus, and storage medium | |
| CN110727406A (en) | Data storage scheduling method and device | |
| US7895247B2 (en) | Tracking space usage in a database | |
| CN117806556A (en) | Low-energy-consumption full flash memory method and system | |
| US20230229580A1 (en) | Dynamic index management for computing storage resources | |
| CN118152378B (en) | Construction method and system of intelligent data center | |
| WO2021056243A1 (en) | Method and device for managing data in partition table, management node, and storage medium | |
| CN110019017B (en) | High-energy physical file storage method based on access characteristics | |
| CN102722450B (en) | Storage method for redundancy deletion block device based on location-sensitive hash | |
| WO2017020735A1 (en) | Data processing method, backup server and storage system | |
| Irie et al. | A novel automated tiered storage architecture for achieving both cost saving and qoe | |
| US20250021148A1 (en) | Powering computing devices of a database system for execution of a database operation in accordance with a power supply strategy | |
| CN114625695A (en) | Data processing method and device | |
| CN109101197A (en) | A kind of file stores and accesses method, apparatus, file memory and system | |
| US9239790B1 (en) | Techniques for evicting cached files | |
| CN115437997A (en) | Intelligent identification optimization system for data life cycle | |
| CN110895520B (en) | File migration method, related device and equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication |