A kind of method and system of server capacity estimation
Technical field
The present invention relates to the volume calculation field, particularly a kind of method and system of server capacity estimation.
Background technology
Along with the expansion of infosystem service application, various application systems are had higher requirement to the digital center of management and storage data.Yet; Along with the continuous development of application system, the data center that has built up, the performance that existing equipment component possibly occur can't satisfy demands of applications; But the assets life cycle does not finish on the one hand; Can't eliminate, if on the other hand existing equipment component is put into the melting pot, the input cost of transformation again can be too high.In this case, if consider to drop into new equipment, the equipment performance configuration that possibly occur newly putting into operation on the one hand is high; Application system server is still underused resource; Cause the wasting of resources, the new equipment energy consumption that the opposing party is put into operation is stable, can not cut down the consumption of energy because of utilization factor is low.
Therefore, how on the basis of legacy data center and application system server, carry out volume calculation, utilize the result of estimation to instruct following resource deployment, most important for the business development of infosystem.Wherein, volume calculation is a vital ring in the whole process.Volume calculation can be avoided the following inadequate resource of disposing and the service disconnection that causes most possibly accurately, can when dropping into new equipment, improve the device resource utilization factor again, disposes with the optimization that realizes global resource.For volume calculation; A kind of method is the server to existing various service applications system, adopts different standards to estimate according to different servers, for example; Estimation OLTP (0n-Line Transaction Processing; OLTP) capacity of database server uses the TPC-C standard usually, and estimation OLAP (0n-Line Analytical Processing, OLAP) capacity of database service uses the TPC-H standard; The capacity of estimation Application Middleware server uses the SPECjbb2005 standard; The capacity of estimation Web server uses the SPECweb99 standard, and (Enterprise Resource Planning, ERP) capacity of server uses the SAPs standard to the estimation Enterprise Resources Plan.
Though these standards provide the basic skills of volume calculation, the standard of appraisal of dissimilar application servers is different, and the general capacity estimation method of neither one is unified estimation to the different server in the various service applications system.And, before the various standards of concrete use are estimated, all need to build strict separately test environment according to the requirement of each standard, can't realize versatility.
In addition, a key factor that influences resource utilization ratio is user's request.Along with the development of business, user's demand possibly change.But before new application system server puts into operation, use various standards to carry out in the process of volume calculation, by standard code fixing user's request value, make estimated capacity and possibly existing between the actual capacity in the future than large deviation.
Summary of the invention
In view of this; The object of the present invention is to provide a kind of method and system of volume calculation; To the server that data of information system center different business is used,, realize general evaluation method to each application system server capacity through the introducing of complexity parameter.
For realizing above-mentioned purpose, the invention provides following scheme:
A kind of method of server capacity estimation comprises step:
The business processing amount of accomplishing in the statistical server unit interval, peak period every day time span;
Calculation server treatment capacity peak period accounts for number percent, the complexity parameter of whole day treatment capacity;
The utilization factor of adjustment server redundancy factor, central processing unit;
The business processing amount of accomplishing in unit interval according to said server, peak period every day, time span, peak treatment capacity accounted for the utilization factor estimation server capacity of number percent, complexity parameter, redundant factor and the central processing unit of whole day treatment capacity.
Preferably, the utilization factor estimation server capacity that the said business processing amount of accomplishing in the unit interval according to said server, peak period every day, time span, peak treatment capacity accounted for number percent, complexity parameter, redundant factor and the central processing unit of whole day treatment capacity comprises:
The business processing amount * peak treatment capacity of accomplishing in the capacity=unit interval of estimation accounts for the redundant factor of number percent * complexity parameter * of the whole day treatment capacity/utilization factor of time span * central processing unit (peak period every day).
Preferably, said computation complexity parameter comprises:
Inquiry obtains the reference performance index of server type;
Carry out the pressure test of server when reaching performance boundary, obtain the performance index under the pressure test;
Calculate the ratio of two performance index, obtain the complexity parameter.
Preferably, said computation complexity parameter comprises:
Obtain the utilization factor of the business processing amount accomplished in the capacity, unit interval of current online application system server, number percent that the peak treatment capacity accounts for the whole day treatment capacity, peak period every day time span, central processing unit, redundant factor,
Complexity parameter according to following formula computing system: the business statistics treatment capacity * peak treatment capacity of accomplishing in capacity=unit interval accounts for the redundant factor of number percent * complexity parameter * of the whole day treatment capacity/utilization factor of time * central processing unit (peak period every day).
Preferably, the said peak period every day time span obtained comprises:
Collect time span peak period every day of preset fate, time span peak period every day of the preset fate that obtained is averaged, obtain time span peak period every day.
A kind of system of server capacity estimation comprises step:
Statistic unit, the business processing amount that is used for accomplishing in the statistical server unit interval, peak period every day time span;
Computing unit is used for number percent, complexity parameter that calculation server treatment capacity peak period accounts for the whole day treatment capacity;
Adjustment unit is used to adjust the utilization factor of redundant factor and central processing unit;
The volume calculation unit; The business processing amount that is used for accomplishing in the unit interval according to the server of said statistic unit output and peak period every day time span; The peak treatment capacity of computing unit output accounts for the number percent and the complexity parameter of whole day treatment capacity, the utilization factor estimation server capacity of the redundant factor of adjustment unit output and central processing unit.
Preferably, said volume calculation unit, concrete following formula calculation server estimated capacity:
The business processing amount * peak treatment capacity of accomplishing in the capacity=unit interval of estimation accounts for the redundant factor of number percent * complexity parameter * of the whole day treatment capacity/utilization factor of time span * central processing unit (peak period every day).
Preferably, said statistic unit further comprises:
Business processing amount statistics subelement is used for the business processing amount of accomplishing in the statistical server unit interval in unit interval;
Peak period, time span statistics subelement was used to add up time span peak period every day;
Preferably, said peak period time span statistics subelement, time span peak period every day that specifically is used to collect preset fate is averaged to time span peak period every day of the preset fate that obtained, obtains time span peak period every day.
Preferably, said computing unit further comprises:
Peak period, treatment capacity percentage calculation subelement was used for the number percent that calculation server treatment capacity peak period accounts for the whole day treatment capacity;
Complexity calculation of parameter subelement is used for the computation complexity parameter;
Preferably, said complexity calculation of parameter subelement specifically is used for:
Inquiry obtains the reference performance index of server type;
Carry out the pressure test of server when reaching performance boundary, obtain the performance index under the pressure test;
Calculate the ratio of two performance index, obtain the complexity parameter.
Preferably, said complexity calculation of parameter subelement specifically is used for:
Obtain the utilization factor of the business processing amount accomplished in the capacity, unit interval of current online application system server, number percent that the peak treatment capacity accounts for the whole day treatment capacity, peak period every day time span, central processing unit, redundant factor;
Complexity parameter according to following formula computing system: the business statistics treatment capacity * peak treatment capacity of accomplishing in capacity=unit interval accounts for the redundant factor of number percent * complexity parameter * of the whole day treatment capacity/utilization factor of time * central processing unit (peak period every day).
According to the specific embodiment that the application provides, the invention discloses following technique effect:
On the basis of existing information system data center and service application, the capacity estimation method that the present invention designed has reflected the important performance standard of industry to various application system server effectively, but concrete evaluation method is not limited to concrete certain standard again.In the volume calculation process,, taken into full account the complicacy of each application system, through the introducing of complexity parameter to the server of different business application; Eliminate the difference of different application systems; Realization has also been avoided having simplified the volume calculation to the different application systems server for using different testing standards to build the different expenses that test environment brought to the general evaluation method of each application system server capacity; Reduce the complicacy of volume calculation, improved estimation efficient.
In addition; In the process of volume calculation,, the user's request under estimation result and the running environment is combined closely owing to the real data of utilizing the current online application system server to provide is estimated; Therefore; Can reduce the error between estimated capacity and the actual capacity,, thereby avoid causing service disconnection most possibly by inadequate resource for the resource deployment of following application system provides foundation more accurately; Can when dropping into new equipment, improve the device resource utilization factor again, dispose with the optimization that realizes global resource.
Description of drawings
In order to be illustrated more clearly in the embodiment of the invention or technical scheme of the prior art; To do to introduce simply to the accompanying drawing of required use among the embodiment below; Obviously, the accompanying drawing in describing below only is some embodiments of the present invention, for those of ordinary skills; Under the prerequisite of not paying creative work, can also obtain other accompanying drawing according to these accompanying drawings.
Fig. 1 is the inventive method schematic flow sheet;
Fig. 2 connects synoptic diagram for system of the present invention.
Embodiment
To combine the accompanying drawing in the embodiment of the invention below, the technical scheme in the embodiment of the invention is carried out clear, intactly description, obviously, described embodiment only is the present invention's part embodiment, rather than whole embodiment.Based on the embodiment among the present invention, the every other embodiment that those of ordinary skills obtained belongs to the scope that the present invention protects.
With reference to shown in Figure 1, the present embodiment capacity estimation method is following:
S101) the business processing amount Task that accomplishes in the statistical server unit interval, peak period every day time span T.
According to the certain applications system, obtain and use the business statistics treatment capacity that system server is accomplished in the unit interval, for example, for the server that OLTP uses, Task is the in-line processing transactions of accomplishing in the unit interval.And the server of using for OLAP, Task is the on-line analysis operation amount of the completion in the unit interval.For Application Middleware server Task is the business operation quantity of accomplishing in the unit interval.When concrete the realization, can be through obtain the business processing amount that server is accomplished in the unit interval in the mode of server deploy monitoring software.
The distribution of different application systems server process affairs is uneven, wherein, the most important thing is that the period is handled on the peak of the portfolio of every day.For example, peak processing time every day concentrates on 4 hours of every day, and 4*60=240 minute, T=240, promptly peak processing time every day concentrates in 240 minutes and accomplishes.The unit of T can be for dividing or second, and it is decided by the application system server of concrete estimation.For example, for the OLTP server, because the unit of Task is tpmC (transaction per minute C), i.e. the in-line processing transactions accomplished of per minute, this moment, corresponding T should get minute as unit of account.And for example, for the Application Middleware server, the unit of Task is bops (business operations per second), the business operation of promptly accomplishing p.s., and this moment, T should get second as unit of account.
When concrete the realization; For making that peak period every day, time span reflected actual usage trend more truly; Can collect time span peak period every day that preestablishes fate; Time span peak period every day to collected many days is averaged, and obtains time span peak period every day.
S102) calculation server treatment capacity peak period accounts for number percent Per, the complexity parameter S of whole day treatment capacity.
For various application system server, the distribution of the time of its processing transactions is not uniform usually.For example; In most application systems, the treatment capacity in working hour possibly be far longer than the treatment capacity of inoperative period, considers this factor; Adding treatment capacity peak period accounts for the number percent of all treatment capacities in volume calculation, can embody the uneven distribution property of server handling ability.For example, 80% treatment capacity concentrated in peak period in the unit interval, then Per=80%.
The complexity parameter S is the complexity that the processing operation during practical business is used is operated with respect to the processing in the standard testing environment.S value for all kinds application system server can have following two kinds evaluation method:
A kind of method is to calculate S according to the typical transaction of types of applications system server;
Industry all has one by vendors ship or by third-party institution's test with credible qualification or the reference performance index of calculating for each business computer server at present, therefore can obtain the reference performance index of server type through inquiry.To certain concrete application system; Build a test environment near the actual services application system; Application system server under this test environment is carried out pressure test, makes this server reach performance boundary, obtain under this pressure test with inquiry gained similar performance index.For example, the performance index of being told are the operation amount of accomplishing in the unit interval.
The server reference performance index that inquiry obtains is compared with the similar performance index that obtain through pressure test, promptly can be obtained the complexity parameter of this business application system server.Model and the reality measured are identical more, and the result's of measurement deviation property is just more little, and is just bigger to estimation result's reference significance.As: use certain OLTP application server, the performance index that obtain this server through inquiry are 1000t pmC.This server is carried out the OLTP pressure test, and the result who obtains is that per minute is accomplished 100 transaction.The complexity parameter of this application server is 10 so.
Second method is to calculate S according to the resource operating position of existing application system;
In the online all kinds of business application systems of enterprises; Resource operating position through sample collection current online application system server; Volume calculation when the anti-S value of extrapolating in the substitution volume calculation formula, this S value are used for following new application system server and reach the standard grade as the complexity parameter of such application system server.
As: the processing power of the database server of certain service application is 10000t pmC, and current C PU utilization rate is 30%, and the transaction of handling number of deals 20000,80% every day concentrates in 2 hours and takes place, and the redundant factor of business system server is 1, then
S=Capacity*(T?*C)/(Task*Per*F)=10000*(120*30%)/(20000*80%*1)=22.5
The complexity parameter that can tentatively judge this service application is 22.5.
For making this complexity parameter according to representativeness, can select the server of a plurality of these business application systems respectively, calculate the S value respectively, all S value result of calculation to be averaged, this mean value is as the complexity parameter of such application system server.
Through the introducing of complexity parameter S, eliminate the difference of different application systems server in the volume calculation process, realize general evaluation method each application system server capacity.Because handling the complexity and the operation of the processing in the standard testing of operation, real application systems has bigger difference, the accuracy of the direct shadow volume calculation of complexity veracity of parameters.Through sample collection current resource operating position; Obtain current actual treatment ability; The approaching S value of anti-release in the substitution appraising model; Make the complex parameters S maximum possible calculate embodiment actual user's request, the capacity that estimates also provides data more accurately more near system's true capacity for the resource deployment of instructing following application system.
S103) the utilization factor C of adjustment server redundancy factor F, central processing unit.
Usually in the factor that the business that need look to the future when system server carries out volume calculation need increase to using, the rising of number of users, the raising of performance etc. can not accurately be foreseen; If do not consider the increase of this fractional load, may cause server to be reached the standard grade soon because of the too high dilatation once more that needs of loading.Therefore need be when volume calculation, to the business application system server certain amount of redundancy of business development reservation in following one period.Suppose that when the processing power in following 3 years of estimation business system server, the processing power that need reserve 1 times is redundant, then F=2.
Generally, when the cpu busy percentage of a station server is higher than 80%, show that then the utilization factor of CPU is too high, be prone to produce the bottleneck of operation system this moment.In addition; Consider a part of system resource that is consumed when carrying out system management; As when carrying out data backup, data recovery, failure problems diagnosis, performance evaluation and software maintenance, all bringing extra consumption to the CUP resource of using system server; Therefore, when estimation server cpu busy percentage, tackle this part operation and keep certain resource.For example set C=70%, promptly utilization factor is at 70% o'clock, and the operation system of being estimated is in the utilization factor optimum condition.
S104) utilize the business processing amount Task that accomplishes in the server unit interval, peak period every day time span T, peak treatment capacity to account for the utilization factor C estimation server capacity of number percent Per, complexity parameter S, redundant factor F and the central processing unit of whole day treatment capacity.
A kind of concrete evaluation method is: Capacity=Task*Per*S*F/ (T*C)
This capacity estimation method has reflected all kinds of performance standards of industry to various application system server effectively; Can be in estimation process to the server of different business application; Taken into full account the complexity of each application system; Through the introducing of complexity parameter, eliminate the difference of different application systems, realize general evaluation method to each application system server capacity.
In the process of volume calculation,, the user's request under estimation result and the running environment is combined closely owing to the real data of utilizing the current online application system to provide is estimated; Therefore; Can reduce the error between estimated capacity and the actual capacity,, thereby avoid causing service disconnection most possibly by inadequate resource for the resource deployment of following application system provides foundation more accurately; Can when dropping into new equipment, improve the device resource utilization factor again, dispose with the optimization that realizes global resource.
Certainly, in practical application, except this method; Also can adopt other modes to realize; For example, behind the capacity that once estimates application server, can repeatedly estimate; Method to all estimation results averaged obtains final volume calculation result, enumerates no longer one by one here.
With reference to shown in Figure 2, this figure is the pairing system of an embodiment of the invention connection layout.
Statistic unit 201, the business processing amount that is used for accomplishing in the statistical server unit interval, peak period every day time span.Computing unit 202 is used for number percent, complexity parameter that calculation server treatment capacity peak period accounts for the whole day treatment capacity.Adjustment unit 203 is used to adjust the utilization factor of redundant factor and central processing unit.Volume calculation unit 204; The business processing amount that is used for accomplishing in the unit interval according to the server of said statistic unit output and peak period every day time span; The peak treatment capacity of computing unit output accounts for the number percent and the complexity parameter of whole day treatment capacity, the utilization factor estimation server capacity of the redundant factor of adjustment unit output and central processing unit.
The volume calculation unit, can be according to the estimated capacity of following formula calculation server: the business processing amount * peak treatment capacity of accomplishing in the capacity=unit interval of estimation accounts for the redundant factor of number percent * complexity parameter * of the whole day treatment capacity/utilization factor of time span * central processing unit (peak period every day).
Statistic unit further can by business processing amount statistics subelement in the unit interval with peak period time span add up subelement and form.Business processing amount statistics subelement is responsible for the business processing amount of accomplishing in the statistical server unit interval in unit interval.Peak period, time span statistics subelement was responsible for statistics time span peak period every day.During concrete the realization, time span peak period every day that peak period, time span statistics subelement can be collected preset fate is averaged to time span peak period every day of the preset fate that obtained, obtains time span peak period every day.
Computing unit further comprises can comprise treatment capacity percentage calculation subelement and complexity calculation of parameter subelement peak period.Peak period, treatment capacity percentage calculation subelement was used for the number percent that server treatment capacity peak period accounts for the whole day treatment capacity.Complexity calculation of parameter subelement is used for the number percent that calculation server treatment capacity peak period accounts for the whole day treatment capacity.
Complexity calculation of parameter subelement can have multiple implementation.
A kind of method is that inquiry obtains the reference performance index of server type; Carry out the pressure test of server when reaching performance boundary, obtain the performance index under the pressure test; Calculate the ratio of two performance index, obtain the complexity parameter.
Another kind method is to obtain the utilization factor of the business processing amount accomplished in the capacity of current online application system server, unit interval, number percent that the peak treatment capacity accounts for the whole day treatment capacity, peak period every day time span, central processing unit; Redundant factor, according to the complexity parameter of following formula computing system: the business statistics treatment capacity * peak treatment capacity of accomplishing in capacity=unit interval accounts for the redundant factor of number percent * complexity parameter * of the whole day treatment capacity/utilization factor of time * central processing unit (peak period every day).
More than to method, the system of a kind of volume calculation provided by the present invention; Carried out detailed introduction; Used concrete example among this paper principle of the present invention and embodiment are set forth, the explanation of above embodiment just is used for helping to understand method of the present invention and core concept thereof; Simultaneously, for one of ordinary skill in the art, according to thought of the present invention, part all can change on embodiment and range of application.In sum, this description should not be construed as limitation of the present invention.