CN103778474A - Resource load capacity prediction method, analysis prediction system and service operation monitoring system - Google Patents
Resource load capacity prediction method, analysis prediction system and service operation monitoring system Download PDFInfo
- Publication number
- CN103778474A CN103778474A CN201210397865.7A CN201210397865A CN103778474A CN 103778474 A CN103778474 A CN 103778474A CN 201210397865 A CN201210397865 A CN 201210397865A CN 103778474 A CN103778474 A CN 103778474A
- Authority
- CN
- China
- Prior art keywords
- historical data
- data sequence
- resource load
- load amount
- business factor
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012544 monitoring process Methods 0.000 title claims abstract description 167
- 238000000034 method Methods 0.000 title claims abstract description 71
- 238000004458 analytical method Methods 0.000 title abstract description 61
- 238000005314 correlation function Methods 0.000 claims abstract description 65
- 230000006870 function Effects 0.000 claims description 55
- 238000012545 processing Methods 0.000 claims description 29
- 238000004422 calculation algorithm Methods 0.000 claims description 9
- 230000008531 maintenance mechanism Effects 0.000 abstract description 6
- 238000007726 management method Methods 0.000 description 58
- 238000009499 grossing Methods 0.000 description 26
- 230000002354 daily effect Effects 0.000 description 24
- 238000010586 diagram Methods 0.000 description 14
- 238000004364 calculation method Methods 0.000 description 13
- 238000007781 pre-processing Methods 0.000 description 11
- 230000008569 process Effects 0.000 description 10
- 238000012886 linear function Methods 0.000 description 7
- 230000009471 action Effects 0.000 description 4
- 230000001186 cumulative effect Effects 0.000 description 4
- 238000013277 forecasting method Methods 0.000 description 4
- 238000013508 migration Methods 0.000 description 4
- 230000005012 migration Effects 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 3
- 230000002159 abnormal effect Effects 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 238000007405 data analysis Methods 0.000 description 2
- 238000013507 mapping Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000003068 static effect Effects 0.000 description 2
- NAWXUBYGYWOOIX-SFHVURJKSA-N (2s)-2-[[4-[2-(2,4-diaminoquinazolin-6-yl)ethyl]benzoyl]amino]-4-methylidenepentanedioic acid Chemical compound C1=CC2=NC(N)=NC(N)=C2C=C1CCC1=CC=C(C(=O)N[C@@H](CC(=C)C(O)=O)C(O)=O)C=C1 NAWXUBYGYWOOIX-SFHVURJKSA-N 0.000 description 1
- 230000005856 abnormality Effects 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000005315 distribution function Methods 0.000 description 1
- 230000003203 everyday effect Effects 0.000 description 1
- 238000013178 mathematical model Methods 0.000 description 1
- 239000011159 matrix material Substances 0.000 description 1
- 230000035772 mutation Effects 0.000 description 1
- 238000003672 processing method Methods 0.000 description 1
- 238000005316 response function Methods 0.000 description 1
- 239000013589 supplement Substances 0.000 description 1
- 230000001502 supplementing effect Effects 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
- 230000002618 waking effect Effects 0.000 description 1
Images
Landscapes
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
本发明提供一种资源负载量预测方法、分析预测系统及业务运营监控系统。其中所述方法包括:分别获取业务要素历史数据序列和资源负载量历史数据序列;根据所述业务要素历史数据序列,生成预期业务要素;根据所述业务要素历史数据序列和资源负载量历史数据序列,建立业务要素与资源负载量的关联函数;根据所述关联函数,生成所述预期业务要素对应的预期资源负载量。本发明实施例充分考虑了不同用户的应用部署需求以及各应用的负载均衡特性,为不同用户部署相应的资源,根据不同应用的负载均衡特性准确的预测出不同应用未来所需的资源负载量,提高了云计算平台的资源部署和维护机制,有助于提高云计算系统的基础设施资源的利用率。
The invention provides a resource load prediction method, an analysis and prediction system, and a business operation monitoring system. Wherein the method includes: respectively obtaining the historical data sequence of business elements and the historical data sequence of resource load; generating the expected business element according to the historical data sequence of business elements; , establishing a correlation function between the business element and the resource load; and generating the expected resource load corresponding to the expected business element according to the correlation function. The embodiment of the present invention fully considers the application deployment requirements of different users and the load balancing characteristics of each application, deploys corresponding resources for different users, and accurately predicts the resource load required by different applications in the future according to the load balancing characteristics of different applications. The resource deployment and maintenance mechanism of the cloud computing platform is improved, which helps to improve the utilization rate of the infrastructure resources of the cloud computing system.
Description
技术领域 technical field
本发明涉及通信技术及网络技术,尤其涉及一种资源负载量预测方法、分析预测系统及业务运营监控系统。The present invention relates to communication technology and network technology, in particular to a method for predicting resource load, an analysis and prediction system, and a business operation monitoring system.
背景技术 Background technique
随着云技术的成熟,云计算业界趋向于针对基础资源的负载量(如虚拟机的CPU利用率与内存资源量)进行分析及预测,出现了如图1所示的云计算系统架构。如图1所示,该云计算系统架构包括:服务管理系统、基础资源管理系统和分析预测系统。其中,服务管理系统主要实现SLA(Service-LevelAgreement,服务等级协议)管理、服务目录管理、计费管理、客户管理等功能。基础资源管理系统主要实现资源监测、资源控制、资源动态配置、资源动态迁移等功能。分析预测系统主要实现数据分析、趋势分析、预测告警等功能。数据分析功能主要是对采集的基础资源负载量进行预处理;趋势分析功能主要针对分析后的基础资源负载量,依据特定的预测模型和预测算法,预测未来某个时间基础资源负载量的变化趋势;预测告警功能主要针对趋势预测的异常状态资源数据,以网络通信的方式发送到服务管理系统,由服务管理系统以短信或邮件的形式告知各个用户。With the maturity of cloud technology, the cloud computing industry tends to analyze and predict the load of basic resources (such as the CPU utilization rate of virtual machines and the amount of memory resources), and the cloud computing system architecture shown in Figure 1 appears. As shown in Figure 1, the cloud computing system architecture includes: a service management system, a basic resource management system, and an analysis and prediction system. Among them, the service management system mainly implements functions such as SLA (Service-Level Agreement, Service Level Agreement) management, service catalog management, billing management, and customer management. The basic resource management system mainly realizes functions such as resource monitoring, resource control, resource dynamic allocation, and resource dynamic migration. The analysis and prediction system mainly realizes the functions of data analysis, trend analysis, forecast and alarm. The data analysis function is mainly to preprocess the collected basic resource load; the trend analysis function is mainly aimed at the analyzed basic resource load, and predicts the change trend of the basic resource load at a certain time in the future according to a specific prediction model and prediction algorithm ; The prediction and alarm function is mainly aimed at the abnormal state resource data of trend prediction, which is sent to the service management system through network communication, and the service management system notifies each user in the form of SMS or email.
现有技术中,所述分析预测系统单一的根据所述基础资源管理系统监测到的资源负载量作为历史数据,对未来资源负载量的预测,未考虑云计算平台中各应用的负载特性等其他外界因素对资源负载量的影响,预测准确度低。In the prior art, the analysis and prediction system only uses the resource load monitored by the basic resource management system as historical data, and predicts the future resource load without considering other aspects such as the load characteristics of each application in the cloud computing platform. The impact of external factors on the resource load, the prediction accuracy is low.
发明内容 Contents of the invention
本发明的多个方面提供一种资源负载量预测方法、分析预测系统及业务运营监控系统,用以提高预测的准确度。Aspects of the present invention provide a resource load forecasting method, an analysis and forecasting system, and a business operation monitoring system, so as to improve the accuracy of forecasting.
本发明的第一个方面,提供一种资源负载量预测方法,包括:A first aspect of the present invention provides a resource load prediction method, including:
分别获取业务要素历史数据序列和资源负载量历史数据序列,其中,所述业务要素历史数据序列中各业务要素信息携带的监测时间分别与所述资源负载量历史数据序列中各资源负载量信息携带的监测时间相同,所述业务要素信息为业务运营监控系统将监测到的业务要素及监测时间一同存储至数据库中的信息,所述资源负载量信息为资源管理系统将监测到的资源负载量及监测时间一同存储至所述数据库中的信息;Respectively obtain the historical data sequence of business elements and the historical data sequence of resource load, wherein the monitoring time carried by each business element information in the historical data sequence of business elements is respectively the same as that carried by the information of each resource load in the historical data sequence of resource load The monitoring time is the same, the business element information is the information that the business operation monitoring system stores the monitored business elements and monitoring time together in the database, and the resource load information is the resource load and the resource load that the resource management system will monitor. The information stored in the database together with the monitoring time;
根据所述业务要素历史数据序列,生成预期业务要素;generating expected business elements according to the historical data sequence of the business elements;
根据所述业务要素历史数据序列和资源负载量历史数据序列,建立业务要素与资源负载量的关联函数;Establishing a correlation function between business elements and resource loads according to the historical data sequence of the business elements and the historical data sequence of the resource load;
根据所述关联函数,生成所述预期业务要素对应的预期资源负载量。According to the association function, an expected resource load corresponding to the expected business element is generated.
如上所述的资源负载量预测方法,其中,所述分别获取业务要素历史数据序列和资源负载量历史数据序列之前,还包括:The method for predicting resource load as described above, wherein, before acquiring the historical data sequence of business elements and the historical data sequence of resource load respectively, further includes:
获取业务要素信息;Obtain business element information;
判断所述业务要素信息携带的监测时间是否在预设奇异日时段内,若是,则将所述业务要素信息存入业务要素奇异日历史数据序列,否则,将所述业务要素信息存入业务要素正常日历史数据序列;Judging whether the monitoring time carried by the business element information is within the preset singular day period, if so, storing the business element information into the business element singular day historical data sequence, otherwise, storing the business element information into the business element Normal daily historical data series;
获取资源负载量信息;Obtain resource load information;
判断所述资源负载量信息携带的监测时间是否在预设奇异日时段内,若是,则将所述资源负载量信息存入资源负载量奇异日历史数据序列,否则,将所述资源负载量信息存入资源负载量正常日历史数据序列;Judging whether the monitoring time carried by the resource load information is within the preset singular day period, if so, storing the resource load information into the resource load singular daily historical data sequence, otherwise, storing the resource load information Store the normal daily historical data sequence of resource load;
相应地,所述分别获取业务要素历史数据序列和资源负载量历史数据序列中,所述业务要素历史数据序列为业务要素奇异日历史数据序列,所述资源负载量历史数据序列为资源负载量奇异日历史数据序列,或者所述业务要素历史数据序列为业务要素正常日历史数据序列,所述资源负载量历史数据序列为资源负载量正常日历史数据序列。Correspondingly, in the respectively acquiring the historical data sequence of the business element and the historical data sequence of the resource load, the historical data sequence of the business element is the singular day historical data sequence of the business element, and the historical data sequence of the resource load is the singular daily data sequence of the resource load. The daily historical data sequence, or the historical data sequence of the business element is a normal daily historical data sequence of the business element, and the historical data sequence of the resource load is a normal daily historical data sequence of the resource load.
如上所述的资源负载量预测方法,其中,所述分别获取业务要素历史数据序列和资源负载量历史数据序列之后,还包括:The method for predicting resource load as described above, wherein, after acquiring the historical data sequence of business elements and the historical data sequence of resource load respectively, further includes:
分别对所述业务要素历史数据序列和资源负载量历史数据序列进行数据预处理。Perform data preprocessing on the historical data sequence of the business element and the historical data sequence of the resource load respectively.
如上所述的资源负载量预测方法,其中,所述根据所述关联函数,计算所述预期业务要素对应的所述预期资源负载量之后,还包括:The method for predicting resource load as described above, wherein, after calculating the expected resource load corresponding to the expected service element according to the correlation function, it further includes:
将所述预期资源负载量存储至数据库中,以使所述服务管理系统从所述数据库中读取所述预期资源负载量,并根据所述预期资源负载量生成资源部署指令,所述资源管理系统根据所述资源部署指令执行资源部署。storing the expected resource load in a database, so that the service management system reads the expected resource load from the database, and generates a resource deployment instruction according to the expected resource load, the resource management system The system executes resource deployment according to the resource deployment instruction.
如上所述的资源负载量预测方法,其中,所述根据所述业务要素历史数据序列,生成预期业务要素,包括:The method for predicting resource load as described above, wherein the generating expected business elements according to the historical data sequence of the business elements includes:
根据所述业务要素历史数据序列,得出至少两种预测模型的预测误差;Obtaining prediction errors of at least two prediction models according to the historical data sequence of the business elements;
根据所述业务要素历史数据序列,采用所述预测误差最小的预测模型计算预期业务要素。According to the historical data sequence of the business elements, the expected business elements are calculated by using the prediction model with the smallest prediction error.
如上所述的资源负载量预测方法,其中,所述根据所述业务要素历史数据序列和资源负载量历史数据序列,建立业务要素与资源负载量的关联函数,包括:The method for predicting resource loads as described above, wherein said establishment of a correlation function between business elements and resource loads according to the historical data sequence of business elements and the historical data sequence of resource loads includes:
根据所述业务要素历史数据序列和资源负载量历史数据序列,采用至少两个函数模型进行所述业务要素和资源负载量的函数拟合处理,生成至少两个候选关联函数;According to the historical data sequence of the business element and the historical data sequence of the resource load, at least two function models are used to perform function fitting processing of the business element and the resource load, and at least two candidate correlation functions are generated;
根据所述业务要素历史数据序列和资源负载量历史数据序列,按照预设的最小二乘计算算法计算采用各候选关联函数的拟合残差;According to the historical data sequence of the business element and the historical data sequence of the resource load, calculate the fitting residual using each candidate correlation function according to the preset least square calculation algorithm;
比较各候选关联函数的拟合残差,将拟合残差最小的候选关联函数作为所述业务要素与资源负载量的关联函数。The fitting residuals of the candidate correlation functions are compared, and the candidate correlation function with the smallest fitting residual is used as the correlation function between the business element and the resource load.
本发明的第二个方面,提供一种资源负载量预测方法,包括:A second aspect of the present invention provides a resource load prediction method, including:
监测业务要素;monitoring business elements;
将监控到的所述业务要素及监测时间存储至数据库中,以使分析预测系统从所述数据库中获取业务要素历史数据序列,根据所述业务要素历史数据序列,生成预期业务要素,根据所述业务要素历史数据序列和资源负载量历史数据序列,建立业务要素与资源负载量的关联函数,根据所述关联函数,生成所述预期业务要素对应的预期资源负载量;Store the monitored business elements and monitoring time in the database, so that the analysis and prediction system can obtain the historical data series of business elements from the database, generate expected business elements according to the historical data series of business elements, and generate expected business elements according to the The historical data sequence of the business element and the historical data sequence of the resource load, establishing a correlation function between the business element and the resource load, and generating the expected resource load corresponding to the expected business element according to the correlation function;
其中,所述业务要素历史数据序列中各业务要素信息携带的监测时间分别与所述资源负载量历史数据序列中各资源负载量信息携带的监测时间相同,所述资源负载量历史数据序列由所述分析预测系统从所述数据库中获取,所述资源负载量信息为资源管理系统将监测到的资源负载量及监测时间一同存储至所述数据库中的信息。Wherein, the monitoring time carried by each business element information in the business element historical data sequence is the same as the monitoring time carried by each resource load information in the resource load historical data sequence, and the resource load historical data sequence is determined by the The analysis and prediction system obtains from the database, and the resource load information is information that the resource management system stores in the database together with the monitored resource load and monitoring time.
如上所述的资源负载量预测方法,所述监测业务要素之前,还包括:According to the method for predicting resource load as described above, before the monitoring of business elements, it also includes:
接收服务管理系统发送的监测指令信息,所述监测指令信息携带有欲监测业务要素;相应地Receive monitoring instruction information sent by the service management system, the monitoring instruction information carries business elements to be monitored; correspondingly
所述监测业务要素,具体为:The monitoring business elements are specifically:
根据所述监测指令信息,监测业务要素。The business element is monitored according to the monitoring instruction information.
本发明的第三个方面,提供一种分析预测系统,包括:A third aspect of the present invention provides an analysis and prediction system, including:
第一获取模块,用于分别获取业务要素历史数据序列和资源负载量历史数据序列,其中,所述业务要素历史数据序列中各业务要素信息携带的监测时间分别与所述资源负载量历史数据序列中各资源负载量信息携带的监测时间相同,所述业务要素信息为业务运营监控系统将监测到的业务要素及监测时间一同存储至数据库中的信息,所述资源负载量信息为资源管理系统将监测到的资源负载量及监测时间一同存储至所述数据库中的信息;The first acquisition module is used to obtain the historical data sequence of business elements and the historical data sequence of resource load respectively, wherein the monitoring time carried by each business element information in the historical data sequence of business elements is respectively the same as the historical data sequence of resource load The monitoring time carried by each resource load information is the same. The business element information is the information that the business operation monitoring system stores the monitored business elements and monitoring time together in the database. The resource load information is the resource management system. Information stored in the database together with the monitored resource load and monitoring time;
第一处理模块,用于根据所述业务要素历史数据序列,生成预期业务要素;A first processing module, configured to generate expected business elements according to the historical data sequence of the business elements;
建立模块,用于根据所述业务要素历史数据序列和资源负载量历史数据序列,建立业务要素与资源负载量的关联函数;Establishing a module for establishing a correlation function between business elements and resource loads according to the historical data sequence of the business elements and the historical data sequence of the resource load;
第二处理模块,用于根据所述关联函数,生成所述预期业务要素对应的预期资源负载量。The second processing module is configured to generate an expected resource load corresponding to the expected business element according to the association function.
如上所述的分析预测系统,还包括:The analysis and prediction system described above also includes:
第二获取模块,用于获取业务要素信息;The second obtaining module is used to obtain business element information;
判断模块,用于判断所述业务要素信息携带的监测时间是否在预设奇异日时段内,若是,生成第一判断信息,否则,生成第二判断信息;A judging module, configured to judge whether the monitoring time carried by the business element information is within the preset singular day period, if so, generate first judgment information, otherwise, generate second judgment information;
执行模块,用于根据所述第一判断信息,将所述业务要素信息存入业务要素奇异日历史数据序列;根据所述第二判断信息,将所述业务要素信息存入业务要素正常日历史数据序列;The execution module is used to store the business element information into the business element singular day history data sequence according to the first judgment information; according to the second judgment information, store the business element information into the business element normal day history data sequence;
所述第二获取模块,还用于获取资源负载量信息;The second obtaining module is also used to obtain resource load information;
所述判断模块,还用于判断所述资源负载量信息携带的监测时间是否在预设奇异日时段内,若是,生成第三判断信息,否则,生成第四判断信息;The judging module is also used to judge whether the monitoring time carried by the resource load information is within the preset singular day period, if so, generate third judging information, otherwise, generate fourth judging information;
所述执行模块,还用于根据所述第三判断信息,将所述资源负载量信息存入资源负载量奇异日历史数据序列;根据所述第二判断信息,将所述资源负载量信息存入资源负载量正常日历史数据序列;The execution module is further configured to store the resource load information in the resource load singular daily historical data sequence according to the third judgment information; and store the resource load information in the resource load data sequence according to the second judgment information. Enter the normal daily historical data sequence of resource load;
相应地,所述第一获取单元获取的所述业务要素历史数据序列为业务要素奇异日历史数据序列,所述资源负载量历史数据序列为资源负载量奇异日历史数据序列,或者,所述第一获取单元获取的所述业务要素历史数据序列为业务要素正常日历史数据序列,所述资源负载量历史数据序列为资源负载量正常日历史数据序列。Correspondingly, the historical data sequence of business elements acquired by the first acquisition unit is a historical data sequence of singular days of business elements, and the historical data sequence of resource loads is a historical data sequence of singular days of resource loads, or, the first The historical data sequence of business elements acquired by an acquisition unit is a normal day historical data sequence of business elements, and the historical data sequence of resource load is a normal daily historical data sequence of resource load.
如上所述的分析预测系统,还包括:The analysis and prediction system described above also includes:
数据预处理模块,用于分别对所述业务要素的历史数据和所述资源负载量的历史数据进行数据预处理。A data preprocessing module, configured to perform data preprocessing on the historical data of the business element and the historical data of the resource load respectively.
如上所述的分析预测系统,还包括:The analysis and prediction system described above also includes:
存储模块,用于将所述预期资源负载量存储至数据库中,以使所述服务管理系统从所述数据库中读取所述预期资源负载量,并根据所述预期资源负载量生成资源部署指令,所述资源管理系统根据所述资源部署指令执行资源部署。A storage module, configured to store the expected resource load in a database, so that the service management system reads the expected resource load from the database, and generates a resource deployment instruction according to the expected resource load , the resource management system executes resource deployment according to the resource deployment instruction.
如上所述的分析预测系统,所述第一处理模块,包括:The analysis and prediction system as described above, the first processing module includes:
第一处理单元,用于根据所述业务要素历史数据序列,得出至少两种预测模型的预测误差;A first processing unit, configured to obtain forecast errors of at least two forecast models according to the historical data sequence of the business elements;
第二处理单元,用于根据所述业务要素历史数据序列,采用所述预测误差最小的预测模型计算预期业务要素。The second processing unit is configured to calculate an expected business element by using the prediction model with the smallest prediction error according to the historical data sequence of the business element.
如上所述的分析预测系统,所述建立模块包括:As described above in the analysis and prediction system, the building module includes:
拟合单元,用于根据所述业务要素历史数据序列和资源负载量历史数据序列,采用至少两个函数模型进行所述业务要素和资源负载量的函数拟合处理,生成至少两个候选关联函数;A fitting unit, configured to use at least two function models to perform function fitting processing of the business elements and resource loads according to the historical data sequence of the business elements and the historical data sequence of the resource load, and generate at least two candidate correlation functions ;
第三处理单元,用于根据所述业务要素历史数据序列和资源负载量历史数据序列,按照预设的最小二乘计算算法计算采用各候选关联函数的拟合残差;The third processing unit is used to calculate the fitting residual using each candidate correlation function according to the preset least square calculation algorithm according to the historical data sequence of the business element and the historical data sequence of the resource load;
比较单元,用于比较各候选关联函数的拟合残差,将拟合残差最小的候选关联函数作为所述业务要素与资源负载量的关联函数。The comparison unit is configured to compare the fitting residuals of each candidate correlation function, and use the candidate correlation function with the smallest fitting residual as the correlation function between the business element and the resource load.
本发明的第四个方面,提供一种业务运营监控系统,包括:A fourth aspect of the present invention provides a business operation monitoring system, including:
监测模块,用于监测业务要素;A monitoring module for monitoring business elements;
存储模块,用于将监控到的所述业务要素及监测时间存储至数据库中,以使分析预测系统从所述数据库中获取业务要素历史数据序列,根据所述业务要素历史数据序列,生成预期业务要素,根据所述业务要素历史数据序列和资源负载量历史数据序列,建立业务要素与资源负载量的关联函数,根据所述关联函数,生成所述预期业务要素对应的预期资源负载量;A storage module, configured to store the monitored business elements and monitoring time in a database, so that the analysis and forecasting system can obtain the historical data sequence of business elements from the database, and generate expected business elements according to the historical data sequence of business elements An element, establishing a correlation function between a business element and a resource load according to the historical data sequence of the business element and the historical data sequence of the resource load, and generating an expected resource load corresponding to the expected business element according to the correlation function;
其中,所述业务要素历史数据序列中各业务要素信息携带的监测时间分别与所述资源负载量历史数据序列中各资源负载量信息携带的监测时间相同,所述资源负载量历史数据序列由所述分析预测系统从所述数据库中获取,所述资源负载量信息为资源管理系统将监测到的资源负载量及监测时间一同存储至所述数据库中的信息。Wherein, the monitoring time carried by each business element information in the business element historical data sequence is the same as the monitoring time carried by each resource load information in the resource load historical data sequence, and the resource load historical data sequence is determined by the The analysis and prediction system obtains from the database, and the resource load information is information that the resource management system stores in the database together with the monitored resource load and monitoring time.
如上所述的业务运营监控系统,还包括:The above-mentioned business operation monitoring system also includes:
接收模块,用于接收服务管理系统发送的监测指令信息,所述监测指令信息携带有欲监测业务要素,相应地The receiving module is used to receive the monitoring instruction information sent by the service management system, the monitoring instruction information carries the business elements to be monitored, and correspondingly
所述监测模块具体用于,根据所述监测指令信息,监测业务要素。The monitoring module is specifically configured to monitor business elements according to the monitoring instruction information.
本发明的第五个方面,提供一种云计算系统架构,包括:服务管理系统、数据库、资源管理系统、上述的分析预测系统,以及上述的业务运营监控系统。A fifth aspect of the present invention provides a cloud computing system architecture, including: a service management system, a database, a resource management system, the above-mentioned analysis and prediction system, and the above-mentioned business operation monitoring system.
由上述技术方案可知,本发明实施例通过在预测方法中引入业务要素作为影响因素,通过拟合业务要素与资源负载量间的关联函数,实现了对该应用的资源负载量未来状态的准确预测。本发明实施例充分考虑了不同用户的应用部署需求以及各应用的负载均衡特性,为不同用户部署相应的资源,根据不同应用的负载均衡特性准确的预测出不同应用未来所需的资源负载量,提高了云计算平台的资源部署和维护机制,有助于提高云计算系统的基础设施资源的利用率。It can be seen from the above technical solution that the embodiment of the present invention realizes accurate prediction of the future state of the resource load of the application by introducing business elements as influencing factors in the prediction method and by fitting the correlation function between the business elements and the resource load . The embodiment of the present invention fully considers the application deployment requirements of different users and the load balancing characteristics of each application, deploys corresponding resources for different users, and accurately predicts the resource load required by different applications in the future according to the load balancing characteristics of different applications. The resource deployment and maintenance mechanism of the cloud computing platform is improved, which helps to improve the utilization rate of the infrastructure resources of the cloud computing system.
附图说明 Description of drawings
为了更清楚地说明本发明实施例或现有技术中的技术方案,下面将对实施例或现有技术描述中所需要使用的附图作一简单地介绍,显而易见地,下面描述中的附图是本发明的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动性的前提下,还可以根据这些附图获得其他的附图。In order to more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description These are some embodiments of the present invention. For those skilled in the art, other drawings can also be obtained according to these drawings without any creative effort.
图1为现有技术云计算系统架构的结构示意图;FIG. 1 is a schematic structural diagram of a cloud computing system architecture in the prior art;
图2为本发明提供的负载量预测方法实施例一的流程图;FIG. 2 is a flow chart of Embodiment 1 of the load prediction method provided by the present invention;
图3为本发明提供的负载量预测方法实施例二的流程图;FIG. 3 is a flow chart of
图4为本发明提供的负载量预测方法实施例三的流程图;FIG. 4 is a flow chart of
图5为GPS应用的业务要素历史数据序列的一具体实例的曲线示意图;Fig. 5 is a curve schematic diagram of a specific example of the historical data sequence of business elements of GPS application;
图6为GPS应用的资源负载量历史数据序列的一具体实例的曲线示意图;Fig. 6 is a schematic diagram of a curve of a specific example of the historical data sequence of the resource load of the GPS application;
图7为采用本发明实施例提供的负载量预测方法基于图5所示的业务要素历史数据序列预测出的2012年1月1号~2012年7月1号GPS应用的预期业务要素的图表示意图;Fig. 7 is a schematic diagram of the expected business elements of GPS applications from January 1, 2012 to July 1, 2012 predicted by the load forecasting method provided by the embodiment of the present invention based on the historical data sequence of business elements shown in Fig. 5 ;
图8为计算拟合残差的原理示意图;Figure 8 is a schematic diagram of the principle of calculating the fitting residual;
图9为采用本发明实施例提供的负载量预测方法基于图7所示的GPS应用的预期业务要素根据计算出的关联函数得出的2012年1月1号~2012年7月1号GPS应用的预期资源负载量的图表示意图;Fig. 9 shows the GPS applications from January 1, 2012 to July 1, 2012 obtained by using the load forecasting method provided by the embodiment of the present invention based on the expected business elements of the GPS application shown in Fig. A graphical representation of the expected resource load for ;
图10为本发明提供的分析预测系统实施例一的结构示意图;FIG. 10 is a schematic structural diagram of Embodiment 1 of the analysis and prediction system provided by the present invention;
图11为本发明提供的分析预测系统实施例二的结构示意图;Fig. 11 is a schematic structural diagram of
图12为本发明提供的分析预测系统实施例中第一处理模块的一具体实例的结构示意图;Fig. 12 is a schematic structural diagram of a specific example of the first processing module in the embodiment of the analysis and prediction system provided by the present invention;
图13为本发明提供的分析预测系统实施例中建立模块的一具体实例的结构示意图;Fig. 13 is a schematic structural diagram of a specific example of the building module in the embodiment of the analysis and prediction system provided by the present invention;
图14为本发明提供的业务运营监控系统实施例一的结构示意图;FIG. 14 is a schematic structural diagram of Embodiment 1 of the business operation monitoring system provided by the present invention;
图15为本发明提供的云计算系统架构实施例一的结构示意图。FIG. 15 is a schematic structural diagram of Embodiment 1 of the cloud computing system architecture provided by the present invention.
具体实施方式 Detailed ways
为使本发明实施例的目的、技术方案和优点更加清楚,下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例是本发明一部分实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例,都属于本发明保护的范围。In order to make the purpose, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments It is a part of embodiments of the present invention, but not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of the present invention.
图2为本发明提供的资源负载量预测方法实施例一的流程图,如图2所示,该方法包括:Fig. 2 is a flow chart of Embodiment 1 of the resource load prediction method provided by the present invention. As shown in Fig. 2, the method includes:
步骤101、分别获取业务要素历史数据序列和资源负载量历史数据序列,其中,所述业务要素历史数据序列中各业务要素信息携带的监测时间分别与所述资源负载量历史数据序列中各资源负载量信息携带的监测时间相同,所述业务要素信息为业务运营监控系统将监测到的业务要素及监测时间一同存储至数据库中的信息,所述资源负载量信息为资源管理系统将监测到的资源负载量及监测时间一同存储至所述数据库中的信息。
具体地,分析预测系统分别获取业务要素历史数据序列和资源负载量历史数据序列。其中,所述业务要素历史数据序列中的各业务要素信息应分别与资源负载量历史数据序列中各资源负载量信息对应。即业务运营监控系统监测到业务要素时,所述资源管理系统应同时监测此时业务要素对应的资源负载量。因此,所述业务运营监控系统在监测到所述业务要素时,同时需记录监测时间,并将所述业务要素和监测时间一起存储至数据中。所述资源管理系统在监测到所述资源负载量时,同样地需记录监测时间,并将所述资源负载量和监测时间一起存储至数据中。具体地,为了保证业务要素和资源负载量在监测时间上的对应,所述业务运营监控系统按照预设时间或预设周期监测业务要素,并将监测到的业务要素及监测时间一同存储至数据库中。同样地,所述资源管理系统按照与所述业务运营监控系统一样的预设时间或预设周期监测资源负载量,并将监测到的资源负载量及监测时间一同存储至数据库中。其中,所述业务要素具体可以是:注册用户数、同时在线用户数、同时在线请求数等。例如,GPS业务应用可分为三种类型,分别为A类GPS业务应用、B类GPS业务应用和C类GPS业务应用。其中,A类GPS业务应用依据用户范围,如号码段,提前进行相对静态负载均衡,当过载时增加号码段的划分粒度,因此A类GPS业务应用主要依据注册用户数进行负载均衡。B类GPS业务应用依据用户请求相对动态分配资源,但由于该类应用业务请求之间存在关联关系,单个用户的请求在一定时间内会绑定在特定的应用实例上,因此B类GPS业务应用主要依据同时在线用户数进行负载均衡和资源部署。C类GPS业务应用依据用户请求动态分配,由于该类应用请求之间没有关联性,可以将任意请求路由到任意的资源节点,因此C类GPS业务应用主要依据同时在线请求数进行资源的动态申请。所述资源负载量可以包括以下一种或多种:CPU占用率、内存使用量、硬盘使用量和网络带宽占用率。Specifically, the analysis and prediction system obtains the historical data sequence of business elements and the historical data sequence of resource load respectively. Wherein, each business element information in the business element historical data sequence should correspond to each resource load information in the resource load historical data sequence. That is, when the business operation monitoring system detects a business element, the resource management system should simultaneously monitor the resource load corresponding to the business element at this time. Therefore, when the business operation monitoring system monitors the business element, it needs to record the monitoring time at the same time, and store the business element and the monitoring time together in the data. When the resource management system monitors the resource load, it also needs to record the monitoring time, and store the resource load and the monitoring time together in data. Specifically, in order to ensure the correspondence between business elements and resource loads in terms of monitoring time, the business operation monitoring system monitors business elements according to a preset time or preset cycle, and stores the monitored business elements and monitoring time together in the database middle. Likewise, the resource management system monitors the resource load at the same preset time or period as the business operation monitoring system, and stores the monitored resource load and monitoring time in the database. Wherein, the business element may specifically be: the number of registered users, the number of simultaneous online users, the number of simultaneous online requests, and the like. For example, GPS service applications can be divided into three types, which are Class A GPS service applications, Class B GPS service applications, and Class C GPS service applications. Among them, Class A GPS service applications perform relatively static load balancing in advance based on user ranges, such as number segments, and increase the division granularity of number segments when overloaded. Therefore, Class A GPS service applications mainly perform load balancing based on the number of registered users. Class B GPS service applications allocate resources relatively dynamically according to user requests. However, due to the correlation between service requests of this type of applications, a single user's request will be bound to a specific application instance within a certain period of time. Therefore, Class B GPS service applications Load balancing and resource deployment are mainly based on the number of concurrent online users. Class C GPS service applications are dynamically allocated based on user requests. Since there is no correlation between the requests of this type of applications, any request can be routed to any resource node. Therefore, Class C GPS service applications mainly perform dynamic resource application based on the number of simultaneous online requests. . The resource load may include one or more of the following: CPU usage, memory usage, hard disk usage, and network bandwidth usage.
步骤102、根据所述业务要素历史数据序列,生成预期业务要素。
具体地,分析预测系统,首先,根据所述业务要素历史数据序列,得出预设的至少两种预测模型的预测误差;然后,根据所述业务要素历史数据序列,采用所述预测误差最小的预测模型计算预期业务要素。其中,根据所述业务要素历史数据序列,得出预设的至少两种预测模型的预测误差,具体可采用如下方法来实现。该方法包括:将所述业务要素历史数据序列中的业务要素信息按照业务要素携带的监测信息进行划分,例如,业务要素历史数据序列包含有8月1号至9月5号的业务要素信息。按照业务要素信息携带的时间信息,将序列中的业务要素信息进行划分,分成两组,如8月1号至8月31号的业务要素为第一数组,9月1号至9月5号的业务要素为第二数组。然后,将第一数组作为历史数据,第二数组作为预测数据,采用预测模型,根据第一数组分别计算出与第二数组中各业务要素对应监测时间的预测数据。最后,分别比较预测数据与第二数组中各对应监测时间的业务要素,得出差值,根据各差值计算出该预测模型的预测误差。同样地,采用上述方法,即可得出其他各预测模型的预测误差。Specifically, in analyzing the forecasting system, first, according to the historical data sequence of the business elements, obtain the forecast errors of at least two preset forecast models; then, according to the historical data series of the business elements, adopt the least predictive error Forecasting models calculate expected business elements. Wherein, according to the historical data sequence of the business elements, the prediction errors of at least two preset prediction models are obtained, which may be specifically implemented by the following method. The method includes: dividing the business element information in the business element historical data sequence according to the monitoring information carried by the business element, for example, the business element historical data sequence includes the business element information from August 1st to September 5th. According to the time information carried by the business element information, divide the business element information in the sequence into two groups, for example, the business elements from August 1 to August 31 are the first group, and the business elements from September 1 to September 5 The business element of is the second array. Then, the first array is used as historical data, the second array is used as forecast data, and the forecast model is used to calculate the forecast data corresponding to the monitoring time of each business element in the second array according to the first array. Finally, compare the predicted data with the business elements corresponding to the monitoring time in the second array to obtain the difference, and calculate the prediction error of the prediction model according to the difference. Similarly, using the above method, the prediction errors of other prediction models can be obtained.
步骤103、根据所述业务要素历史数据序列和资源负载量历史数据序列,建立业务要素与资源负载量的关联函数。
具体地,分析预测系统,首先根据所述业务要素历史数据序列和资源负载量历史数据序列,采用至少两个函数模型进行所述业务要素和资源负载量的函数拟合处理,生成至少两个候选关联函数;然后,根据所述业务要素历史数据序列和资源负载量历史数据序列,按照预设的最小二乘计算算法计算采用各候选关联函数的拟合残差;最后,比较各候选关联函数的拟合残差,将拟合残差最小的候选关联函数作为所述业务要素与资源负载量的关联函数。Specifically, the analysis and prediction system first uses at least two function models to perform function fitting processing of the business elements and resource loads according to the historical data sequence of the business elements and the historical data sequence of the resource load, and generates at least two candidate correlation function; then, according to the historical data sequence of the business element and the historical data sequence of the resource load, calculate the fitting residual of each candidate correlation function according to the preset least square calculation algorithm; finally, compare the fitting residuals of each candidate correlation function For the fitting residual, the candidate correlation function with the smallest fitting residual is used as the correlation function between the business element and the resource load.
步骤104、根据所述关联函数,生成所述预期业务要素对应的预期资源负载量。Step 104: Generate an expected resource load corresponding to the expected business element according to the correlation function.
具体地,分析预测系统将所述预期业务要素作为计算参数,根据所述关联函数,继而生成所述预期业务要素对应的预期资源负载量。Specifically, the analysis and forecasting system takes the expected business element as a calculation parameter, and then generates the expected resource load corresponding to the expected business element according to the correlation function.
本发明实施例通过在预测方法中引入业务要素作为影响因素,通过拟合业务要素与资源负载量间的关联函数,实现了对该应用的资源负载量未来状态的准确预测。本实施例充分考虑了不同用户的应用部署需求以及各应用的负载均衡特性,为不同用户部署相应的资源,准确的预测出不同应用未来所需的资源负载量,提高了云计算平台的资源部署和维护机制,有助于提高云计算系统的基础设施资源的利用率。The embodiment of the present invention realizes accurate prediction of the future state of the resource load of the application by introducing business elements as influencing factors in the prediction method, and by fitting the correlation function between the business elements and the resource load. This embodiment fully considers the application deployment requirements of different users and the load balancing characteristics of each application, deploys corresponding resources for different users, accurately predicts the resource load required by different applications in the future, and improves the resource deployment of the cloud computing platform. And the maintenance mechanism helps to improve the utilization rate of the infrastructure resources of the cloud computing system.
进一步地,在实际应用中,各应用在不同时间段内会出现业务要素突增或突降的情况,例如,GPS应用,在节假日期间,其业务要素,即注册用户数、同时在线用户数或同时在线请求数会明显高于工作日。因此,为了进一步提高本发明实施例所述的资源负载量预测方法的预测准确度,则需将资源负载量预测分成奇异日期间的资源负载量预测和正常日期间的资源负载量预测。其中,奇异日是指多次在这一天出现业务要素和资源负载量突增或突降的日期,即业务要素和资源负载量不同于正常日的时段,例如GPS应用的奇异日为法定节假日。正常日是除奇异日以外的日期,例如,GPS应用的正常日为除法定节假日外的工作日。具体地,本发明提供所述资源负载量预测方法实施例二,如图3所示,本实施例二除包括上述步骤101~104之外,在所述步骤101之前还包括:Furthermore, in practical applications, each application may experience a sudden increase or decrease in business elements in different time periods, for example, GPS applications, during holidays, its business elements, namely the number of registered users, the number of concurrent online users or The number of simultaneous online requests will be significantly higher than that of working days. Therefore, in order to further improve the prediction accuracy of the resource load prediction method described in the embodiment of the present invention, the resource load prediction needs to be divided into resource load prediction during odd days and resource load prediction during normal days. Among them, a strange day refers to a date on which business elements and resource loads suddenly increase or decrease several times on this day, that is, a period of time when the business elements and resource loads are different from normal days. For example, the strange days of GPS applications are legal holidays. A normal day is a date other than an odd day, for example, a normal day of a GPS application is a working day except legal holidays. Specifically, the present invention provides the second embodiment of the resource load prediction method. As shown in FIG. 3 , in addition to the above steps 101-104, the second embodiment also includes before the step 101:
步骤201、获取业务要素信息。
具体地,所述分析预测系统从数据库中获取业务要素信息,其中,所述业务要素信息至少包括业务要素和监测时间。Specifically, the analysis and prediction system acquires business element information from a database, wherein the business element information includes at least a business element and monitoring time.
步骤202、判断所述业务要素信息携带的监测时间是否在预设奇异日时段内,若是,则将所述业务要素信息存入业务要素奇异日历史数据序列,否则,将所述业务要素信息存入业务要素正常日历史数据序列。Step 202: Determine whether the monitoring time carried by the business element information is within the preset singular day period, if so, store the business element information in the business element singular day historical data sequence, otherwise, store the business element information Enter the normal daily historical data series of business elements.
具体地,所述分析预测系统判断业务要素信息携带的监测时间是否在预设奇异日时段内,若是,则所述分析预测系统将所述业务要素信息存入业务要素奇异日历史数据序列,否则,所述分析预测系统将所述业务要素信息存入业务要素正常日历史数据序列。Specifically, the analysis and prediction system judges whether the monitoring time carried by the business element information is within the preset singular day period, and if so, the analysis and prediction system stores the business element information into the business element singular day historical data sequence, otherwise , the analysis and prediction system stores the business element information into a normal day historical data sequence of the business element.
步骤203、获取资源负载量信息。
具体地,所述分析预测系统从数据库中获取资源负载量信息,其中,所述资源负载量信息至少包括业务要素和监测时间。Specifically, the analysis and prediction system acquires resource load information from a database, wherein the resource load information includes at least business elements and monitoring time.
步骤204、判断所述资源负载量信息携带的监测时间是否在预设奇异日时段内,若是,则将所述资源负载量信息存入资源负载量奇异日历史数据序列,否则,将所述资源负载量信息存入资源负载量正常日历史数据序列。Step 204: Determine whether the monitoring time carried by the resource load information is within the preset singular day period, if so, store the resource load information into the resource load singular day historical data sequence, otherwise, save the resource The load information is stored in the normal daily historical data sequence of the resource load.
具体地,所述分析预测系统判断所述资源负载量信息携带的监测时间是否在预设奇异日时段内,若是,则所述分析预测系统将所述资源负载量信息存入资源负载量信息奇异日历史数据序列,否则,所述分析预测系统将所述资源负载量信息存入资源负载量信息正常日历史数据序列。Specifically, the analysis and prediction system judges whether the monitoring time carried by the resource load information is within the preset singular day period, and if so, the analysis and prediction system stores the resource load information in the resource load information singular daily historical data sequence, otherwise, the analysis and prediction system stores the resource load information into a normal daily historical data sequence of resource load information.
相应地,上述实施例一步骤101中,分别获取的所述业务要素历史数据序列和资源负载量历史数据序列,具体为:所述业务要素历史数据序列为业务要素奇异日历史数据序列,所述资源负载量历史数据序列为资源负载量奇异日历史数据序列,或者所述业务要素历史数据序列为业务要素正常日历史数据序列,所述资源负载量历史数据序列为资源负载量正常日历史数据序列。Correspondingly, in
分别采用上述实施例一的步骤102~104,可分别预测出奇异日期间的预期资源负载量和正常日期间的预期资源负载量。Using
再进一步地,上述各实施例所述资源负载预测方法中,所述步骤101之后,还包括:分别对所述业务要素历史数据序列和资源负载量历史数据序列进行数据预处理。Still further, in the method for predicting resource load in each of the above embodiments, after the
具体地,分析预测系统对获取到的业务要素历史数据序列进行数据预处理,所述分析预测系统对获取到的资源负载量历史数据序列进行数据预处理。其中,数据预处理的目的在于:业务运营监控系统在监测所述业务要素时,可能会出现监测遗漏、监测到的业务要素异常等问题。为避免这些异常数据对后续步骤的影响,以进一步提高本实施例所述资源负载量预测方法的预测准确度。因此,所述分析预测系统需分别对所述业务要素历史数据序列和所述资源负载量历史数据序列进行数据预处理,可以包括如下处理内容,例如,补充历史数据序列中缺失的值,光滑业务要素历史数据序列和所述资源负载量历史数据序列中的噪声数据、识别或删除业务要素历史数据序列和所述资源负载量历史数据序列中的离群数据等。其中,补充历史数据序列中缺失的值,可根据前后两相邻数据的值,计算出两相邻数据的平均进行补充,也可采用插值计算补充该缺失值。Specifically, the analysis and prediction system performs data preprocessing on the acquired historical data series of business elements, and the analysis and forecasting system performs data preprocessing on the acquired historical data series of resource loads. Among them, the purpose of data preprocessing is: when the business operation monitoring system monitors the business elements, there may be problems such as monitoring omissions and abnormality of the monitored business elements. In order to avoid the influence of these abnormal data on subsequent steps, the prediction accuracy of the resource load prediction method described in this embodiment is further improved. Therefore, the analysis and prediction system needs to perform data preprocessing on the historical data sequence of the business elements and the historical data sequence of the resource load respectively, which may include the following processing contents, for example, supplementing missing values in the historical data sequence, smoothing business Noise data in the element historical data sequence and the resource load historical data sequence, identify or delete outlier data in the business element historical data sequence and the resource load historical data sequence, and the like. Among them, to supplement the missing value in the historical data sequence, the average value of the two adjacent data can be calculated according to the values of the two adjacent data before and after, and the missing value can also be supplemented by interpolation calculation.
更进一步地,上述各资源负载量预测方法实施例中,所述步骤104之后,还包括:将所述预期资源负载量存储至数据库中,以使服务管理系统从所述数据库中读取所述预期资源负载量,并根据所述预期资源负载量生成资源部署指令,所述资源管理系统根据所述资源部署指令执行资源部署。Furthermore, in each embodiment of the resource load forecasting method described above, after the
图4为本发明提供的负载量预测方法实施例三的流程图,如图5所示,该方法包括:Fig. 4 is a flow chart of
步骤301、监测业务要素。
具体地,业务运营监控系统按照预设时间或预设周期监测业务要素。其中,其中,所述业务要素具体可以是:注册用户数、同时在线用户数、同时在线请求数等。例如,GPS业务应用可分为三种类型,分别为A类GPS业务应用、B类GPS业务应用和C类GPS业务应用。其中,A类GPS业务应用依据用户范围,如号码段,提前进行相对静态负载均衡,当过载时增加号码段的划分粒度,因此A类GPS业务应用主要依据注册用户数进行负载均衡。B类GPS业务应用依据用户请求相对动态分配资源,但由于该类应用业务请求之间存在关联关系,单个用户的请求在一定时间内会绑定在特定的应用实例上,因此B类GPS业务应用主要依据同时在线用户数进行负载均衡和资源部署。C类GPS业务应用依据用户请求动态分配,由于该类应用请求之间没有关联性,可以将任意请求路由到任意的资源节点,因此C类GPS业务应用主要依据同时在线请求数进行资源的动态申请。Specifically, the business operation monitoring system monitors business elements according to a preset time or a preset cycle. Wherein, wherein, the business element may specifically be: the number of registered users, the number of concurrently online users, the number of concurrently online requests, and the like. For example, GPS service applications can be divided into three types, which are Class A GPS service applications, Class B GPS service applications, and Class C GPS service applications. Among them, Class A GPS service applications perform relatively static load balancing in advance based on user ranges, such as number segments, and increase the division granularity of number segments when overloaded. Therefore, Class A GPS service applications mainly perform load balancing based on the number of registered users. Class B GPS service applications allocate resources relatively dynamically according to user requests. However, due to the correlation between service requests of this type of applications, a single user's request will be bound to a specific application instance within a certain period of time. Therefore, Class B GPS service applications Load balancing and resource deployment are mainly based on the number of concurrent online users. Class C GPS service applications are dynamically allocated based on user requests. Since there is no correlation between the requests of this type of applications, any request can be routed to any resource node. Therefore, Class C GPS service applications mainly perform dynamic resource application based on the number of simultaneous online requests. .
步骤302、将监控到的所述业务要素及监测时间存储至数据库中,以使分析预测系统从所述数据库中获取业务要素历史数据序列,根据所述业务要素历史数据序列,生成预期业务要素,根据所述业务要素历史数据序列和资源负载量历史数据序列,建立业务要素与资源负载量的关联函数,根据所述关联函数,生成所述预期业务要素对应的预期资源负载量;其中,所述业务要素历史数据序列中各业务要素信息携带的监测时间分别与所述资源负载量历史数据序列中各资源负载量信息携带的监测时间相同,所述资源负载量历史数据序列由所述分析预测系统从所述数据库中获取,所述资源负载量信息为资源管理系统将监测到的资源负载量及监测时间一同存储至所述数据库中的信息。
具体地,业务运营监控系统监测到业务要素时,所述资源管理系统应同时监测此时业务要素对应的资源负载量。因此,所述业务运营监控系统在监测到所述业务要素时,同时需记录监测时间,并将所述业务要素和监测时间一起存储至数据中。所述资源管理系统在监测到所述资源负载量时,同样地需记录监测时间,并将所述资源负载量和监测时间一起存储至数据中。具体地,为了保证业务要素和资源负载量在监测时间上的对应,所述业务运营监控系统按照预设时间或预设周期监测业务要素,并将监测到的业务要素及监测时间一同存储至数据库中。同样地,所述资源管理系统按照与所述业务运营监控系统一样的预设时间或预设周期监测资源负载量,并将监测到的资源负载量及监测时间一同存储至数据库中。Specifically, when the business operation monitoring system detects a business element, the resource management system should simultaneously monitor the resource load corresponding to the business element at this time. Therefore, when the business operation monitoring system monitors the business element, it needs to record the monitoring time at the same time, and store the business element and the monitoring time together in the data. When the resource management system monitors the resource load, it also needs to record the monitoring time, and store the resource load and the monitoring time together in data. Specifically, in order to ensure the correspondence between business elements and resource loads in terms of monitoring time, the business operation monitoring system monitors business elements according to a preset time or preset cycle, and stores the monitored business elements and monitoring time together in the database middle. Likewise, the resource management system monitors the resource load at the same preset time or period as the business operation monitoring system, and stores the monitored resource load and monitoring time in the database.
进一步地,上述资源负载量预测方法实施例三中,所述步骤301之前还包括:接收服务管理系统发送的监测指令信息,所述监测指令信息携带有欲监测业务要素,以使所述业务运营监控系统根据所述监测指令信息,监测所述业务要素。具体地,服务管理系统接收到用户终端发送的申请部署应用时,服务管理系统将针对该应用的负载均衡特征,选择相应的业务要素,如注册用户数、同时在线用户数或同时在线请求数,并向业务运营监控系统发送监测指令信息,其中,该监测指令信息中携带有业务要素信息。所述业务运营监控系统接收到所述监测指令信息后,开始对所述业务要素进行监测。Further, in the third embodiment of the resource load prediction method above, before the
本发明实施例通过在预测方法中引入业务要素作为影响因素,通过拟合业务要素与资源负载量间的关联函数,实现了对该应用的资源负载量未来状态的准确预测。本实施例充分考虑了不同用户的应用部署需求以及各应用的负载均衡特性,为不同用户部署相应的资源,准确的预测出不同应用未来所需的资源负载量,提高了云计算平台的资源部署和维护机制,有助于提高云计算系统的基础设施资源的利用率。The embodiment of the present invention realizes accurate prediction of the future state of the resource load of the application by introducing business elements as influencing factors in the prediction method, and by fitting the correlation function between the business elements and the resource load. This embodiment fully considers the application deployment requirements of different users and the load balancing characteristics of each application, deploys corresponding resources for different users, accurately predicts the resource load required by different applications in the future, and improves the resource deployment of the cloud computing platform. And the maintenance mechanism helps to improve the utilization rate of the infrastructure resources of the cloud computing system.
为使得本发明实施例提供的所述资源负载量预测方法更加清楚,下面将以GPS应用作为举例。In order to make the resource load prediction method provided by the embodiment of the present invention more clear, the GPS application will be used as an example below.
第一,第三方用户(申请部署应用的用户),向服务管理系统申请部署应用,即发送监控申请请求,所述监控申请请求携带有欲监测业务要素,如同时在线用户数。所述服务管理系统根据所述监控申请请求,向业务运营监控系统发送监测指令信息,所述监测指令信息携带有欲监测业务要素。同时,向所述资源管理系统发送资源监控指令信息。First, third-party users (users who apply for application deployment) apply to the service management system for application deployment, that is, send a monitoring application request, and the monitoring application request carries business elements to be monitored, such as the number of concurrent online users. The service management system sends monitoring instruction information to the business operation monitoring system according to the monitoring application request, and the monitoring instruction information carries business elements to be monitored. At the same time, resource monitoring instruction information is sent to the resource management system.
第二、所述业务运营监控系统根据所述监测指令信息,监测GPS应用的同时在线用户数。本实例中,所述业务运营监控系统将监测到的2009年1月~2012年1月GPS应用的同时在线用户数存储至数据库中。业务运营监控系统的监测周期为天,共1095个监测数据,如图5所示。同时,所述资源管理系统根据所述资源监控指令信息,监测GPS应用在2009年1月~2012年1月间每天的资源负载量,并将监测到的资源负载量存储在数据库中。资源管理系统的监测周期为天,共1095个监测数据,如图6所示。Second, the business operation monitoring system monitors the number of simultaneous online users of the GPS application according to the monitoring instruction information. In this example, the business operation monitoring system stores the monitored number of simultaneous online users of the GPS application from January 2009 to January 2012 into the database. The monitoring period of the business operation monitoring system is 1 day, with a total of 1095 monitoring data, as shown in Figure 5. At the same time, the resource management system monitors the daily resource load of the GPS application from January 2009 to January 2012 according to the resource monitoring instruction information, and stores the monitored resource load in the database. The monitoring cycle of the resource management system is every day, and there are 1095 monitoring data in total, as shown in Figure 6.
第三,分析预测系统根据2009年1月1号~2012年1月1号GPS应用的同时在线用户数及资源负载量预测未来半年的资源负载量。2009年1月~2012年1月中奇异日时段信息包括:法定节假日。除法定节假日外的其他均为正常日。具体可从图5和图6中看出,突变点均为奇异日时段监测到GPS应用同时在线用户数及GPS应用的资源负载量。对未来半年资源负载量的预测,具体实现如下:Third, the analysis and prediction system predicts the resource load for the next six months based on the number of simultaneous online users and resource load of GPS applications from January 1, 2009 to January 1, 2012. From January 2009 to mid-January 2012, the information on strange days includes: statutory holidays. Except for statutory holidays, other days are normal days. Specifically, it can be seen from Figure 5 and Figure 6 that the mutation points are the number of simultaneous online users of the GPS application and the resource load of the GPS application monitored during the singular day period. For the forecast of resource load in the next half year, the specific realization is as follows:
首先,分析预测系统从数据库中获取2009年1月1号~2012年1月1号监测的业务要素信息,并分别判断这1095个业务要素信息携带的监测时间是否在上述奇异日时段内,若是,则将所述业务要素信息存入业务要素奇异日历史数据序列,否则,将所述业务要素信息存入业务要素正常日历史数据序列。同理分析预测系统从数据库中获取2009年1月1号~2012年1月1号监测的资源负载量信息,并分别判断这1095个资源负载量携带的监测时间是否在上述奇异日时段内,若是,则将所述资源负载量信息存入资源负载量奇异日历史数据序列,否则,将所述资源负载量信息存入资源负载量正常日历史数据序列。所述分析预测系统先根据业务要素正常日历史数据序列和资源负载量正常日历史数据序列预测GPS应用在未来半年正常日内的资源负载量,再根据业务要素奇异日历史数据序列和资源负载量奇异日历史数据序列预测GPS应用在未来半年奇异日内的资源负载量。First, the analysis and prediction system obtains the business element information monitored from January 1, 2009 to January 1, 2012 from the database, and judges whether the monitoring time carried by the 1095 business element information is within the above-mentioned singular day period, and if so , then store the business element information into the singular day historical data sequence of the business element, otherwise, store the business element information into the normal day historical data sequence of the business element. In the same way, the analysis and prediction system obtains the resource load information monitored from January 1, 2009 to January 1, 2012 from the database, and judges whether the monitoring time carried by these 1095 resource loads is within the above-mentioned singular day period, If yes, store the resource load information in the odd day historical data sequence of resource load; otherwise, store the resource load information in the normal daily historical data sequence of resource load. The analysis and forecasting system first predicts the resource load of the GPS application in the next six months of normal days according to the normal day historical data sequence of business elements and the resource load normal day historical data sequence, and then according to the business element singular day historical data sequence and the resource load singularity The daily historical data sequence predicts the resource load of GPS applications in singular days in the next six months.
然后,所述分析预测系统分别获取业务要素历史数据序列和资源负载量历史数据序列,根据所述业务要素历史数据序列,生成预期业务要素。Then, the analysis and forecasting system obtains the historical data sequence of business elements and the historical data sequence of resource load respectively, and generates expected business elements according to the historical data sequence of business elements.
其中,所述业务要素历史数据序列包括业务要素正常日历史数据序列和业务要素奇异日历史数据序列。具体地,将业务要素正常日历史数据序列按监测时间划分为两个数组,为了减低计算复杂度,本实例将业务要素正常日历史数据序列中2009年1月1号~2011年12月31号的业务要素信息划分到第一数组,将2012年1月1号的业务要素信息划分到第二数组。采用三种预测模型即相空间重构预测模型、灰色预测模型、三次指数平滑预测模型,分别基于所述第一数组,预测出2012年1月1号的业务要素,比较预测出的2012年1月1号的业务要素和第二数组中的2012年1月1号的业务要素之间的差值,根据所述差值计算出个预测模型的预测误差。该预测误差可表征为百分比数,例如,差值与第二数组中的2012年1月1号的业务要素的百分比。具体计算结果如表1所示。Wherein, the historical data sequence of the business element includes a normal day historical data sequence of the business element and a singular day historical data sequence of the business element. Specifically, the normal day historical data sequence of the business element is divided into two arrays according to the monitoring time. In order to reduce the calculation complexity, this example divides the normal day historical data sequence of the business element from January 1, 2009 to December 31, 2011 The business element information of 2012 is divided into the first array, and the business element information of January 1, 2012 is divided into the second array. Using three forecasting models, namely phase space reconstruction forecasting model, gray forecasting model, and cubic exponential smoothing forecasting model, respectively based on the first array, predict the business elements on January 1, 2012, and compare the forecasted January 1, 2012 The difference between the business element on January 1 and the business element on January 1, 2012 in the second array, and calculate the prediction error of a prediction model according to the difference. The prediction error may be expressed as a percentage, for example, the percentage of the difference and the business element on January 1, 2012 in the second array. The specific calculation results are shown in Table 1.
表1三种预测模型的预测误差对照表Table 1 Comparison table of forecast errors of three forecast models
从表1可以看出,相空间重构预测模型的预测误差最小。因此,本实例采用相空间重构预测模型,根据所述业务要素正常日历史数据序列得出预期业务要素。如图7所示,根据2009年1月1号~2012年1月1号的业务要素正常日历史数据序列,得出2012年1月2号~2012年7月1号的预期正常日业务要素。同理,根据2009年1月1号~2012年1月1号的业务要素奇异日历史数据序列,得出2012年1月2号~2012年7月1号的预期奇异日业务要素。如图7所示,所述预期正常日业务要素和所述预期奇异日业务要素即构成了2012年1月2号~2012年7月1号的预期业务要素。It can be seen from Table 1 that the prediction error of the phase space reconstruction prediction model is the smallest. Therefore, this example adopts the phase space reconstruction prediction model, and obtains the expected business elements according to the normal daily historical data series of the business elements. As shown in Figure 7, based on the normal day historical data series of business elements from January 1, 2009 to January 1, 2012, the expected normal day business elements from January 2, 2012 to July 1, 2012 are obtained . Similarly, based on the historical data sequence of singular days of business elements from January 1, 2009 to January 1, 2012, the expected singular day business elements from January 2, 2012 to July 1, 2012 are obtained. As shown in FIG. 7 , the expected normal day business elements and the expected odd day business elements constitute the expected business elements from January 2, 2012 to July 1, 2012.
其中,相空间重构预测模型实现原理是,首先确定相空间参数:相空间重构过程中有两个非常重要的参数:延迟时间τ和嵌入维数m。它们选择直接关系到相空间重构的质量。利用C-C法采用关联积分来确定延迟时间τ和嵌入维数m,计算公式如下:Among them, the realization principle of the phase space reconstruction prediction model is to first determine the phase space parameters: there are two very important parameters in the phase space reconstruction process: delay time τ and embedding dimension m. Their selection is directly related to the quality of the phase space reconstruction. The C-C method is used to determine the delay time τ and the embedding dimension m by using the correlation integral, and the calculation formula is as follows:
上式(1)中
由上述式(1)可以看出,关联积分是个累积分布函数,表示相空间中任意两点之间距离小于r的概率。这里点与点之间的距离用矢量之差的无穷范数表示。定义检验统计量:S(m,N,r,t)=C(m,N,r,t)-Cm(1,N,r,t)来描述非线性时间序列的相关性,并由统计量S(m,N,r,t)来寻找延迟时间τ和嵌入维数m。It can be seen from the above formula (1) that the correlation integral is a cumulative distribution function, which represents the probability that the distance between any two points in the phase space is less than r. Here the distance between points is represented by the infinite norm of the vector difference. Define the test statistic: S(m,N,r,t)=C(m,N,r,t)-C m (1,N,r,t) to describe the correlation of nonlinear time series, and is given by Statistics S(m, N, r, t) to find the delay time τ and embedding dimension m.
其中,统计量S(m,N,r,t)的计算过程为:将时间序列分解成t个互不重迭的子序列,t为重构时延,即:Among them, the calculation process of the statistic S(m,N,r,t) is: decompose the time series into t non-overlapping subsequences, and t is the reconstruction time delay, namely:
x1={x(k),k=1,1+t,...,1+N-t}x 1 ={x(k),k=1,1+t,...,1+Nt}
x2={x(k),k=2,2+t,...,2+N-t}x 2 ={x(k),k=2,2+t,...,2+Nt}
......
xt={x(k),k=t,2t,...,N} (4)x t ={x(k),k=t,2t,...,N} (4)
上述(4)式中,N为t的整数倍,则上述定义的统计量S(m,N,r,t)采用分块平均的策略,即如下式:In the above formula (4), N is an integer multiple of t, then the above-defined statistic S(m, N, r, t) adopts the strategy of block average, which is the following formula:
当(5)式中N →∞时,When N →∞ in formula (5),
最佳时延t可以取S(m,r,t)对所有半径r相互差别最小的时间点,选择最大和最小的两个半径r,定义差量:The optimal time delay t can be taken as the time point where S(m,r,t) has the smallest mutual difference between all radii r, select the largest and smallest two radii r, and define the difference:
ΔS(m,t)=max{S(m,rj,t)}-min{S(m,rj,t)} (7)ΔS(m,t)=max{S(m,r j ,t)}-min{S(m,r j ,t)} (7)
ΔS(m,t)度量了S(m,r,t)对半径r的最大偏差。由于ΔS(m,t)总为正数,最佳时延τ可以取ΔS(m,t)~t第一个局部最小值所对应的时间点。由于均反映了原时间序列的自相关特性,定义指标:ΔS(m,t) measures the maximum deviation of S(m,r,t) from radius r. Since ΔS(m,t) is always a positive number, the optimal time delay τ can take the time point corresponding to the first local minimum of ΔS(m,t)~t. because Both reflect the autocorrelation characteristics of the original time series, define the index:
寻找Scor(t)的全局最小值所对应的t即可获得最佳嵌入窗tw。相空间重构的嵌入窗法认为延迟时间τ的选取不应独立于嵌入维数m,而应依赖于嵌入窗tw=(m-1)τ,由此可计算出嵌入维数m。Find the t corresponding to the global minimum of S cor (t) to obtain the best embedding window t w . The embedded window method of phase space reconstruction considers that the selection of the delay time τ should not be independent of the embedding dimension m, but should depend on the embedding window t w = (m-1)τ, from which the embedding dimension m can be calculated.
然后,根据上述计算出的延迟时间τ和嵌入维数m进行相空间重构预测。根据拟合相空间中吸引子的方式可分为全局法和局域法两种方法。所谓全局法是将轨迹中的全部点作为拟合对象,找出其规律,即得f(*),由此预测轨迹的走向。这种方法理论上是可行的,但当相空间轨迹比较复杂时却难以做出准确的预测。局域法是将相空间轨迹的最后一点作为中心点,把离中心点最近的若干轨迹点作为相关点,然后对这些相关点做出拟合,再估计轨迹下一点的走向,最后从预测出的轨迹点的坐标中分离出所需的预测值。Then, phase space reconstruction prediction is performed according to the above-calculated delay time τ and embedding dimension m. According to the way of fitting attractors in phase space, it can be divided into two methods: global method and local method. The so-called global method is to use all the points in the trajectory as the fitting object, find out its law, that is, get f( * ), and predict the direction of the trajectory. This method is theoretically feasible, but it is difficult to make accurate predictions when the phase space trajectory is complex. The local method is to take the last point of the phase space trajectory as the center point, and use the trajectory points closest to the center point as the relevant points, and then make a fitting for these relevant points, and then estimate the direction of the next point of the trajectory, and finally from the predicted The desired predicted values are separated from the coordinates of the trajectory points of .
在局域法中,依据与中心点的邻近点的值或走向来预测相空间轨迹。比如,我们要预测明天的天气,可以在历史上寻找与今天的自然状况最相近的一天,把那天的第二天的天气状况作为明天的天气预测值。以一阶近似拟合的局域法为例,在相空间中以第n点的一个小邻域来推测下一点的走势。所谓一阶近似是指以X(t+1)=a+bX(t)来拟合第n点周围的小邻域。In local methods, phase space trajectories are predicted from the values or orientations of neighboring points to the center point. For example, if we want to predict tomorrow's weather, we can find the day that is the closest to today's natural conditions in history, and use the weather conditions of the next day of that day as tomorrow's weather forecast value. Taking the local method of first-order approximate fitting as an example, in the phase space, a small neighborhood of the nth point is used to infer the trend of the next point. The so-called first-order approximation refers to fitting the small neighborhood around the nth point with X(t+1)=a+bX(t).
在相空间重构的过程中,设N是时X(t+1)=a+bX(t)间序列长度,M是相空间中点的个数,则M=N-(m-1)*τ,相空间轨迹的表达式为:In the process of phase space reconstruction, let N be the sequence length between X(t+1)=a+bX(t), and M be the number of midpoints in the phase space, then M=N-(m-1) *τ, the expression of the phase space trajectory is:
X(t+τ)=f(X(t)) (9)X(t+τ)=f(X(t)) (9)
其中,X(t+τ)可视为f(X(t))的映射,则Among them, X(t+τ) can be regarded as the mapping of f(X(t)), then
X(t)=[x(t),x(t+τ),...,x(t+(m-1)τ)] (10)X(t)=[x(t),x(t+τ),...,x(t+(m-1)τ)] (10)
上述(10)式中的映射可表示为以下的时间序列:The mapping in the above formula (10) can be expressed as the following time series:
X(1)=[x(1),x(1+τ),...,x(1+(m-1)τ)]X(1)=[x(1),x(1+τ),...,x(1+(m-1)τ)]
X(2)=[x(2),x(2+τ),...,x(2+(m-1)τ)]X(2)=[x(2),x(2+τ),...,x(2+(m-1)τ)]
......
X(M)=[x(M),x(M+τ),...,x(N)] (11)X(M)=[x(M),x(M+τ),...,x(N)] (11)
设中心点XM的参考向量集{XMi},i=1,2,...,q其演化k步后的相点集为{XMi+k},则一阶局域线性拟合为如下函数:Let the reference vector set {X Mi } of the central point X M , i=1, 2,...,q, the phase point set after k steps of evolution be {X Mi+k }, then the first-order local linear fitting as the following function:
XMi+k=ake+bkXMi,i=1,2,...,q (12)X Mi+k =a k e+b k X Mi ,i=1,2,...,q (12)
根据加权最小二乘法可得:According to the weighted least squares method:
其中,是参考向量XMi的第j个元素。将上式(13)看成是关于未知数ak和bk的二元函数,将上述式(13)两边求偏导并化简得出:in, is the jth element of the reference vector X Mi. The above formula (13) is regarded as a binary function about the unknowns a k and b k , and the partial derivative and simplification of both sides of the above formula (13) are obtained:
将上述(14)式改写成矩阵形式为:Rewrite the above formula (14) into matrix form as:
其中:
根据求得的ak、bk,代入k步预测公式XM+1=ake+bkXM,即可得到演化k步后的相点预测值:According to the obtained a k , b k , substituting the k-step prediction formula X M+1 = a k e+b k X M , the phase point prediction value after k-step evolution can be obtained:
XM+k=(xM+k,xM+k+τ,...,xM+k+(m-1)τ) (17)X M+k =(x M+k ,x M+k+τ ,...,x M+k+(m-1)τ ) (17)
这里,XM+k中的第m个元素xM+k+(m-1)τ即为原序列的k步预测值。Here, the mth element x M+k+(m-1)τ in X M+ k is the k-step predicted value of the original sequence.
基于上述相空间重构预测算法,经过计算得到在t=12时取得第一个局部极小值点,因此取τ=12作为最佳时延。Scor(t)在t=52时取得全局最小点,即tw=52。根据tw=(m-1)τ,因此取m=5,按照式(11)进行相空间重构。Based on the above phase space reconstruction prediction algorithm, after calculation Get the first local minimum value point at t=12, so take τ=12 as the best time delay. S cor (t) obtains the global minimum point at t=52, that is, t w =52. According to t w =(m-1)τ, m=5 is taken, and the phase space reconstruction is carried out according to formula (11).
灰色预测模型的实现原理是,GM(1,1)模型是灰色系统理论中一种动态序列处理方法,它是仅包含单变量的一阶微分方程。The realization principle of the gray forecasting model is that the GM (1, 1) model is a dynamic sequence processing method in the gray system theory, and it is a first-order differential equation containing only a single variable.
设x(0)为非负序列:Let x (0) be a non-negative sequence:
x(0)={x(0)(1),x(0)(2),...,x(0)(n)}(18)x (0) ={x (0) (1),x (0) (2),...,x (0) (n)}(18)
x(1)为x(0)的一阶累加序列:x (1) is the first-order cumulative sequence of x (0) :
x(1)={x(1)(1),x(1)(2),...,x(1)(n)} (19)x (1) ={x (1) (1),x (1) (2),...,x (1) (n)} (19)
其中:x(0)(k)>0,k=1,2,...,k=1,2,...,n,则GM(1,1)模型相应的微分方程为:Where: x (0) (k)>0,k=1,2,..., k=1,2,...,n, then the corresponding differential equation of the GM(1,1) model is:
式(20)中,α为发展灰数;u为灰色作用量。In formula (20), α is the development gray number; u is the gray action.
参数向量利用最小二乘法求解得:其中,parameter vector Using the method of least squares to solve: in,
将计算求得的参数α、u代入式(20),并求解,取x(1)(0)=x(0)(1),即得灰色预测模型:Substituting the calculated parameters α and u into formula (20) and solving it, taking x (1) (0)=x (0) (1), the gray forecasting model is obtained:
由式(21)得到的是依次累加值的模拟值,再由一次累减得到真实的预测值:The value obtained by formula (21) is the cumulative value The simulated value of , and then the real predicted value is obtained by a cumulative subtraction:
基于上述灰色预测模型的原理,首先利用最小二乘法求解参数向量:Based on the principle of the above-mentioned gray prediction model, first use the least square method to solve the parameter vector:
根据
其中,后验差比值为C=32.83%,小误差概率为P=91.64%,可知预测精度等级较好。Among them, the posterior difference ratio is C=32.83%, and the small error probability is P=91.64%, which shows that the prediction accuracy level is good.
三次指数平滑预测模型的实现原理是,指数平滑预测原理是利用对历史数据进行平滑来消除随机因素的影响。当历史数据序列具有曲线型倾向时需要使用三次指数平滑法。三次指数平滑预测模型的基本原理是对原始数据经过三次指数平滑处理后,用以估计二次多项式参数,从而建立预测模型。如下所示:The realization principle of the cubic exponential smoothing forecasting model is that the principle of exponential smoothing forecasting is to use the smoothing of historical data to eliminate the influence of random factors. Triple exponential smoothing is required when the historical data series has a curvilinear tendency. The basic principle of Cubic Exponential Smoothing Forecasting Model is to estimate the quadratic polynomial parameters after the original data is processed by Cubic Exponential Smoothing, so as to establish a forecasting model. As follows:
设时间序列为X1,X2,X3,...,Xn,用S表示指数平滑值,第t期一次指数平滑值记为二次指数平滑值记为三次指数平滑值记为其中,平滑初始值的确定采用如下公式:Let the time series be X 1 , X 2 , X 3 ,...,X n , use S to denote the exponential smoothing value, and record the exponential smoothing value in the tth period as The quadratic exponential smoothing value is denoted as Triple exponential smoothing is denoted as Among them, the smooth initial value is determined using the following formula:
则指数平滑值计算公式为:Then the formula for calculating the exponential smoothing value is:
其中,α∈[0,1]为平滑系数,平滑系数α可由实际情况确定其合理大小,一般根据最小均方差选取,即分别对不同α值进行指数平滑预测,分别计算均方差,取最小均方差的α值作为平滑系数。对预测周期为T天、基数为第t天的指标预测值Yt+T,其三次指数平滑法的数学模型为:Among them, α∈[0,1] is the smoothing coefficient, and the smoothing coefficient α can determine its reasonable size according to the actual situation. Generally, it is selected according to the minimum mean square error, that is, to perform exponential smoothing prediction on different α values, respectively calculate the mean square error, and take the smallest mean square error. The alpha value of the variance is used as the smoothing coefficient. For the index forecast value Y t+T with a forecast period of T days and a base number of the t-th day, the mathematical model of the triple exponential smoothing method is:
Yt+T=at+btT+ctT2 (27)Y t+T =a t +b t T+c t T 2 (27)
其中:at,bt,ct均为平滑系数,计算公式为:Among them: a t , b t , c t are smoothing coefficients, and the calculation formula is:
在三次指数平滑法预测过程中,首先确定平滑初始值:In the forecasting process of the triple exponential smoothing method, the smoothing initial value is first determined:
其次分别对[0,1]之间以0.02为间隔的不同α值进行指数平滑预测,取最小均方差的α=0.72值作为平滑系数。设预测周期T=1,2,...,5天,基数为第t=1095天的指标预测值Y1095+T,分别利用指数平滑值计算公式得出代入平滑系数计算公式a1095=29.3925,b1095=-0.4814,c1095=0.0212,则同时在线用户数的三次指数平滑法计算公式Y1095+T=29.3925-0.4814T+0.0212T2。Secondly, the exponential smoothing prediction is performed on different α values between [0, 1] with an interval of 0.02, and the value of α=0.72 with the minimum mean square error is taken as the smoothing coefficient. Assuming that the forecast period T=1,2,...,5 days, the base is the index forecast value Y 1095+T on the t=1095th day, which is obtained by using the exponential smoothing value calculation formula Substituting the smoothing coefficient calculation formula a 1095 =29.3925, b 1095 =-0.4814, c 1095 =0.0212, then the calculation formula of the triple exponential smoothing method for the number of simultaneous online users is Y 1095+T =29.3925-0.4814T+0.0212T 2 .
随后,所述分析预测系统根据获取到的所述业务要素正常日历史数据序列和资源负载量正常日历史数据序列,建立业务要素与资源负载量的关联函数。Subsequently, the analysis and forecasting system establishes a correlation function between business elements and resource loads according to the acquired normal daily historical data series of business elements and normal daily historical data series of resource loads.
具体地,从历史数据图6中可以观察得出,随着同时在线用户数的增长,资源负载量也呈现出正比例增长趋势。因此,分析预测系统可分别利用预设的四种增长型函数对资源负载量与同时在线用户数进行函数拟合处理。这四种增长型函数包括:线性函数类型、多项式函数类型、指数函数类型和幂函数类型。Specifically, it can be observed from the historical data in Figure 6 that as the number of simultaneous online users increases, the resource load also shows a proportional increase trend. Therefore, the analysis and prediction system can respectively use the four preset growth functions to perform function fitting processing on the resource load and the number of concurrent online users. The four growth functions include: linear function type, polynomial function type, exponential function type, and power function type.
线性函数:y=ax+b;Linear function: y=ax+b;
多项式函数:y=a1xn+a2xn-1+a3xn-2+....+an-1x+an;Polynomial function: y=a 1 x n +a 2 x n-1 +a 3 x n-2 +....+a n-1 x+a n ;
指数函数:y=aebx;Exponential function: y=ae bx ;
幂函数:y=axb。Power function: y=ax b .
其中,多项式函数中n值的选择不宜过高,n值越高,拟合计算过程就越复杂。Among them, the choice of n value in the polynomial function should not be too high, the higher the n value, the more complicated the fitting calculation process.
实质上,函数拟合处理过程就是,将业务要素正常日历史数据序列和资源负载量正常日历史数据序列中携带有相同监测时间的业务要素和资源负载量分别代入到函数中,求解出上述函数中,如线性函数中的系数a和b,多项式函数中的系数a1、a2、a3、…an,指数函数和幂函数中的系数a和幂指数b。上述函数中系数或指数的求解完成后,即得出了四个候选关联函数。随后,根据所述业务要素正常日历史数据序列和资源负载量正常日历史数据序列,按照预设的最小二乘计算算法计算出采用各候选关联函数的拟合残差,以选择拟合残差最小的候选关联函数作为同时在线用户数与资源负载量的关联函数。In essence, the function fitting process is to substitute the business elements and resource loads with the same monitoring time in the normal day historical data series of business elements and resource load normal day historical data series into the function respectively, and solve the above function Among them, such as the coefficients a and b in the linear function, the coefficients a1, a2, a3,...an in the polynomial function, the coefficient a and the power exponent b in the exponential function and the power function. After the coefficients or exponents in the above functions are solved, four candidate correlation functions are obtained. Subsequently, according to the normal day historical data sequence of the business element and the normal day historical data sequence of the resource load, the fitting residual using each candidate correlation function is calculated according to the preset least square calculation algorithm, so as to select the fitting residual The smallest candidate correlation function is used as the correlation function between the number of simultaneous online users and the resource load.
其中,所述最小二乘计算算法的原理是,根据业务要素正常日历史数据序列和资源负载量正常日历史数据序列中携带有相同监测时间的业务要素和资源负载量,可得n个节点,如(x1,y1),(x2,y2),(x3,y3)…,(xn,yn)。如图8所示,候选关联函数在相同x1,x2,x3,…,xn坐标处对应的y1’,y2’,y3’…,yn’值分别与y1,y2,y3,…,yn的差值的平方和,即为拟合残差。具体表示为:采用四种增长型函数进行函数拟合处理后的候选关联函数及各候选关联函数的拟合残差,如表2所示。Wherein, the principle of the least square calculation algorithm is that, according to the normal daily historical data sequence of business elements and the normal daily historical data sequence of resource load carrying business elements and resource loads with the same monitoring time, n nodes can be obtained, Such as (x 1 , y 1 ), (x 2 , y 2 ), (x 3 , y 3 )..., (x n , y n ). As shown in Figure 8, the values of y 1 ', y 2 ', y 3 '..., y n ' corresponding to the candidate correlation functions at the same x 1 , x 2 , x 3 , ... , x n coordinates are respectively the same as y 1 , The sum of the squares of the differences of y 2 , y 3 , ..., y n is the fitting residual. Specifically expressed as: The candidate correlation functions and the fitting residuals of each candidate correlation function are shown in Table 2 after using four kinds of growth functions for function fitting.
表2、候选关联函数及各候选关联函数的拟合残差对照表Table 2. Comparison table of candidate correlation functions and fitting residuals of each candidate correlation function
由上述表2可知,线性函数y=0.04x-45.00的拟合残差最小,该线性函数y=0.04x-45.00为GPS应用同时在线用户数与资源负载量的关联函数。It can be seen from the above table 2 that the fitting residual error of the linear function y=0.04x-45.00 is the smallest, and the linear function y=0.04x-45.00 is the correlation function between the number of simultaneous online users and the resource load of the GPS application.
最后,根据所述线性函数y=0.04x-45.00,将上述预测出的预期业务要素作为计算参数,即该线性函数中的x,计算出预期资源负载量y。根据图8所述的2012年1月2号~2012年7月1号的预期业务要素,计算出如图9所示的2012年1月2号~2012年7月1号的预期资源负载量。Finally, according to the linear function y=0.04x-45.00, the expected resource load y is calculated by using the predicted expected business elements as calculation parameters, that is, x in the linear function. According to the expected business elements from January 2, 2012 to July 1, 2012 described in Figure 8, calculate the expected resource load from January 2, 2012 to July 1, 2012 as shown in Figure 9 .
本领域普通技术人员可以理解:实现上述各方法实施例的全部或部分步骤可以通过程序指令相关的硬件来完成。前述的程序可以存储于一计算机可读取存储介质中。该程序在执行时,执行包括上述各方法实施例的步骤;而前述的存储介质包括:ROM、RAM、磁碟或者光盘等各种可以存储程序代码的介质。Those of ordinary skill in the art can understand that all or part of the steps for implementing the above method embodiments can be completed by program instructions and related hardware. The aforementioned program can be stored in a computer-readable storage medium. When the program is executed, it executes the steps including the above-mentioned method embodiments; and the aforementioned storage medium includes: ROM, RAM, magnetic disk or optical disk and other various media that can store program codes.
如图10所示,本发明提供的分析预测系统实施例一的结构示意图,如图中所示,所述分析预测系统包括:第一获取模块1、第一处理模块2、建立模块3和第二处理模块4。其中,所述第一获取模块1用于分别获取业务要素历史数据序列和资源负载量历史数据序列,其中,所述业务要素历史数据序列中各业务要素信息携带的监测时间分别与所述资源负载量历史数据序列中各资源负载量信息携带的监测时间相同,所述业务要素信息为业务运营监控系统将监测到的业务要素及监测时间一同存储至数据库中的信息,所述资源负载量信息为资源管理系统将监测到的资源负载量及监测时间一同存储至所述数据库中的信息。所述第一处理模块2用于根据所述业务要素历史数据序列,生成预期业务要素。所述建立模块3用于根据所述业务要素历史数据序列和资源负载量历史数据序列,建立业务要素与资源负载量的关联函数。所述第二处理模块4用于根据所述关联函数,生成所述预期业务要素对应的预期资源负载量。As shown in FIG. 10 , a schematic structural diagram of Embodiment 1 of the analysis and prediction system provided by the present invention. As shown in the figure, the analysis and prediction system includes: a first acquisition module 1, a
本发明实施例所述分析预测系统通过在预测过程中引入业务要素作为影响因素,通过拟合业务要素与资源负载量间的关联函数,实现了对该应用的资源负载量未来状态的准确预测。本实施例充分考虑了不同用户的应用部署需求以及各应用的负载均衡特性,为不同用户部署相应的资源,准确的预测出不同应用未来所需的资源负载量,提高了云计算平台的资源部署和维护机制,有助于提高云计算系统的基础设施资源的利用率。The analysis and prediction system described in the embodiment of the present invention realizes accurate prediction of the future state of the resource load of the application by introducing business elements as influencing factors in the prediction process and by fitting the correlation function between the business elements and the resource load. This embodiment fully considers the application deployment requirements of different users and the load balancing characteristics of each application, deploys corresponding resources for different users, accurately predicts the resource load required by different applications in the future, and improves the resource deployment of the cloud computing platform. And the maintenance mechanism helps to improve the utilization rate of the infrastructure resources of the cloud computing system.
进一步地,如图11所示,上述分析预测系统实施例还包括:第二获取模块5、判断模块6和执行模块7。其中,所述第二获取模块5用于获取业务要素信息。所述判断模块6用于判断所述业务要素信息携带的监测时间是否在预设奇异日时段内,若是,生成第一判断信息,否则,生成第二判断信息。所述执行模块用于根据所述第一判断信息,将所述业务要素信息存入业务要素奇异日历史数据序列;根据所述第二判断信息,将所述业务要素信息存入业务要素正常日历史数据序列。所述第二获取模块7还用于获取资源负载量信息。所述判断模块还用于判断所述资源负载量信息携带的监测时间是否在预设奇异日时段内,若是,生成第三判断信息,否则,生成第四判断信息。所述执行模块还用于根据所述第三判断信息,将所述资源负载量信息存入资源负载量奇异日历史数据序列;根据所述第二判断信息,将所述资源负载量信息存入资源负载量正常日历史数据序列。相应地,所述第一获取单元1获取的所述业务要素历史数据序列为业务要素奇异日历史数据序列,所述资源负载量历史数据序列为资源负载量奇异日历史数据序列,或者,所述第一获取单元获取的所述业务要素历史数据序列为业务要素正常日历史数据序列,所述资源负载量历史数据序列为资源负载量正常日历史数据序列。Further, as shown in FIG. 11 , the above embodiment of the analysis and prediction system further includes: a
再进一步地,上述分析预测系统实施例还包括:数据预处理模块。其中,所述数据预处理模块用于分别对所述业务要素历史数据序列和资源负载量历史数据序列进行数据预处理。Still further, the above-mentioned embodiment of the analysis and prediction system further includes: a data preprocessing module. Wherein, the data preprocessing module is used to perform data preprocessing on the historical data sequence of the business element and the historical data sequence of the resource load respectively.
更进一步的,上述分析预测系统实施例还包括:存储模块。所述存储模块用于将所述预期资源负载量存储至数据库中,以使所述服务管理系统从所述数据库中读取所述预期资源负载量,并根据所述预期资源负载量生成资源部署指令,所述资源管理系统根据所述资源部署指令执行资源部署。Furthermore, the above-mentioned embodiment of the analysis and prediction system further includes: a storage module. The storage module is configured to store the expected resource load in a database, so that the service management system reads the expected resource load from the database, and generates resource deployment according to the expected resource load An instruction, the resource management system executes resource deployment according to the resource deployment instruction.
其中,上述分析预测系统实施例中,所述第一处理模块可采用如图12所示的结构实现。具体地所述第一处理模块2包括:第一处理单元21和第二处理单元22。其中,所述第一处理单元21用于根据所述业务要素历史数据序列,得出预设的至少两种预测模型的预测误差。所述第二处理单元22用于根据所述业务要素历史数据序列,采用所述预测误差最小的预测模型计算预期业务要素。所述建立模块3可采用如图13所示的结构实现,具体地,所述建立模块3包括:拟合单元31、第三处理单元32和比较单元33。其中,所述拟合单元31用于根据所述业务要素历史数据序列和资源负载量历史数据序列,采用至少两个函数模型进行所述业务要素和资源负载量的函数拟合处理,生成至少两个候选关联函数。所述第三处理单元32用于根据所述业务要素历史数据序列和资源负载量历史数据序列,按照预设的最小二乘计算算法计算采用各候选关联函数的拟合残差。所述比较单元33用于比较各候选关联函数的拟合残差,将拟合残差最小的候选关联函数作为所述业务要素与资源负载量的关联函数。Wherein, in the above-mentioned embodiment of the analysis and prediction system, the first processing module can be realized by adopting the structure shown in FIG. 12 . Specifically, the
如图14所示,本发明提供的业务运营监控系统实施例一的结构示意图。如图中所示,本实施例所述业务运营监控系统包括:监测模块8和存储模块9。其中,所述监测模块8用于监测业务要素。所述存储模块9用于将监控到的所述业务要素及监测时间存储至数据库中,以使分析预测系统从所述数据库中获取业务要素历史数据序列,根据所述业务要素历史数据序列,生成预期业务要素,根据所述业务要素历史数据序列和资源负载量历史数据序列,建立业务要素与资源负载量的关联函数,根据所述关联函数,生成所述预期业务要素对应的预期资源负载量。其中,所述业务要素历史数据序列中各业务要素信息携带的监测时间分别与所述资源负载量历史数据序列中各资源负载量信息携带的监测时间相同,所述资源负载量历史数据序列由所述分析预测系统从所述数据库中获取,所述资源负载量信息为资源管理系统将监测到的资源负载量及监测时间一同存储至所述数据库中的信息。As shown in FIG. 14 , it is a schematic structural diagram of Embodiment 1 of the business operation monitoring system provided by the present invention. As shown in the figure, the business operation monitoring system in this embodiment includes: a
本发明实施例所述业务运营监控系统通过监测业务要素,可使分析预测系统在预测过程中引入业务要素作为影响因素,通过拟合业务要素与资源负载量间的关联函数,实现了对该应用的资源负载量未来状态的准确预测。本实施例充分考虑了不同用户的应用部署需求以及各应用的负载均衡特性,为不同用户部署相应的资源,准确的预测出不同应用未来所需的资源负载量,提高了云计算平台的资源部署和维护机制,有助于提高云计算系统的基础设施资源的利用率。The business operation monitoring system described in the embodiment of the present invention can enable the analysis and prediction system to introduce business elements as influencing factors in the forecasting process by monitoring the business elements, and realize the application by fitting the correlation function between the business elements and the resource load. accurate prediction of the future state of the resource load. This embodiment fully considers the application deployment requirements of different users and the load balancing characteristics of each application, deploys corresponding resources for different users, accurately predicts the resource load required by different applications in the future, and improves the resource deployment of the cloud computing platform. And the maintenance mechanism helps to improve the utilization rate of the infrastructure resources of the cloud computing system.
进一步地,上述业务运营监控系统实施例还包括接收模块。所述接收模块用于接收服务管理系统发送的监测指令信息,所述监测指令信息携带有欲监测业务要素,以使所述业务运营监控系统根据所述监测指令信息,监测所述业务要素。Further, the above embodiment of the business operation monitoring system further includes a receiving module. The receiving module is used to receive the monitoring instruction information sent by the service management system, the monitoring instruction information carries the service elements to be monitored, so that the business operation monitoring system can monitor the service elements according to the monitoring instruction information.
如图15所示,本发明提供的云计算系统架构实施例一的结构示意图。如图15中所示,本实施例所述云计算系统架构包括:服务管理系统11、数据库12、资源管理系统13、分析预测系统14以及业务运营监控系统15。其中,所述分析预测系统14采用上述各实施例中所述的分析预测系统。所述业务运营监控系统15采用上述各实施例中所述的业务运营监控系统。所述分析预测系统和所述业务运营监控系统的具体实现原理参见上述对应实施例中所揭露的相关内容,此处不再赘述。所述服务管理系统11用于实现SLA管理、服务目录管理、计费管理、客户管理等功能。其中SLA管理功能可以对SLA模板及其相关因素,如系统告警等,进行查看。服务目录管理功能可以对服务进行查询、开通、关闭和删除操作。计费管理功能可以对计费策略进行增加、删除以及对订单进行查询、续约和结算。客户管理功能可以对客户相关信息进行查询及修改。资源管理系统13用于实现资源监测、资源控制、动态配置、动态迁移等功能。其中资源监测功能主要针对物理机及虚拟机的CPU占用率、内存使用量、硬盘使用量、网络带宽占用率进行实时监测。资源控制功能主要对虚拟机进行开启、关闭、重启、暂停、恢复、休眠、唤醒等生命周期控制,对物理机进行开启、重启等生命周期控制。动态配置功能主要针对虚拟机在运行的情况下进行CPU或内存的配置。动态迁移功能主要针对虚拟机在运行的情况下,虚拟机从一个宿主机快速平滑的迁移到另一个宿主机上。As shown in FIG. 15 , it is a schematic structural diagram of Embodiment 1 of the cloud computing system architecture provided by the present invention. As shown in FIG. 15 , the cloud computing system architecture of this embodiment includes: a
在本发明所提供的几个实施例中,应该理解到,所揭露的系统,装置和方法,可以通过其它的方式实现。例如,以上所描述的装置实施例仅仅是示意性的,例如,所述单元的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,例如多个单元或组件可以结合或者可以集成到另一个系统,或一些特征可以忽略,或不执行。In the several embodiments provided by the present invention, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are only illustrative. For example, the division of the units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components can be combined or May be integrated into another system, or some features may be ignored, or not implemented.
所述作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是或者也可以不是物理单元,即可以位于一个地方,或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place, or may be distributed to multiple network units. Part or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.
另外,在本发明各个实施例中的各功能单元可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中。上述集成的单元既可以采用硬件的形式实现,也可以采用硬件加软件功能单元的形式实现。In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, each unit may exist separately physically, or two or more units may be integrated into one unit. The above-mentioned integrated units can be implemented in the form of hardware, or in the form of hardware plus software functional units.
上述以软件功能单元的形式实现的集成的单元,可以存储在一个计算机可读取存储介质中。上述软件功能单元存储在一个存储介质中,包括若干指令用以使得一台计算机设备(可以是个人计算机,服务器,或者网络设备等)或处理器(processor)执行本发明各个实施例所述方法的部分步骤。而前述的存储介质包括:U盘、移动硬盘、只读存储器(Read-Only Memory,简称ROM)、随机存取存储器(Random Access Memory,简称RAM)、磁碟或者光盘等各种可以存储程序代码的介质。The above-mentioned integrated units implemented in the form of software functional units may be stored in a computer-readable storage medium. The above-mentioned software functional units are stored in a storage medium, including several instructions to enable a computer device (which may be a personal computer, server, or network device, etc.) or a processor (processor) to execute the methods described in various embodiments of the present invention. partial steps. The aforementioned storage media include: U disk, mobile hard disk, read-only memory (Read-Only Memory, ROM for short), random access memory (Random Access Memory, RAM for short), magnetic disk or optical disk, etc., which can store program codes. medium.
需要说明的是:对于前述的各方法实施例,为了简单描述,故将其都表述为一系列的动作组合,但是本领域技术人员应该知悉,本发明并不受所描述的动作顺序的限制,因为依据本发明,某些步骤可以采用其他顺序或者同时进行。其次,本领域技术人员也应该知悉,说明书中所描述的实施例均属于优选实施例,所涉及的动作和模块并不一定是本发明所必须的。It should be noted that, for the foregoing method embodiments, for the sake of simple description, they are expressed as a series of action combinations, but those skilled in the art should know that the present invention is not limited by the described action sequence. Because of the present invention, certain steps may be performed in other orders or simultaneously. Secondly, those skilled in the art should also know that the embodiments described in the specification belong to preferred embodiments, and the actions and modules involved are not necessarily required by the present invention.
在上述实施例中,对各个实施例的描述都各有侧重,某个实施例中没有详述的部分,可以参见其他实施例的相关描述。所属领域的技术人员可以清楚地了解到,为描述的方便和简洁,上述描述的系统,装置和单元的具体工作过程,可以参考前述方法实施例中的对应过程,在此不再赘述。In the foregoing embodiments, the descriptions of each embodiment have their own emphases, and for parts not described in detail in a certain embodiment, reference may be made to relevant descriptions of other embodiments. Those skilled in the art can clearly understand that for the convenience and brevity of the description, the specific working process of the above-described system, device and unit can refer to the corresponding process in the foregoing method embodiment, which will not be repeated here.
最后应说明的是:以上实施例仅用以说明本发明的技术方案,而非对其限制;尽管参照前述实施例对本发明进行了详细的说明,本领域的普通技术人员应当理解:其依然可以对前述各实施例所记载的技术方案进行修改,或者对其中部分技术特征进行等同替换;而这些修改或者替换,并不使相应技术方案的本质脱离本发明各实施例技术方案的精神和范围。Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that: it can still be Modifications are made to the technical solutions described in the foregoing embodiments, or equivalent replacements are made to some of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the various embodiments of the present invention.
Claims (10)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201210397865.7A CN103778474A (en) | 2012-10-18 | 2012-10-18 | Resource load capacity prediction method, analysis prediction system and service operation monitoring system |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201210397865.7A CN103778474A (en) | 2012-10-18 | 2012-10-18 | Resource load capacity prediction method, analysis prediction system and service operation monitoring system |
Publications (1)
Publication Number | Publication Date |
---|---|
CN103778474A true CN103778474A (en) | 2014-05-07 |
Family
ID=50570682
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201210397865.7A Pending CN103778474A (en) | 2012-10-18 | 2012-10-18 | Resource load capacity prediction method, analysis prediction system and service operation monitoring system |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN103778474A (en) |
Cited By (20)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN104135525A (en) * | 2014-07-31 | 2014-11-05 | 广州杰赛科技股份有限公司 | Resource expanding method and device for cloud platform ELB components |
CN105607948A (en) * | 2015-12-18 | 2016-05-25 | 国云科技股份有限公司 | Virtual machine migration prediction method based on SLA |
CN106254166A (en) * | 2016-09-30 | 2016-12-21 | 中国银联股份有限公司 | A kind of cloud platform resource allocation method based on Disaster Preparation Center and system |
CN107517481A (en) * | 2017-09-21 | 2017-12-26 | 上海斐讯数据通信技术有限公司 | A kind of load of base station balanced management method and system |
CN107977986A (en) * | 2016-10-21 | 2018-05-01 | 北京君正集成电路股份有限公司 | The Forecasting Methodology and device of a kind of movement locus |
CN108241864A (en) * | 2016-12-26 | 2018-07-03 | 摩根士丹利服务集团有限公司 | Server performance Forecasting Methodology based on multivariable grouping |
CN109324905A (en) * | 2018-09-30 | 2019-02-12 | 拉卡拉支付股份有限公司 | Database operation method, device, electronic equipment and storage medium |
CN109388480A (en) * | 2018-11-01 | 2019-02-26 | 郑州云海信息技术有限公司 | A kind of method and device handling cloud resource |
CN109543891A (en) * | 2018-11-09 | 2019-03-29 | 深圳前海微众银行股份有限公司 | Method for building up, equipment and the computer readable storage medium of capacity prediction model |
CN109640094A (en) * | 2018-11-27 | 2019-04-16 | Oppo广东移动通信有限公司 | Video encoding/decoding method, device and electronic equipment |
CN109918170A (en) * | 2019-01-25 | 2019-06-21 | 西安电子科技大学 | A kind of cloud data center virtual machine dynamic resource allocation method and system |
CN110321240A (en) * | 2019-06-28 | 2019-10-11 | 阿里巴巴集团控股有限公司 | A kind of business impact assessment method and apparatus based on time series forecasting |
CN110609747A (en) * | 2019-08-29 | 2019-12-24 | 联想(北京)有限公司 | Information processing method and electronic equipment |
CN110858346A (en) * | 2018-08-22 | 2020-03-03 | 阿里巴巴集团控股有限公司 | Data processing method, device and machine readable medium |
CN110875838A (en) * | 2018-09-03 | 2020-03-10 | 中移(杭州)信息技术有限公司 | A resource deployment method, device and storage medium |
CN111143165A (en) * | 2019-12-20 | 2020-05-12 | 深圳前海微众银行股份有限公司 | Monitoring method and device |
CN111598299A (en) * | 2020-06-10 | 2020-08-28 | 西安陕鼓动力股份有限公司 | Energy load prediction method and system based on phase space reconstruction and first-order local area method |
CN112000457A (en) * | 2019-05-27 | 2020-11-27 | 伊姆西Ip控股有限责任公司 | Method, apparatus and computer program product for managing tasks in a processing system |
CN112035324A (en) * | 2020-09-03 | 2020-12-04 | 中国银行股份有限公司 | Batch job execution condition monitoring method and device |
CN113760515A (en) * | 2020-06-03 | 2021-12-07 | 戴尔产品有限公司 | Configuration optimization with performance prediction |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20090235268A1 (en) * | 2008-03-17 | 2009-09-17 | David Isaiah Seidman | Capacity planning based on resource utilization as a function of workload |
CN102082703A (en) * | 2009-11-26 | 2011-06-01 | 中国移动通信集团贵州有限公司 | Method and device for monitoring equipment performance of service supporting system |
US20110276982A1 (en) * | 2010-05-06 | 2011-11-10 | Hitachi, Ltd. | Load Balancer and Load Balancing System |
CN102326134A (en) * | 2009-02-23 | 2012-01-18 | 微软公司 | Energy-aware server management |
-
2012
- 2012-10-18 CN CN201210397865.7A patent/CN103778474A/en active Pending
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20090235268A1 (en) * | 2008-03-17 | 2009-09-17 | David Isaiah Seidman | Capacity planning based on resource utilization as a function of workload |
CN102326134A (en) * | 2009-02-23 | 2012-01-18 | 微软公司 | Energy-aware server management |
CN102082703A (en) * | 2009-11-26 | 2011-06-01 | 中国移动通信集团贵州有限公司 | Method and device for monitoring equipment performance of service supporting system |
US20110276982A1 (en) * | 2010-05-06 | 2011-11-10 | Hitachi, Ltd. | Load Balancer and Load Balancing System |
Non-Patent Citations (1)
Title |
---|
陈蓉: "话务量分析和多种预测模型的比较研究", 《中国优秀硕士学位论文全文数据库(经济与管理科学辑)》 * |
Cited By (29)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN104135525A (en) * | 2014-07-31 | 2014-11-05 | 广州杰赛科技股份有限公司 | Resource expanding method and device for cloud platform ELB components |
CN104135525B (en) * | 2014-07-31 | 2017-12-01 | 广州杰赛科技股份有限公司 | The resource expansion method and apparatus of cloud platform ELB components |
CN105607948A (en) * | 2015-12-18 | 2016-05-25 | 国云科技股份有限公司 | Virtual machine migration prediction method based on SLA |
CN106254166A (en) * | 2016-09-30 | 2016-12-21 | 中国银联股份有限公司 | A kind of cloud platform resource allocation method based on Disaster Preparation Center and system |
CN106254166B (en) * | 2016-09-30 | 2020-06-23 | 中国银联股份有限公司 | Disaster recovery center-based cloud platform resource configuration method and system |
CN107977986A (en) * | 2016-10-21 | 2018-05-01 | 北京君正集成电路股份有限公司 | The Forecasting Methodology and device of a kind of movement locus |
CN107977986B (en) * | 2016-10-21 | 2021-11-23 | 北京君正集成电路股份有限公司 | Method and device for predicting motion trail |
CN108241864A (en) * | 2016-12-26 | 2018-07-03 | 摩根士丹利服务集团有限公司 | Server performance Forecasting Methodology based on multivariable grouping |
CN107517481A (en) * | 2017-09-21 | 2017-12-26 | 上海斐讯数据通信技术有限公司 | A kind of load of base station balanced management method and system |
CN107517481B (en) * | 2017-09-21 | 2021-06-04 | 台州市吉吉知识产权运营有限公司 | Base station load balancing management method and system |
CN110858346A (en) * | 2018-08-22 | 2020-03-03 | 阿里巴巴集团控股有限公司 | Data processing method, device and machine readable medium |
CN110858346B (en) * | 2018-08-22 | 2023-05-02 | 阿里巴巴集团控股有限公司 | Data processing method, apparatus and machine readable medium |
CN110875838A (en) * | 2018-09-03 | 2020-03-10 | 中移(杭州)信息技术有限公司 | A resource deployment method, device and storage medium |
CN110875838B (en) * | 2018-09-03 | 2022-10-18 | 中移(杭州)信息技术有限公司 | Resource deployment method, device and storage medium |
CN109324905A (en) * | 2018-09-30 | 2019-02-12 | 拉卡拉支付股份有限公司 | Database operation method, device, electronic equipment and storage medium |
CN109388480A (en) * | 2018-11-01 | 2019-02-26 | 郑州云海信息技术有限公司 | A kind of method and device handling cloud resource |
CN109543891A (en) * | 2018-11-09 | 2019-03-29 | 深圳前海微众银行股份有限公司 | Method for building up, equipment and the computer readable storage medium of capacity prediction model |
CN109543891B (en) * | 2018-11-09 | 2022-02-01 | 深圳前海微众银行股份有限公司 | Method and apparatus for establishing capacity prediction model, and computer-readable storage medium |
CN109640094B (en) * | 2018-11-27 | 2021-06-15 | Oppo广东移动通信有限公司 | Video decoding method, device and electronic device |
CN109640094A (en) * | 2018-11-27 | 2019-04-16 | Oppo广东移动通信有限公司 | Video encoding/decoding method, device and electronic equipment |
CN109918170A (en) * | 2019-01-25 | 2019-06-21 | 西安电子科技大学 | A kind of cloud data center virtual machine dynamic resource allocation method and system |
CN112000457A (en) * | 2019-05-27 | 2020-11-27 | 伊姆西Ip控股有限责任公司 | Method, apparatus and computer program product for managing tasks in a processing system |
CN110321240B (en) * | 2019-06-28 | 2023-06-09 | 创新先进技术有限公司 | Business impact assessment method and device based on time sequence prediction |
CN110321240A (en) * | 2019-06-28 | 2019-10-11 | 阿里巴巴集团控股有限公司 | A kind of business impact assessment method and apparatus based on time series forecasting |
CN110609747A (en) * | 2019-08-29 | 2019-12-24 | 联想(北京)有限公司 | Information processing method and electronic equipment |
CN111143165A (en) * | 2019-12-20 | 2020-05-12 | 深圳前海微众银行股份有限公司 | Monitoring method and device |
CN113760515A (en) * | 2020-06-03 | 2021-12-07 | 戴尔产品有限公司 | Configuration optimization with performance prediction |
CN111598299A (en) * | 2020-06-10 | 2020-08-28 | 西安陕鼓动力股份有限公司 | Energy load prediction method and system based on phase space reconstruction and first-order local area method |
CN112035324A (en) * | 2020-09-03 | 2020-12-04 | 中国银行股份有限公司 | Batch job execution condition monitoring method and device |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN103778474A (en) | Resource load capacity prediction method, analysis prediction system and service operation monitoring system | |
Bhattacharjee et al. | Barista: Efficient and scalable serverless serving system for deep learning prediction services | |
US10949116B2 (en) | Storage resource capacity prediction utilizing a plurality of time series forecasting models | |
US20070250630A1 (en) | Method and a system of generating and evaluating potential resource allocations for an application | |
CN108089921A (en) | Server for cloud big data operation architecture and operation resource optimization method thereof | |
Ghorbani et al. | Prediction and control of bursty cloud workloads: a fractal framework | |
CN113615137B (en) | CDN optimization platform | |
US20150271023A1 (en) | Cloud estimator tool | |
CN109460301B (en) | A method and system for configuring elastic resources for streaming data load | |
CN115297112A (en) | Dynamic resource quota and scheduling component based on Kubernetes | |
CN107301466A (en) | To business load and resource distribution and the Forecasting Methodology and forecasting system of property relationship | |
CN117479049B (en) | Data transmission control method for intelligent fuel gas, internet of things system and medium | |
Mahan et al. | A novel resource productivity based on granular neural network in cloud computing | |
Xiao et al. | Dscaler: A horizontal autoscaler of microservice based on deep reinforcement learning | |
CN117435306A (en) | Cluster container expansion and contraction method, device, equipment and storage medium | |
CN114172819A (en) | Demand resource prediction method, system, electronic device and storage medium for NFV network element | |
CN105656709A (en) | Method and apparatus for predicting capacity of packet domain network | |
Milocco et al. | Evaluating the upper bound of energy cost saving by proactive data center management | |
CN118245205A (en) | Hybrid multi-cloud resource scheduling method based on GPT technology and genetic optimization | |
Rac et al. | Cost-effective scheduling for kubernetes in the edge-to-cloud continuum | |
CN115269176A (en) | Task allocation method, device, computer equipment, storage medium and product | |
Rayan et al. | Resource Prediction for Big Data Processing in a Cloud Data Center: A Machine Learning Approach: A Machine Learning Approach | |
Preetham et al. | Resource provisioning in cloud using ARIMA and LSTM technique | |
CN111277445B (en) | Method and device for evaluating performance of online node server | |
Lasantha et al. | Priority based modeling and comparative study of Google cloud resources between 2011 and 2019 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
RJ01 | Rejection of invention patent application after publication | ||
RJ01 | Rejection of invention patent application after publication |
Application publication date: 20140507 |