Background technology
The investigation display of certain operator external, in the client having negative user experience, the customer selecting of 98% is not complained, and half wherein directly turns net, so also causes the operator likely large losses client when network operation index is good.Traditional network optimization and appraisal procedure have been difficult to adapt to new customer demand, become common recognition in the industry to promote new network optimization that user awareness is target.
Traditional network quality assessment is the appraisement system taking KPI (Key Performance Indication), KPI and critical sales index, normally network level monitor measurable important parameter.KPI from a side reflection network quality, but can not reflect the quality of network in general, and more can not reflect Consumer's Experience, because single KPI can only from the performance of a side projection network, often limitation is high especially.
Such as, traditional network quality inspection requires that network meets every KPI, if this every, network KPI has just passed, then judges that network quality is qualified, and in fact network quality is probably and bad; If the KPI of network in general is very outstanding, an insignificant KPI is only had just not reach requirement, at this moment network probably quality be good, and according to KPI, we can judge that network quality is defective, similarly, a communication network may use few area to be qualified at video, uses many areas just dying at video.
Current mobile network's test system problems faced is inquired into below with concrete scene:
When certain user in somewhere sees video with data network, find that experience is bad, video has Ka Dun and unsharp phenomenon, but be through Drive Test Data Analysis and find that the critical sales index KPI in this user area is fine, the coverage rate being embodied in this community, user place has been 100%, RRC (Radio Resource Control, radio resource control) connect into power, RAB (Radio Access Bearer, the carrying of user plane) be created as power, wireless interface passband and RNC (Radio Network Controller, radio network controller) index of correlation such as soft handover success rate is more than 95%, and find through core net test, network quality KQI (Key Quality Indicators, Key Quality Indicator) also fine: TCP (the Transmission Control Protocol monitored, transmission control protocol) retransmission rate is low, RTT two-way time (Round-Trip Time) is less, and time delay is little etc., under normal circumstances, think according to this series of tests, network condition is good, up to standard.But actual conditions be user's side reaction out be but experience very poor, this shows that KPI and KQI cannot complete reaction Consumer's Experience.
So, a kind of index for network thoroughly evaluating is more needed in Network Quality Analysis, be badly in need of traditional network monitor index and different application corresponding modeling analysis respectively such as KPI and KQI, the real user such as adopting the Qoe index (Quality of Experience, Consumer's Experience index) closest to user's impression to carry out reaction network experiences situation.
In addition, in network, business determines the demand of network for network quality.The network of information to be all the network of Email and information be all instant video is different for the demand of network quality certainly.The business that zones of different uses, offered load are different, and a network may can complete the task of Internet Transmission smoothly in a region, but the task of completing Internet Transmission in other region possibly will go wrong.
Operator of China is made the transition to the network optimization based on user awareness by the network optimization based on performance index.Following difficulty is faced among transformation process:
(1) first, lack the end-to-end QoS evaluation and test based on Consumer's Experience and analytical system, comprise collecting device, test system and analysis software instrument etc., to promote service management and the Consumer's Experience of user oriented perception.
(2) again, with user awareness be foundation assessing network system need improve and standardization, be badly in need of the user experience quality system proposing complete set maturation, true reflection user awareness, there is operability, wherein set up user's body check the quality index QoE index with between Key Quality Indicator KQI and Key Performance Indicator KPI associate and mapping is the key of appraisement system.
(3) last, the optimum theory of user oriented perception and optimization method are also immature, need to continue exploration and practice.
Corresponding, radio network problems is detected, faces following Railway Project at present:
(1) how by judging quality of service, judge whether network has problems, or whether network can meet current service needed.
(2) when confirmation current network has problem or can not meet current service needed, the index that how bad according to performance we are, where estimation network may go wrong and which element of estimation network may damage or not satisfy the demands.
(3) needed to collect a large amount of business error datas before finding problem, therefrom extract the business datum that can not satisfy the demands, what rely on each business that can not satisfy the demands may be caused by which network problem determines in network, which element is out of joint.
Summary of the invention
The object of the invention is the shortcoming overcoming above-mentioned prior art, provide the system and method that a kind ofly can judge whether network quality has problems by quality of service, realize network quality case study positioning control from the network quality communication network that recursion is found out concrete network of problem element, avoids traditional network quality assessment cannot find Consumer's Experience problem, analyzed comprehensively layer by layer, accuracy is high.
Realize the system and method for network quality case study positioning control to achieve these goals in communication network, of the present invention have following formation:
Realize the system of network quality case study positioning control in this communication network, its main feature is, described system comprises:
Network quality detection module, in order to be sent to described index analysis decomposing module when network quality goes wrong by case study instruction;
Index analysis decomposing module, in-problem one-level problem index is obtained in order to the first class index that each business analyzing described network is corresponding, and the one-level problem index described in decomposing obtains corresponding two-level index, and the two-level index described in analyzing obtains in-problem secondary problem index;
Described all three grades of indexs in order to collect all three grades of indexs corresponding to described secondary problem index, and are sent to network problem locating module by index collection module;
Network problem locating module, in order to analyze all three grades of indexs that described index collection module is collected, and judges the position of network of problem element according to analysis result.
Wherein, described first class index is the Key Quality Indicator that in described network, each business is corresponding, described two-level index is KPI Key Performance Indicator corresponding to described one-level problem index, and three grades of described indexs are the KPI Key Performance Indicator of network element corresponding to described secondary problem index.
In addition, the present invention also provides a kind of method realizing network quality case study positioning control in communication network, and the method comprises the following steps:
(1) described case study instruction is sent to described index analysis decomposing module when network quality goes wrong by the network quality detection module described in;
(2) the case study instruction described in index analysis decomposing module described in receives, and first class index corresponding to each business of network described in analyzing obtains in-problem one-level problem index;
(3) the one-level problem index described in the decomposition of index analysis decomposing module described in obtains corresponding two-level index, and the two-level index described in analyzing obtains in-problem secondary problem index;
(4) all three grades of indexs that the secondary problem index described in the collection of index collection module described in is corresponding, and described all three grades of indexs are sent to described network problem locating module;
(5) all three grades of indexs described in the analysis of network problem locating module described in, and the position of network of problem element is judged according to analysis result.
Further, described case study instruction is sent to described index decomposition module when network quality goes wrong by described network quality detection module, comprises the following steps:
(1.1) the Consumer's Experience index that the network quality detection module described in is corresponding according to described network judges whether network quality has problems;
(1.2) if judged result is network quality existing problems, then continue step (1.3), otherwise continue step (1.1);
(1.3) described case study instruction is sent to described index analysis decomposing module by the network quality detection module described in.
Further, before described step (1), comprise the following steps:
(0) the network quality detection module described in measures quality of service index corresponding to each business of described network, and obtains described Consumer's Experience index according to described quality of service index calculate.
Further, between described step (3) and (4), further comprising the steps of:
(3.1) information of described secondary problem index is sent to described index collection module by the index analysis decomposing module described in.
Have employed in communication network the system and method realizing network quality case study positioning control, when QoE is lower than a certain particular value, miscellaneous service KQI is decomposed into KPI and then the position at place of pinpointing the problems by us, the analysis of network quality is no longer the stiff requirement for KPI, the substitute is one Network Quality Analysis method flexibly.
Simultaneously, because the communication network of varying environment has different concrete quality requirements for business, the present invention integrates for the business in communication network and classifies, be divided into the subservice of six large types and its correspondence, when analyzing network quality, communication network is required also different for variety classes business need difference and corresponding subservice and impact that is that produce is taken into account, the benchmark that to accomplish with business KQI be Network Quality Analysis, makes the result of Network Quality Analysis more consistent with Consumer's Experience.
The object of our Network Quality Analysis is the assessment experience of user and the performance of Sampling network, Consumer's Experience can only be assessed by quality of service, so analyze network quality by business KQI, so we need not analyze the quality of network element at the beginning, also the KPI of each business in network need not be analyzed, our Water demand service feature.Service feature is difficult to by business KPI direct-detection out, because service feature is except being determined by network performance, also determined by the performance of terminal capabilities and application service end, so it is more reliable than being undertaken analyzing by business KPI to analyze network quality by business KQI.
If network quality difference only causes because client is of poor quality or application service end is of poor quality, so we are judging that QoE can be judged by business KPI after sub-standard.Like this we would not because of client of poor quality or application service end is of poor quality and the judgement network element of mistake existing problems, realize the analysis of the whole network full-service, and then can reflect that user uses the actual experience perception of business fast and accurately, there is range of application more widely.
Embodiment
In order to more clearly describe technology contents of the present invention, conduct further description below in conjunction with specific embodiment.
Refer to shown in Fig. 1, in one embodiment, the system realizing network quality case study positioning control in communication network comprises:
Network quality detection module, in order to be sent to described index analysis decomposing module when network quality goes wrong by case study instruction;
Index analysis decomposing module, in-problem one-level problem index is obtained in order to the first class index that each business analyzing described network is corresponding, and the one-level problem index described in decomposing obtains corresponding two-level index, and the two-level index described in analyzing obtains in-problem secondary problem index;
Described all three grades of indexs in order to collect all three grades of indexs corresponding to described secondary problem index, and are sent to network problem locating module by index collection module;
Network problem locating module, in order to analyze all three grades of indexs that described index collection module is collected, and judges the position of network of problem element according to analysis result.
Wherein, described first class index is the Key Quality Indicator that in described network, each business is corresponding, described two-level index is KPI Key Performance Indicator corresponding to described one-level problem index, and three grades of described indexs are the KPI Key Performance Indicator of network element corresponding to described secondary problem index.
In addition, the present invention also provides a kind of method realizing network quality case study positioning control in communication network, and as shown in Figure 2, the method comprises the following steps:
(1) described case study instruction is sent to described index analysis decomposing module when network quality goes wrong by the network quality detection module described in;
(2) the case study instruction described in index analysis decomposing module described in receives, and first class index corresponding to each business of network described in analyzing obtains in-problem one-level problem index;
(3) the one-level problem index described in the decomposition of index analysis decomposing module described in obtains corresponding two-level index, and the two-level index described in analyzing obtains in-problem secondary problem index;
(4) all three grades of indexs that the secondary problem index described in the collection of index collection module described in is corresponding, and described all three grades of indexs are sent to described network problem locating module;
(5) all three grades of indexs described in the analysis of network problem locating module described in, and the position of network of problem element is judged according to analysis result.
In a preferred embodiment, described case study instruction is sent to described index decomposition module when network quality goes wrong by described network quality detection module, comprises the following steps:
(1.1) the Consumer's Experience index that the network quality detection module described in is corresponding according to described network judges whether network quality has problems;
(1.2) if judged result is network quality existing problems, then continue step (1.3), otherwise continue step (1.1);
(1.3) described case study instruction is sent to described index analysis decomposing module by the network quality detection module described in.
In the preferred execution mode of one, before described step (1), comprise the following steps:
(0) the network quality detection module described in measures quality of service index corresponding to each business of described network, and obtains described Consumer's Experience index according to described quality of service index calculate.
In a preferred embodiment, between described step (3) and (4), further comprising the steps of:
(3.1) information of described secondary problem index is sent to described index collection module by the index analysis decomposing module described in.
According to the quality of service index of each business, described system judges whether Consumer's Experience index QoE has problems, and often kind of quality of service index is determined by the KQI of this business, although Consumer's Experience index QoE can not measure in network terminal completely, but but can estimate according to quality of service index, consider that the network of different business has different concrete quality requirements, so propose a kind of more optimal embodiment on the basis of above-mentioned system and method, this embodiment comprises two parts:
1) first, the subservice KQI index of miscellaneous service in Sampling network, obtains the business KQI index of miscellaneous service, then experiences index QoE according to the frequency of utilization estimating user of the different business in network.
2) when Consumer's Experience index goes wrong, the subservice KQI index of miscellaneous service is decomposed by we, be decomposed into subservice KPI index corresponding in network, decomposing in the subservice KPI index obtained, for problematic subservice KPI index, corresponding concrete KPI index in our further Sampling network, the concrete KPI index detected further is the reason that the KPI index that possible cause being decomposed goes wrong, and then the position at place of pinpointing the problems.
Part I is performed by network quality detection module, and Part II is processed by index analysis decomposing module, index collection module and network problem locating module.
By reference to the levels of standards 3GPP2 S.R0079-A " Support for End-to-End QoS " of standardization body 3gpp2, find that business is divided into instant conversation class, interactive class, Streaming Media class and background classes by this file, analyze network quality according to the different business in communication network, dissimilar business will have different network quality requirements.The same with this normative document of 3gpp2, business is also classified when analyzing network quality by the present invention, thus whether analysis network quality meets business need, as shown in Figure 3, business is divided into six types, comprise web-browsing service, page video traffic, FTP downloading service, game service, mail and instant messaging service, to determine different business frequency of utilization different for environment for use in a communication network, and the impact of different business KQI on Consumer's Experience index QoE is different, so need to consider weight when utilizing different business KQI to calculate Consumer's Experience index QoE.
Business weight according to often kind of business KQI and correspondence thereof estimating user can experience index QoE by calculating, wherein, described business weight is determined by the frequency of utilization of business, if we can obtain the active situation of whole communication network, so we can have detailed understanding for all service conditions of communication network, if we can only partial data in collection network, so our frequency of occurrences with regard to needing the frequency of occurrences of collecting each business in data according to us to estimate each business in communication network.The business frequency of utilization of diverse geographic location may be different, so different service needed analyzes network quality objectively according to the business frequency of occurrences, described operational authority is reused wi and is represented (i=a, b, c, d, e, f), by the Key Quality Indicator of six types, namely web page browsing KQI, the page video KQI, FTP download KQI, game KQI, mail KQI and instant messaging KQI are designated as KQIa, KQIb, KQIc, KQId, KQIe and KQIf, and Consumer's Experience Index Formula is shown below:
QoE=wa×KQIa+wb×KQIb+wc×KQIc+wd×KQId+we×KQIe+wf×KQIf
In addition, as shown in Figure 3, different business can according to promptness, availability and fluency carry out classifying and obtain subservice KQI and subservice KQI has specific mapping relations with corresponding subservice KPI, and after the subservice KPI data of described network quality detection module collection network, need each subservice KPI data nondimensionalization, such as, the subservice KPI data corresponding relation figure of usual various transmission speed and nondimensionalization as shown in Figure 4, speed of download lower than certain limit alternatively bright network have problem, such as congestion problems or other what problems, but after speed of download is lower than a certain particular value, its nondimensionalization subservice KPI declines rapidly, this is because now downloading rate is difficult to the quality proving network quality, downloading rate may be because the limited bandwidth that user buys causes slowly completely.
Communication network is made up of various network element, these network elements determine network performance, the height etc. of such as packet loss, and network performance determines service feature, the such as size etc. of page end-to-end time delay, simultaneously, service feature determines the experience of user, for video traffic, the transmission quality of video is determined by the network element in communication network in essence, the subservice KQI that the business KPI that the network performances such as the packet loss in communication network are corresponding and this business KPI is corresponding is determined due to network element, comprise video end-to-end time delay KQI, the end-to-end success rate KQI of video and the such service part quality KQI of transmission of video speed, the subservice KQI of these video traffics determines video traffic KQI, the KQI of the video traffic KQI obtained and other business of acquisition determines the value of the Consumer's Experience index QoE of communication network jointly.
According to above-mentioned corresponding relation, by the Key Quality Indicator of six types, namely web page browsing KQI, the page video KQI, FTP download KQI, game KQI, mail KQI and instant messaging KQI are designated as KQIa, KQIb, KQIc, KQId, KQIe and KQIf, the Key Quality Indicator of several subservices that each business is corresponding is designated as KQI1, KQI2, KQI3.Subservice weight corresponding to each subservice is respectively w1, w2, w3, the impact of subservice weight on business KQI that different subservice KQI is corresponding is different, such as mail time delay weight corresponding to mail time delay subservice is just very low on the impact of mail service, when instant messaging corresponding to instant messaging end-to-end time delay subservice is end-to-end, weight is high for the impact of instant messaging service.So for different subservices, corresponding w1, w2, w3 have significant difference.
We utilize the subservice KQI of business and the subservice weight of its correspondence to estimate business KQI, wherein said subservice weight is determined by its importance, for page browsing business, subservice KQI1, subservice KQI2 and subservice KQI3 represent web page browsing end-to-end time delay KQI respectively, the end-to-end success rate KQI of web page browsing and web page browsing downloading rate KQI, the subservice weight of its correspondence is w1, w2, w3 respectively, and the mathematical formulae of page browsing business KQI is shown below:
KQIa=w1×KQI1+w2×KQI2+w3×KQI3
The relation of the business KQI of other several types and its subservice KQI and respective weights thereof by that analogy, then tries to achieve corresponding Consumer's Experience index by the business KQI of gained.
As shown in Figure 5, be the corresponding relation figure of KPI, KQI and the QoE in communication network, we can measure the KPI index in network, also directly can measure the part mass KQI index of each business, and then draw the KQI index of each business.In network quality detection module, according to KQI, we judge whether the QoE of network touches the mark.
As shown in Figure 5, network signal is by Ue (User Equipment, subscriber equipment), NodeB (base station of 3G network), the network components such as RNC, MSC (Mobile Switching Center, mobile switching centre).User's online has the steps such as Call Attemp (call try), Call Alert (call prompt), Call Connection (call connection), Call Termination (end call), thereby produce session data record (SDR, Session Data Record), SDR indirectly can show the call experience of user, we judge business KQI by SDR, and then judge that whether QoE is qualified.Be to obtain transmission data record (TDR, Transaction Data Record) between network different piece, among TDR, we can obtain there are corresponding mapping relations between KPI and KQI, and the KPI parameter of network determines business KQI.
When QoE is lower than certain value, we think that problem has appearred in network.At this moment need to find the problem in network.This task is processed by index analysis decomposing module, index collection module network problem locating module.First we judge first class index, the i.e. size of subservice KQI, judge whether this part quality of service has gone wrong accordingly, if quality of service has gone wrong, we continue first class index to be decomposed into corresponding two-level index, corresponding subservice KPI is resolved into by subservice KQI, decomposable process is as shown in table 1 below, detect two-level index and judge which existing problem in two-level index, after finding out in-problem two-level index, we detect the concrete KPI index of network site corresponding to secondary problem index, i.e. three grades of indexs, the index of such as wireless side, the index of core net, and then judge which network element existing problem.
Owing to there being the index of many KPI among a network, we need not detect all KPI indexs, only need to detect the concrete KPI index relevant to going out secondary problem index, if such as TCP connection duration is out of joint, we just can detect the KPI coefficient of long correlation when being connected with TCP.When judging that certain KPI coefficient goes wrong, we enumerate the various possibilities that this coefficient goes wrong, and collect a large number of services and to go wrong data, and then judge which element concrete has gone wrong.
Cause because the root problem of network is element, and the mode that we understand the performance of element can only be understood by KPI, a KPI goes wrong, and has the possibility of many element problem.Such as packet loss is too serious, may be because network capacity is little, congestedly to cause, also may cause because network signal quality is bad.So need by collecting a large amount of data, by compare flow large time packet loss and the packet loss of flow hour to determine the end be that network capacity has problem or signal quality has problem, and then determine problematic element.
The decomposition corresponding relation of table 1 subservice KQI and subservice KPI
Have employed in communication network the system and method realizing network quality case study positioning control, when QoE is lower than a certain particular value, miscellaneous service KQI is decomposed into KPI and then the position at place of pinpointing the problems by us, the analysis of network quality is no longer the stiff requirement for KPI, the substitute is one Network Quality Analysis method flexibly.
Simultaneously, because the communication network of varying environment has different concrete quality requirements for business, the present invention integrates for the business in communication network and classifies, be divided into the subservice of six large types and its correspondence, when analyzing network quality, communication network is required also different for variety classes business need difference and corresponding subservice and impact that is that produce is taken into account, the benchmark that to accomplish with business KQI be Network Quality Analysis, makes the result of Network Quality Analysis more consistent with Consumer's Experience.
The object of our Network Quality Analysis is the assessment experience of user and the performance of Sampling network, Consumer's Experience can only be assessed by quality of service, so analyze network quality by business KQI, so we need not analyze the quality of network element at the beginning, also the KPI of each business in network need not be analyzed, our Water demand service feature.Service feature is difficult to by business KPI direct-detection out, because service feature is except being determined by network performance, also determined by the performance of terminal capabilities and application service end, so it is more reliable than being undertaken analyzing by business KPI to analyze network quality by business KQI.
If network quality difference only causes because client is of poor quality or application service end is of poor quality, so we are judging that QoE can be judged by business KPI after sub-standard.Like this we would not because of client of poor quality or application service end is of poor quality and the judgement network element of mistake existing problems, realize the analysis of the whole network full-service, and then can reflect that user uses the actual experience perception of business fast and accurately, there is range of application more widely.
In this description, the present invention is described with reference to its specific embodiment.But, still can make various amendment and conversion obviously and not deviate from the spirit and scope of the present invention.Therefore, specification and accompanying drawing are regarded in an illustrative, rather than a restrictive.