CN115361284A - A deployment adjustment method for SDN-based virtual network functions - Google Patents
A deployment adjustment method for SDN-based virtual network functions Download PDFInfo
- Publication number
- CN115361284A CN115361284A CN202210716111.7A CN202210716111A CN115361284A CN 115361284 A CN115361284 A CN 115361284A CN 202210716111 A CN202210716111 A CN 202210716111A CN 115361284 A CN115361284 A CN 115361284A
- Authority
- CN
- China
- Prior art keywords
- node
- physical
- network
- virtual network
- path
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 230000006870 function Effects 0.000 title claims abstract description 90
- 238000000034 method Methods 0.000 title claims abstract description 46
- 238000004808 supercritical fluid chromatography Methods 0.000 claims abstract description 38
- 238000002037 sum-frequency generation spectroscopy Methods 0.000 claims description 30
- 238000012545 processing Methods 0.000 claims description 19
- 238000010845 search algorithm Methods 0.000 claims description 12
- 230000008569 process Effects 0.000 claims description 10
- 238000004590 computer program Methods 0.000 claims description 2
- 239000002243 precursor Substances 0.000 claims 2
- 239000002131 composite material Substances 0.000 claims 1
- 238000004422 calculation algorithm Methods 0.000 description 24
- 238000004891 communication Methods 0.000 description 11
- 238000005457 optimization Methods 0.000 description 11
- 238000010586 diagram Methods 0.000 description 7
- 238000005516 engineering process Methods 0.000 description 7
- 230000008859 change Effects 0.000 description 6
- 230000005540 biological transmission Effects 0.000 description 5
- 238000013210 evaluation model Methods 0.000 description 5
- 238000013507 mapping Methods 0.000 description 5
- 101100380241 Caenorhabditis elegans arx-2 gene Proteins 0.000 description 3
- 101150092805 actc1 gene Proteins 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 230000008901 benefit Effects 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 2
- 230000003068 static effect Effects 0.000 description 2
- 230000004913 activation Effects 0.000 description 1
- 230000004075 alteration Effects 0.000 description 1
- 230000007423 decrease Effects 0.000 description 1
- 230000001934 delay Effects 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 230000006855 networking Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000004088 simulation Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/08—Configuration management of networks or network elements
- H04L41/0803—Configuration setting
- H04L41/0813—Configuration setting characterised by the conditions triggering a change of settings
- H04L41/0816—Configuration setting characterised by the conditions triggering a change of settings the condition being an adaptation, e.g. in response to network events
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/08—Configuration management of networks or network elements
- H04L41/0803—Configuration setting
- H04L41/0806—Configuration setting for initial configuration or provisioning, e.g. plug-and-play
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/08—Configuration management of networks or network elements
- H04L41/0803—Configuration setting
- H04L41/0823—Configuration setting characterised by the purposes of a change of settings, e.g. optimising configuration for enhancing reliability
- H04L41/0826—Configuration setting characterised by the purposes of a change of settings, e.g. optimising configuration for enhancing reliability for reduction of network costs
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/08—Configuration management of networks or network elements
- H04L41/0893—Assignment of logical groups to network elements
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D30/00—Reducing energy consumption in communication networks
- Y02D30/50—Reducing energy consumption in communication networks in wire-line communication networks, e.g. low power modes or reduced link rate
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
本发明公开了一种基于SDN的虚拟网络功能的部署调整方法,所述方法包括:在接收到部署虚拟网络功能的请求后,确定网络中部署该请求的虚拟网络功能后的初始部署方案;基于初始部署方案,针对网络中的所有SFC组成的SFG,遍历其中的物理节点和链路,确定出超负载的物理节点和链路;针对超负载的物理节点和链路进行虚拟网络功能的部署调整。应用本发明可以从网络全局均衡负载。
The invention discloses a method for deploying and adjusting a virtual network function based on SDN. The method includes: after receiving a request for deploying a virtual network function, determining an initial deployment plan after deploying the requested virtual network function in the network; For the initial deployment plan, for the SFG composed of all SFCs in the network, traverse the physical nodes and links in it, and determine the overloaded physical nodes and links; adjust the deployment of virtual network functions for the overloaded physical nodes and links . The application of the invention can balance the load globally from the network.
Description
技术领域technical field
本发明涉及计算机技术领域,特别是指一种基于SDN的虚拟网络功能的部署调整方法。The invention relates to the field of computer technology, in particular to an SDN-based virtual network function deployment adjustment method.
背景技术Background technique
目前,NFV已经成为一种很有前途的技术,可以有效地部署和管理各种网络功能。在NFV架构中,这些软件形式的网络功能被作为虚拟网络功能(VNF)处理,并可由NFV MANO管理。NFV可以以端到端服务功能链(SFC)的形式提供服务,它定义了VNF的特定序列及其逻辑连接,可以以灵活的方式嵌入物理网络中。与传统的依赖于专用硬件的中间件相比,NFV利用了使用标准硬件的商用服务器。这种演进带来的一个主要好处是,网络功能可以根据用户流量灵活伸缩。例如,当流量突发时,可以配置一组服务器,以运行相同VNF来处理数据包。Currently, NFV has emerged as a promising technology to efficiently deploy and manage various network functions. In the NFV architecture, these network functions in the form of software are handled as virtual network functions (VNFs) and can be managed by NFV MANOs. NFV can provide services in the form of an end-to-end service function chain (SFC), which defines a specific sequence of VNFs and their logical connections, which can be embedded in a physical network in a flexible manner. In contrast to traditional middleware that relies on specialized hardware, NFV leverages commodity servers that use standard hardware. A major benefit of this evolution is that network functions can be flexibly scaled according to user traffic. For example, when traffic bursts, a group of servers can be configured to run the same VNF to process packets.
在基于软件定义网络(SDN)的云边缘协同网络中,由于网络流量的变化,SFC需要通过及时地缩放来调整部署策略,传统的SFC缩放方法往往是基于用户请求中的单个SFC,这样不能有效的从网络全局来节约成本、均衡负载。In a cloud-edge collaborative network based on software-defined networking (SDN), due to changes in network traffic, SFC needs to adjust the deployment strategy by scaling in time. Traditional SFC scaling methods are often based on a single SFC in user requests, which cannot be effective It saves costs and balances loads from the perspective of the overall network.
也就是说,现有的SFC缩放方法关注在单条SFC的缩放,无法有效地从全局优化网络性能。对于已经部署了SFC服务的基底网络,面对流量突发时,从单条SFC的角度进行网络功能缩放,无法高效地保证整个网络资源的利用率和平衡网络设备间负载。同时,现有的部分研究,虽然预测了流量的峰值并提出了一些优化策略,但是没有提出具体的缩放SFC部署方案。此外,在云边结合的网络环境下,综合SDN云边网络结构特点的缩放问题没有被考虑。That is to say, the existing SFC scaling methods focus on the scaling of a single SFC, and cannot effectively optimize network performance globally. For the basic network where SFC services have been deployed, in the face of traffic bursts, scaling network functions from the perspective of a single SFC cannot efficiently ensure the utilization of the entire network resources and balance the load among network devices. At the same time, although some existing studies have predicted the peak traffic and proposed some optimization strategies, they have not proposed a specific scaling SFC deployment scheme. In addition, in the cloud-edge network environment, the scaling problem of the integrated SDN cloud-edge network structure characteristics has not been considered.
发明内容Contents of the invention
有鉴于此,本发明的目的在于提出一种基于SDN的虚拟网络功能的部署调整方法,可以从网络全局均衡负载。In view of this, the purpose of the present invention is to propose an SDN-based virtual network function deployment adjustment method, which can balance the load globally from the network.
基于上述目的,本发明提供一种基于SDN的虚拟网络功能的部署调整方法,包括:Based on the above purpose, the present invention provides a deployment adjustment method based on SDN virtual network function, including:
在接收到部署虚拟网络功能的请求后,确定网络中部署该请求的虚拟网络功能后的初始部署方案;After receiving a request to deploy a virtual network function, determine an initial deployment plan after deploying the requested virtual network function in the network;
基于初始部署方案,针对网络中的所有SFC组成的SFG,遍历其中的物理节点和链路,确定出超负载的物理节点和链路;Based on the initial deployment plan, for the SFG composed of all SFCs in the network, traverse the physical nodes and links in it, and determine the overloaded physical nodes and links;
针对超负载的物理节点和链路进行虚拟网络功能的部署调整。Adjust the deployment of virtual network functions for overloaded physical nodes and links.
其中,所述针对超负载的物理节点和链路进行虚拟网络功能的部署调整,具体包括:Wherein, the deployment and adjustment of virtual network functions for overloaded physical nodes and links specifically includes:
将超负载的物理节点和链路,分别组成节点集和链路集;The overloaded physical nodes and links are composed of node sets and link sets respectively;
按负载率大小对所述节点集中各物理节点依次进行虚拟网络功能的部署调整;Carrying out deployment and adjustment of virtual network functions sequentially on each physical node in the node set according to the load rate;
按负载率大小对所述链路集中各链路依次进行虚拟网络功能的部署调整。The deployment and adjustment of the virtual network function is sequentially performed on each link in the link set according to the load rate.
较佳地,所述按负载率大小对所述节点集中各物理节点依次进行虚拟网络功能的部署调整,具体包括:Preferably, the deployment and adjustment of the virtual network function is sequentially performed on each physical node in the node set according to the load rate, which specifically includes:
对所述节点集中各物理节点按负载率从大到小排序;将排序后的物理节点依次进行虚拟网络功能的部署调整:The physical nodes in the node set are sorted from large to small according to the load rate; the sorted physical nodes are sequentially adjusted for the deployment of virtual network functions:
对于当前待进行部署调整的物理节点,确定该物理节点所属SFC的前驱节点和后继节点;For the current physical node to be deployed and adjusted, determine the predecessor node and successor node of the SFC to which the physical node belongs;
将所述前驱节点作为起始节点,后继节点作为终止节点;将起始节点与终止节点之间的路径,作为待调整路径;Using the predecessor node as the starting node, and the successor node as the ending node; using the path between the starting node and the ending node as the path to be adjusted;
使用禁忌搜索算法从所述起始节点与终止节点之间的多条路径中,选择具有与该物理节点类型一致、且负载率符合要求的服务器节点的路径,将该物理节点的虚拟网络功能调整部署到所选择的路径的服务器节点上。Use a tabu search algorithm to select a path with a server node that is consistent with the type of the physical node and whose load rate meets the requirements from multiple paths between the starting node and the terminating node, and adjust the virtual network function of the physical node Deploy to the server node of the selected path.
较佳地,所述按负载率大小对所述链路集中各物理链路依次进行虚拟网络功能的部署调整,具体包括:Preferably, the deployment and adjustment of the virtual network function is sequentially performed on each physical link in the link set according to the load rate, which specifically includes:
对所述链路集中各物理链路按负载率从大到小排序;将排序后的物理链路依次进行虚拟网络功能的部署调整:Sorting the physical links in the link set from large to small according to the load rate; and adjusting the deployment of the virtual network function on the sorted physical links in turn:
对于当前待进行部署调整的物理链路,进行m次路径的部署调整;其中,第k次路径的部署调整过程如下:For the current physical link to be deployed and adjusted, the deployment and adjustment of m paths are performed; wherein, the deployment and adjustment process of the kth path is as follows:
以所述物理链路的第1个物理节点作为起始节点,以所述物理链路的第k+2个物理节点作为终止节点;将起始节点与终止节点之间的路径,作为待调整路径;The first physical node of the physical link is used as the starting node, and the k+2th physical node of the physical link is used as the terminating node; the path between the starting node and the terminating node is used as the to-be-adjusted path;
使用禁忌搜索算法从所述起始节点与终止节点之间的多条路径中,选择具有与该物理节点类型一致、且负载率符合要求的服务器节点的路径,将第k+1个物理节点的虚拟网络功能调整部署到所选择的路径的服务器节点上。Use the tabu search algorithm to select a path with a server node that is consistent with the type of the physical node and that meets the requirements of the load rate from the multiple paths between the starting node and the terminating node, and the k+1th physical node The virtual network function is adjusted and deployed on the server node of the selected path.
较佳地,所述使用禁忌搜索算法从所述起始节点与终止节点之间的多条路径中,选择具有与该物理节点类型一致、且负载率符合要求的服务器节点的路径,具体包括:Preferably, using the tabu search algorithm to select a path with a server node that is consistent with the physical node type and has a load rate that meets the requirements from multiple paths between the starting node and the terminating node, specifically including:
基于最优综合成本,使用禁忌搜索算法从所述起始节点与终止节点之间的多条路径中,选择具有与该物理节点类型一致的服务器节点的路径作为候选路径;Based on the optimal comprehensive cost, using a tabu search algorithm to select a path with a server node consistent with the physical node type as a candidate path from among the multiple paths between the starting node and the terminating node;
针对每个候选路径,计算将该物理节点的虚拟网络功能调整部署到该候选路径后,整个网络的综合成本;For each candidate path, calculate the comprehensive cost of the entire network after adjusting and deploying the virtual network function of the physical node to the candidate path;
将该物理节点的虚拟网络功能最终调整部署到网络的综合成本最小的路径。The virtual network function of the physical node is finally adjusted and deployed to the path with the minimum comprehensive cost in the network.
较佳地,所述综合成本具体包括:负载成本、业务时延成本和节点开启成本。Preferably, the comprehensive cost specifically includes: load cost, service delay cost and node start-up cost.
较佳地,所述网络具体为基于SDN的云边缘协同网络。Preferably, the network is specifically an SDN-based cloud-edge collaboration network.
本发明还提供一种电子设备,包括中央处理单元、信号处理和存储单元,以及存储在信号处理和存储单元上并可在中央处理单元上运行的计算机程序,其中,所述中央处理单元执行如上所述的基于SDN的虚拟网络功能的部署调整方法。The present invention also provides an electronic device, including a central processing unit, a signal processing and storage unit, and a computer program stored on the signal processing and storage unit and operable on the central processing unit, wherein the central processing unit executes the above The deployment adjustment method of the SDN-based virtual network function.
本发明的技术方案中,在接收到部署虚拟网络功能的请求后,在基于SDN的网络中确定部署该请求的虚拟网络功能后的初始部署方案;基于初始部署方案,针对所述网络中的所有SFC组成的SFG,遍历其中的物理节点和链路,确定出超负载的物理节点和链路;针对超负载的物理节点和链路进行虚拟网络功能的部署调整。从而能够针对已部署的所有SFC组合成的SFG,将网络全局中过载的节点和链路重新部署和路由,输出一个全局的虚拟网络功能的部署调整方案;相比于现有的从单条SFC的角度进行网络功能缩放的技术,本发明的技术方案可以高效地保证整个网络资源的利用率和平衡网络设备间负载。In the technical solution of the present invention, after receiving a request for deploying a virtual network function, the initial deployment plan after deploying the requested virtual network function is determined in the SDN-based network; based on the initial deployment plan, for all The SFG composed of SFCs traverses the physical nodes and links in it to determine the overloaded physical nodes and links; and adjusts the deployment of virtual network functions for the overloaded physical nodes and links. Therefore, for the SFG composed of all deployed SFCs, the overloaded nodes and links in the global network can be re-deployed and routed, and a global virtual network function deployment adjustment plan can be output; compared with the existing single SFC From the perspective of network function scaling technology, the technical solution of the present invention can efficiently ensure the utilization rate of the entire network resources and balance the load among network devices.
进一步,本发明的技术方案还提出了一种基于SDN的云边缘协同网络的流量峰值时缩放成本综合优化评估模型,将其应用于本发明的虚拟网络功能的部署调整方案中,可以实现SFG的成本-负载均衡,使得调整部署后的网络的综合成本得到优化,使得SDN网络能在流量峰值保证SFC的服务质量,从网络全局均衡负载。Further, the technical solution of the present invention also proposes an SDN-based cloud-edge collaborative network scaling cost comprehensive optimization evaluation model at peak traffic times, which is applied to the deployment adjustment scheme of the virtual network function of the present invention, and the SFG can be realized. Cost-load balancing optimizes the overall cost of the adjusted and deployed network, enables the SDN network to guarantee the service quality of SFC at traffic peaks, and balances the load globally from the network.
附图说明Description of drawings
为了更清楚地说明本发明实施例或现有技术中的技术方案,下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本发明的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。In order to more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are only These are some embodiments of the present invention. Those skilled in the art can also obtain other drawings based on these drawings without creative work.
图1为本发明实施例提供的一种基于SDN的云边缘协同网络架构示意图;FIG. 1 is a schematic diagram of an SDN-based cloud-edge collaboration network architecture provided by an embodiment of the present invention;
图2为本发明实施例提供的一种基于SDN的虚拟网络功能的部署调整方法流程图;FIG. 2 is a flowchart of a method for deploying and adjusting an SDN-based virtual network function provided by an embodiment of the present invention;
图3为本发明实施例提供的一种对物理节点依次进行虚拟网络功能的部署调整的方法流程图;FIG. 3 is a flow chart of a method for sequentially performing deployment and adjustment of virtual network functions on physical nodes according to an embodiment of the present invention;
图4为本发明实施例提供的一种对当前物理节点进行虚拟网络功能的部署调整的具体方法流程图;FIG. 4 is a flow chart of a specific method for deploying and adjusting a virtual network function on a current physical node provided by an embodiment of the present invention;
图5为本发明实施例提供的一种对物理链路依次进行虚拟网络功能的部署调整的方法流程图;FIG. 5 is a flowchart of a method for sequentially performing deployment and adjustment of virtual network functions on physical links according to an embodiment of the present invention;
图6为本发明实施例提供的一次路径的部署调整的具体方法流程图;FIG. 6 is a flow chart of a specific method for deploying and adjusting primary paths provided by an embodiment of the present invention;
图7为本发明实施例提供的流量峰值时SFG部署的一个实例示意图;FIG. 7 is a schematic diagram of an example of SFG deployment during traffic peaks provided by an embodiment of the present invention;
图8、9、10为本发明实施例提供的多种部署调整算法的实验结果对比示意图;Figures 8, 9, and 10 are schematic diagrams comparing the experimental results of various deployment adjustment algorithms provided by the embodiments of the present invention;
图11为本发明实施例提供的一种电子设备硬件结构示意图。FIG. 11 is a schematic diagram of a hardware structure of an electronic device provided by an embodiment of the present invention.
具体实施方式Detailed ways
为使本发明的目的、技术方案和优点更加清楚明白,以下结合具体实施例,并参照附图,对本发明进一步详细说明。In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be described in further detail below in conjunction with specific embodiments and with reference to the accompanying drawings.
需要说明的是,除非另外定义,本发明实施例使用的技术术语或者科学术语应当为本公开所属领域内具有一般技能的人士所理解的通常意义。本公开中使用的“第一”、“第二”以及类似的词语并不表示任何顺序、数量或者重要性,而只是用来区分不同的组成部分。“包括”或者“包含”等类似的词语意指出现该词前面的元件或者物件涵盖出现在该词后面列举的元件或者物件及其等同,而不排除其他元件或者物件。“连接”或者“相连”等类似的词语并非限定于物理的或者机械的连接,而是可以包括电性的连接,不管是直接的还是间接的。“上”、“下”、“左”、“右”等仅用于表示相对位置关系,当被描述对象的绝对位置改变后,则该相对位置关系也可能相应地改变。It should be noted that, unless otherwise defined, the technical terms or scientific terms used in the embodiments of the present invention shall have the usual meanings understood by those skilled in the art to which the present disclosure belongs. "First", "second" and similar words used in the present disclosure do not indicate any order, quantity or importance, but are only used to distinguish different components. "Comprising" or "comprising" and similar words mean that the elements or items appearing before the word include the elements or items listed after the word and their equivalents, without excluding other elements or items. Words such as "connected" or "connected" are not limited to physical or mechanical connections, but may include electrical connections, whether direct or indirect. "Up", "Down", "Left", "Right" and so on are only used to indicate the relative positional relationship. When the absolute position of the described object changes, the relative positional relationship may also change accordingly.
本发明的发明人为了解决上述问题,本发明技术方案提供了一种多条SFC场景下全局的SFG缩放方法,考虑网络中已部署的所有SFC组合成的SFG,将网络全局中过载的节点和链路重新部署和路由,输出一个SFG的缩放方案,即全局的虚拟网络功能的部署调整方案,相比于现有的从单条SFC的角度进行网络功能缩放的技术,本发明的技术方案可以高效地保证整个网络资源的利用率和平衡网络设备间负载。In order to solve the above problems, the inventors of the present invention provide a global SFG scaling method in a multi-SFC scenario. Considering the SFG composed of all deployed SFCs in the network, the overloaded nodes and Link re-deployment and routing, and output a SFG scaling solution, that is, a global virtual network function deployment adjustment solution. Compared with the existing technology for network function scaling from the perspective of a single SFC, the technical solution of the present invention can efficiently Ensure the utilization of the entire network resources and balance the load among network devices.
更优地,本发明的技术方案还提出了一种SDN云边缘协同网络流量峰值时缩放成本综合优化评估模型,将其应用于上述的全局SFG的缩放方案中,可以实现SFG的成本-负载均衡缩放部署算法,使得调整部署后的网络的综合成本得到优化,使得SDN网络能在流量峰值保证SFC的服务质量,从网络全局均衡负载。More preferably, the technical solution of the present invention also proposes an SDN cloud-edge collaborative network traffic scaling cost comprehensive optimization evaluation model, which is applied to the above-mentioned global SFG scaling solution, which can realize SFG cost-load balancing The scaling deployment algorithm optimizes the overall cost of the adjusted and deployed network, enables the SDN network to guarantee the service quality of SFC at traffic peaks, and balances the load globally from the network.
下面结合附图详细说明本发明实施例的技术方案。The technical solutions of the embodiments of the present invention will be described in detail below in conjunction with the accompanying drawings.
基于SDN的云边缘协同网络架构如图1所示,包括云层、边缘层和终端层。云层(Cloud Layer)包括云服务器(Cloud Server)节点和路由器(Router)节点,边缘层(EdgeLayer)包括边缘服务器(Edge Server)和路由器(Router)节点,终端层(Terminal Layer)包括IoT设备的接入和用户终端。终端层产生的用户请求和云-边层网络基础信息一起作为NFV管理编排器的输入,多个请求可以构成基于实例共享的SFG,NFV MANO输出相应SFG的部署策略。这样,可以通过给网络服务分配相应的计算及通信资源从而完成网络服务的部署。The SDN-based cloud-edge collaboration network architecture is shown in Figure 1, including the cloud layer, edge layer, and terminal layer. The cloud layer (Cloud Layer) includes cloud server (Cloud Server) nodes and router (Router) nodes, the edge layer (EdgeLayer) includes edge server (Edge Server) and router (Router) nodes, and the terminal layer (Terminal Layer) includes IoT access and user terminals. The user requests generated at the terminal layer and the basic information of the cloud-edge network are used as the input of the NFV management orchestrator. Multiple requests can form an SFG based on instance sharing, and NFV MANO outputs the deployment strategy of the corresponding SFG. In this way, network service deployment can be completed by allocating corresponding computing and communication resources to the network service.
本发明技术方案中,建立了SFC场景下的网络模型、SFG模型、流量变化评估模型、时延模型以及最优化问题模型。In the technical solution of the present invention, a network model, an SFG model, a flow change evaluation model, a time delay model and an optimization problem model under the SFC scene are established.
网络模型反映了物理网络的信息,定义如下:The network model reflects the information of the physical network and is defined as follows:
将基于SDN的云边缘协同网络的基底网络定义成无向图G(N,E),N是物理节点集,N={NSV,NRT}={n1,n2,...,n|N|},E是物理链路集,E={e1,e2,...,e|E|}。Define the base network of the SDN-based cloud-edge collaborative network as an undirected graph G(N,E), where N is a physical node set, N={NS SV ,N RT }={n 1 ,n 2 ,..., n |N| }, E is a physical link set, E={e 1 , e 2 ,...,e |E| }.
其中NSV={ΝE,NC},ΝE为边缘服务器节点集,NC为云服务器节点集。Where N SV ={Ν E , N C }, Ν E is the edge server node set, and N C is the cloud server node set.
N中第i个物理节点ni可以用元组表示,其中是该物理节点总共的计算资源,表示该节点剩余的计算资源,pri表示该节点的处理数据包的能力,actci表示启用当前节点所的开启成本。typei表示该节点的类型。The i-th physical node n i in N can use tuples said, among them is the total computing resources of the physical node, Indicates the remaining computing resources of the node, pri indicates the ability of the node to process data packets, and actc i indicates the activation cost of the current node. type i indicates the type of the node.
当ni∈NRT为路由节点时,typei=0,表示路由节点没有服务器,pri=0,因此不承载VNF。When n i ∈ N RT is a routing node, type i = 0, indicating that the routing node has no server, pri = 0, so no VNF is carried.
当ni为边缘服务器节点时,typei=1,ni∈NE∈NSV。When n i is an edge server node, type i =1, n i ∈N E ∈NS SV .
当ni为云服务器节点时,typei=2,ni∈NC∈NSV。When n i is a cloud server node, type i = 2, n i ∈ N C ∈ N SV .
相较边缘服务器节点,云服务器节点有更多的计算资源和数据处理能力。Compared with edge server nodes, cloud server nodes have more computing resources and data processing capabilities.
E={EEE,EEC,ECC}表示整个网络的节点之间的链路集合,EEE代表边缘服务器节点间的链路集合,EEC代表云服务器节点与边缘服务器节点之间的链路集合,ECC表示云服务器节点之间的链路集合。E={E EE , E EC , E CC } represents the link set between nodes in the entire network, E EE represents the link set between edge server nodes, and E EC represents the link set between cloud server nodes and edge server nodes A collection of roads, and E CC represents a collection of links between cloud server nodes.
每个物理链路用元组表示,其中表示该物理链路总共的带宽资源,表示该链路剩余的带宽资源,dj表示链路ej的传播时延。ej∈EEE时,链路在边缘节点之间,链路带宽小,传播时延小;ej∈EEC时,链路连接边缘节点和云服务器节点,链路有较大的带宽和较大的传播时延;ej∈ECC时,链路连接不同的云服务器节点,有大的链路带宽和小的传播时延。注意,ej可以写成其中i1,i2表示链路ej连接的两个物理节点的序号。同理, tuple per physical link said, among them Indicates the total bandwidth resources of the physical link, Indicates the remaining bandwidth resources of the link, and d j indicates the propagation delay of the link e j . When e j ∈ E EE , the link is between the edge nodes, the link bandwidth is small, and the propagation delay is small; when e j ∈ E EC , the link connects the edge node and the cloud server node, the link has a large bandwidth and Larger propagation delay; when e j ∈ E CC , the link connects different cloud server nodes, with large link bandwidth and small propagation delay. Note that e j can be written as Among them, i 1 and i 2 represent the sequence numbers of the two physical nodes connected by the link e j . In the same way,
结合上述网络模型,定义了两个变量nlr,elr来分别描述物理节点和物理链路的负载率,分别如公式1、2所示,从而评估整个网络的负载情况。Combined with the above network model, two variables nlr and elr are defined to describe the load rate of physical nodes and physical links, respectively, as shown in
进一步地,整个网络的负载率如公式3所示:Further, the load rate of the entire network is shown in formula 3:
SFG模型反映了虚拟网络的信息,定义如下:The SFG model reflects the information of the virtual network and is defined as follows:
将SFC业务描述成一个有向无环图,GV(NV,EV,snum,RD),图由若干条SFC组成。是虚拟节点集,表示网络功能组件,是虚拟链路集,表示业务流量路径,snum表示SFG包含的SFC数量。集合RD={rd1,rd2,...,rdsnum}记录GV中每条SFC的最大容忍时延。同理,第s条SFCs可以表示成 Describe the SFC business as a directed acyclic graph, G V (N V , E V , snum, RD), and the graph consists of several SFCs. is a set of virtual nodes representing network functional components, is a virtual link set, indicating the service traffic path, and snum indicates the number of SFCs included in the SFG. The set RD={rd 1 ,rd 2 ,...,rd snum } records the maximum tolerable time delay of each SFC in G V. Similarly, the s-th SFCs can be expressed as
第i个虚拟节点由元组描述,其中vi表示该虚拟节点的VNF类型,表示该虚拟节点所需的计算资源,Pi表示该虚拟节点待处理的数据包大小,表示该虚拟节点所属的SFC集合。The i-th virtual node consists of the tuple description, where v i represents the VNF type of the virtual node, Indicates the computing resources required by the virtual node, Pi indicates the size of the data packet to be processed by the virtual node, represents the virtual node The SFC collection to which it belongs.
第j个虚拟链路由元组描述,其中分别表示的源虚拟节点和目标虚拟节点。表示所需的带宽资源,表示流量经过的SFC集合。与物理链路类似,虚拟链路也可以由其两端的节点表示,因此 jth virtual link routing tuple description, where Respectively The source virtual node and target virtual node. express required bandwidth resources, Indicates that traffic passes through The SFC collection. Similar to physical links, virtual links can also be represented by nodes at both ends, so
此外,定义了两个二进制变量来描述虚拟网络到物理网络的映射情况。表示虚拟节点部署在物理节点ni'上;表示虚拟链路部署在物理链路ej'上。假设虚拟节点到服务器节点为1到1映射,虚拟链路到物理链路是m到n映射。Additionally, two binary variables are defined To describe the mapping from virtual network to physical network. Represents a virtual node Deployed on the physical node n i' ; Represents a virtual link Deployed on the physical link e j' . It is assumed that virtual nodes are mapped to server nodes from 1 to 1, and virtual links to physical links are mapped from m to n.
结合节点与链路对应的SFC信息和部署信息可以获得每条SFC部署信息。SFCs部署的物理节点集为物理链路集为对满足如下公式4:Combining SFC information corresponding to nodes and links and deployment information The deployment information of each SFC can be obtained. The set of physical nodes deployed by SFCs is The physical link set is right Satisfies the following formula 4:
数据包大小序列如公式5所示:The packet size sequence is shown in Equation 5:
路由节点不处理VNF,Ns中的物理节点承载的数据包大小如公式6所示:Routing nodes do not process VNFs, and the size of packets carried by physical nodes in Ns is shown in Equation 6:
流量变化评估模型可以反映流量峰值的负载信息,定义如下:The traffic change evaluation model can reflect the load information of the traffic peak, which is defined as follows:
定义流量峰值时,虚拟节点的计算资源请求为虚拟链路的带宽资源请求为设则虚拟节点的流量变化如公式7所示:When defining traffic peaks, virtual nodes The computing resource request for virtual link The bandwidth resource request for Assume then the virtual node The flow change of is shown in Equation 7:
虚拟链路的流量变化如公式8所示:virtual link The flow change of is shown in Equation 8:
当时,当前部署的服务器有能力承载突发流量所需的新VNF实例,选择进行VNF实例的垂直缩放,否则只能进行水平缩放,在新的服务器节点部署n1实例并分配路径。同理,时,进行路由的垂直缩放,在原有路径上请求新的带宽,否则进行路由的水平缩放。when When the currently deployed server is capable of carrying the new VNF instance required by the burst traffic, choose to perform vertical scaling of the VNF instance, otherwise, only horizontal scaling can be performed, and n 1 instances are deployed on the new server node and paths are allocated. In the same way, When , the vertical scaling of the route is performed, and new bandwidth is requested on the original path, otherwise, the horizontal scaling of the route is performed.
流量峰值时,节点负载率如公式9所示:When the traffic peaks, the node load rate is shown in Formula 9:
流量峰值时,链路负载率如公式10所示:When the traffic peaks, the link load rate is shown in Equation 10:
流量峰值时,整个网络的负载率如公式11所示:When the traffic peaks, the load rate of the entire network is shown in Formula 11:
其中,表示流量峰值时,整个网络的节点负载率;表示流量峰值时,整个网络的链路负载率;|NSV|表示整个网络的服务器节点的数量;|E|表示整个网络的物理链路的数量。in, Indicates the node load rate of the entire network when the traffic peaks; Indicates the link load rate of the entire network when traffic peaks; | NSV | indicates the number of server nodes in the entire network; |E| indicates the number of physical links in the entire network.
网络中已部署虚拟节点,即已部署虚拟网络功能的服务器的开启总成本如公式12所示:The total start-up cost of deployed virtual nodes in the network, that is, servers with deployed virtual network functions, is shown in Equation 12:
其中,actci表示第i个服务器的开启成本,表示虚拟节点与物理节点ni的映射关系,表示部署于物理节点ni;表示没有部署于物理节点ni;Among them, actc i represents the opening cost of the i-th server, Represents a virtual node The mapping relationship with the physical node n i , express Deployed on physical node n i ; express Not deployed on physical node n i ;
时延模型定义如下:The delay model is defined as follows:
SFC的端到端时延包括三个部分,传播时延,传输时延,排队及处理时延。The end-to-end delay of SFC includes three parts, propagation delay, transmission delay, queuing and processing delay.
1.传播时延:与物理链路的长度相关,由dj决定。SFCs的传播时延总和如公式13所示:1. Propagation delay: It is related to the length of the physical link and is determined by d j . The sum of propagation delays for SFCs is given in Equation 13:
2.传输时延:SFCs的传输时延指数据包从服务器到输出链路的传输时间,与数据包大小和请求带宽有关,计算公式如公式14所示:2. Transmission delay: The transmission delay of SFCs refers to the transmission time of the data packet from the server to the output link, which is related to the size of the data packet and the requested bandwidth. The calculation formula is shown in formula 14:
3.排队及处理时延:SFCs的VNF的处理时延和数据包大小、节点处理能力以及请求的计算资源有关,可根据公式15计算:3. Queuing and processing delay: The processing delay of the VNF of SFCs is related to the data packet size, node processing capability and requested computing resources, and can be calculated according to formula 15:
其中,虚拟节点部署在物理节点上。VNF的排队时延等于待处理数据包达到后的等待处理时间。将接入点的服务器建模为M/M/1队列,到达服务器进行计算的任务遵循泊松过程,到达率为λ。因此服务器完成VNF的平均时延(包括排队和服务时间)可以表示为公式16所示:Among them, the virtual node Deployed on physical nodes superior. The queuing delay of the VNF is equal to the waiting processing time after the data packets to be processed arrive. Model the server of the access point as an M/M/1 queue, reaching the server The tasks performing the computation follow a Poisson process with an arrival rate λ. so the server Average latency to complete the VNF (including queuing and service time) can be expressed as shown in formula 16:
其中,因此,SFCs的排队及处理时延可以表示为公式17:in, Therefore, the queuing and processing delay of SFCs can be expressed as Equation 17:
综上所述,SFCs的总时延计算为公式18:In summary, the total delay of SFCs is calculated as Equation 18:
delays=ppds+trds+qpds. (公式18)delay s = ppd s + trd s + qpd s . (Formula 18)
最优化问题模型定义如下:The optimization problem model is defined as follows:
本文的优化目标是最小化部署调整(SFC缩放)后,网络中的负载成本、业务时延成本和节点开启成本的综合成本,所述综合成本如公式19表达所示:The optimization goal of this paper is to minimize the comprehensive cost of load cost, service delay cost and node start-up cost in the network after deployment adjustment (SFC scaling), and the comprehensive cost is expressed as formula 19:
其中,ω1,ω2,ω3是自定义参数,ω1+ω2+ω3=1。为流量峰值时,整个网络的负载率;rds表示SFCs的最大容忍时延;表示SFCs的时延率;表示所有SFC的时延率之和;snum表示SFG包含的SFC数量;actc表示所述网络中已部署虚拟网络功能的服务器的开启总成本;表示所述网络中所有服务器的开启总成本;ρ为接受率惩罚值,由流量峰值导致业务无法部署造成,可根据如下公式20计算得到:Wherein, ω 1 , ω 2 , and ω 3 are user-defined parameters, and ω 1 +ω 2 +ω 3 =1. is the load rate of the entire network when traffic peaks; rd s represents the maximum tolerable delay of SFCs; Indicates the delay rate of SFCs; Indicates the sum of the delay rates of all SFCs; snum indicates the number of SFCs contained in the SFG; actc indicates the total cost of starting the server with the deployed virtual network function in the network; Indicates the total cost of opening all servers in the network; ρ is the acceptance rate penalty value, which is caused by the failure of service deployment due to traffic peaks, and can be calculated according to the following formula 20:
其中,total_sfc表示所有的SFC的数量,accepted_sfc表示成功部署的SFC的数量。Among them, total_sfc indicates the number of all SFCs, and accepted_sfc indicates the number of successfully deployed SFCs.
为了解决VNF实例的缩放问题,即虚拟网络功能的部署调整问题,需要满足一些约束条件。首先,在任何一个物理节点或物理链路上,所部署的虚拟节点或链路所要求的资源之和不超过其总资源,如公式21、22所示:In order to solve the scaling problem of VNF instances, that is, the deployment adjustment problem of virtual network functions, some constraints need to be satisfied. First, on any physical node or physical link, the sum of the resources required by the deployed virtual nodes or links does not exceed its total resources, as shown in formulas 21 and 22:
然后,服务器节点和虚拟节点的映射是1对1的,如公式23、24所示:Then, the mapping between server nodes and virtual nodes is 1-to-1, as shown in formulas 23 and 24:
另外,所有SFC的延迟不能超过最大容忍延迟,如公式25所示:In addition, the delay of all SFCs cannot exceed the maximum tolerated delay, as shown in Equation 25:
综上所述,本文的最优化问题模型可以总结为:In summary, the optimization problem model in this paper can be summarized as:
s.t.:s.t.:
本发明提供了一种基于SDN的虚拟网络功能的部署调整方法,流程如图2所示,包括如下步骤:The present invention provides a method for deploying and adjusting an SDN-based virtual network function, the process of which is shown in Figure 2, including the following steps:
步骤S201:在接收到部署虚拟网络功能的请求后,确定网络中部署该请求的虚拟网络功能后的初始部署方案。Step S201: After receiving a request for deploying a virtual network function, determine an initial deployment scheme after deploying the requested virtual network function in the network.
具体地,在接收到用户设备发送的用于部署虚拟网络功能的请求后,从所述请求中确定出源节点和待部署的多个虚拟网络功能的信息;进而采用现有的方法,在基于SDN的网络中确定部署该请求的多个虚拟网络功能后的部署方案,作为初始部署方案。Specifically, after receiving the request for deploying the virtual network function sent by the user equipment, determine the information of the source node and the multiple virtual network functions to be deployed from the request; and then adopt the existing method, based on A deployment scheme after deploying the requested multiple virtual network functions is determined in the SDN network as an initial deployment scheme.
步骤S202:基于初始部署方案,针对网络中的所有SFC组成的SFG,遍历其中的物理节点和物理链路,确定出超负载的物理节点和物理链路。Step S202: Based on the initial deployment scheme, for the SFG composed of all SFCs in the network, traverse the physical nodes and physical links therein, and determine the overloaded physical nodes and physical links.
具体地,基于初始部署方案,针对网络中的所有SFC组成的SFG,遍历其中的物理节点和物理链路,确定出超负载的物理节点和物理链路;Specifically, based on the initial deployment scheme, for the SFG composed of all SFCs in the network, traverse the physical nodes and physical links in it, and determine the overloaded physical nodes and physical links;
例如,将负载率超过节点负载度阈值α的物理节点确定为超负载的物理节点;将负载率超过链路负载度阈值β的物理链路确定为超负载的物理链路。其中,α和β可以由本领域技术人员根据经验设置,比如设置α=β=0.7。For example, a physical node whose load rate exceeds a node load degree threshold α is determined as an overloaded physical node; a physical link whose load rate exceeds a link load degree threshold β is determined as an overloaded physical link. Wherein, α and β can be set empirically by those skilled in the art, such as setting α=β=0.7.
将超负载的物理节点组成节点集,将超负载的物理链路组成链路集。The overloaded physical nodes form a node set, and the overloaded physical links form a link set.
步骤S203:针对超负载的物理节点和物理链路进行虚拟网络功能的部署调整。Step S203: adjusting the deployment of virtual network functions for overloaded physical nodes and physical links.
本步骤中,按负载率大小对所述节点集中各物理节点依次进行虚拟网络功能的部署调整;按负载率大小对所述链路集中各物理链路依次进行虚拟网络功能的部署调整。In this step, the deployment and adjustment of the virtual network function is sequentially performed on each physical node in the node set according to the load rate; and the deployment and adjustment of the virtual network function is performed on each physical link in the link set according to the load rate.
具体地,按负载率大小对所述节点集中各物理节点依次进行虚拟网络功能的部署调整的方法,流程如图3所示,包括如下步骤:Specifically, according to the load rate, each physical node in the node set sequentially performs a method of deploying and adjusting the virtual network function, as shown in Figure 3, including the following steps:
步骤S301:对所述节点集中各物理节点按负载率从大到小排序;Step S301: sort each physical node in the node set according to the load rate from large to small;
步骤S302:将排序后的物理节点依次进行虚拟网络功能的部署调整。Step S302: Perform deployment and adjustment of virtual network functions on the sorted physical nodes in sequence.
本步骤中,将排序后的物理节点按负载率从大到小的顺序,依次进行虚拟网络功能的部署调整;对于当前待进行部署调整的物理节点,进行虚拟网络功能的部署调整的具体方法,流程如图4所示,包括如下子步骤:In this step, the sorted physical nodes are adjusted according to the order of load ratio from large to small, and the deployment and adjustment of virtual network functions are carried out sequentially; for the physical nodes currently to be deployed and adjusted, the specific method of performing deployment and adjustment of virtual network functions is as follows: The process is shown in Figure 4, including the following sub-steps:
子步骤S401:确定该物理节点所属SFC的前驱节点和后继节点;Sub-step S401: determine the predecessor node and successor node of the SFC to which the physical node belongs;
子步骤S402:将所述前驱节点作为起始节点,后继节点作为终止节点;将起始节点与终止节点之间的路径,作为待调整路径;Sub-step S402: use the predecessor node as the start node, and the successor node as the end node; use the path between the start node and the end node as the path to be adjusted;
子步骤S403:使用禁忌搜索算法从所述起始节点与终止节点之间的多条路径中,选择具有与该物理节点类型一致、且负载率符合要求的服务器节点的路径,将该物理节点的虚拟网络功能调整部署到所选择的路径的服务器节点上。Sub-step S403: use the tabu search algorithm to select a path with a server node that is consistent with the type of the physical node and whose load rate meets the requirements from the multiple paths between the start node and the end node, and select the path of the server node of the physical node The virtual network function is adjusted and deployed on the server node of the selected path.
本子步骤中,在选择路径时,可以采用一种更优的实施方式:In this sub-step, when selecting a path, a better implementation method can be adopted:
基于最优综合成本,使用禁忌搜索算法从所述起始节点与终止节点之间的多条路径中,选择具有与该物理节点类型一致的服务器节点的路径作为候选路径;针对每个候选路径,计算将该物理节点的虚拟网络功能调整部署到该候选路径后,整个网络的综合成本;将该物理节点的虚拟网络功能最终调整部署到网络的综合成本最小的路径。Based on the optimal comprehensive cost, use a tabu search algorithm to select a path with a server node consistent with the physical node type as a candidate path from multiple paths between the starting node and the terminating node; for each candidate path, After the virtual network function of the physical node is adjusted and deployed to the candidate path, the comprehensive cost of the entire network is calculated; the virtual network function of the physical node is finally adjusted and deployed to the path with the smallest comprehensive cost of the network.
其中,所述网络的综合成本可以包括网络中的负载成本、业务时延成本和节点开启成本;Wherein, the comprehensive cost of the network may include load cost in the network, service delay cost and node start-up cost;
在所述网络具体为上述的基于SDN的云边缘协同网络的情况下,网络的综合成本可以根据上述的公式19计算得到;也就是说,根据所述网络的基底网络的信息(即物理网络的信息)、所述网络中所有SFC组成的SFG的信息(即虚拟网络的信息)、虚拟网络到物理网络的映射信息、流量峰值的负载信息,以及所述网络中所有SFC的时延、服务器的开启成本,计算得到当前部署情况的网络的综合成本。In the case that the network is specifically the above-mentioned SDN-based cloud-edge collaborative network, the comprehensive cost of the network can be calculated according to the above formula 19; that is, according to the information of the base network of the network (that is, the physical network information), the information of SFG composed of all SFCs in the network (that is, the information of the virtual network), the mapping information from the virtual network to the physical network, the load information of the traffic peak, the delay of all SFCs in the network, and the server’s Turn on the cost to calculate the comprehensive cost of the network in the current deployment situation.
具体地,按负载率大小对所述链路集中各物理链路依次进行虚拟网络功能的部署调整的方法,流程如图5所示,包括如下步骤:Specifically, according to the load rate, each physical link in the link set sequentially performs a method for deploying and adjusting the virtual network function, as shown in Figure 5, including the following steps:
步骤S501:对所述链路集中各物理链路按负载率从大到小排序;Step S501: sort each physical link in the link set according to the load rate from large to small;
步骤S502:将排序后的物理链路依次进行虚拟网络功能的部署调整。Step S502: Perform deployment and adjustment of virtual network functions on the sorted physical links in sequence.
本步骤中,将排序后的物理链路按负载率从大到小的顺序,依次进行虚拟网络功能的部署调整;In this step, the sorted physical links are adjusted according to the order of load rate from large to small, and the deployment of virtual network functions is carried out in sequence;
对于当前待进行部署调整的物理链路,进行m次路径的部署调整;其中,m=L-2,L为该物理链路中物理节点的总数;其中,第k次路径的部署调整过程,如图6所示,包括如下子步骤:For the physical link currently to be deployed and adjusted, the deployment adjustment of the path is performed m times; wherein, m=L-2, L is the total number of physical nodes in the physical link; wherein, the deployment adjustment process of the kth path, As shown in Figure 6, the following sub-steps are included:
子步骤S601:以所述链路的第1个物理节点作为起始节点,以所述链路的第k+2个物理节点作为终止节点;Sub-step S601: taking the first physical node of the link as the starting node, and taking the k+2th physical node of the link as the ending node;
子步骤S602:将起始节点与终止节点之间的路径,作为待调整路径;Sub-step S602: use the path between the start node and the end node as the path to be adjusted;
子步骤S603:使用禁忌搜索算法从所述起始节点与终止节点之间的多条路径中,选择具有与该物理节点类型一致、且负载率符合要求的服务器节点的路径,将第k+1个物理节点的虚拟网络功能调整部署到所选择的路径的服务器节点上。Sub-step S603: use the tabu search algorithm to select a path with a server node that is consistent with the physical node type and has a load rate that meets the requirements from the multiple paths between the start node and the end node, and set the k+1th The virtual network function of each physical node is adjusted and deployed to the server node of the selected path.
本子步骤中,在选择路径时,可以采用一种更优的实施方式:In this sub-step, when selecting a path, a better implementation method can be adopted:
基于最优综合成本,使用禁忌搜索算法从所述起始节点与终止节点之间的多条路径中,选择具有与该物理节点类型一致的服务器节点的路径作为候选路径;针对每个候选路径,计算将该物理节点的虚拟网络功能调整部署到该候选路径后,整个网络的综合成本;将该物理节点的虚拟网络功能最终调整部署到网络的综合成本最小的路径。Based on the optimal comprehensive cost, use a tabu search algorithm to select a path with a server node consistent with the physical node type as a candidate path from multiple paths between the starting node and the terminating node; for each candidate path, After the virtual network function of the physical node is adjusted and deployed to the candidate path, the comprehensive cost of the entire network is calculated; the virtual network function of the physical node is finally adjusted and deployed to the path with the smallest comprehensive cost of the network.
其中,所述网络的综合成本可以包括网络中的负载成本、业务时延成本和节点开启成本;Wherein, the comprehensive cost of the network may include load cost in the network, service delay cost and node start-up cost;
在所述网络具体为上述的基于SDN的云边缘协同网络的情况下,网络的综合成本可以根据上述的公式19计算得到;也就是说,根据所述网络的基底网络的信息(即物理网络的信息)、所述网络中所有SFC组成的SFG的信息(即虚拟网络的信息)、虚拟网络到物理网络的映射信息、流量峰值的负载信息,以及所述网络中所有SFC的时延、服务器的开启成本,计算得到当前部署情况的网络的综合成本。In the case that the network is specifically the above-mentioned SDN-based cloud-edge collaborative network, the comprehensive cost of the network can be calculated according to the above formula 19; that is, according to the information of the base network of the network (that is, the physical network information), the information of SFG composed of all SFCs in the network (that is, the information of the virtual network), the mapping information from the virtual network to the physical network, the load information of the traffic peak, the delay of all SFCs in the network, and the server’s Turn on the cost to calculate the comprehensive cost of the network in the current deployment situation.
例如,如图7所示,展示了在流量峰值时,SFG部署的一个实例。在图7的上半部分展示的是未部署调整(水平缩放)时的SFG部署情况,设α=0.7,此时过载的服务器节点包括边缘服务器n1和云服务器n3,n7,过载的物理链路为途径这些服务器的部分链路。为了均衡网络的负载,在进行部署调整时将n1,n3,n7承载的部分实例迁移到新的服务器节点部署。具体来说,将n1承载的两个VNF1的实例部署到边缘服务器n8,将n3承载的1个VNF3实例部署到云服务器n10,将n7承载的两个VNF6实例部署到云服务器n9。同时,调整与上述节点相关的链路部署。这样,过载的节点和链路资源被部分释放,网络的局部过载情况得到缓解。For example, Figure 7 shows an instance of SFG deployment during traffic peaks. The upper part of Figure 7 shows the deployment of SFG without deployment adjustment (horizontal scaling), assuming α=0.7, the overloaded server nodes at this time include edge server n 1 and cloud servers n 3 , n 7 , and the overloaded Physical links are partial links that pass through these servers. In order to balance the load of the network, some instances carried by n 1 , n 3 , and n 7 are migrated to new server node deployments during deployment adjustment. Specifically, two instances of VNF1 carried by n 1 are deployed to edge server n 8 , one instance of VNF3 carried by n 3 is deployed to cloud server n 10 , and two instances of VNF6 carried by n 7 are deployed to cloud server n 9 . At the same time, adjust the link deployment related to the above nodes. In this way, the overloaded node and link resources are partially released, and the local overload situation of the network is alleviated.
为了验证本发明技术方案的技术效果,我们使用了一个由40个物理节点组成的网络拓扑,其中20个是云服务器,10个是边缘服务器,10个路由器节点,模拟CEC网络架构。网络中的节点有204条物理链路连接。在我们的模拟中,SFC请求将根据一定的到达频率生成,流量峰值时λ=4。此外,我们假设每个SFC由2到5种不同的VNF组成,每个VNF的所需带宽设置为700到900Mbps,每个VNF的延迟限制设置为100ms~200ms。对于我们基于禁忌搜索的部署的算法,禁忌表大小为20,迭代次数为50,设置ε-greedy法的ε=0.3。对于本文的优化目标,ω1=0.7,ω2=0.2,ω3=0.1为默认配置。节点和链路负载度阈值α=β=0.7。In order to verify the technical effect of the technical solution of the present invention, we used a network topology consisting of 40 physical nodes, 20 of which are cloud servers, 10 are edge servers, and 10 router nodes, simulating the CEC network architecture. The nodes in the network are connected by 204 physical links. In our simulation, SFC requests will be generated according to a certain arrival frequency, and λ=4 at the traffic peak. In addition, we assume that each SFC is composed of 2 to 5 different VNFs, the required bandwidth of each VNF is set to 700 to 900 Mbps, and the delay limit of each VNF is set to 100 ms to 200 ms. For our deployed algorithm based on tabu search, the tabu table size is 20, the number of iterations is 50, and ε = 0.3 for the ε-greedy method is set. For the optimization objective in this paper, ω 1 =0.7, ω 2 =0.2, and ω 3 =0.1 are default configurations. Node and link load threshold α=β=0.7.
本发明的技术方案的算法为SFG-Scaling,是基于SFG的成本-负载均衡缩放部署算法;The algorithm of the technical solution of the present invention is SFG-Scaling, which is a cost-load balancing scaling deployment algorithm based on SFG;
现有技术方案算法SFC-Scaling,是按照每次单个SFC来考虑,面向成本与负载的缩放部署算法。The prior art solution algorithm SFC-Scaling is a cost- and load-oriented scaling deployment algorithm based on a single SFC each time.
现有技术方案算法SFC-LEB,是面向负载和能耗的平衡部署算法,旨在优化负载的同时,减少流量峰值时缩放对网络拓扑造成的变化。The prior art solution algorithm SFC-LEB is a load- and energy-consumption-oriented balanced deployment algorithm, aiming at optimizing the load while reducing changes to the network topology caused by scaling during traffic peaks.
现有技术方案算法SFC-DA,是时延感知的SFC部署算法,流量峰值时不均衡负载。The prior art solution algorithm SFC-DA is a delay-aware SFC deployment algorithm, and the load is unbalanced during traffic peaks.
本文从SFC接受率,业务时延,综合缩放成本三个方面对比,验证上述几个算法的性能。This paper compares the performance of the above algorithms from three aspects: SFC acceptance rate, service delay, and comprehensive scaling cost.
(1)定义SFC的接受率为成功部署的SFC数量除以用户请求的SFC总数。如图8所示,本文提出的算法可以保证在业务数量较大时仍有较高的接受率。SFC-Scaling和SFC-LEB均会对网络的负载进行平衡,以保证后续业务的顺利部署所以随着业务数量增加,二者的接受率虽然下降但是仍然在70%以上。SFC-LEB没有考虑时延的优化,可能会有因为服务超时而部署失败的SFC,因此接受率相较SFC-Scaling更低。SFC-DA不对流量峰值时的部署情况进行缩放,大量业务因为单个服务器节点或单条链路资源不够而部署失败,SFC接受率最差。(1) Define the SFC acceptance rate by dividing the number of successfully deployed SFCs by the total number of SFCs requested by users. As shown in Figure 8, the algorithm proposed in this paper can guarantee a high acceptance rate when the number of services is large. Both SFC-Scaling and SFC-LEB will balance the load of the network to ensure the smooth deployment of subsequent services. Therefore, as the number of services increases, the acceptance rate of the two decreases but is still above 70%. SFC-LEB does not consider the optimization of delay, and there may be SFCs that fail to be deployed due to service timeouts, so the acceptance rate is lower than that of SFC-Scaling. SFC-DA does not scale the deployment when the traffic peaks. A large number of services fail to be deployed due to insufficient resources of a single server node or a single link, and the acceptance rate of SFC is the worst.
(2)服务的时延在时延模型中定义,结果如图9所示。在服务时延方面,SFC-Scaling的表现最佳,相较于SFG-Scaling针对多条SFCs共同优化,SFC-Scaling倾向于给每条SFC都部署在时延较低的路径上。同时,本文提出的SFG-Scaling算法是表现第二好的。SFC-DA是面向时延优化的部署算法,时延最短的关键路径在早期被占用,因此时延较低。然而,SFC-DA算法不会对SFC进行缩放,所以随着业务的增加,关键路径上的节点和链路已经无法承载更多SFC,因此需要通过更远的路径完成部署,产生大量时延。SFC-LEB算法不关注业务的时延表现,因此时延最高。(2) The service delay is defined in the delay model, and the result is shown in Fig. 9 . In terms of service latency, SFC-Scaling performs best. Compared with SFG-Scaling, which optimizes multiple SFCs together, SFC-Scaling tends to deploy each SFC on a path with lower latency. At the same time, the SFG-Scaling algorithm proposed in this paper is the second best. SFC-DA is a delay-optimized deployment algorithm. The critical path with the shortest delay is occupied in the early stage, so the delay is low. However, the SFC-DA algorithm does not scale the SFC, so with the increase of services, the nodes and links on the critical path can no longer carry more SFC, so the deployment needs to be completed through a longer path, resulting in a large amount of delay. The SFC-LEB algorithm does not pay attention to the delay performance of the service, so the delay is the highest.
(3)我们定义综合缩放成本为网络负载度、服务时延、节点开启成本和接受率的加权计算值,同时作为本文的优化目标。从图10可以看出,本文提出的算法有最低的平均综合部署成本。本文提出的算法面向一次请求的多SFG,在与单SFC缩放算法对比时,在网络负载率方面有更好的表现。SFC-Scaling算法相较负载-能耗平衡的SFC部署算法,在时延成本上有更多的考虑,因此综合成本更低。时延感知的SFC部署算法,在流量峰值期间无法缓解局部过载的情况,因此部署成本高。随着时间增大,SFC-DA算法因为没有节点能承载更多的VNF,因此综合部署成本增长趋于平缓。(3) We define the comprehensive scaling cost as the weighted calculation value of network load, service delay, node opening cost and acceptance rate, which is also the optimization goal of this paper. It can be seen from Figure 10 that the algorithm proposed in this paper has the lowest average comprehensive deployment cost. The algorithm proposed in this paper is oriented to multiple SFGs for one request, and it has a better performance in terms of network load rate when compared with the single SFC scaling algorithm. Compared with the load-energy balancing SFC deployment algorithm, the SFC-Scaling algorithm has more considerations on the delay cost, so the overall cost is lower. The delay-aware SFC deployment algorithm cannot alleviate local overload during traffic peaks, so the deployment cost is high. As time increases, the SFC-DA algorithm has no nodes that can carry more VNFs, so the growth of comprehensive deployment costs tends to be flat.
图11示出了本实施例所提供的一种更为具体的电子设备硬件结构示意图,该设备可以包括:处理器1010、存储器1020、输入/输出接口1030、通信接口1040和总线1050。其中处理器1010、存储器1020、输入/输出接口1030和通信接口1040通过总线1050实现彼此之间在设备内部的通信连接。FIG. 11 shows a schematic diagram of a more specific hardware structure of an electronic device provided by this embodiment. The device may include: a
处理器1010可以采用通用的CPU(Central Processing Unit,中央处理器)、微处理器、应用专用集成电路(Application Specific Integrated Circuit,ASIC)、或者一个或多个集成电路等方式实现,用于执行相关程序,以实现本说明书实施例所提供的虚拟网络功能的部署调整方法。The
存储器1020可以采用ROM(Read Only Memory,只读存储器)、RAM(Random AccessMemory,随机存取存储器)、静态存储设备,动态存储设备等形式实现。存储器1020可以存储操作系统和其他应用程序,在通过软件或者固件来实现本说明书实施例所提供的技术方案时,相关的程序代码保存在存储器1020中,并由处理器1010来调用执行。The
输入/输出接口1030用于连接输入/输出模块,可以与非线性接收机相连,从非线性接收机接收信息,实现信息输入及输出。输入输出/模块可以作为组件配置在设备中(图中未示出),也可以外接于设备以提供相应功能。其中输入设备可以包括键盘、鼠标、触摸屏、麦克风、各类传感器等,输出设备可以包括显示器、扬声器、振动器、指示灯等。The input/
通信接口1040用于连接通信模块(图中未示出),以实现本设备与其他设备的通信交互。其中通信模块可以通过有线方式(例如USB、网线等)实现通信,也可以通过无线方式(例如移动网络、WIFI、蓝牙等)实现通信。The
总线1050包括一通路,在设备的各个组件(例如处理器1010、存储器1020、输入/输出接口1030和通信接口1040)之间传输信息。
需要说明的是,尽管上述设备仅示出了处理器1010、存储器1020、输入/输出接口1030、通信接口1040以及总线1050,但是在具体实施过程中,该设备还可以包括实现正常运行所必需的其他组件。此外,本领域的技术人员可以理解的是,上述设备中也可以仅包含实现本说明书实施例方案所必需的组件,而不必包含图中所示的全部组件。It should be noted that although the above device only shows the
本发明的技术方案中,在接收到部署虚拟网络功能的请求后,确定网络中部署该请求的虚拟网络功能后的初始部署方案;基于初始部署方案,针对网络中的所有SFC组成的SFG,遍历其中的物理节点和链路,确定出超负载的物理节点和链路;针对超负载的物理节点和链路进行虚拟网络功能的部署调整。从而能够针对已部署的所有SFC组合成的SFG,将网络全局中过载的节点和链路重新部署和路由,输出一个全局的虚拟网络功能的部署调整方案;相比于现有的从单条SFC的角度进行网络功能缩放的技术,本发明的技术方案可以高效地保证整个网络资源的利用率和平衡网络设备间负载。In the technical solution of the present invention, after receiving a request for deploying a virtual network function, determine the initial deployment plan after deploying the requested virtual network function in the network; based on the initial deployment plan, for the SFG composed of all SFCs in the network, traverse The physical nodes and links among them determine the overloaded physical nodes and links; and adjust the deployment of virtual network functions for the overloaded physical nodes and links. Therefore, for the SFG composed of all deployed SFCs, the overloaded nodes and links in the global network can be re-deployed and routed, and a global virtual network function deployment adjustment plan can be output; compared with the existing single SFC From the perspective of network function scaling technology, the technical solution of the present invention can efficiently ensure the utilization rate of the entire network resources and balance the load among network devices.
进一步,本发明的技术方案还提出了一种基于SDN的云边缘协同网络的流量峰值时缩放成本综合优化评估模型,将其应用于本发明的虚拟网络功能的部署调整方案中,可以实现SFG的成本-负载均衡,使得调整部署后的网络的综合成本得到优化,使得SDN网络能在流量峰值保证SFC的服务质量,从网络全局均衡负载。Further, the technical solution of the present invention also proposes an SDN-based cloud-edge collaborative network scaling cost comprehensive optimization evaluation model at peak traffic times, which is applied to the deployment adjustment scheme of the virtual network function of the present invention, and the SFG can be realized. Cost-load balancing optimizes the overall cost of the adjusted and deployed network, enables the SDN network to guarantee the service quality of SFC at traffic peaks, and balances the load globally from the network.
本实施例的计算机可读介质包括永久性和非永久性、可移动和非可移动媒体可以由任何方法或技术来实现信息存储。信息可以是计算机可读指令、数据结构、程序的模块或其他数据。计算机的存储介质的例子包括,但不限于相变内存(PRAM)、静态随机存取存储器(SRAM)、动态随机存取存储器(DRAM)、其他类型的随机存取存储器(RAM)、只读存储器(ROM)、电可擦除可编程只读存储器(EEPROM)、快闪记忆体或其他内存技术、只读光盘只读存储器(CD-ROM)、数字多功能光盘(DVD)或其他光学存储、磁盒式磁带,磁带磁磁盘存储或其他磁性存储设备或任何其他非传输介质,可用于存储可以被计算设备访问的信息。The computer-readable medium in this embodiment includes permanent and non-permanent, removable and non-removable media, and information storage can be realized by any method or technology. Information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read only memory (ROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Flash memory or other memory technology, Compact Disc Read-Only Memory (CD-ROM), Digital Versatile Disc (DVD) or other optical storage, Magnetic tape cartridge, tape magnetic disk storage or other magnetic storage device or any other non-transmission medium that can be used to store information that can be accessed by a computing device.
所属领域的普通技术人员应当理解:以上任何实施例的讨论仅为示例性的,并非旨在暗示本公开的范围(包括权利要求)被限于这些例子;在本发明的思路下,以上实施例或者不同实施例中的技术特征之间也可以进行组合,步骤可以以任意顺序实现,并存在如上所述的本发明的不同方面的许多其它变化,为了简明它们没有在细节中提供。Those of ordinary skill in the art should understand that: the discussion of any of the above embodiments is exemplary only, and is not intended to imply that the scope of the present disclosure (including claims) is limited to these examples; under the idea of the present invention, the above embodiments or Combinations between technical features in different embodiments are also possible, steps may be carried out in any order, and there are many other variations of the different aspects of the invention as described above, which are not presented in detail for the sake of brevity.
另外,为简化说明和讨论,并且为了不会使本发明难以理解,在所提供的附图中可以示出或可以不示出与集成电路(IC)芯片和其它部件的公知的电源/接地连接。此外,可以以框图的形式示出装置,以便避免使本发明难以理解,并且这也考虑了以下事实,即关于这些框图装置的实施方式的细节是高度取决于将要实施本发明的平台的(即,这些细节应当完全处于本领域技术人员的理解范围内)。在阐述了具体细节(例如,电路)以描述本发明的示例性实施例的情况下,对本领域技术人员来说显而易见的是,可以在没有这些具体细节的情况下或者这些具体细节有变化的情况下实施本发明。因此,这些描述应被认为是说明性的而不是限制性的。In addition, well-known power/ground connections to integrated circuit (IC) chips and other components may or may not be shown in the provided figures, for simplicity of illustration and discussion, and so as not to obscure the present invention. . Furthermore, devices may be shown in block diagram form in order to avoid obscuring the invention, and this also takes into account the fact that details regarding the implementation of these block diagram devices are highly dependent on the platform on which the invention is to be implemented (i.e. , these details should be well within the understanding of those skilled in the art). Where specific details (eg, circuits) have been set forth to describe example embodiments of the invention, it will be apparent to those skilled in the art that other embodiments may be implemented without or with variations from these specific details. Implement the present invention down. Accordingly, these descriptions should be regarded as illustrative rather than restrictive.
尽管已经结合了本发明的具体实施例对本发明进行了描述,但是根据前面的描述,这些实施例的很多替换、修改和变型对本领域普通技术人员来说将是显而易见的。例如,其它存储器架构(例如,动态RAM(DRAM))可以使用所讨论的实施例。Although the invention has been described in conjunction with specific embodiments of the invention, many alternatives, modifications and variations of those embodiments will be apparent to those of ordinary skill in the art from the foregoing description. For example, other memory architectures such as dynamic RAM (DRAM) may use the discussed embodiments.
本发明的实施例旨在涵盖落入所附权利要求的宽泛范围之内的所有这样的替换、修改和变型。因此,凡在本发明的精神和原则之内,所做的任何省略、修改、等同替换、改进等,均应包含在本发明的保护范围之内。Embodiments of the present invention are intended to embrace all such alterations, modifications and variations that fall within the broad scope of the appended claims. Therefore, any omissions, modifications, equivalent replacements, improvements, etc. within the spirit and principles of the present invention shall be included within the protection scope of the present invention.
Claims (10)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202210716111.7A CN115361284B (en) | 2022-06-22 | 2022-06-22 | Deployment adjustment method of virtual network function based on SDN |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202210716111.7A CN115361284B (en) | 2022-06-22 | 2022-06-22 | Deployment adjustment method of virtual network function based on SDN |
Publications (2)
Publication Number | Publication Date |
---|---|
CN115361284A true CN115361284A (en) | 2022-11-18 |
CN115361284B CN115361284B (en) | 2023-12-05 |
Family
ID=84030298
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202210716111.7A Active CN115361284B (en) | 2022-06-22 | 2022-06-22 | Deployment adjustment method of virtual network function based on SDN |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN115361284B (en) |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN108900358A (en) * | 2018-08-01 | 2018-11-27 | 重庆邮电大学 | Virtual network function dynamic migration method based on deepness belief network resource requirement prediction |
US20200099625A1 (en) * | 2018-09-24 | 2020-03-26 | Netsia, Inc. | Path determination method and system for delay-optimized service function chaining |
CN112738820A (en) * | 2020-12-22 | 2021-04-30 | 国网北京市电力公司 | A method, device and computer equipment for dynamic deployment of service function chain |
-
2022
- 2022-06-22 CN CN202210716111.7A patent/CN115361284B/en active Active
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN108900358A (en) * | 2018-08-01 | 2018-11-27 | 重庆邮电大学 | Virtual network function dynamic migration method based on deepness belief network resource requirement prediction |
US20200099625A1 (en) * | 2018-09-24 | 2020-03-26 | Netsia, Inc. | Path determination method and system for delay-optimized service function chaining |
CN112738820A (en) * | 2020-12-22 | 2021-04-30 | 国网北京市电力公司 | A method, device and computer equipment for dynamic deployment of service function chain |
Also Published As
Publication number | Publication date |
---|---|
CN115361284B (en) | 2023-12-05 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN112738820B (en) | Dynamic deployment method and device of service function chain and computer equipment | |
CN108121512B (en) | Edge computing service caching method, system and device and readable storage medium | |
CN109218355B (en) | Load balancing engine, client, distributed computing system and load balancing method | |
CN112565082B (en) | Service chain mapping method based on hybrid network, intelligent terminal and storage medium | |
CN113300881B (en) | 5G network-based scheduling method, device, equipment and storage medium | |
CN113472844B (en) | Edge computing server deployment method, device and equipment for Internet of vehicles | |
CN111130858B (en) | A Dynamic Multi-Object Virtual Network Mapping Method in SD-WAN Scenario | |
CN113709876B (en) | Satellite service resource allocation method and electronic equipment | |
CN110535705B (en) | A Service Function Chain Construction Method for Adaptive User Delay Requirements | |
CN104917659B (en) | A kind of mapping method of virtual network based on virtual network connection performance | |
WO2022142277A1 (en) | Method and system for dynamically adjusting communication architecture | |
CN110851235B (en) | Virtual network function deployment method suitable for multidimensional resource optimization configuration | |
CN112491741B (en) | Virtual network resource allocation method and device and electronic equipment | |
CN115361332B (en) | Fault-tolerant route processing method and device, processor and electronic equipment | |
CN108696427B (en) | A data transmission method and device | |
CN114785692B (en) | A virtual power plant aggregation control communication network traffic balancing method and device | |
CN117176722A (en) | Dynamic reconstruction method, device and server | |
CN115361284B (en) | Deployment adjustment method of virtual network function based on SDN | |
CN118118437A (en) | Method and related equipment for calculating unloading | |
CN113014302B (en) | Network function service chain deployment method facing satellite network | |
CN113259189B (en) | A kind of VNF deployment method, device and electronic device based on non-uniform service | |
CN117278566A (en) | Computing power node selection method, device, electronic equipment and readable storage medium | |
CN116489158A (en) | Load balancing method for container migration in cloud environment | |
CN113037805B (en) | Multi-instance micro-service migration method facing mobile edge calculation | |
CN111585784A (en) | A network slice deployment method and device |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |