CN104636198B - A kind of nearly data source moving method of calculating task based on OSGi - Google Patents
A kind of nearly data source moving method of calculating task based on OSGi Download PDFInfo
- Publication number
- CN104636198B CN104636198B CN201510083101.4A CN201510083101A CN104636198B CN 104636198 B CN104636198 B CN 104636198B CN 201510083101 A CN201510083101 A CN 201510083101A CN 104636198 B CN104636198 B CN 104636198B
- Authority
- CN
- China
- Prior art keywords
- task
- computing
- osgi
- data source
- module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Classifications
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
本发明提出了一种基于OSGi的计算任务近数据源迁移方法,基于计算任务决策模块、计算任务检测模块和计算任务迁移模块,把计算任务进行OSGi组件化,使之具有OSGi的灵活、可热插拔等优点,在充分利用OSGi上下文管理的前提下,找到最适合计算任务的最佳近数据源,把计算任务迁移到近数据源进行计算,达到高效率低功耗的目的。
The present invention proposes an OSGi-based computing task near-data source migration method. Based on the computing task decision module, computing task detection module and computing task migration module, the computing task is OSGi componentized, so that it has the flexibility and heat of OSGi. With the advantages of plugging and unplugging, on the premise of making full use of OSGi context management, find the best near data source that is most suitable for computing tasks, and migrate computing tasks to near data sources for computing, achieving the purpose of high efficiency and low power consumption.
Description
技术领域technical field
本发明涉及互联网领域,具体涉及到一种基于OSGi的计算任务近数据源迁移方法。The invention relates to the Internet field, in particular to an OSGi-based method for migrating computing tasks near data sources.
背景技术Background technique
近数据源的任务迁移可以让计算任务在近数据源处进行执行,而省去了端到端的数据传输环节,大大地提高了计算任务完成的效率,节省了原计算主体的计算资源消耗。最接近本发明的技术有:The task migration near the data source allows computing tasks to be executed near the data source, eliminating the need for end-to-end data transmission, which greatly improves the efficiency of computing tasks and saves the computing resource consumption of the original computing subject. The techniques closest to the present invention are:
(1)、CloneCloud:它可以从移动设备复制计算任务和数据到强计算结点,并返回计算结果;(1), CloneCloud: It can copy computing tasks and data from mobile devices to strong computing nodes, and return computing results;
(2)、CloudLet:利用虚拟机技术在附近的CloudLet上面实例化服务实例,减少空间网络传输时间和带宽的限制。(2) CloudLet: Use virtual machine technology to instantiate service instances on nearby CloudLet to reduce space network transmission time and bandwidth limitations.
其中,CloneCloud需要修改JVM,因此在实际应用中不太现实;CloudLet缺少对计算任务和数据在不同结点间的分布和管理。而且CloneCloud和CloudLet不是基于OSGi技术规范实现的,这就使得它们不具备OSGi的高度模块化、灵活、可热插拔等优势。同时,基于近数据源的计算,现有的技术都没有在这方面进行考虑与设计。Among them, CloneCloud needs to modify the JVM, so it is not realistic in practical applications; CloudLet lacks the distribution and management of computing tasks and data among different nodes. Moreover, CloneCloud and CloudLet are not implemented based on OSGi technical specifications, which makes them not have the advantages of highly modularized, flexible, and hot-swappable OSGi. At the same time, based on the calculation of near data sources, the existing technologies have not considered and designed in this regard.
发明内容Contents of the invention
为解决现有技术中的缺点和不足,本发明提出了一种基于OSGi的计算任务近数据源迁移方法,把计算任务进行OSGi组件化,在充分利用OSGi上下文管理的前提下,找到最适合计算任务的最佳近数据源,把计算任务迁移到最佳近数据源进行计算。In order to solve the shortcomings and deficiencies in the prior art, the present invention proposes an OSGi-based migration method for computing tasks near data sources, which implements OSGi componentization of computing tasks, and finds the most suitable computing task under the premise of fully utilizing OSGi context management. The best near data source for the task, and migrate the computing task to the best near data source for calculation.
本发明的技术方案为:Technical scheme of the present invention is:
一种基于OSGi的计算任务近数据源迁移方法,基于计算任务决策模块、计算任务检测模块和计算任务迁移模块,包括以下步骤:An OSGi-based migration method for computing tasks near data sources, based on a computing task decision module, a computing task detection module and a computing task migration module, comprising the following steps:
步骤(1)、根据OSGi的上下文获取计算任务信息,计算任务检测模块实时检查是否有可迁移的计算任务;Step (1), obtain computing task information according to the context of OSGi, and the computing task detection module checks in real time whether there is a computing task that can be migrated;
步骤(2)、当检测到可迁移的任务时,由计算任务决策模块进行决策是否将其迁移;Step (2), when a task that can be migrated is detected, the calculation task decision module makes a decision whether to migrate it;
步骤(3)、如果不进行任务迁移,则获取计算任务所需要的数据,然后本地执行计算任务,返回计算结果;如果决定转移该计算任务,那么任务决策模块根据上下文选择最佳近数据源;Step (3), if no task migration is performed, obtain the data required by the computing task, then execute the computing task locally, and return the calculation result; if it is decided to transfer the computing task, then the task decision module selects the best near data source according to the context;
步骤(4)、任务决策模块调用任务迁移模块把计算任务以OSGi组件的形式迁移目标最佳近数据源处,计算任务在目标近数据源进行计算;Step (4), the task decision module calls the task migration module to migrate the calculation task to the best near data source of the target in the form of OSGi components, and the calculation task is calculated at the target near data source;
步骤(5)、返回计算结果。Step (5), return the calculation result.
可选地,本发明的基于OSGi的计算任务近数据源迁移方法,还包括异常处理模块,异常处理模块处理整个过程中所捕获的异常。Optionally, the OSGi-based computing task migration method near the data source of the present invention further includes an exception handling module, which handles the exceptions caught in the whole process.
本发明的有益效果:Beneficial effects of the present invention:
(1)通过把计算任务迁移到近数据源进行计算,避免了源数据的传输,有效地提高了计算效率;(1) By migrating computing tasks to near data sources for calculation, the transmission of source data is avoided, and the computing efficiency is effectively improved;
(2)使之具有OSGi的高度模块化、灵活、可热插拔等优点;(2) Make it have the advantages of OSGi's highly modular, flexible, hot-swappable, etc.;
(3)节省了原计算主体的计算资源消耗,如电量、带宽、内存等。(3) The consumption of computing resources of the original computing body, such as power, bandwidth, and memory, is saved.
附图说明Description of drawings
为了更清楚地说明本发明实施例或现有技术中的技术方案,下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本发明的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。In order to more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are only These are some embodiments of the present invention. Those skilled in the art can also obtain other drawings based on these drawings without creative work.
图1为本发明基于OSGi的计算任务近数据源迁移方法的系统结构图;Fig. 1 is the system structural diagram of the near data source migration method of computing tasks based on OSGi in the present invention;
图2为本发明基于OSGi的计算任务近数据源迁移方法的流程图。FIG. 2 is a flow chart of the method for migrating computing tasks near data sources based on OSGi in the present invention.
具体实施方式Detailed ways
下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本发明一部分实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本发明保护的范围。The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some of the embodiments of the present invention, not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.
如图1所示,本发明的基于OSGi的计算任务近数据源迁移方法的系统结构包含四个模块:计算任务检测模块、计算任务决策模块、计算任务迁移模块和异常处理模块。As shown in FIG. 1 , the system structure of the OSGi-based computing task near data source migration method of the present invention includes four modules: a computing task detection module, a computing task decision module, a computing task migration module and an exception handling module.
下面结合图1与图2,对基于OSGi的计算任务近数据源迁移方法的具体流程进行详细说明:The specific flow of the OSGi-based computing task migration method near the data source will be described in detail below in combination with Figure 1 and Figure 2:
步骤(1)、根据OSGi的上下文获取计算任务信息,计算任务检测模块实时检查是否有可迁移的计算任务。In step (1), computing task information is obtained according to the OSGi context, and the computing task detection module checks in real time whether there is a computing task that can be migrated.
步骤(2)、当检测到可迁移的任务时,由计算任务决策模块进行决策是否将其迁移。Step (2), when a task that can be migrated is detected, the calculation task decision module decides whether to migrate it.
步骤(3)、如果不进行任务迁移,则获取计算任务所需要的数据,然后本地执行计算任务,返回计算结果;如果决定转移该计算任务,那么计算任务决策模块估算任务执行资源消耗,根据上下文选择最佳近数据源,其中,最佳近数据源指的是可以用来执行计算任务,以此来达到资源消耗最小的邻近计算主体的数据源。Step (3), if the task migration is not performed, obtain the data required by the computing task, then execute the computing task locally, and return the calculation result; if it decides to transfer the computing task, then the computing task decision module estimates the task execution resource consumption, according to the context Select the best near data source, where the best near data source refers to the data source near the computing subject that can be used to perform computing tasks to achieve the minimum resource consumption.
步骤(4)、任务决策模块调用任务迁移模块把计算任务以OSGi组件的形式迁移目标最佳近数据源处,计算任务在目标近数据源进行计算。In step (4), the task decision module calls the task migration module to migrate the calculation task to the best near data source in the form of an OSGi component, and the calculation task is calculated at the target near data source.
步骤(5)、返回计算结果,进行相关处理。Step (5), return the calculation result, and perform related processing.
优选地,在整个过程中,异常处理模块会处理整个过程中所捕获的异常,包括任务检测异常、计算任务组件获取异常、计算任务组件传输异常、计算任务组件远程执行异常。Preferably, during the whole process, the exception handling module handles the exceptions caught in the whole process, including task detection exception, calculation task component acquisition exception, calculation task component transmission exception, and calculation task component remote execution exception.
本发明的基于OSGi的计算任务近数据源迁移方法,通过把计算任务迁移到近数据源进行计算,避免了源数据的传输,有效地提高了计算效率;而且,使之具有OSGi的高度模块化、灵活、可热插拔等优点;节省了原计算主体的计算资源消耗,如电量、带宽、内存等。The OSGi-based calculation task near data source migration method of the present invention avoids the transmission of source data by migrating the calculation task to the near data source for calculation, and effectively improves the calculation efficiency; moreover, it has the high degree of modularization of OSGi , flexible, hot-swappable and other advantages; it saves the consumption of computing resources of the original computing body, such as power, bandwidth, memory, etc.
以上所述仅为本发明的较佳实施例而已,并不用以限制本发明,凡在本发明的精神和原则之内,所作的任何修改、等同替换、改进等,均应包含在本发明的保护范围之内。The above descriptions are only preferred embodiments of the present invention, and are not intended to limit the present invention. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the present invention shall be included in the scope of the present invention. within the scope of protection.
Claims (2)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201510083101.4A CN104636198B (en) | 2015-02-11 | 2015-02-11 | A kind of nearly data source moving method of calculating task based on OSGi |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201510083101.4A CN104636198B (en) | 2015-02-11 | 2015-02-11 | A kind of nearly data source moving method of calculating task based on OSGi |
Publications (2)
Publication Number | Publication Date |
---|---|
CN104636198A CN104636198A (en) | 2015-05-20 |
CN104636198B true CN104636198B (en) | 2018-05-29 |
Family
ID=53214989
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201510083101.4A Expired - Fee Related CN104636198B (en) | 2015-02-11 | 2015-02-11 | A kind of nearly data source moving method of calculating task based on OSGi |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN104636198B (en) |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN105530313A (en) * | 2015-12-21 | 2016-04-27 | 中国石油大学(华东) | A context-aware service migration method based on OSGi pervasive cloud environment |
CN108388470B (en) * | 2018-01-26 | 2022-09-16 | 福建星瑞格软件有限公司 | Big data task processing method and computer equipment |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN1624670A (en) * | 2003-12-03 | 2005-06-08 | 华为技术有限公司 | A Method of Local Data Migration |
CN101907989A (en) * | 2010-06-01 | 2010-12-08 | 南京大学 | A method for seamless application migration based on mobile agent |
CN103366238A (en) * | 2012-03-30 | 2013-10-23 | 北京千橡网景科技发展有限公司 | Method and device for automatic allocation of calculation task |
CN103631657A (en) * | 2013-11-19 | 2014-03-12 | 浪潮电子信息产业股份有限公司 | Task scheduling algorithm based on MapReduce |
Family Cites Families (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10318284B2 (en) * | 2008-06-02 | 2019-06-11 | International Business Machines Corporation | System and method of generating and managing computing tasks |
-
2015
- 2015-02-11 CN CN201510083101.4A patent/CN104636198B/en not_active Expired - Fee Related
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN1624670A (en) * | 2003-12-03 | 2005-06-08 | 华为技术有限公司 | A Method of Local Data Migration |
CN101907989A (en) * | 2010-06-01 | 2010-12-08 | 南京大学 | A method for seamless application migration based on mobile agent |
CN103366238A (en) * | 2012-03-30 | 2013-10-23 | 北京千橡网景科技发展有限公司 | Method and device for automatic allocation of calculation task |
CN103631657A (en) * | 2013-11-19 | 2014-03-12 | 浪潮电子信息产业股份有限公司 | Task scheduling algorithm based on MapReduce |
Also Published As
Publication number | Publication date |
---|---|
CN104636198A (en) | 2015-05-20 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP5758995B2 (en) | System, method and computer-readable storage medium for sharing analysis results between virtual machines | |
CN104239122B (en) | A kind of virtual machine migration method and device | |
US20100161559A1 (en) | Maintaining a network connection of a workload during transfer | |
CN111880911A (en) | Task load scheduling method, device and equipment and readable storage medium | |
CN106227587A (en) | A kind of band snapshot virtual machine complete machine dynamic migration method and device | |
CN106210046A (en) | A kind of volume based on Cinder is across cluster hanging method and system | |
CN114202027A (en) | Execution configuration information generation method, model training method and device | |
CN107395731A (en) | A kind of adjusting method and device of the container cluster based on service orchestration | |
CN103324532A (en) | Dynamic migration method and system of virtual machine | |
CN111049900B (en) | Internet of things flow calculation scheduling method and device and electronic equipment | |
CN103685539A (en) | Method for running Windows system on home-made processor platform | |
CN105260238A (en) | Multi-process performance improvement deployment method | |
CN102625144A (en) | Parallel video processing method based on Cloud Network of local area network | |
CN105607606B (en) | A kind of data acquisition device and method based on double mainboard frameworks | |
CN104636198B (en) | A kind of nearly data source moving method of calculating task based on OSGi | |
CN117971906A (en) | A multi-card collaborative database query method, device, equipment and storage medium | |
CN104866528A (en) | Multi-platform data acquisition method and system | |
CN103986665A (en) | The method of network load balancing in Yunhai OS | |
CN102118437B (en) | A Xen-based virtual machine live migration progress monitoring method and device | |
CN109150574B (en) | Large-scale network reproduction method | |
US20150286493A1 (en) | Virtual-machine placement based on information from multiple data centers | |
CN105068899A (en) | Automatic restart stability test method under Vmware system | |
CN104123135B (en) | A kind of method and device of unified back office interface | |
CN105808340B (en) | Load balancing method and system | |
CN105515933A (en) | Management method for realizing network function of VMware based on OpenStack |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant | ||
CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20180529 |
|
CF01 | Termination of patent right due to non-payment of annual fee |