[go: up one dir, main page]
More Web Proxy on the site http://driver.im/

CN104636198B - A kind of nearly data source moving method of calculating task based on OSGi - Google Patents

A kind of nearly data source moving method of calculating task based on OSGi Download PDF

Info

Publication number
CN104636198B
CN104636198B CN201510083101.4A CN201510083101A CN104636198B CN 104636198 B CN104636198 B CN 104636198B CN 201510083101 A CN201510083101 A CN 201510083101A CN 104636198 B CN104636198 B CN 104636198B
Authority
CN
China
Prior art keywords
task
computing
osgi
data source
module
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN201510083101.4A
Other languages
Chinese (zh)
Other versions
CN104636198A (en
Inventor
张卫山
陈立成
卢清华
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
China University of Petroleum East China
Original Assignee
China University of Petroleum East China
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by China University of Petroleum East China filed Critical China University of Petroleum East China
Priority to CN201510083101.4A priority Critical patent/CN104636198B/en
Publication of CN104636198A publication Critical patent/CN104636198A/en
Application granted granted Critical
Publication of CN104636198B publication Critical patent/CN104636198B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D10/00Energy efficient computing, e.g. low power processors, power management or thermal management

Landscapes

  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

本发明提出了一种基于OSGi的计算任务近数据源迁移方法,基于计算任务决策模块、计算任务检测模块和计算任务迁移模块,把计算任务进行OSGi组件化,使之具有OSGi的灵活、可热插拔等优点,在充分利用OSGi上下文管理的前提下,找到最适合计算任务的最佳近数据源,把计算任务迁移到近数据源进行计算,达到高效率低功耗的目的。

The present invention proposes an OSGi-based computing task near-data source migration method. Based on the computing task decision module, computing task detection module and computing task migration module, the computing task is OSGi componentized, so that it has the flexibility and heat of OSGi. With the advantages of plugging and unplugging, on the premise of making full use of OSGi context management, find the best near data source that is most suitable for computing tasks, and migrate computing tasks to near data sources for computing, achieving the purpose of high efficiency and low power consumption.

Description

一种基于OSGi的计算任务近数据源迁移方法An OSGi-based Migration Method for Computing Tasks Near Data Sources

技术领域technical field

本发明涉及互联网领域,具体涉及到一种基于OSGi的计算任务近数据源迁移方法。The invention relates to the Internet field, in particular to an OSGi-based method for migrating computing tasks near data sources.

背景技术Background technique

近数据源的任务迁移可以让计算任务在近数据源处进行执行,而省去了端到端的数据传输环节,大大地提高了计算任务完成的效率,节省了原计算主体的计算资源消耗。最接近本发明的技术有:The task migration near the data source allows computing tasks to be executed near the data source, eliminating the need for end-to-end data transmission, which greatly improves the efficiency of computing tasks and saves the computing resource consumption of the original computing subject. The techniques closest to the present invention are:

(1)、CloneCloud:它可以从移动设备复制计算任务和数据到强计算结点,并返回计算结果;(1), CloneCloud: It can copy computing tasks and data from mobile devices to strong computing nodes, and return computing results;

(2)、CloudLet:利用虚拟机技术在附近的CloudLet上面实例化服务实例,减少空间网络传输时间和带宽的限制。(2) CloudLet: Use virtual machine technology to instantiate service instances on nearby CloudLet to reduce space network transmission time and bandwidth limitations.

其中,CloneCloud需要修改JVM,因此在实际应用中不太现实;CloudLet缺少对计算任务和数据在不同结点间的分布和管理。而且CloneCloud和CloudLet不是基于OSGi技术规范实现的,这就使得它们不具备OSGi的高度模块化、灵活、可热插拔等优势。同时,基于近数据源的计算,现有的技术都没有在这方面进行考虑与设计。Among them, CloneCloud needs to modify the JVM, so it is not realistic in practical applications; CloudLet lacks the distribution and management of computing tasks and data among different nodes. Moreover, CloneCloud and CloudLet are not implemented based on OSGi technical specifications, which makes them not have the advantages of highly modularized, flexible, and hot-swappable OSGi. At the same time, based on the calculation of near data sources, the existing technologies have not considered and designed in this regard.

发明内容Contents of the invention

为解决现有技术中的缺点和不足,本发明提出了一种基于OSGi的计算任务近数据源迁移方法,把计算任务进行OSGi组件化,在充分利用OSGi上下文管理的前提下,找到最适合计算任务的最佳近数据源,把计算任务迁移到最佳近数据源进行计算。In order to solve the shortcomings and deficiencies in the prior art, the present invention proposes an OSGi-based migration method for computing tasks near data sources, which implements OSGi componentization of computing tasks, and finds the most suitable computing task under the premise of fully utilizing OSGi context management. The best near data source for the task, and migrate the computing task to the best near data source for calculation.

本发明的技术方案为:Technical scheme of the present invention is:

一种基于OSGi的计算任务近数据源迁移方法,基于计算任务决策模块、计算任务检测模块和计算任务迁移模块,包括以下步骤:An OSGi-based migration method for computing tasks near data sources, based on a computing task decision module, a computing task detection module and a computing task migration module, comprising the following steps:

步骤(1)、根据OSGi的上下文获取计算任务信息,计算任务检测模块实时检查是否有可迁移的计算任务;Step (1), obtain computing task information according to the context of OSGi, and the computing task detection module checks in real time whether there is a computing task that can be migrated;

步骤(2)、当检测到可迁移的任务时,由计算任务决策模块进行决策是否将其迁移;Step (2), when a task that can be migrated is detected, the calculation task decision module makes a decision whether to migrate it;

步骤(3)、如果不进行任务迁移,则获取计算任务所需要的数据,然后本地执行计算任务,返回计算结果;如果决定转移该计算任务,那么任务决策模块根据上下文选择最佳近数据源;Step (3), if no task migration is performed, obtain the data required by the computing task, then execute the computing task locally, and return the calculation result; if it is decided to transfer the computing task, then the task decision module selects the best near data source according to the context;

步骤(4)、任务决策模块调用任务迁移模块把计算任务以OSGi组件的形式迁移目标最佳近数据源处,计算任务在目标近数据源进行计算;Step (4), the task decision module calls the task migration module to migrate the calculation task to the best near data source of the target in the form of OSGi components, and the calculation task is calculated at the target near data source;

步骤(5)、返回计算结果。Step (5), return the calculation result.

可选地,本发明的基于OSGi的计算任务近数据源迁移方法,还包括异常处理模块,异常处理模块处理整个过程中所捕获的异常。Optionally, the OSGi-based computing task migration method near the data source of the present invention further includes an exception handling module, which handles the exceptions caught in the whole process.

本发明的有益效果:Beneficial effects of the present invention:

(1)通过把计算任务迁移到近数据源进行计算,避免了源数据的传输,有效地提高了计算效率;(1) By migrating computing tasks to near data sources for calculation, the transmission of source data is avoided, and the computing efficiency is effectively improved;

(2)使之具有OSGi的高度模块化、灵活、可热插拔等优点;(2) Make it have the advantages of OSGi's highly modular, flexible, hot-swappable, etc.;

(3)节省了原计算主体的计算资源消耗,如电量、带宽、内存等。(3) The consumption of computing resources of the original computing body, such as power, bandwidth, and memory, is saved.

附图说明Description of drawings

为了更清楚地说明本发明实施例或现有技术中的技术方案,下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本发明的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。In order to more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are only These are some embodiments of the present invention. Those skilled in the art can also obtain other drawings based on these drawings without creative work.

图1为本发明基于OSGi的计算任务近数据源迁移方法的系统结构图;Fig. 1 is the system structural diagram of the near data source migration method of computing tasks based on OSGi in the present invention;

图2为本发明基于OSGi的计算任务近数据源迁移方法的流程图。FIG. 2 is a flow chart of the method for migrating computing tasks near data sources based on OSGi in the present invention.

具体实施方式Detailed ways

下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本发明一部分实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本发明保护的范围。The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some of the embodiments of the present invention, not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

如图1所示,本发明的基于OSGi的计算任务近数据源迁移方法的系统结构包含四个模块:计算任务检测模块、计算任务决策模块、计算任务迁移模块和异常处理模块。As shown in FIG. 1 , the system structure of the OSGi-based computing task near data source migration method of the present invention includes four modules: a computing task detection module, a computing task decision module, a computing task migration module and an exception handling module.

下面结合图1与图2,对基于OSGi的计算任务近数据源迁移方法的具体流程进行详细说明:The specific flow of the OSGi-based computing task migration method near the data source will be described in detail below in combination with Figure 1 and Figure 2:

步骤(1)、根据OSGi的上下文获取计算任务信息,计算任务检测模块实时检查是否有可迁移的计算任务。In step (1), computing task information is obtained according to the OSGi context, and the computing task detection module checks in real time whether there is a computing task that can be migrated.

步骤(2)、当检测到可迁移的任务时,由计算任务决策模块进行决策是否将其迁移。Step (2), when a task that can be migrated is detected, the calculation task decision module decides whether to migrate it.

步骤(3)、如果不进行任务迁移,则获取计算任务所需要的数据,然后本地执行计算任务,返回计算结果;如果决定转移该计算任务,那么计算任务决策模块估算任务执行资源消耗,根据上下文选择最佳近数据源,其中,最佳近数据源指的是可以用来执行计算任务,以此来达到资源消耗最小的邻近计算主体的数据源。Step (3), if the task migration is not performed, obtain the data required by the computing task, then execute the computing task locally, and return the calculation result; if it decides to transfer the computing task, then the computing task decision module estimates the task execution resource consumption, according to the context Select the best near data source, where the best near data source refers to the data source near the computing subject that can be used to perform computing tasks to achieve the minimum resource consumption.

步骤(4)、任务决策模块调用任务迁移模块把计算任务以OSGi组件的形式迁移目标最佳近数据源处,计算任务在目标近数据源进行计算。In step (4), the task decision module calls the task migration module to migrate the calculation task to the best near data source in the form of an OSGi component, and the calculation task is calculated at the target near data source.

步骤(5)、返回计算结果,进行相关处理。Step (5), return the calculation result, and perform related processing.

优选地,在整个过程中,异常处理模块会处理整个过程中所捕获的异常,包括任务检测异常、计算任务组件获取异常、计算任务组件传输异常、计算任务组件远程执行异常。Preferably, during the whole process, the exception handling module handles the exceptions caught in the whole process, including task detection exception, calculation task component acquisition exception, calculation task component transmission exception, and calculation task component remote execution exception.

本发明的基于OSGi的计算任务近数据源迁移方法,通过把计算任务迁移到近数据源进行计算,避免了源数据的传输,有效地提高了计算效率;而且,使之具有OSGi的高度模块化、灵活、可热插拔等优点;节省了原计算主体的计算资源消耗,如电量、带宽、内存等。The OSGi-based calculation task near data source migration method of the present invention avoids the transmission of source data by migrating the calculation task to the near data source for calculation, and effectively improves the calculation efficiency; moreover, it has the high degree of modularization of OSGi , flexible, hot-swappable and other advantages; it saves the consumption of computing resources of the original computing body, such as power, bandwidth, memory, etc.

以上所述仅为本发明的较佳实施例而已,并不用以限制本发明,凡在本发明的精神和原则之内,所作的任何修改、等同替换、改进等,均应包含在本发明的保护范围之内。The above descriptions are only preferred embodiments of the present invention, and are not intended to limit the present invention. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the present invention shall be included in the scope of the present invention. within the scope of protection.

Claims (2)

1.一种基于OSGi的计算任务近数据源迁移方法,其特征在于,基于计算任务决策模块、计算任务检测模块和计算任务迁移模块,包括以下步骤:1. An OSGi-based calculation task near data source migration method is characterized in that, based on a calculation task decision module, a calculation task detection module and a calculation task migration module, comprising the following steps: 步骤(1)、根据OSGi的上下文获取计算任务信息,计算任务检测模块实时检查是否有可迁移的计算任务;Step (1), obtain computing task information according to the context of OSGi, and the computing task detection module checks in real time whether there is a computing task that can be migrated; 步骤(2)、当检测到可迁移的任务时,由计算任务决策模块进行决策是否将其迁移;Step (2), when a task that can be migrated is detected, the calculation task decision module makes a decision whether to migrate it; 步骤(3)、如果不进行任务迁移,则获取计算任务所需要的数据,然后本地执行计算任务,返回计算结果;如果决定转移该计算任务,那么计算任务决策模块估算任务执行资源消耗,任务决策模块根据上下文选择最佳近数据源,其中,最佳近数据源指的是用来执行计算任务,以此来达到资源消耗最小的邻近计算主体的数据源;Step (3), if the task migration is not performed, obtain the data required by the computing task, then execute the computing task locally, and return the calculation result; if it is decided to transfer the computing task, then the computing task decision module estimates the resource consumption of the task execution, and the task decision The module selects the best near data source according to the context, where the best near data source refers to the data source that is used to perform computing tasks to achieve the minimum resource consumption of the adjacent computing subject; 步骤(4)、任务决策模块调用任务迁移模块把计算任务以OSGi组件的形式迁移目标最佳近数据源处,计算任务在目标近数据源进行计算;Step (4), the task decision module calls the task migration module to migrate the calculation task to the best near data source of the target in the form of OSGi components, and the calculation task is calculated at the target near data source; 步骤(5)、返回计算结果。Step (5), return the calculation result. 2.如权利要求1所述的基于OSGi的计算任务近数据源迁移方法,其特征在于,还包括异常处理模块,异常处理模块处理整个过程中所捕获的异常。2. The OSGi-based method for migrating computing tasks near data sources according to claim 1, further comprising an exception handling module, which handles the exceptions captured during the whole process.
CN201510083101.4A 2015-02-11 2015-02-11 A kind of nearly data source moving method of calculating task based on OSGi Expired - Fee Related CN104636198B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510083101.4A CN104636198B (en) 2015-02-11 2015-02-11 A kind of nearly data source moving method of calculating task based on OSGi

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510083101.4A CN104636198B (en) 2015-02-11 2015-02-11 A kind of nearly data source moving method of calculating task based on OSGi

Publications (2)

Publication Number Publication Date
CN104636198A CN104636198A (en) 2015-05-20
CN104636198B true CN104636198B (en) 2018-05-29

Family

ID=53214989

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510083101.4A Expired - Fee Related CN104636198B (en) 2015-02-11 2015-02-11 A kind of nearly data source moving method of calculating task based on OSGi

Country Status (1)

Country Link
CN (1) CN104636198B (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105530313A (en) * 2015-12-21 2016-04-27 中国石油大学(华东) A context-aware service migration method based on OSGi pervasive cloud environment
CN108388470B (en) * 2018-01-26 2022-09-16 福建星瑞格软件有限公司 Big data task processing method and computer equipment

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1624670A (en) * 2003-12-03 2005-06-08 华为技术有限公司 A Method of Local Data Migration
CN101907989A (en) * 2010-06-01 2010-12-08 南京大学 A method for seamless application migration based on mobile agent
CN103366238A (en) * 2012-03-30 2013-10-23 北京千橡网景科技发展有限公司 Method and device for automatic allocation of calculation task
CN103631657A (en) * 2013-11-19 2014-03-12 浪潮电子信息产业股份有限公司 Task scheduling algorithm based on MapReduce

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10318284B2 (en) * 2008-06-02 2019-06-11 International Business Machines Corporation System and method of generating and managing computing tasks

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1624670A (en) * 2003-12-03 2005-06-08 华为技术有限公司 A Method of Local Data Migration
CN101907989A (en) * 2010-06-01 2010-12-08 南京大学 A method for seamless application migration based on mobile agent
CN103366238A (en) * 2012-03-30 2013-10-23 北京千橡网景科技发展有限公司 Method and device for automatic allocation of calculation task
CN103631657A (en) * 2013-11-19 2014-03-12 浪潮电子信息产业股份有限公司 Task scheduling algorithm based on MapReduce

Also Published As

Publication number Publication date
CN104636198A (en) 2015-05-20

Similar Documents

Publication Publication Date Title
JP5758995B2 (en) System, method and computer-readable storage medium for sharing analysis results between virtual machines
CN104239122B (en) A kind of virtual machine migration method and device
US20100161559A1 (en) Maintaining a network connection of a workload during transfer
CN111880911A (en) Task load scheduling method, device and equipment and readable storage medium
CN106227587A (en) A kind of band snapshot virtual machine complete machine dynamic migration method and device
CN106210046A (en) A kind of volume based on Cinder is across cluster hanging method and system
CN114202027A (en) Execution configuration information generation method, model training method and device
CN107395731A (en) A kind of adjusting method and device of the container cluster based on service orchestration
CN103324532A (en) Dynamic migration method and system of virtual machine
CN111049900B (en) Internet of things flow calculation scheduling method and device and electronic equipment
CN103685539A (en) Method for running Windows system on home-made processor platform
CN105260238A (en) Multi-process performance improvement deployment method
CN102625144A (en) Parallel video processing method based on Cloud Network of local area network
CN105607606B (en) A kind of data acquisition device and method based on double mainboard frameworks
CN104636198B (en) A kind of nearly data source moving method of calculating task based on OSGi
CN117971906A (en) A multi-card collaborative database query method, device, equipment and storage medium
CN104866528A (en) Multi-platform data acquisition method and system
CN103986665A (en) The method of network load balancing in Yunhai OS
CN102118437B (en) A Xen-based virtual machine live migration progress monitoring method and device
CN109150574B (en) Large-scale network reproduction method
US20150286493A1 (en) Virtual-machine placement based on information from multiple data centers
CN105068899A (en) Automatic restart stability test method under Vmware system
CN104123135B (en) A kind of method and device of unified back office interface
CN105808340B (en) Load balancing method and system
CN105515933A (en) Management method for realizing network function of VMware based on OpenStack

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20180529

CF01 Termination of patent right due to non-payment of annual fee