[go: up one dir, main page]
More Web Proxy on the site http://driver.im/

WO2022094746A1 - Multi-robot multi-task collaborative working method, and server - Google Patents

Multi-robot multi-task collaborative working method, and server Download PDF

Info

Publication number
WO2022094746A1
WO2022094746A1 PCT/CN2020/126092 CN2020126092W WO2022094746A1 WO 2022094746 A1 WO2022094746 A1 WO 2022094746A1 CN 2020126092 W CN2020126092 W CN 2020126092W WO 2022094746 A1 WO2022094746 A1 WO 2022094746A1
Authority
WO
WIPO (PCT)
Prior art keywords
task
robot
available
information
robots
Prior art date
Application number
PCT/CN2020/126092
Other languages
French (fr)
Chinese (zh)
Inventor
吴新开
霍向
马亚龙
Original Assignee
北京洛必德科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 北京洛必德科技有限公司 filed Critical 北京洛必德科技有限公司
Priority to PCT/CN2020/126092 priority Critical patent/WO2022094746A1/en
Publication of WO2022094746A1 publication Critical patent/WO2022094746A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00Administration; Management
    • G06Q10/04Forecasting or optimisation specially adapted for administrative or management purposes, e.g. linear programming or "cutting stock problem"

Definitions

  • the invention relates to the technical field of multi-robot multi-task cooperative work, in particular to a multi-robot multi-task cooperative work method and a server.
  • patent application CN201910369515.1 provides a multi-task service robot and service system
  • patent application CN202010190435.2 provides a robot multi-task control method, control device and terminal equipment.
  • the present application provides a multi-robot multi-task cooperative working method and server.
  • a multi-robot multi-task cooperative working method comprises the following steps:
  • Step 1 At the beginning of the working day, the central decision-making system of the robot determines multiple task service decision-making time points within 24 hours of the working day. According to the historical information of task requirements, more task services are set during the peak time period of task demand generation. Decision time points, set less task service decision time points in the off-peak time period of task demand generation;
  • Step 2 All robots upload the status information and remaining power information of the robot at the current time to the robot central decision-making system in real time;
  • Step 3 All robots use multiple positioning methods in real time to determine the current position in indoor or outdoor scenes and upload the position information to the robot central decision-making system;
  • Step 4 The central decision-making system of the robot obtains the task demand information in real time, and stores the obtained task demand information in the set of tasks to be served;
  • Step 5 The robot central decision-making system determines the corresponding task requirement weight and the task requirement fixed cost information from the set task database according to the task requirement type;
  • Step 6 When the robot central decision-making system determines in real time whether the current time has reached the task service decision time point;
  • Step 7 When the robot central decision-making system determines that the current time has reached the task service decision time point, the robot central decision-making system obtains the number of idle robots at the current time, the number of idle robots, the location information of idle robots, the remaining power of idle robots, and the working capacity of each idle robot. , the robot information about the motion speed of each idle robot, and save the information of the idle robot into the available robot set;
  • Step 8 The robot central decision-making system uses the robot task matching optimization algorithm to realize the matching relationship between the available robots and the tasks to be served according to the set of tasks to be served and the set of available robots at the task service decision time point;
  • Step 9 The robot central decision-making system sends the information of the tasks to be served corresponding to each available robot to the available robots.
  • the decision-making system of the available robots uses the robot path planning intelligent algorithm to plan and obtain the global path for the available robots to perform tasks according to the tasks to be performed. ;
  • Step 10 The robot can change the state information from the idle state to the working state, and then execute the task according to the planned global path, and ensure the local path obstacle avoidance requirements in real time during the movement process;
  • Step 11 After the robot completes the task, the robot automatically checks whether the system is normal. If there is any fault, it will change from the working state to the maintenance state, and send the fault to the background. If there is no fault, it will return to the charging closest to the current location. stub and change the status information from working to idle.
  • the state information in the above step 2 includes an idle state, a working state and a maintenance state.
  • the positioning methods in the above-mentioned step 3 include but are not limited to: 1) use Beidou satellite navigation system, GPS navigation system, GLONASS navigation system or GALILEO navigation system to obtain position information; 2) use the environmental point cloud data detected by lidar The position information is obtained by analysis; 3) the position information is determined by visual analysis of the environmental image captured by the robot camera; 4) the position information is obtained by the trajectory measurement of the robot IMU and the odometer.
  • the task requirement information in the above step 4 includes task requirement generation time, task requirement type, and task requirement location information.
  • the robot task matching optimization algorithm in the above step 8 also includes:
  • ri is the task requirement weight of the i -th task, and this parameter is the reward obtained after completing the i-th task;
  • z j,i indicates whether the j-th available robot will serve the i-th task;
  • ⁇ i is the i-th task.
  • the loss cost of the i task is the penalty obtained after failing to complete the i-th task; M is the number of available robots used; c 1 is the fixed loss cost of the robot to perform the task; c 2 is the motion of the robot to perform the task cost; ⁇ j is the path that the robot needs to move to perform the task; d i is the path that the i-th task needs to move; E j,i is the electricity consumed by the j-th available robot to serve the i-th task; b o is power threshold; b j is the remaining power of the jth available robot; g i is the work capacity required by the i-th task, where the work capacity requirements include but are not limited to weight or volume; A j is the work of the jth available robot ability.
  • the robot path planning intelligent algorithm in the above step 9 also includes:
  • step 8 Determine the current position l j of the jth available robot
  • the system adds an intelligent virtual position point in the process of planning the robot path Smart virtual location point
  • the movement cost to the current position l j is a very small number, and the system can be initially set to a positive number approximately 0, and the current position l j to the intelligent virtual position point
  • the movement cost of is a very large number, which is initially set in the system and can be set as the maximum value of the movement cost between the tasks in the current position l j and U j , the intelligent virtual position point
  • the movement cost between any task in U j can be set to be the same as the movement cost between the current position l j and any task in U j ;
  • a task-related motion cost matrix D is established.
  • the elements d h and k in the matrix can be l i .
  • any element in U j which represents the direct motion cost of h and k, and establishes the following path planning model, that is, by generating the robot path selection matrix Y, the elements y h, k in the matrix Y indicate whether the jth available robot is determined. After passing position h or after the service completes task h, go to position k or go to service task k.
  • y h,k 1
  • y h,k 2
  • the generated robot path selection matrix Y realizes the optimal path planning model objective function, that is, the minimum objective function value, and then obtains the planned path of the robot,
  • the path planning model objective function is:
  • the path planning model constraints are:
  • y h,k indicates whether the jth available robot will go to position k or serve task k after passing through position h or after completing task h;
  • d h,k indicates the direct movement cost of h and k, h and k can be l i , or any element in U j ;
  • is the set Any subset of ,
  • is the number of elements in the set ⁇ , the set The number of elements is N lj .
  • the present invention also provides a multi-robot multi-task cooperative work server, the intelligent optimization system includes: a processor and a memory for storing instructions, and when the above-mentioned instructions are executed by the processor, the processor realizes the process as claimed in claims 1-6. Any one of the multi-robot multi-task cooperative work methods
  • the present invention has the advantages of simple method and high efficiency, and can quickly plan an optimal task execution scheme for multiple robots in a complex scene.
  • Fig. 1 is the schematic flow chart of the optimization method of the present invention
  • FIG. 1 is a schematic flowchart of the optimization method of the present invention.
  • the intelligent optimization method for multi-robot multi-task cooperative work provided by the present invention comprises the following steps:
  • Step 1 At the beginning of the working day, the central decision-making system of the robot determines multiple task service decision-making time points within 24 hours of the working day. According to the historical information of task requirements, more task services are set during the peak time period of task demand generation. Decision time points, set less task service decision time points in the off-peak time period of task demand generation;
  • Step 2 All robots upload the status information and remaining power information of the robot at the current time to the robot central decision-making system in real time, where the status information includes: idle state, working state and maintenance state;
  • Step 3 All robots use a variety of positioning methods to determine the current position in real time in indoor or outdoor scenes and upload the position information to the robot central decision-making system.
  • the positioning methods include but are not limited to: 1) Using Beidou satellite navigation system, GPS navigation system, GLONASS navigation system or GALILEO navigation system to obtain position information; 2) use the environmental point cloud data detected by lidar to obtain position information; 3) use the environmental image captured by the robot camera to determine the position information through visual analysis; 4) use the robot IMU and odometer use trajectory measurement to obtain location information;
  • Step 4 The central decision-making system of the robot acquires task demand information in real time, and stores the acquired task demand information into the task set to be served, wherein the task demand information includes: task demand generation time, task demand type, task demand location and other information;
  • Step 5 The robot central decision-making system determines the corresponding task demand weight, task demand fixed cost and other information from the set task database according to the task demand type;
  • Step 6 When the robot central decision-making system determines in real time whether the current time has reached the task service decision time point;
  • Step 7 When the robot central decision-making system determines that the current time has reached the task service decision time point, the robot central decision-making system obtains the number of idle robots at the current time, the number of idle robots, the location information of idle robots, the remaining power of idle robots, and the working capacity of each idle robot. , the robot information such as the motion speed of each idle robot, and save the information of the idle robot into the available robot set;
  • Step 8 The robot central decision-making system uses the robot task matching optimization algorithm to realize the matching relationship between the available robots and the tasks to be served according to the set of tasks to be served and the set of available robots at the task service decision time point;
  • the optimal matching model objective function is achieved, that is, the maximum objective function value, the matching relationship between the available robots and the tasks to be served is obtained. Which matches the model objective function:
  • ri is the task requirement weight of the i -th task, and this parameter is the reward obtained after completing the i-th task;
  • z j,i indicates whether the j-th available robot will serve the i-th task;
  • ⁇ i is the i-th task.
  • the loss cost of the i task is the penalty obtained after failing to complete the i-th task; M is the number of available robots used; c 1 is the fixed loss cost of the robot to perform the task; c 2 is the motion of the robot to perform the task cost; ⁇ j is the path that the robot needs to move to perform the task; d i is the path that the i-th task needs to move; E j,i is the electricity consumed by the j-th available robot to serve the i-th task; b o is power threshold; b j is the remaining power of the jth available robot; g i is the working capacity required by the i-th task, which includes but is not limited to weight or volume; A j is the jth available robot Ability to work;
  • Step 9 The robot central decision-making system sends the information of the tasks to be served corresponding to each available robot to the available robots.
  • the decision-making system of the available robots uses the robot path planning intelligent algorithm to plan and obtain the global path for the available robots to perform tasks according to the tasks to be performed. ;
  • Described robot path planning intelligent algorithm comprises: for the task to be performed determined in step 8 for the jth available robot Determine the current position l j of the jth available robot;
  • the system adds an intelligent virtual position point in the process of planning the robot path Smart virtual location point
  • the movement cost to the current position l j is a very small number, and the system can be initially set to a positive number approximately 0, and the current position l j to the intelligent virtual position point
  • the movement cost of is a very large number, which is initially set in the system and can be set as the maximum value of the movement cost between the tasks in the current position l j and U j , the intelligent virtual position point
  • the movement cost between any task in U j can be set to be the same as the movement cost between the current position l j and any task in U j ;
  • a task-related motion cost matrix D is established.
  • the elements d h and k in the matrix can be l i .
  • any element in U j which represents the direct motion cost of h and k, and establishes the following path planning model, that is, by generating the robot path selection matrix Y, the elements y h, k in the matrix Y indicate whether the jth available robot is determined. After passing position h or after the service completes task h, go to position k or go to service task k.
  • y h,k 1
  • y h,k 2
  • the generated robot path selection matrix Y realizes the optimal path planning model objective function, that is, the minimum objective function value, and then obtains the planned path of the robot,
  • the path planning model objective function is:
  • the path planning model constraints are:
  • y h,k indicates whether the jth available robot will go to position k or serve task k after passing through position h or after completing task h;
  • d h,k indicates the direct movement cost of h and k, h and k can be l i , or any element in U j ;
  • is the set Any subset of ,
  • is the number of elements in the set ⁇ , the set The number of elements is N lj ;
  • Step 10 The robot can change the state information from the idle state to the working state, and then execute the task according to the planned global path, and ensure the local path obstacle avoidance requirements in real time during the movement process;
  • Step 11 After the robot completes the task, the robot automatically checks whether the system is normal. If there is any fault, it will change from the working state to the maintenance state, and send the fault to the background. If there is no fault, it will return to the charging closest to the current location. stub and change the status information from working to idle.

Landscapes

  • Engineering & Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Human Resources & Organizations (AREA)
  • Economics (AREA)
  • Strategic Management (AREA)
  • Marketing (AREA)
  • Game Theory and Decision Science (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Development Economics (AREA)
  • Operations Research (AREA)
  • Quality & Reliability (AREA)
  • Tourism & Hospitality (AREA)
  • Physics & Mathematics (AREA)
  • General Business, Economics & Management (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Control Of Position, Course, Altitude, Or Attitude Of Moving Bodies (AREA)

Abstract

A multi-robot multi-task collaborative working method, and a server. The multi-robot multi-task collaborative working method comprises: a robot central decision-making system establishing, by using a robot task matching optimization algorithm, the optimal matching relationship between available robots and tasks to be served; and the robot decision-making system planning, by using an intelligent robot path planning algorithm, a global path for task execution, and the robots executing respective tasks. The advantages of the method are that the method is simple and highly efficient, and the optimal task execution scheme can be quickly and efficiently planned for a plurality of robots in a complex scenario.

Description

一种多机器人多任务协同工作方法与服务器A multi-robot multi-task cooperative working method and server 技术领域technical field
本发明涉及多机器人多任务协同工作技术领域,尤其涉及一种多机器人多任务协同工作方法与服务器。The invention relates to the technical field of multi-robot multi-task cooperative work, in particular to a multi-robot multi-task cooperative work method and a server.
背景技术Background technique
随着机器人智能化技术的进步,智能服务机器人在多个领域投入使用,如何有效的进行多机器人多任务的协同工作规划从而进一步提升机器人智能化水平是目前重要的研究方向。然而目前的传统方法中针对多机器人多任务协同工作的规划方法存在方法复杂或者规划的方案使得多机器人协同工作的效果差等问题。With the advancement of robot intelligence technology, intelligent service robots have been put into use in many fields. How to effectively carry out multi-robot and multi-task collaborative work planning to further improve the level of robot intelligence is an important research direction at present. However, the planning methods for multi-robots and multi-task cooperative work in the current traditional methods have problems such as complicated methods or the planning scheme makes the multi-robot cooperative work ineffective.
该方法在目前的研究具备一定的创新性,目前如专利申请CN201910369515.1提供一种多任务服务机器人及服务系统,专利申请CN202010190435.2提供机器人多任务控制方法、控制装置及终端设备。目前研究缺少针对多机器人多任务系统工作方案规划时系统的考虑对多机器人与多任务直接的服务匹配以及机器人服务多任务路径规划两个方面的方法规划,需要提供一种用于多机器人多任务协同工作的智能规划方法。The method has certain innovation in the current research. Currently, patent application CN201910369515.1 provides a multi-task service robot and service system, and patent application CN202010190435.2 provides a robot multi-task control method, control device and terminal equipment. At present, there is a lack of systematic consideration in the planning of the multi-robot multi-task system work plan, the direct service matching between multi-robots and multi-tasks, and the planning of two aspects of robot-service multi-task path planning. It is necessary to provide a method for multi-robot multi-tasking. An intelligent planning approach that works together.
因此为丰富相关领域的算法研究,以科学的方法解决市场中多机器人协同执行多任务时工作效率低、服务质量差的问题,设计了智能优化方法。Therefore, in order to enrich the algorithm research in related fields and solve the problems of low work efficiency and poor service quality when multi-robots cooperate to perform multi-tasks in the market in a scientific way, an intelligent optimization method is designed.
发明内容SUMMARY OF THE INVENTION
有鉴于此,本申请提供一种多机器人多任务协同工作方法与服务器。In view of this, the present application provides a multi-robot multi-task cooperative working method and server.
本申请是通过如下技术方案实现的:This application is achieved through the following technical solutions:
一种多机器人多任务协同工作方法,该方法包括如下步骤:A multi-robot multi-task cooperative working method, the method comprises the following steps:
步骤1:机器人中央决策系统在工作日初始时刻,将工作日的24个小时内确定出多个任务服务决策时间点,根据任务需求历史信息,在任务需求产生量高峰时间段多设置一些任务服务决策时间点,在任务需求产生量非高峰时间段少设置一些任务服务决策时间点;Step 1: At the beginning of the working day, the central decision-making system of the robot determines multiple task service decision-making time points within 24 hours of the working day. According to the historical information of task requirements, more task services are set during the peak time period of task demand generation. Decision time points, set less task service decision time points in the off-peak time period of task demand generation;
步骤2:所有机器人均实时将当前时间机器人的状态信息和剩余电量信息实时上传至机器人中央决策系统;Step 2: All robots upload the status information and remaining power information of the robot at the current time to the robot central decision-making system in real time;
步骤3:所有机器人在室内或室外场景均实时利用多种定位方式确定当前位置并将位置信息上传至机器人中央决策系统;Step 3: All robots use multiple positioning methods in real time to determine the current position in indoor or outdoor scenes and upload the position information to the robot central decision-making system;
步骤4:机器人中央决策系统实时获取任务需求信息,将获取任务需求信息存入待服务任务集合;Step 4: The central decision-making system of the robot obtains the task demand information in real time, and stores the obtained task demand information in the set of tasks to be served;
步骤5:机器人中央决策系统根据任务需求类型从设定的任务数据库中确定对应的任务需求权重,以及任务需求固定成本信息;Step 5: The robot central decision-making system determines the corresponding task requirement weight and the task requirement fixed cost information from the set task database according to the task requirement type;
步骤6:当机器人中央决策系统实时判断当前时间是否到任务服务决策时间点;Step 6: When the robot central decision-making system determines in real time whether the current time has reached the task service decision time point;
步骤7:当机器人中央决策系统判断当前时间已到任务服务决策时间点,机器人中央决策系统获取当前时间空闲机器人数量、空闲机器人编号、空闲机器人位置信息,空闲机器人剩余电量,每个空闲机器人工作能力,每个空闲机器人运动速度机器人信息,将空闲机器人的各项信息存入可用机器人集合;Step 7: When the robot central decision-making system determines that the current time has reached the task service decision time point, the robot central decision-making system obtains the number of idle robots at the current time, the number of idle robots, the location information of idle robots, the remaining power of idle robots, and the working capacity of each idle robot. , the robot information about the motion speed of each idle robot, and save the information of the idle robot into the available robot set;
步骤8:机器人中央决策系统在任务服务决策时间点根据待服务任务集合和可用机器人集合,利用机器人任务匹配优化算法实现可用机器人与待服务任务的匹配关系;Step 8: The robot central decision-making system uses the robot task matching optimization algorithm to realize the matching relationship between the available robots and the tasks to be served according to the set of tasks to be served and the set of available robots at the task service decision time point;
步骤9:机器人中央决策系统将每个可用机器人对应匹配到的待服务任务信息发送给可用机器人,可用机器人的决策系统根据要执行的任务利用机器人路径规划智能算法规划得到可用机器人执行任务的全局路径;Step 9: The robot central decision-making system sends the information of the tasks to be served corresponding to each available robot to the available robots. The decision-making system of the available robots uses the robot path planning intelligent algorithm to plan and obtain the global path for the available robots to perform tasks according to the tasks to be performed. ;
步骤10:可用机器人将状态信息由闲置状态更改为工作状态,然后按照 规划的全局路径去执行任务,在运动过程中实时保证局部路径避障要求;Step 10: The robot can change the state information from the idle state to the working state, and then execute the task according to the planned global path, and ensure the local path obstacle avoidance requirements in real time during the movement process;
步骤11:机器人在执行完任务后,机器人自主检查系统是否正常,如有故障问题将由工作状态更改为维护状态,并将故障问题发送给后台,如没有故障问题将返回到距离当前位置最近的充电桩,并将状态信息由工作状态更改为闲置状态。Step 11: After the robot completes the task, the robot automatically checks whether the system is normal. If there is any fault, it will change from the working state to the maintenance state, and send the fault to the background. If there is no fault, it will return to the charging closest to the current location. stub and change the status information from working to idle.
进一步的,上述步骤2中的状态信息包括闲置状态,工作状态和维护状态。Further, the state information in the above step 2 includes an idle state, a working state and a maintenance state.
进一步的,上述步骤3中的定位方式包括且不局限于:1)利用北斗卫星导航系统、GPS导航系统、GLONASS导航系统或者GALILEO导航系统获得位置信息;2)利用激光雷达探测的环境点云数据分析得到位置信息;3)利用机器人摄像头拍摄的环境图像经视觉分析确定的位置信息;4)利用机器人IMU和里程计的轨迹测算获得位置信息。Further, the positioning methods in the above-mentioned step 3 include but are not limited to: 1) use Beidou satellite navigation system, GPS navigation system, GLONASS navigation system or GALILEO navigation system to obtain position information; 2) use the environmental point cloud data detected by lidar The position information is obtained by analysis; 3) the position information is determined by visual analysis of the environmental image captured by the robot camera; 4) the position information is obtained by the trajectory measurement of the robot IMU and the odometer.
进一步的,上述步骤4中的任务需求信息包括任务需求产生时间,任务需求类型,以及任务需求位置信息。Further, the task requirement information in the above step 4 includes task requirement generation time, task requirement type, and task requirement location information.
进一步的,上述步骤8中的机器人任务匹配优化算法还包括:Further, the robot task matching optimization algorithm in the above step 8 also includes:
所述待服务任务集合U={1,…,i,…,N U},待服务任务集合中待服务任务数量为N U,所述可用机器人集合R={1,…,j,…,N R},建立下述匹配模型,即通过生成机器人任务匹配矩阵Z,矩阵Z中元素z j,i表示决定第j辆可用机器人是否去服务第i项任务,z j,i=1,决定第j辆可用机器人去服务第i项任务,z j,i=0,决定第j辆可用机器人不去服务第i项任务,生成的机器人任务匹配矩阵Z实现了最优的匹配模型目标函数即最大的目标函数值,则获得了可用机器人与待服务任务的匹配关系, The set of tasks to be served U={1,...,i,...,N U }, the number of tasks to be served in the set of tasks to be served is N U , the set of available robots R={1,...,j,..., N R }, establish the following matching model, that is, by generating a robot task matching matrix Z, the elements z j,i in the matrix Z indicate whether the jth available robot will serve the i-th task, z j,i =1, determine The jth available robot serves the i-th task, z j, i = 0, it is decided that the j-th available robot does not serve the i-th task, and the generated robot task matching matrix Z realizes the optimal matching model objective function that is The maximum objective function value is obtained, the matching relationship between the available robots and the tasks to be served is obtained,
其中匹配模型目标函数:Which matches the model objective function:
Figure PCTCN2020126092-appb-000001
Figure PCTCN2020126092-appb-000001
其中匹配模型约束条件:which matches the model constraints:
Figure PCTCN2020126092-appb-000002
Figure PCTCN2020126092-appb-000002
Figure PCTCN2020126092-appb-000003
Figure PCTCN2020126092-appb-000003
Figure PCTCN2020126092-appb-000004
Figure PCTCN2020126092-appb-000004
z j,i·(E j,i+b o)≤b j z j,i ·(E j,i +b o )≤b j
Figure PCTCN2020126092-appb-000005
Figure PCTCN2020126092-appb-000005
z j,i∈{0,1} z j,i ∈{0,1}
其中,r i为第i项任务的任务需求权重,该参数是完成第i项任务后获得的奖励;z j,i表示决定第j辆可用机器人是否去服务第i项任务;λ i为第i项任务的损失成本,该参数是未能完成第i项任务后获得的惩罚;M为使用了可用机器人的数量;c 1为机器人执行任务的固定损耗成本;c 2为机器人执行任务的运动成本;ω j为机器人执行任务需要运动的路径;d i为第i项任务需要运动的路径;E j,i为第j辆可用机器人去服务第i项任务所需要消耗的电量;b o为电量阀值;b j为第j辆可用机器人的剩余电量;g i为第i项任务要求的工作能力,其中工作能力要求包括又不局限于重量或体积;A j为第j辆可用机器人工作能力。 Among them, ri is the task requirement weight of the i -th task, and this parameter is the reward obtained after completing the i-th task; z j,i indicates whether the j-th available robot will serve the i-th task; λ i is the i-th task. The loss cost of the i task, this parameter is the penalty obtained after failing to complete the i-th task; M is the number of available robots used; c 1 is the fixed loss cost of the robot to perform the task; c 2 is the motion of the robot to perform the task cost; ω j is the path that the robot needs to move to perform the task; d i is the path that the i-th task needs to move; E j,i is the electricity consumed by the j-th available robot to serve the i-th task; b o is power threshold; b j is the remaining power of the jth available robot; g i is the work capacity required by the i-th task, where the work capacity requirements include but are not limited to weight or volume; A j is the work of the jth available robot ability.
进一步的,上述步骤9中的机器人路径规划智能算法还包括:Further, the robot path planning intelligent algorithm in the above step 9 also includes:
对于第j辆可用机器人在步骤8所确定的要执行的任务
Figure PCTCN2020126092-appb-000006
确定第j辆可用机器人的当前位置l j
For the task to be performed by the jth available robot as determined in step 8
Figure PCTCN2020126092-appb-000006
Determine the current position l j of the jth available robot;
系统在规划机器人路径过程中增加一个智能虚拟位置点
Figure PCTCN2020126092-appb-000007
智能虚拟位置点
Figure PCTCN2020126092-appb-000008
到当前位置l j的运动成本为一个极小数,系统中可以初始设定近似为0的正数,当前位置l j到智能虚拟位置点
Figure PCTCN2020126092-appb-000009
的运动成本为一个极大数,系统中被初始设定,可以设定为当前位置l j与U j中各任务之间的运动成本的最大值,智能虚拟位置点
Figure PCTCN2020126092-appb-000010
与U j中任一任务之间的运动成本可以设置为和当前位置l j 与U j中任一任务之间的运动成本相同;
The system adds an intelligent virtual position point in the process of planning the robot path
Figure PCTCN2020126092-appb-000007
Smart virtual location point
Figure PCTCN2020126092-appb-000008
The movement cost to the current position l j is a very small number, and the system can be initially set to a positive number approximately 0, and the current position l j to the intelligent virtual position point
Figure PCTCN2020126092-appb-000009
The movement cost of is a very large number, which is initially set in the system and can be set as the maximum value of the movement cost between the tasks in the current position l j and U j , the intelligent virtual position point
Figure PCTCN2020126092-appb-000010
The movement cost between any task in U j can be set to be the same as the movement cost between the current position l j and any task in U j ;
建立任务关联运动成本矩阵D,矩阵中元素d h,k中h与k可以为l i
Figure PCTCN2020126092-appb-000011
或U j中任意一个元素,表示h与k直接的运动成本,并建立下述路径规划模型,即通过生成机器人路径选择矩阵Y,矩阵Y中元素y h,k表示决定第j辆可用机器人是否经过位置h后或者服务完成任务h后去往位置k或者去服务任务k。y h,k=1,决定第j辆可用机器人经过位置h后或者服务完成任务h后去往位置k或者去服务任务k,y h,k=0,决定第j辆可用机器人经过位置h后或者服务完成任务h后不会去往位置k或者去服务任务k。生成的机器人路径选择矩阵Y实现了最优的路径规划模型目标函数即最小的目标函数值,则获得了机器人的规划路径,
A task-related motion cost matrix D is established. The elements d h and k in the matrix can be l i .
Figure PCTCN2020126092-appb-000011
Or any element in U j , which represents the direct motion cost of h and k, and establishes the following path planning model, that is, by generating the robot path selection matrix Y, the elements y h, k in the matrix Y indicate whether the jth available robot is determined. After passing position h or after the service completes task h, go to position k or go to service task k. y h,k = 1, it is determined that the jth available robot will go to position k or go to service task k after the jth available robot passes through the position h or after the service completes the task h, y h,k = 0, it is determined that the jth available robot passes through the position h. Or the service will not go to location k or go to service task k after completing task h. The generated robot path selection matrix Y realizes the optimal path planning model objective function, that is, the minimum objective function value, and then obtains the planned path of the robot,
其中路径规划模型目标函数:The path planning model objective function is:
Figure PCTCN2020126092-appb-000012
Figure PCTCN2020126092-appb-000012
其中路径规划模型约束条件:The path planning model constraints are:
Figure PCTCN2020126092-appb-000013
Figure PCTCN2020126092-appb-000013
Figure PCTCN2020126092-appb-000014
Figure PCTCN2020126092-appb-000014
Figure PCTCN2020126092-appb-000015
Figure PCTCN2020126092-appb-000015
y h,k∈{0,1} y h, k∈{0,1}
其中,y h,k表示决定第j辆可用机器人是否经过位置h后或者服务完成任务h后去往位置k或者去服务任务k;d h,k表示h与k直接的运动成本,h与k可以为l i
Figure PCTCN2020126092-appb-000016
或U j中任意一个元素;Φ为集合
Figure PCTCN2020126092-appb-000017
的任意一个子集合,|Φ|为集合Φ内的元素个数,集合
Figure PCTCN2020126092-appb-000018
的元素个数为N lj
Among them, y h,k indicates whether the jth available robot will go to position k or serve task k after passing through position h or after completing task h; d h,k indicates the direct movement cost of h and k, h and k can be l i ,
Figure PCTCN2020126092-appb-000016
or any element in U j ; Φ is the set
Figure PCTCN2020126092-appb-000017
Any subset of , |Φ| is the number of elements in the set Φ, the set
Figure PCTCN2020126092-appb-000018
The number of elements is N lj .
进一步的,本发明还提供一种多机器人多任务协同工作服务器,该智能优化系统包括:处理器和存储指令的存储器,且上述指令在由处理器执行时使处理器实现如权利要求1-6任意一项所述的多机器人多任务协同工作方法Further, the present invention also provides a multi-robot multi-task cooperative work server, the intelligent optimization system includes: a processor and a memory for storing instructions, and when the above-mentioned instructions are executed by the processor, the processor realizes the process as claimed in claims 1-6. Any one of the multi-robot multi-task cooperative work methods
与现有技术相比,本发明的优点在于:方法简单、效率高,在复杂的场景中可以高效地为多机器人快速规划出最优的任务执行方案。Compared with the prior art, the present invention has the advantages of simple method and high efficiency, and can quickly plan an optimal task execution scheme for multiple robots in a complex scene.
附图说明Description of drawings
图1为本发明的优化方法的流程示意图;Fig. 1 is the schematic flow chart of the optimization method of the present invention;
具体实施方式Detailed ways
这里将详细地对示例性实施例进行说明,其示例表示在附图中。下面的描述涉及附图时,除非另有表示,不同附图中的相同数字表示相同或相似的要素。以下示例性实施例中所描述的实施方式并不代表与本申请相一致的所有实施方式。相反,它们仅是与如所附权利要求书中所详述的、本申请的一些方面相一致的装置和方法的例子。Exemplary embodiments will be described in detail herein, examples of which are illustrated in the accompanying drawings. Where the following description refers to the drawings, the same numerals in different drawings refer to the same or similar elements unless otherwise indicated. The implementations described in the illustrative examples below are not intended to represent all implementations consistent with this application. Rather, they are merely examples of apparatus and methods consistent with some aspects of the present application as recited in the appended claims.
在本申请使用的术语是仅仅出于描述特定实施例的目的,而非旨在限制本申请。在本申请和所附权利要求书中所使用的单数形式的“一种”、“所述”和“该”也旨在包括多数形式,除非上下文清楚地表示其他含义。还应当理解,本文中使用的术语“和/或”是指并包含一个或多个相关联的列出项目的任何或所有可能组合。The terminology used in this application is for the purpose of describing particular embodiments only and is not intended to limit the application. As used in this application and the appended claims, the singular forms "a," "the," and "the" are intended to include the plural forms as well, unless the context clearly dictates otherwise. It will also be understood that the term "and/or" as used herein refers to and includes any and all possible combinations of one or more of the associated listed items.
下面将结合附图和实例对本发明作进一步的详细说明。The present invention will be further described in detail below in conjunction with the accompanying drawings and examples.
图1为本发明的优化方法的流程示意图。本发明提供的用于多机器人多任务协作工作的智能优化方法包括如下步骤:FIG. 1 is a schematic flowchart of the optimization method of the present invention. The intelligent optimization method for multi-robot multi-task cooperative work provided by the present invention comprises the following steps:
步骤1:机器人中央决策系统在工作日初始时刻,将工作日的24个小时内确定出多个任务服务决策时间点,根据任务需求历史信息,在任务需求产生量高峰时间段多设置一些任务服务决策时间点,在任务需求产生量非高峰时间段少设置一些任务服务决策时间点;Step 1: At the beginning of the working day, the central decision-making system of the robot determines multiple task service decision-making time points within 24 hours of the working day. According to the historical information of task requirements, more task services are set during the peak time period of task demand generation. Decision time points, set less task service decision time points in the off-peak time period of task demand generation;
步骤2:所有机器人均实时将当前时间机器人的状态信息和剩余电量信息实时上传至机器人中央决策系统,其中状态信息包括:闲置状态,工作状态和维护状态;Step 2: All robots upload the status information and remaining power information of the robot at the current time to the robot central decision-making system in real time, where the status information includes: idle state, working state and maintenance state;
步骤3:所有机器人在室内或室外场景均实时利用多种定位方式确定当 前位置并将位置信息上传至机器人中央决策系统,其中定位方式包括且不局限于:1)利用北斗卫星导航系统、GPS导航系统、GLONASS导航系统或者GALILEO导航系统获得位置信息;2)利用激光雷达探测的环境点云数据分析得到位置信息;3)利用机器人摄像头拍摄的环境图像经视觉分析确定的位置信息;4)利用机器人IMU和里程计等利用轨迹测算获得位置信息;Step 3: All robots use a variety of positioning methods to determine the current position in real time in indoor or outdoor scenes and upload the position information to the robot central decision-making system. The positioning methods include but are not limited to: 1) Using Beidou satellite navigation system, GPS navigation system, GLONASS navigation system or GALILEO navigation system to obtain position information; 2) use the environmental point cloud data detected by lidar to obtain position information; 3) use the environmental image captured by the robot camera to determine the position information through visual analysis; 4) use the robot IMU and odometer use trajectory measurement to obtain location information;
步骤4:机器人中央决策系统实时获取任务需求信息,将获取任务需求信息存入待服务任务集合,其中任务需求信息包括:任务需求产生时间,任务需求类型,任务需求位置等信息;Step 4: The central decision-making system of the robot acquires task demand information in real time, and stores the acquired task demand information into the task set to be served, wherein the task demand information includes: task demand generation time, task demand type, task demand location and other information;
步骤5:机器人中央决策系统根据任务需求类型从设定的任务数据库中确定对应的任务需求权重,任务需求固定成本等信息;Step 5: The robot central decision-making system determines the corresponding task demand weight, task demand fixed cost and other information from the set task database according to the task demand type;
步骤6:当机器人中央决策系统实时判断当前时间是否到任务服务决策时间点;Step 6: When the robot central decision-making system determines in real time whether the current time has reached the task service decision time point;
步骤7:当机器人中央决策系统判断当前时间已到任务服务决策时间点,机器人中央决策系统获取当前时间空闲机器人数量、空闲机器人编号、空闲机器人位置信息,空闲机器人剩余电量,每个空闲机器人工作能力,每个空闲机器人运动速度等机器人信息,将空闲机器人的各项信息存入可用机器人集合;Step 7: When the robot central decision-making system determines that the current time has reached the task service decision time point, the robot central decision-making system obtains the number of idle robots at the current time, the number of idle robots, the location information of idle robots, the remaining power of idle robots, and the working capacity of each idle robot. , the robot information such as the motion speed of each idle robot, and save the information of the idle robot into the available robot set;
步骤8:机器人中央决策系统在任务服务决策时间点根据待服务任务集合和可用机器人集合,利用机器人任务匹配优化算法实现可用机器人与待服务任务的匹配关系;Step 8: The robot central decision-making system uses the robot task matching optimization algorithm to realize the matching relationship between the available robots and the tasks to be served according to the set of tasks to be served and the set of available robots at the task service decision time point;
所述的机器人任务匹配优化算法包括:所述待服务任务集合U={1,…,i,…,N U},待服务任务集合中待服务任务数量为N U,所述可用机器人集合R={1,…,j,…,N R},建立下述匹配模型,即通过生成机器人任务匹配矩阵Z,矩阵Z中元素z j,i表示决定第j辆可用机器人是否去服务第i项任务,z j,i=1,决定第j辆可用机器人去服务第i项任务,z j,i=0,决定第j辆可用机器人不去服务第i项任务,生成的机器人任务匹配矩阵Z实现了最优的匹配模型目标函数即最大的目标函数值,则获得了可用机器人与待服务任务的匹配关系。 其中匹配模型目标函数: The robot task matching optimization algorithm includes: the set of tasks to be served U={1,...,i,...,N U }, the number of tasks to be served in the set of tasks to be served is N U , the set of available robots R ={1,...,j,...,N R }, establish the following matching model, that is, by generating a robot task matching matrix Z, the elements z j,i in the matrix Z indicate whether the j-th available robot will serve the i-th item Task, z j,i = 1, decides the jth available robot to serve the i-th task, z j,i = 0, decides that the j-th available robot does not serve the i-th task, the generated robot task matching matrix Z When the optimal matching model objective function is achieved, that is, the maximum objective function value, the matching relationship between the available robots and the tasks to be served is obtained. Which matches the model objective function:
Figure PCTCN2020126092-appb-000019
Figure PCTCN2020126092-appb-000019
其中匹配模型约束条件:which matches the model constraints:
Figure PCTCN2020126092-appb-000020
Figure PCTCN2020126092-appb-000020
Figure PCTCN2020126092-appb-000021
Figure PCTCN2020126092-appb-000021
Figure PCTCN2020126092-appb-000022
Figure PCTCN2020126092-appb-000022
z j,i·(E j,i+b o)≤b j z j,i ·(E j,i +b o )≤b j
Figure PCTCN2020126092-appb-000023
Figure PCTCN2020126092-appb-000023
z j,i∈{0,1} z j,i ∈{0,1}
其中,r i为第i项任务的任务需求权重,该参数是完成第i项任务后获得的奖励;z j,i表示决定第j辆可用机器人是否去服务第i项任务;λ i为第i项任务的损失成本,该参数是未能完成第i项任务后获得的惩罚;M为使用了可用机器人的数量;c 1为机器人执行任务的固定损耗成本;c 2为机器人执行任务的运动成本;ω j为机器人执行任务需要运动的路径;d i为第i项任务需要运动的路径;E j,i为第j辆可用机器人去服务第i项任务所需要消耗的电量;b o为电量阀值;b j为第j辆可用机器人的剩余电量;g i为第i项任务要求的工作能力,其中工作能力要求包括又不局限于重量或体积等;A j为第j辆可用机器人工作能力; Among them, ri is the task requirement weight of the i -th task, and this parameter is the reward obtained after completing the i-th task; z j,i indicates whether the j-th available robot will serve the i-th task; λ i is the i-th task. The loss cost of the i task, this parameter is the penalty obtained after failing to complete the i-th task; M is the number of available robots used; c 1 is the fixed loss cost of the robot to perform the task; c 2 is the motion of the robot to perform the task cost; ω j is the path that the robot needs to move to perform the task; d i is the path that the i-th task needs to move; E j,i is the electricity consumed by the j-th available robot to serve the i-th task; b o is power threshold; b j is the remaining power of the jth available robot; g i is the working capacity required by the i-th task, which includes but is not limited to weight or volume; A j is the jth available robot Ability to work;
步骤9:机器人中央决策系统将每个可用机器人对应匹配到的待服务任务信息发送给可用机器人,可用机器人的决策系统根据要执行的任务利用机器人路径规划智能算法规划得到可用机器人执行任务的全局路径;Step 9: The robot central decision-making system sends the information of the tasks to be served corresponding to each available robot to the available robots. The decision-making system of the available robots uses the robot path planning intelligent algorithm to plan and obtain the global path for the available robots to perform tasks according to the tasks to be performed. ;
所述的机器人路径规划智能算法包括:对于第j辆可用机器人在步骤8所确定的要执行的任务
Figure PCTCN2020126092-appb-000024
确定第j辆可用机器人的当前位置l j
Described robot path planning intelligent algorithm comprises: for the task to be performed determined in step 8 for the jth available robot
Figure PCTCN2020126092-appb-000024
Determine the current position l j of the jth available robot;
系统在规划机器人路径过程中增加一个智能虚拟位置点
Figure PCTCN2020126092-appb-000025
智能虚拟位置点
Figure PCTCN2020126092-appb-000026
到当前位置l j的运动成本为一个极小数,系统中可以初始设定近似为0的正数,当前位置l j到智能虚拟位置点
Figure PCTCN2020126092-appb-000027
的运动成本为一个极大数,系统中被初始设定,可以设定为当前位置l j与U j中各任务之间的运动成本的最大值,智能虚拟位置点
Figure PCTCN2020126092-appb-000028
与U j中任一任务之间的运动成本可以设置为和当前位置l j与U j中任一任务之间的运动成本相同;
The system adds an intelligent virtual position point in the process of planning the robot path
Figure PCTCN2020126092-appb-000025
Smart virtual location point
Figure PCTCN2020126092-appb-000026
The movement cost to the current position l j is a very small number, and the system can be initially set to a positive number approximately 0, and the current position l j to the intelligent virtual position point
Figure PCTCN2020126092-appb-000027
The movement cost of is a very large number, which is initially set in the system and can be set as the maximum value of the movement cost between the tasks in the current position l j and U j , the intelligent virtual position point
Figure PCTCN2020126092-appb-000028
The movement cost between any task in U j can be set to be the same as the movement cost between the current position l j and any task in U j ;
建立任务关联运动成本矩阵D,矩阵中元素d h,k中h与k可以为l i
Figure PCTCN2020126092-appb-000029
或U j中任意一个元素,表示h与k直接的运动成本,并建立下述路径规划模型,即通过生成机器人路径选择矩阵Y,矩阵Y中元素y h,k表示决定第j辆可用机器人是否经过位置h后或者服务完成任务h后去往位置k或者去服务任务k。y h,k=1,决定第j辆可用机器人经过位置h后或者服务完成任务h后去往位置k或者去服务任务k,y h,k=0,决定第j辆可用机器人经过位置h后或者服务完成任务h后不会去往位置k或者去服务任务k。生成的机器人路径选择矩阵Y实现了最优的路径规划模型目标函数即最小的目标函数值,则获得了机器人的规划路径,
A task-related motion cost matrix D is established. The elements d h and k in the matrix can be l i .
Figure PCTCN2020126092-appb-000029
Or any element in U j , which represents the direct motion cost of h and k, and establishes the following path planning model, that is, by generating the robot path selection matrix Y, the elements y h, k in the matrix Y indicate whether the jth available robot is determined. After passing position h or after the service completes task h, go to position k or go to service task k. y h,k = 1, it is determined that the jth available robot will go to position k or go to service task k after the jth available robot passes through the position h or after the service completes the task h, y h,k = 0, it is determined that the jth available robot passes through the position h. Or the service will not go to location k or go to service task k after completing task h. The generated robot path selection matrix Y realizes the optimal path planning model objective function, that is, the minimum objective function value, and then obtains the planned path of the robot,
其中路径规划模型目标函数:The path planning model objective function is:
Figure PCTCN2020126092-appb-000030
Figure PCTCN2020126092-appb-000030
其中路径规划模型约束条件:The path planning model constraints are:
Figure PCTCN2020126092-appb-000031
Figure PCTCN2020126092-appb-000031
Figure PCTCN2020126092-appb-000032
Figure PCTCN2020126092-appb-000032
Figure PCTCN2020126092-appb-000033
Figure PCTCN2020126092-appb-000033
y h,k∈{0,1} y h, k∈{0,1}
其中,y h,k表示决定第j辆可用机器人是否经过位置h后或者服务完成任务h后去往位置k或者去服务任务k;d h,k表示h与k直接的运动成本,h与k可以为 l i
Figure PCTCN2020126092-appb-000034
或U j中任意一个元素;Φ为集合
Figure PCTCN2020126092-appb-000035
的任意一个子集合,|Φ|为集合Φ内的元素个数,集合
Figure PCTCN2020126092-appb-000036
的元素个数为N lj
Among them, y h,k indicates whether the jth available robot will go to position k or serve task k after passing through position h or after completing task h; d h,k indicates the direct movement cost of h and k, h and k can be l i ,
Figure PCTCN2020126092-appb-000034
or any element in U j ; Φ is the set
Figure PCTCN2020126092-appb-000035
Any subset of , |Φ| is the number of elements in the set Φ, the set
Figure PCTCN2020126092-appb-000036
The number of elements is N lj ;
步骤10:可用机器人将状态信息由闲置状态更改为工作状态,然后按照规划的全局路径去执行任务,在运动过程中实时保证局部路径避障要求;Step 10: The robot can change the state information from the idle state to the working state, and then execute the task according to the planned global path, and ensure the local path obstacle avoidance requirements in real time during the movement process;
步骤11:机器人在执行完任务后,机器人自主检查系统是否正常,如有故障问题将由工作状态更改为维护状态,并将故障问题发送给后台,如没有故障问题将返回到距离当前位置最近的充电桩,并将状态信息由工作状态更改为闲置状态。Step 11: After the robot completes the task, the robot automatically checks whether the system is normal. If there is any fault, it will change from the working state to the maintenance state, and send the fault to the background. If there is no fault, it will return to the charging closest to the current location. stub and change the status information from working to idle.
本领域普通技术人员可以理解上述方法中的全部或部分步骤可通过程序来指令相关硬件完成,所述程序可以存储于计算机可读存储介质中,如只读存储器、磁盘或光盘等。可选地,上述实施例的全部或部分步骤也可以使用一个或多个集成电路来实现,相应地,上述实施例中的各模块/单元可以采用硬件的形式实现,也可以采用软件功能模块的形式实现。本发明不限制于任何特定形式的硬件和软件的结合。Those skilled in the art can understand that all or part of the steps in the above method can be completed by instructing relevant hardware through a program, and the program can be stored in a computer-readable storage medium, such as a read-only memory, a magnetic disk or an optical disk. Optionally, all or part of the steps in the above embodiments may also be implemented by using one or more integrated circuits. Correspondingly, each module/unit in the above embodiments may be implemented in the form of hardware, or may be implemented in the form of software function modules. form realization. The present invention is not limited to any particular form of combination of hardware and software.
需要说明的是,本发明还可有其他多种实施例,在不背离本发明精神及其实质的情况下,熟悉本领域的技术人员可根据本发明作出各种相应的改变和变形,但这些相应的改变和变形都应属于本发明所附的权利要求的保护范围。It should be noted that the present invention can also have other various embodiments. Without departing from the spirit and essence of the present invention, those skilled in the art can make various corresponding changes and deformations according to the present invention, but these Corresponding changes and deformations should belong to the protection scope of the appended claims of the present invention.

Claims (7)

  1. 一种多机器人多任务协同工作方法,该方法包括如下步骤:A multi-robot multi-task cooperative working method, the method comprises the following steps:
    步骤1:机器人中央决策系统在工作日初始时刻,将工作日的24个小时内确定出多个任务服务决策时间点,根据任务需求历史信息,在任务需求产生量高峰时间段多设置一些任务服务决策时间点,在任务需求产生量非高峰时间段少设置一些任务服务决策时间点;Step 1: At the beginning of the working day, the central decision-making system of the robot determines multiple task service decision-making time points within 24 hours of the working day. According to the historical information of task requirements, more task services are set during the peak time period of task demand generation. Decision time points, set less task service decision time points in the off-peak time period of task demand generation;
    步骤2:所有机器人均实时将当前时间机器人的状态信息和剩余电量信息实时上传至机器人中央决策系统;Step 2: All robots upload the status information and remaining power information of the robot at the current time to the robot central decision-making system in real time;
    步骤3:所有机器人在室内或室外场景均实时利用多种定位方式确定当前位置并将位置信息上传至机器人中央决策系统;Step 3: All robots use multiple positioning methods in real time to determine the current position in indoor or outdoor scenes and upload the position information to the robot central decision-making system;
    步骤4:机器人中央决策系统实时获取任务需求信息,将获取任务需求信息存入待服务任务集合;Step 4: The central decision-making system of the robot obtains the task demand information in real time, and stores the obtained task demand information in the set of tasks to be served;
    步骤5:机器人中央决策系统根据任务需求类型从设定的任务数据库中确定对应的任务需求权重,以及任务需求固定成本信息;Step 5: The robot central decision-making system determines the corresponding task requirement weight and the task requirement fixed cost information from the set task database according to the task requirement type;
    步骤6:当机器人中央决策系统实时判断当前时间是否到任务服务决策时间点;Step 6: When the robot central decision-making system determines in real time whether the current time has reached the task service decision time point;
    步骤7:当机器人中央决策系统判断当前时间已到任务服务决策时间点,机器人中央决策系统获取当前时间空闲机器人数量、空闲机器人编号、空闲机器人位置信息,空闲机器人剩余电量,每个空闲机器人工作能力,每个空闲机器人运动速度机器人信息,将空闲机器人的各项信息存入可用机器人集合;Step 7: When the robot central decision-making system determines that the current time has reached the task service decision time point, the robot central decision-making system obtains the number of idle robots at the current time, the number of idle robots, the location information of idle robots, the remaining power of idle robots, and the working capacity of each idle robot. , the robot information about the motion speed of each idle robot, and save the information of the idle robot into the available robot set;
    步骤8:机器人中央决策系统在任务服务决策时间点根据待服务任务集合和可用机器人集合,利用机器人任务匹配优化算法实现可用机器人与待服务任务的匹配关系;Step 8: The robot central decision-making system uses the robot task matching optimization algorithm to realize the matching relationship between the available robots and the tasks to be served according to the set of tasks to be served and the set of available robots at the task service decision time point;
    步骤9:机器人中央决策系统将每个可用机器人对应匹配到的待服务任务信息发送给可用机器人,可用机器人的决策系统根据要执行的任务利用机 器人路径规划智能算法规划得到可用机器人执行任务的全局路径;Step 9: The robot central decision-making system sends the information of the tasks to be served corresponding to each available robot to the available robots. The decision-making system of the available robots uses the robot path planning intelligent algorithm to plan and obtain the global path for the available robots to perform tasks according to the tasks to be performed. ;
    步骤10:可用机器人将状态信息由闲置状态更改为工作状态,然后按照规划的全局路径去执行任务,在运动过程中实时保证局部路径避障要求;Step 10: The robot can change the state information from the idle state to the working state, and then execute the task according to the planned global path, and ensure the local path obstacle avoidance requirements in real time during the movement process;
    步骤11:机器人在执行完任务后,机器人自主检查系统是否正常,如有故障问题将由工作状态更改为维护状态,并将故障问题发送给后台,如没有故障问题将返回到距离当前位置最近的充电桩,并将状态信息由工作状态更改为闲置状态。Step 11: After the robot completes the task, the robot automatically checks whether the system is normal. If there is any fault, it will change from the working state to the maintenance state, and send the fault to the background. If there is no fault, it will return to the charging closest to the current location. stub and change the status information from working to idle.
  2. 根据权利要求1所述的一种多机器人多任务协同工作方法,其特征在于,所述步骤2中的状态信息包括闲置状态,工作状态和维护状态。The multi-robot multi-task cooperative working method according to claim 1, wherein the state information in the step 2 includes an idle state, a working state and a maintenance state.
  3. 根据权利要求1所述的一种多机器人多任务协同工作方法,其特征在于,所述步骤3中的定位方式包括且不局限于:1)利用北斗卫星导航系统、GPS导航系统、GLONASS导航系统或者GALILEO导航系统获得位置信息;2)利用激光雷达探测的环境点云数据分析得到位置信息;3)利用机器人摄像头拍摄的环境图像经视觉分析确定的位置信息;4)利用机器人IMU和里程计的轨迹测算获得位置信息。A multi-robot multi-task cooperative working method according to claim 1, wherein the positioning method in the step 3 includes but is not limited to: 1) using Beidou satellite navigation system, GPS navigation system, GLONASS navigation system Or the GALILEO navigation system obtains the position information; 2) The position information is obtained by analyzing the environmental point cloud data detected by the lidar; 3) The position information is determined by the visual analysis of the environmental image captured by the robot camera; 4) The position information is determined by the robot IMU and odometer. Trajectory calculation to obtain position information.
  4. 根据权利要求1所述的一种多机器人多任务协同工作方法,其特征在于,所述步骤4中的任务需求信息包括任务需求产生时间,任务需求类型,以及任务需求位置信息。The multi-robot multi-task cooperative working method according to claim 1, wherein the task requirement information in step 4 includes task requirement generation time, task requirement type, and task requirement location information.
  5. 根据权利要求1所述的一种多机器人多任务协同工作方法,其特征在于,所述步骤8中的机器人任务匹配优化算法还包括:A multi-robot multi-task cooperative working method according to claim 1, wherein the robot task matching optimization algorithm in step 8 further comprises:
    所述待服务任务集合U={1,…,i,…,N U},待服务任务集合中待服务任务数量为N U,所述可用机器人集合R={1,…,j,…,N R},建立下述匹配模型,即通过生成机器人任务匹配矩阵Z,矩阵Z中元素z j,i表示决定第j辆可用机器人是否去服务第i项任务,z j,i=1,决定第j辆可用机器人去服务第i项任务,z j,i=0,决定第j辆可用机器人不去服务第i项任务,生成的机器人任务匹配矩阵Z实现了最优的匹配模型目标函数即最大的目标函数值,则获得了可用机器人与待服务任务的匹配关系, The set of tasks to be served U={1,...,i,...,N U }, the number of tasks to be served in the set of tasks to be served is N U , the set of available robots R={1,...,j,..., N R }, establish the following matching model, that is, by generating a robot task matching matrix Z, the elements z j,i in the matrix Z indicate whether the jth available robot will serve the i-th task, z j,i =1, determine The jth available robot serves the i-th task, z j, i = 0, it is decided that the j-th available robot does not serve the i-th task, and the generated robot task matching matrix Z realizes the optimal matching model objective function that is The maximum objective function value is obtained, the matching relationship between the available robots and the tasks to be served is obtained,
    其中匹配模型目标函数:Which matches the model objective function:
    Figure PCTCN2020126092-appb-100001
    Figure PCTCN2020126092-appb-100001
    其中匹配模型约束条件:which matches the model constraints:
    Figure PCTCN2020126092-appb-100002
    Figure PCTCN2020126092-appb-100002
    Figure PCTCN2020126092-appb-100003
    Figure PCTCN2020126092-appb-100003
    Figure PCTCN2020126092-appb-100004
    Figure PCTCN2020126092-appb-100004
    z j,i·(E j,i+b o)≤b j z j,i ·(E j,i +b o )≤b j
    Figure PCTCN2020126092-appb-100005
    Figure PCTCN2020126092-appb-100005
    z j,i∈{0,1} z j,i ∈{0,1}
    其中,r i为第i项任务的任务需求权重,该参数是完成第i项任务后获得的奖励;z j,i表示决定第j辆可用机器人是否去服务第i项任务;λ i为第i项任务的损失成本,该参数是未能完成第i项任务后获得的惩罚;M为使用了可用机器人的数量;c 1为机器人执行任务的固定损耗成本;c 2为机器人执行任务的运动成本;ω j为机器人执行任务需要运动的路径;d i为第i项任务需要运动的路径;E j,i为第j辆可用机器人去服务第i项任务所需要消耗的电量;b o为电量阀值;b j为第j辆可用机器人的剩余电量;g i为第i项任务要求的工作能力,其中工作能力要求包括又不局限于重量或体积;A j为第j辆可用机器人工作能力。 Among them, ri is the task requirement weight of the i -th task, and this parameter is the reward obtained after completing the i-th task; z j,i indicates whether the j-th available robot will serve the i-th task; λ i is the i-th task. The loss cost of the i task, this parameter is the penalty obtained after failing to complete the i-th task; M is the number of available robots used; c 1 is the fixed loss cost of the robot to perform the task; c 2 is the motion of the robot to perform the task cost; ω j is the path that the robot needs to move to perform the task; d i is the path that the i-th task needs to move; E j,i is the electricity consumed by the j-th available robot to serve the i-th task; b o is power threshold; b j is the remaining power of the jth available robot; g i is the work capacity required by the i-th task, where the work capacity requirements include but are not limited to weight or volume; A j is the work of the jth available robot ability.
  6. 根据权利要求1所述的一种多机器人多任务协同工作方法,其特征在于,所述步骤9中的机器人路径规划智能算法还包括:The multi-robot multi-task cooperative working method according to claim 1, wherein the robot path planning intelligent algorithm in step 9 further comprises:
    对于第j辆可用机器人在步骤8所确定的要执行的任务
    Figure PCTCN2020126092-appb-100006
    确定第j辆可用机器人的当前位置l j
    For the task to be performed by the jth available robot as determined in step 8
    Figure PCTCN2020126092-appb-100006
    Determine the current position l j of the jth available robot;
    系统在规划机器人路径过程中增加一个智能虚拟位置点
    Figure PCTCN2020126092-appb-100007
    智能虚拟位 置点
    Figure PCTCN2020126092-appb-100008
    到当前位置l j的运动成本为一个极小数,系统中可以初始设定近似为0的正数,当前位置l j到智能虚拟位置点
    Figure PCTCN2020126092-appb-100009
    的运动成本为一个极大数,系统中被初始设定,可以设定为当前位置l j与U j中各任务之间的运动成本的最大值,智能虚拟位置点
    Figure PCTCN2020126092-appb-100010
    与U j中任一任务之间的运动成本可以设置为和当前位置l j与U j中任一任务之间的运动成本相同;
    The system adds an intelligent virtual position point in the process of planning the robot path
    Figure PCTCN2020126092-appb-100007
    Smart virtual location point
    Figure PCTCN2020126092-appb-100008
    The movement cost to the current position l j is a very small number, and the system can be initially set to a positive number approximately 0, and the current position l j to the intelligent virtual position point
    Figure PCTCN2020126092-appb-100009
    The movement cost of is a very large number, which is initially set in the system and can be set as the maximum value of the movement cost between the tasks in the current position l j and U j , the intelligent virtual position point
    Figure PCTCN2020126092-appb-100010
    The movement cost between any task in U j can be set to be the same as the movement cost between the current position l j and any task in U j ;
    建立任务关联运动成本矩阵D,矩阵中元素d h,k中h与k可以为l i
    Figure PCTCN2020126092-appb-100011
    或U j中任意一个元素,表示h与k直接的运动成本,并建立下述路径规划模型,即通过生成机器人路径选择矩阵Y,矩阵Y中元素y h,k表示决定第j辆可用机器人是否经过位置h后或者服务完成任务h后去往位置k或者去服务任务k。y h,k=1,决定第j辆可用机器人经过位置h后或者服务完成任务h后去往位置k或者去服务任务k,y h,k=0,决定第j辆可用机器人经过位置h后或者服务完成任务h后不会去往位置k或者去服务任务k。生成的机器人路径选择矩阵Y实现了最优的路径规划模型目标函数即最小的目标函数值,则获得了机器人的规划路径,
    A task-related motion cost matrix D is established. The elements d h and k in the matrix can be l i .
    Figure PCTCN2020126092-appb-100011
    Or any element in U j , which represents the direct motion cost of h and k, and establishes the following path planning model, that is, by generating the robot path selection matrix Y, the elements y h, k in the matrix Y indicate whether the jth available robot is determined. After passing position h or after the service completes task h, go to position k or go to service task k. y h,k = 1, it is determined that the jth available robot will go to position k or go to service task k after the jth available robot passes through the position h or after the service completes the task h, y h,k = 0, it is determined that the jth available robot passes through the position h. Or the service will not go to location k or go to service task k after completing task h. The generated robot path selection matrix Y realizes the optimal path planning model objective function, that is, the minimum objective function value, and then obtains the planned path of the robot,
    其中路径规划模型目标函数:The path planning model objective function is:
    Figure PCTCN2020126092-appb-100012
    Figure PCTCN2020126092-appb-100012
    其中路径规划模型约束条件:The path planning model constraints are:
    Figure PCTCN2020126092-appb-100013
    Figure PCTCN2020126092-appb-100013
    Figure PCTCN2020126092-appb-100014
    Figure PCTCN2020126092-appb-100014
    Figure PCTCN2020126092-appb-100015
    Figure PCTCN2020126092-appb-100015
    y h,k∈{0,1} y h, k∈{0,1}
    其中,y h,k表示决定第j辆可用机器人是否经过位置h后或者服务完成任务h后去往位置k或者去服务任务k;d h,k表示h与k直接的运动成本,h与k可以为l i
    Figure PCTCN2020126092-appb-100016
    或U j中任意一个元素;Φ为集合
    Figure PCTCN2020126092-appb-100017
    的任意一个子集合,|Φ| 为集合Φ内的元素个数,集合
    Figure PCTCN2020126092-appb-100018
    的元素个数为N lj
    Among them, y h,k indicates whether the jth available robot will go to position k or serve task k after passing through position h or after completing task h; d h,k indicates the direct movement cost of h and k, h and k can be l i ,
    Figure PCTCN2020126092-appb-100016
    or any element in U j ; Φ is the set
    Figure PCTCN2020126092-appb-100017
    Any subset of , |Φ| is the number of elements in the set Φ, the set
    Figure PCTCN2020126092-appb-100018
    The number of elements is N lj .
  7. 一种多机器人多任务协同工作服务器,其特征在于,该智能优化系统包括:处理器和存储指令的存储器,且上述指令在由处理器执行时使处理器实现如权利要求1-6任意一项所述的多机器人多任务协同工作方法。A multi-robot multi-task cooperative work server, characterized in that the intelligent optimization system comprises: a processor and a memory for storing instructions, and when the above-mentioned instructions are executed by the processor, the processor can implement any one of claims 1-6. The multi-robot multi-task cooperative working method.
PCT/CN2020/126092 2020-11-03 2020-11-03 Multi-robot multi-task collaborative working method, and server WO2022094746A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/CN2020/126092 WO2022094746A1 (en) 2020-11-03 2020-11-03 Multi-robot multi-task collaborative working method, and server

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2020/126092 WO2022094746A1 (en) 2020-11-03 2020-11-03 Multi-robot multi-task collaborative working method, and server

Publications (1)

Publication Number Publication Date
WO2022094746A1 true WO2022094746A1 (en) 2022-05-12

Family

ID=81458435

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/126092 WO2022094746A1 (en) 2020-11-03 2020-11-03 Multi-robot multi-task collaborative working method, and server

Country Status (1)

Country Link
WO (1) WO2022094746A1 (en)

Cited By (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114819424A (en) * 2022-06-30 2022-07-29 国网江西省电力有限公司电力科学研究院 Energy storage residual capacity distribution method suitable for multi-scene application
CN115016533A (en) * 2022-05-31 2022-09-06 中国航空工业集团公司沈阳飞机设计研究所 Unmanned aerial vehicle multi-machine cooperative task allocation control system and method thereof
CN115097816A (en) * 2022-05-20 2022-09-23 深圳市大族机器人有限公司 Modularized multi-robot cooperation control method
CN115112123A (en) * 2022-06-27 2022-09-27 华东理工大学 Multi-mobile-robot cooperative positioning method and system based on vision-IMU fusion
CN115170004A (en) * 2022-09-08 2022-10-11 江西省智能产业技术创新研究院 Multi-system hybrid scheduling method, system, computer and readable storage medium
CN115589431A (en) * 2022-09-28 2023-01-10 上海飒智智能科技有限公司 Robot secrecy escort system
CN115963794A (en) * 2023-01-03 2023-04-14 湖南大学 Intelligent real-time scheduling method and device for opencast mineral oil and electricity hybrid truck
CN116449850A (en) * 2023-06-12 2023-07-18 南京泛美利机器人科技有限公司 Three-body cooperative transportation method and system based on behavioral cloning and cooperative coefficient
CN116494242A (en) * 2023-06-01 2023-07-28 广州东焊智能装备有限公司 Cross coupling control method based on robot system
CN116882500A (en) * 2023-07-17 2023-10-13 重庆邮电大学 A GCN-based knowledge reasoning method for UAV mission planning
CN117371585A (en) * 2023-10-09 2024-01-09 广东翼景信息科技有限公司 Multi-unmanned aerial vehicle airport site selection and scheduling method and equipment considering task concurrency and sequential performance
CN117420760A (en) * 2023-11-24 2024-01-19 东莞市新佰人机器人科技有限责任公司 Multi-mode control algorithm fusion method suitable for autonomous cooperation of robot
CN117608258A (en) * 2024-01-24 2024-02-27 纳博特南京科技有限公司 Balanced task allocation method for multiple robots based on LOF algorithm
WO2024060822A1 (en) * 2023-05-17 2024-03-28 南京航空航天大学 Multi-robot collaborative planning method for machining large capsule member of spacecraft
CN118036750A (en) * 2024-03-05 2024-05-14 深圳若愚科技有限公司 Embodied intelligent task planner training method and system based on multimodal large model
CN118071119A (en) * 2024-04-18 2024-05-24 中国电子科技集团公司第十研究所 Heterogeneous sensor mixed cooperative scheduling decision method
CN118153760A (en) * 2024-03-21 2024-06-07 中国矿业大学 An intelligent generation method for CMIES day-ahead scheduling scheme based on multi-task learning
CN118617425A (en) * 2024-08-13 2024-09-10 国网福建省电力有限公司 A robot automatic control method and system based on scheduling instructions
CN118941181A (en) * 2024-07-24 2024-11-12 山东中创亿丰肥料集团有限公司 Logistics delivery robot management method

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105069530A (en) * 2015-08-13 2015-11-18 肇庆学院 Multi-robot task allocation method based on multi-objective optimization
EP3479972A1 (en) * 2017-11-07 2019-05-08 Atos Spain S.A. Robot tasks scheduling process
CN110712206A (en) * 2019-10-16 2020-01-21 北京洛必德科技有限公司 Multitask allocation method, multitask allocation device, multitask allocation equipment and storage medium of intelligent robot
CN110807236A (en) * 2018-08-03 2020-02-18 深圳先进技术研究院 A Warehousing and Logistics Simulation System Based on Multi-robot
CN111539574A (en) * 2020-04-28 2020-08-14 北京洛必德科技有限公司 Order dispatching method and system for multiple robots

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105069530A (en) * 2015-08-13 2015-11-18 肇庆学院 Multi-robot task allocation method based on multi-objective optimization
EP3479972A1 (en) * 2017-11-07 2019-05-08 Atos Spain S.A. Robot tasks scheduling process
CN110807236A (en) * 2018-08-03 2020-02-18 深圳先进技术研究院 A Warehousing and Logistics Simulation System Based on Multi-robot
CN110712206A (en) * 2019-10-16 2020-01-21 北京洛必德科技有限公司 Multitask allocation method, multitask allocation device, multitask allocation equipment and storage medium of intelligent robot
CN111539574A (en) * 2020-04-28 2020-08-14 北京洛必德科技有限公司 Order dispatching method and system for multiple robots

Cited By (23)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115097816A (en) * 2022-05-20 2022-09-23 深圳市大族机器人有限公司 Modularized multi-robot cooperation control method
CN115016533A (en) * 2022-05-31 2022-09-06 中国航空工业集团公司沈阳飞机设计研究所 Unmanned aerial vehicle multi-machine cooperative task allocation control system and method thereof
CN115112123A (en) * 2022-06-27 2022-09-27 华东理工大学 Multi-mobile-robot cooperative positioning method and system based on vision-IMU fusion
CN114819424A (en) * 2022-06-30 2022-07-29 国网江西省电力有限公司电力科学研究院 Energy storage residual capacity distribution method suitable for multi-scene application
CN114819424B (en) * 2022-06-30 2022-10-11 国网江西省电力有限公司电力科学研究院 Energy storage residual capacity distribution method suitable for multi-scene application
CN115170004A (en) * 2022-09-08 2022-10-11 江西省智能产业技术创新研究院 Multi-system hybrid scheduling method, system, computer and readable storage medium
CN115589431A (en) * 2022-09-28 2023-01-10 上海飒智智能科技有限公司 Robot secrecy escort system
CN115963794A (en) * 2023-01-03 2023-04-14 湖南大学 Intelligent real-time scheduling method and device for opencast mineral oil and electricity hybrid truck
WO2024060822A1 (en) * 2023-05-17 2024-03-28 南京航空航天大学 Multi-robot collaborative planning method for machining large capsule member of spacecraft
US12197196B2 (en) 2023-05-17 2025-01-14 Nanjing University Of Aeronautics And Astronautics Multi-robot collaborative planning method for machining large capsule member of spacecraft
CN116494242A (en) * 2023-06-01 2023-07-28 广州东焊智能装备有限公司 Cross coupling control method based on robot system
CN116449850A (en) * 2023-06-12 2023-07-18 南京泛美利机器人科技有限公司 Three-body cooperative transportation method and system based on behavioral cloning and cooperative coefficient
CN116449850B (en) * 2023-06-12 2023-09-15 南京泛美利机器人科技有限公司 Three-body cooperative transportation method and system based on behavioral cloning and cooperative coefficient
CN116882500A (en) * 2023-07-17 2023-10-13 重庆邮电大学 A GCN-based knowledge reasoning method for UAV mission planning
CN117371585A (en) * 2023-10-09 2024-01-09 广东翼景信息科技有限公司 Multi-unmanned aerial vehicle airport site selection and scheduling method and equipment considering task concurrency and sequential performance
CN117420760A (en) * 2023-11-24 2024-01-19 东莞市新佰人机器人科技有限责任公司 Multi-mode control algorithm fusion method suitable for autonomous cooperation of robot
CN117608258A (en) * 2024-01-24 2024-02-27 纳博特南京科技有限公司 Balanced task allocation method for multiple robots based on LOF algorithm
CN117608258B (en) * 2024-01-24 2024-04-05 纳博特南京科技有限公司 Balanced task allocation method for multiple robots based on LOF algorithm
CN118036750A (en) * 2024-03-05 2024-05-14 深圳若愚科技有限公司 Embodied intelligent task planner training method and system based on multimodal large model
CN118153760A (en) * 2024-03-21 2024-06-07 中国矿业大学 An intelligent generation method for CMIES day-ahead scheduling scheme based on multi-task learning
CN118071119A (en) * 2024-04-18 2024-05-24 中国电子科技集团公司第十研究所 Heterogeneous sensor mixed cooperative scheduling decision method
CN118941181A (en) * 2024-07-24 2024-11-12 山东中创亿丰肥料集团有限公司 Logistics delivery robot management method
CN118617425A (en) * 2024-08-13 2024-09-10 国网福建省电力有限公司 A robot automatic control method and system based on scheduling instructions

Similar Documents

Publication Publication Date Title
WO2022094746A1 (en) Multi-robot multi-task collaborative working method, and server
Kendall et al. Learning to drive in a day
Peralta et al. Next-best view policy for 3d reconstruction
CN110427029B (en) Multi-robot cooperative patrol and scheduling method
CN118298336A (en) Method, system, equipment and medium for distributing inspection tasks of transmission and transformation unmanned aerial vehicle based on deep reinforcement learning
WO2024114543A1 (en) Unmanned aerial vehicle permission management method and system, and storage medium
CN106970631A (en) A kind of method of unmanned boat Automatic-searching pollution sources
CN110120888A (en) A kind of cloud crowdsourcing platform magnanimity Service Source combined optimization method and system
Melnychenko et al. A self-organized automated system to control unmanned aerial vehicles for object detection
Cheng et al. Trace pheromone-based energy-efficient uav dynamic coverage using deep reinforcement learning
CN119573754A (en) A method and system for path planning of equipment groups without human intervention based on RRT* algorithm
CN119512207A (en) Satellite-UAV collaborative mission planning method and system for time-sensitive targets
Hammad et al. A novel implementation for FastSLAM 2.0 algorithm based on cloud robotics
CN116048106B (en) Ocean observation control method and device for self-adaptive sampling of multi-underwater robot
CN117111633A (en) A multi-side drone coordinated inspection control method, system and related equipment for the power grid
CN117249831A (en) Unmanned aerial vehicle route planning method, electronic equipment and storage medium
CN114706389B (en) A multi-robot dynamic environment search system and method based on social platform
CN116341873A (en) Multi-star resource scheduling and task planning method, system and storage medium
CN116880522A (en) Method and device for adjusting flight direction of flight device in inspection in real time
CN115729258A (en) Unmanned aerial vehicle crowd sensing scheduling method, system, equipment and medium
CN114254765A (en) An active sequence decision-making method, device and medium for simulation deduction
Zhao et al. Path Planning with Obstacle Avoidance Based on Double Deep Q Networks
Wang et al. Crowdbot: An open-environment robot management system for on-campus services
CN111737491A (en) Method and device for controlling interactive process, storage medium and equipment
Liu et al. Identification method of unmanned aerial vehicle graphical control strategy based on cloud server

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20960209

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20960209

Country of ref document: EP

Kind code of ref document: A1