Huang et al., 2021 - Google Patents
The USV path planning based on an improved DQN algorithmHuang et al., 2021
- Document ID
- 17009640027888771851
- Author
- Huang Z
- Lin H
- Zhang G
- Publication year
- Publication venue
- 2021 International Conference on Networking, Communications and Information Technology (NetCIT)
External Links
Snippet
Research on the path planning algorithm of USV (unmanned surface vessel) has received widespread attention. Among them, the algorithm based on the combination of deep learning and reinforcement learning achieves better performance. However, in the complex …
- 238000004422 calculation algorithm 0 title abstract description 94
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING; COUNTING
- G06N—COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computer systems based on biological models
- G06N3/02—Computer systems based on biological models using neural network models
- G06N3/08—Learning methods
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING; COUNTING
- G06N—COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N99/00—Subject matter not provided for in other groups of this subclass
- G06N99/005—Learning machines, i.e. computer in which a programme is changed according to experience gained by the machine itself during a complete run
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B13/00—Adaptive control systems, i.e. systems automatically adjusting themselves to have a performance which is optimum according to some preassigned criterion
- G05B13/02—Adaptive control systems, i.e. systems automatically adjusting themselves to have a performance which is optimum according to some preassigned criterion electric
- G05B13/0265—Adaptive control systems, i.e. systems automatically adjusting themselves to have a performance which is optimum according to some preassigned criterion electric the criterion being a learning criterion
- G05B13/027—Adaptive control systems, i.e. systems automatically adjusting themselves to have a performance which is optimum according to some preassigned criterion electric the criterion being a learning criterion using neural networks only
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING; COUNTING
- G06N—COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N5/00—Computer systems utilising knowledge based models
- G06N5/04—Inference methods or devices
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING; COUNTING
- G06N—COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computer systems based on biological models
- G06N3/004—Artificial life, i.e. computers simulating life
- G06N3/006—Artificial life, i.e. computers simulating life based on simulated virtual individual or collective life forms, e.g. single "avatar", social simulations, virtual worlds
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B13/00—Adaptive control systems, i.e. systems automatically adjusting themselves to have a performance which is optimum according to some preassigned criterion
- G05B13/02—Adaptive control systems, i.e. systems automatically adjusting themselves to have a performance which is optimum according to some preassigned criterion electric
- G05B13/04—Adaptive control systems, i.e. systems automatically adjusting themselves to have a performance which is optimum according to some preassigned criterion electric involving the use of models or simulators
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D1/00—Control of position, course or altitude of land, water, air, or space vehicles, e.g. automatic pilot
- G05D1/02—Control of position or course in two dimensions
- G05D1/021—Control of position or course in two dimensions specially adapted to land vehicles
- G05D1/0255—Control of position or course in two dimensions specially adapted to land vehicles using acoustic signals, e.g. ultra-sonic singals
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D1/00—Control of position, course or altitude of land, water, air, or space vehicles, e.g. automatic pilot
- G05D1/02—Control of position or course in two dimensions
- G05D1/021—Control of position or course in two dimensions specially adapted to land vehicles
- G05D1/0268—Control of position or course in two dimensions specially adapted to land vehicles using internal positioning means
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN112241176B (en) | Path planning and obstacle avoidance control method of underwater autonomous vehicle in large-scale continuous obstacle environment | |
Cao et al. | Target search control of AUV in underwater environment with deep reinforcement learning | |
Zhu et al. | Deep reinforcement learning based mobile robot navigation: A review | |
Jiang et al. | Path planning for intelligent robots based on deep Q-learning with experience replay and heuristic knowledge | |
Zhang et al. | Mobile robot path planning based on improved localized particle swarm optimization | |
CN110488859B (en) | Unmanned aerial vehicle route planning method based on improved Q-learning algorithm | |
Huang et al. | The USV path planning based on an improved DQN algorithm | |
Zhu et al. | Task assignment and path planning of a multi-AUV system based on a Glasius bio-inspired self-organising map algorithm | |
CN109597425B (en) | Unmanned aerial vehicle navigation and obstacle avoidance method based on reinforcement learning | |
CN109375625A (en) | A kind of intelligent ship paths planning method based on fast search genetic algorithm | |
Cao et al. | Hunting algorithm for multi-auv based on dynamic prediction of target trajectory in 3d underwater environment | |
Du et al. | An optimized path planning method for coastal ships based on improved DDPG and DP | |
CN117590867B (en) | Underwater autonomous vehicle connection control method and system based on deep reinforcement learning | |
Tang et al. | An improved artificial electric field algorithm for robot path planning | |
Lou et al. | Path planning in an unknown environment based on deep reinforcement learning with prior knowledge | |
Huang et al. | The USV path planning of Dueling DQN algorithm based on tree sampling mechanism | |
CN117606490A (en) | Collaborative search path planning method for autonomous underwater vehicle | |
CN117553798A (en) | Safe navigation method, equipment and medium for mobile robot in complex crowd scene | |
Qin et al. | A path planning algorithm based on deep reinforcement learning for mobile robots in unknown environment | |
Feng et al. | Mobile robot obstacle avoidance based on deep reinforcement learning | |
Jiang et al. | Action guidance-based deep interactive reinforcement learning for AUV path planning | |
Das et al. | Improved real time A*-fuzzy controller for improving multi-robot navigation and its performance analysis | |
Zhu et al. | An Improved A* Algorithm for AUV Path Planning | |
Norkham et al. | Reinforcement Learning Agent for Path Planning with Expert Demonstration | |
Gok et al. | Reinforcement learning based local path planning for mobile robot |