Lee et al., 2022 - Google Patents
Control of wheeled-legged quadrupeds using deep reinforcement learningLee et al., 2022
- Document ID
- 17132466720244985128
- Author
- Lee J
- Bjelonic M
- Hutter M
- Publication year
- Publication venue
- Climbing and Walking Robots Conference
External Links
Snippet
The control problem of wheeled-legged locomotion is still an open problem in the robotics community. Each leg has multiple discrete control modes (rolling, point-foot mode, swing phase), which results in highly nonlinear system dynamics. Most existing works rely on …
- 230000002787 reinforcement 0 title abstract description 9
Classifications
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B13/00—Adaptive control systems, i.e. systems automatically adjusting themselves to have a performance which is optimum according to some preassigned criterion
- G05B13/02—Adaptive control systems, i.e. systems automatically adjusting themselves to have a performance which is optimum according to some preassigned criterion electric
- G05B13/0265—Adaptive control systems, i.e. systems automatically adjusting themselves to have a performance which is optimum according to some preassigned criterion electric the criterion being a learning criterion
- G05B13/027—Adaptive control systems, i.e. systems automatically adjusting themselves to have a performance which is optimum according to some preassigned criterion electric the criterion being a learning criterion using neural networks only
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING; COUNTING
- G06N—COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computer systems based on biological models
- G06N3/02—Computer systems based on biological models using neural network models
- G06N3/04—Architectures, e.g. interconnection topology
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING; COUNTING
- G06N—COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computer systems based on biological models
- G06N3/02—Computer systems based on biological models using neural network models
- G06N3/08—Learning methods
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING; COUNTING
- G06N—COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computer systems based on biological models
- G06N3/02—Computer systems based on biological models using neural network models
- G06N3/06—Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B13/00—Adaptive control systems, i.e. systems automatically adjusting themselves to have a performance which is optimum according to some preassigned criterion
- G05B13/02—Adaptive control systems, i.e. systems automatically adjusting themselves to have a performance which is optimum according to some preassigned criterion electric
- G05B13/04—Adaptive control systems, i.e. systems automatically adjusting themselves to have a performance which is optimum according to some preassigned criterion electric involving the use of models or simulators
- G05B13/042—Adaptive control systems, i.e. systems automatically adjusting themselves to have a performance which is optimum according to some preassigned criterion electric involving the use of models or simulators in which a parameter or coefficient is automatically adjusted to optimise the performance
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B62—LAND VEHICLES FOR TRAVELLING OTHERWISE THAN ON RAILS
- B62D—MOTOR VEHICLES; TRAILERS
- B62D57/00—Vehicles characterised by having other propulsion or other ground- engaging means than wheels or endless track, alone or in addition to wheels or endless track
- B62D57/02—Vehicles characterised by having other propulsion or other ground- engaging means than wheels or endless track, alone or in addition to wheels or endless track with ground-engaging propulsion means, e.g. walking members
- B62D57/032—Vehicles characterised by having other propulsion or other ground- engaging means than wheels or endless track, alone or in addition to wheels or endless track with ground-engaging propulsion means, e.g. walking members with alternately or sequentially lifted supporting base and legs; with alternately or sequentially lifted feet or skid
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING; COUNTING
- G06N—COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N99/00—Subject matter not provided for in other groups of this subclass
- G06N99/005—Learning machines, i.e. computer in which a programme is changed according to experience gained by the machine itself during a complete run
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING; COUNTING
- G06N—COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computer systems based on biological models
- G06N3/004—Artificial life, i.e. computers simulating life
- G06N3/008—Artificial life, i.e. computers simulating life based on physical entities controlled by simulated intelligence so as to replicate intelligent life forms, e.g. robots replicating pets or humans in their appearance or behavior
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING; COUNTING
- G06N—COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N5/00—Computer systems utilising knowledge based models
- G06N5/04—Inference methods or devices
Similar Documents
Publication | Publication Date | Title |
---|---|---|
Gangapurwala et al. | Rloc: Terrain-aware legged locomotion using reinforcement learning and optimal control | |
Hwangbo et al. | Learning agile and dynamic motor skills for legged robots | |
Yu et al. | Sim-to-real transfer for biped locomotion | |
Gangapurwala et al. | Guided constrained policy optimization for dynamic quadrupedal robot locomotion | |
Green et al. | Learning spring mass locomotion: Guiding policies with a reduced-order model | |
Mordatch et al. | Combining model-based policy search with online model learning for control of physical humanoids | |
Léziart et al. | Implementation of a reactive walking controller for the new open-hardware quadruped solo-12 | |
Li et al. | Planning in learned latent action spaces for generalizable legged locomotion | |
Lee et al. | Control of wheeled-legged quadrupeds using deep reinforcement learning | |
Aractingi et al. | Controlling the Solo12 quadruped robot with deep reinforcement learning | |
Bhourji et al. | Reinforcement learning ddpg–ppo agent-based control system for rotary inverted pendulum | |
Li et al. | Zero-shot retargeting of learned quadruped locomotion policies using hybrid kinodynamic model predictive control | |
Seo et al. | Learning to walk by steering: Perceptive quadrupedal locomotion in dynamic environments | |
Wang et al. | Efficient learning of robust quadruped bounding using pretrained neural networks | |
Yue | Learning locomotion for legged robots based on reinforcement learning: A survey | |
Sebastian et al. | Neural network based heterogeneous sensor fusion for robot motion planning | |
Jiang et al. | Stable skill improvement of quadruped robot based on privileged information and curriculum guidance | |
Park et al. | Distributional and hierarchical reinforcement learning for physical systems with noisy state observations and exogenous perturbations | |
Yeom et al. | A dynamic gait stabilization algorithm for quadrupedal locomotion through contact time modulation | |
Ayyıldız et al. | Adaptive sliding mode based fault tolerant control of wheeled mobile robots | |
Carreras et al. | Application of SONQL for real-time learning of robot behaviors | |
Çatalbaş | Control and system identification of legged locomotion with recurrent neural networks | |
Wei et al. | Learning multiple-gait quadrupedal locomotion via hierarchical reinforcement learning | |
Agrawal et al. | Terrain adaptive posture correction in quadruped for locomotion on unstructured terrain | |
Biswas et al. | Achieving Accurate Trajectory Control While Training Legged Robots Using Machine Learning |