[go: up one dir, main page]
More Web Proxy on the site http://driver.im/

Zabala et al., 2019 - Google Patents

Learning to gesticulate by observation using a deep generative approach

Zabala et al., 2019

View PDF
Document ID
12847463483179525382
Author
Zabala U
Rodriguez I
Martínez-Otzeta J
Lazkano E
Publication year
Publication venue
International Conference on Social Robotics

External Links

Snippet

The goal of the system presented in this paper is to develop a natural talking gesture generation behavior for a humanoid robot, by feeding a Generative Adversarial Network (GAN) with human talking gestures recorded by a Kinect. A direct kinematic approach is …
Continue reading at arxiv.org (PDF) (other versions)

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T13/00—Animation
    • G06T13/20—3D [Three Dimensional] animation
    • G06T13/40—3D [Three Dimensional] animation of characters, e.g. humans, animals or virtual beings
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06K—RECOGNITION OF DATA; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K9/00—Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
    • G06K9/62—Methods or arrangements for recognition using electronic means
    • G06K9/6267—Classification techniques
    • G06K9/6268—Classification techniques relating to the classification paradigm, e.g. parametric or non-parametric approaches
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06K—RECOGNITION OF DATA; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K9/00—Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
    • G06K9/00335—Recognising movements or behaviour, e.g. recognition of gestures, dynamic facial expressions; Lip-reading
    • G06K9/00355—Recognition of hand or arm movements, e.g. recognition of deaf sign language
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06F—ELECTRICAL DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06N—COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computer systems based on biological models
    • G06N3/02—Computer systems based on biological models using neural network models
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06K—RECOGNITION OF DATA; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K9/00—Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
    • G06K9/00221—Acquiring or recognising human faces, facial parts, facial sketches, facial expressions
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06N—COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N99/00—Subject matter not provided for in other groups of this subclass
    • G06N99/005—Learning machines, i.e. computer in which a programme is changed according to experience gained by the machine itself during a complete run
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06K—RECOGNITION OF DATA; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K9/00—Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
    • G06K9/36—Image preprocessing, i.e. processing the image information without deciding about the identity of the image
    • G06K9/46—Extraction of features or characteristics of the image
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06F—ELECTRICAL DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures

Similar Documents

Publication Publication Date Title
Ji et al. A survey of human action analysis in HRI applications
Sieb et al. Graph-structured visual imitation
Taheri et al. GRAB: A dataset of whole-body human grasping of objects
Iqbal et al. Human-robot teaming: Approaches from joint action and dynamical systems
Billard et al. Discovering optimal imitation strategies
Liang et al. Barehanded music: real-time hand interaction for virtual piano
Elbasiony et al. Humanoids skill learning based on real-time human motion imitation using Kinect
Zabala et al. Learning to gesticulate by observation using a deep generative approach
Rodriguez et al. Spontaneous talking gestures using generative adversarial networks
Jais et al. A review on gesture recognition using Kinect
Banerjee et al. AI enabled tutor for accessible training
Zabala et al. Modeling and evaluating beat gestures for social robots
Abid et al. Dynamic hand gesture recognition for human-robot and inter-robot communication
Memmesheimer et al. homer@ unikoblenz: Winning team of the robocup@ home open platform league 2017
Chella et al. A posture sequence learning system for an anthropomorphic robotic hand
Patel et al. Learning object, grasping and manipulation activities using hierarchical HMMs
Wang et al. Encoder–decoder recurrent network model for interactive character animation generation
Wang et al. A Generative Human-Robot Motion Retargeting Approach Using a Single RGBD Sensor.
Zabala et al. Can a Social Robot Learn to Gesticulate Just by Observing Humans?
Yan et al. Generating natural pedestrian crowds by learning real crowd trajectories through a transformer-based GAN
Wang A survey of visual analysis of human motion and its applications
Liu et al. Demonstration Learning and Generalization of Robotic Motor Skills Based on Wearable Motion Tracking Sensors
Aslanyan On Mobile Pose Estimation and Action Recognition Design and Implementation
Ajay et al. Analyses of Machine Learning Techniques for Sign Language to Text conversion for Speech Impaired
Wu et al. Video driven adaptive grasp planning of virtual hand using deep reinforcement learning