[go: up one dir, main page]
More Web Proxy on the site http://driver.im/

CN102667672B - Acceleration motion identify method and system thereof - Google Patents

Acceleration motion identify method and system thereof Download PDF

Info

Publication number
CN102667672B
CN102667672B CN200980161332.5A CN200980161332A CN102667672B CN 102667672 B CN102667672 B CN 102667672B CN 200980161332 A CN200980161332 A CN 200980161332A CN 102667672 B CN102667672 B CN 102667672B
Authority
CN
China
Prior art keywords
data
motion
acceleration
action
module
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN200980161332.5A
Other languages
Chinese (zh)
Other versions
CN102667672A (en
Inventor
韩铮
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Shunyuan Kaihua Technology Co Ltd
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Publication of CN102667672A publication Critical patent/CN102667672A/en
Application granted granted Critical
Publication of CN102667672B publication Critical patent/CN102667672B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01PMEASURING LINEAR OR ANGULAR SPEED, ACCELERATION, DECELERATION, OR SHOCK; INDICATING PRESENCE, ABSENCE, OR DIRECTION, OF MOVEMENT
    • G01P15/00Measuring acceleration; Measuring deceleration; Measuring shock, i.e. sudden change of acceleration
    • G01P15/18Measuring acceleration; Measuring deceleration; Measuring shock, i.e. sudden change of acceleration in two or more dimensions
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01CMEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • G01C21/10Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration
    • G01C21/12Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration executed aboard the object being navigated; Dead reckoning
    • G01C21/16Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration executed aboard the object being navigated; Dead reckoning by integrating acceleration or speed, i.e. inertial navigation
    • G01C21/183Compensation of inertial measurements, e.g. for temperature effects
    • G01C21/185Compensation of inertial measurements, e.g. for temperature effects for gravity
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/103Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
    • A61B5/11Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb
    • A61B5/1126Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb using a particular sensing technique
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01PMEASURING LINEAR OR ANGULAR SPEED, ACCELERATION, DECELERATION, OR SHOCK; INDICATING PRESENCE, ABSENCE, OR DIRECTION, OF MOVEMENT
    • G01P7/00Measuring speed by integrating acceleration
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B2562/00Details of sensors; Constructional details of sensor housings or probes; Accessories for sensors
    • A61B2562/02Details of sensors specially adapted for in-vivo measurements
    • A61B2562/0219Inertial sensors, e.g. accelerometers, gyroscopes, tilt switches

Landscapes

  • Engineering & Computer Science (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • General Physics & Mathematics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Automation & Control Theory (AREA)
  • Pathology (AREA)
  • Medical Informatics (AREA)
  • Dentistry (AREA)
  • Biophysics (AREA)
  • Physiology (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Molecular Biology (AREA)
  • Surgery (AREA)
  • Animal Behavior & Ethology (AREA)
  • General Health & Medical Sciences (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • User Interface Of Digital Computer (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)

Abstract

An acceleration motion identification method and a system thereof, said motion identification method comprises the following steps: collecting effective data signals of a motion through a three-dimensional acceleration sensor; confirming quiescency data of the start and the end of the motion; separating the gravitational acceleration from the data collected through the three-dimensional acceleration sensor by using the gravitational acceleration separating arithmetic so as to obtain the movement acceleration data of the motion, based on the effective data signals collected through the three-dimensional and the quiescency data of the start and the end of the motion; and calculating the speed and the path of the motion based on the movement acceleration data of the motion.

Description

A kind of acceleration motion recognition system and method thereof
Technical field
The present invention relates to a kind of acceleration motion recognition system and method thereof, particularly a kind of acceleration motion recognition system and method thereof based on non-gyroscope technology.
Background technology
At present, most motion identification device can be used respectively optics sensing localization method and acceleration of motion sensing location algorithm, although these two kinds of methods can realize basic operating position fixing and identification, all have respectively certain technical limitation.
Action recognition based on optical sensing localization method
The Wii game machine that Nintendo produces of take is representative, referring to U.S. Patent Publication No., is US2008/0119269A1; Title is " GAME SYSTEM AND STORAGEMEDIUM STORING GAME PROGRAM " patent documentation, it utilizes infrared receiver sensor on equipment to receive the relative distance in different and two incident points of power from the signal that infrared generator produces at equipment two ends, calculates two-dimentional movement locus.
But this implementation method exists some intrinsic deficiencies: due to an infrared transmitter must be respectively installed at operating equipment two ends, and enough differentiate in order to guarantee two incident point distances on receiving sensor, two sensors must be separated certain distance, have caused the larger-size defect of equipment.And the signal intensity resolution limit that is subject to infrared receiver sensor, equipment only can reach enough precision in the scope of 1 meter to 5 meters, cannot adapt to closely operation and 5 meters of above remote-controlled operations in 1 meter.
The action recognition of locating in terrestrial magnetic field based on magnet
Magnet positioning system and the method for U.S. Sixense of take is representative.System utilizes one to produce the magnetic base station of 1/50 geomagnetic field intensity and the magnetic field coordinate system that terrestrial magnetic field forms a quadrature, when opertaing device moves in this magnetic field coordinate system, can reflect in real time relative coordinate and the spatial attitude of object in the coordinate system of magnetic field, have higher positioning precision and real-time.
The deficiency that this method exists is, system bulk is not more convenient for carrying, and the effective range in magnetic field is limited by the transmission power intensity that produces base station, magnetic field, and inapplicable and common computer user.
Based on acceleration of motion sensor and gyrostatic action recognition
Motion recognition system and the method for Korea S Samsung Samsung of take is representative, referring to U.S. Patent Publication No., is US 2008/0049102A1; Title is " MOTION DETECTIONSYSTEM AND METHOD " patent documentation, it is in order to obtain 6 complete dimension movable informations (3 maintenance and operations are moving rotates with 3 dimensions), system acquisition data must be used acceleration transducer and gyroscope simultaneously, or with two acceleration transducers (one of them simulates gyroscope) of fixed intervals distance, obtain needed 6 dimension movable informations.
But this method also exists certain limitation, be mainly reflected in following some:
(1) owing to having used gyroscope, the manufacturing process of equipment, small product size and part category have considerable restraint, under this method, if only use a 3-axis acceleration sensor, system cannot be separated acceleration of gravity and acceleration of motion, also the rotation information of equipment in motion cannot be provided, the track of motion cannot be calculated.
(2) due to the limitation of this type systematic data processing algorithm, error that cannot filtering sensor and other are transmitted to acceleration transducer and gyrostatic small size vibrations, cannot detect the initiating process of the proper motion process of equipment, need to utilize other button auxiliary, be to unclamp a specific button after user need to pin in beginning and tenth skill, carry out the initial of marker motion, although the initial identified problems of action solving like this, but but require the operation of user key-press, cannot realize without the action recognition of additional operations and experiencing, affected user's result of use.
(3) owing to being subject to the restriction of manufacturing process, gyrostatic cost is higher, and volume is larger, and data reliability is very low in the situation that acceleration change is violent.
Summary of the invention
The object of the present invention is to provide a kind of acceleration motion recognition system and method based on non-gyroscope technology, it can be separated acceleration of gravity and acceleration of motion, and the rotation information of equipment in motion is provided, and calculates the track of motion.
Another object of the present invention is to provide a kind of acceleration motion recognition system and method based on non-gyroscope technology, it is without optical sensor and infrared, radiofrequency launcher, also without additional mechanical linkage assembly, error that can filtering sensor and other are transmitted to acceleration transducer and gyrostatic small size vibrations, detect the initiating process of the proper motion process of equipment, and reduce the reliability of manufacturing cost and raising system.
The present invention is acceleration motion recognition system and the method based on non-gyroscope technology, the valid data signal of a kind of core algorithm based on 3-axis acceleration sensor wherein, by the minimum optimized algorithm of moving corner, solve one section of complete action in process from start to end, the minimum angles and the direction vector that around certain direction, rotate, and utilize the direction vector of axle and the size of corner solve, rotative component is separated on each sampled point, the attitude of every bit and acceleration of gravity are set up to corresponding mapping, remove the impact of acceleration of gravity on signal under different attitudes, obtain acceleration of motion information accurately, and in conjunction with the matched filtering of acceleration signal is processed, obtain static detection and action start-stop recognizer, realizing unmanned is the high precision action recognition of external intervention.
This acceleration motion recognition system and method based on non-gyroscope technology, also can adopt other algorithm to realize simultaneously.By static motion detection block, perceive after the beginning of motion, first the data-at-rest before motion being started is as initialized first group of stationary posture, and by the data of this attitude, the acceleration information in shorter set time is next removed to acceleration of gravity, acceleration of motion numerical value, movement velocity and track in obtaining during this period of time, and mate with limited group of movement instruction in the middle of pattern match database, draw one group of definite direction of motion.When static motion detection block detects motion end, stationary posture during using end is as second group of stationary posture, and the data in the shorter set time before motion is finished are removed acceleration of gravity, acceleration of motion numerical value, movement velocity and track in obtaining during this period of time, and again mate with limited group of movement instruction in the middle of pattern match database, show that another organizes definite direction of motion.Before and after calculating, after two groups of direction of motion, system is cut apart the variation of direction and is assigned to every bit in entire motion data, and movement velocity is revised, and finally obtains complete movement velocity and track.
A kind of typical technical scheme application is the game control to human action perception (body sense), hardware based on 3-axis acceleration sensor is fixed on to user's palm, shank and other joint component, when user is from static while starting to do an action that has a certain sense (such as the batting of swinging the bat), static motion detection block is by processing signal, isolate the data that in entire motion process, acceleration transducer collects, by above-mentioned non-gyroscope acceleration action recognition algorithm, after data are processed, obtain the movement locus of whole motion process, the attitude of the relative cartesian coordinate system of the speed of every and equipment (terrestrial gravitation coordinate system) on track.
Accompanying drawing explanation
Fig. 1 is the structural drawing of acceleration motion recognition system of the present invention;
Fig. 2 is the structural drawing of the data acquisition transport module of acceleration motion recognition system;
Fig. 3 is the structural drawing of the driver module of acceleration motion recognition system;
Fig. 4 be acceleration motion recognition system static-structural drawing of motion detection block;
Fig. 5 is the attitude variation diagram of the conventional motion of human body of acceleration motion recognition system;
Fig. 6 is that the attitude of the accelerometer of acceleration motion recognition system represents with the coordinate system connecting firmly on accelerometer;
Fig. 7 is the structural drawing of the acceleration of gravity separation module of acceleration motion recognition system;
Fig. 8 is the action coupling application interface of acceleration motion recognition system;
Fig. 9 is the action display module of acceleration motion recognition system.
Embodiment
In the detailed description that above these and other some objects of the present invention, function and the above accompanying drawing of advantages are done, can see clearlyer.
Please refer to Fig. 1, Fig. 1 is the structural drawing of motion recognition system of the present invention, as seen from Figure 1, this motion recognition system by data acquisition transport module, data reception module, driver module, data processing module, pattern matching module and action display module totally 6 parts form, wherein data acquisition transport module, data processing module, action matching module are the cores of system.
Data acquisition transport module of the present invention comprises 3-axis acceleration sensor, microprocessor and data transmission module.This data acquisition transport module is mainly responsible for data based certain host-host protocol that 3-axis acceleration sensor is gathered, by wired or wireless channel, data are sent to data reception module, the data that simultaneously on microprocessor, data read from acceleration transducer are microprocessor during buffer memory, data are encrypted, then the data transmission of encrypting is arrived to data transmission module, and data transmission module sends to data reception module by the data of encryption.Than optics motion recognition system and existing acceleration sensor system, the realization of data acquisition transport module is more succinct, to user's experience, system bulk and complexity, all has greatly improved.
Data reception module, by after the wired or wireless data demodulates receiving, uploads to driver module.Driver module device registration port, and order is by the data buffer storage after demodulation, utilizes afterwards corresponding to the cryptographic protocol in data acquisition module and key, and data are decrypted.Acceleration information after deciphering is transferred to data processing module.After data processing module, pattern matching module, action display module are processed, calculate speed, the track of motion and the operation of moving after coupling, transmit back respectively driver module, through the display driver in driver module and human-computer interaction device, drive, system applies interface is provided to upper strata.
It should be noted that, data acquisition transport module can not be encrypted data yet.Like this, in driven by program module, also without deciphering filtration drive, process.
Data after encrypt/decrypt filtration drive is processed, by the data transmission after deciphering in data processing module static-motion detection block (or directly the data that receive from data reception module directly being delivered to static-motion detection block).In the middle of static-motion detection block, module is by calculating size and the corresponding variance of signal, and judge by static-motion detection algorithm (specifically describing hereinafter) whether signal belongs to the data in Large Amplitude Motion state procedure, and the partial data in motion process is stored.By the information notification action display module of initial motion, by acceleration of gravity separation module, the gravitational acceleration component of all sampled points in motion valid data is separated with acceleration of motion afterwards, calculate the acceleration that the space motion of each sampled point in cartesian coordinate system produces, and utilize every bit acceleration of gravity to calculate every bit residing attitude (in static-motion detection block and acceleration of gravity separation module, all having used new algorithm to obtain better effect) in Cartesian coordinates in the distribution situation of three axles.
Data after acceleration of gravity separating treatment are sent to pattern matching module, in human action data in various scenes and the mapping ensemblen of operational order, carry out matched and searched, and the operational order after coupling is sent to human-computer interaction device drive to be used for realizing and in application program, click the operational orders such as selection, or in amusement game, impact the operational orders such as enemy.Human motion acceleration information after acceleration of gravity separating treatment is sent to action display module, together with the initial motion information of the human motion from static-motion detection block, by equation of motion V=V simultaneously 0+ a*t (speed=initial velocity+acceleration * time), S=V 0* t+0.5*a*t 2(displacement=initial velocity * time+0.5* acceleration * time square) calculates movement velocity and track (example for cartesian coordinate system, the present invention also can adopt other algorithms), and the result of speed and track is sent to the display driver of computing machine, demonstrate in real time human action.
Below in conjunction with accompanying drawing, specifically describe structure and the effect of each module:
(1) data acquisition transport module
Fig. 2 is the structural drawing of data acquisition transport module, and this module is mainly comprised of three parts: 3-axis acceleration sensor, microprocessor and data transmission module, and between each module, by bus communication, wherein the function of each submodule is as follows:
3-axis acceleration sensor
With the acceleration information in frequency F collection ± N (g) scope of fixing, (g represents the size of normal acceleration of gravity to 3-axis acceleration sensor, gather negative N times of acceleration of gravity and arrive the acceleration of motion data within the scope of positive N times acceleration of gravity), and upgrade fixing memory address space in acceleration transducer with fixed frequency F, every group of data are comprised of the accekeration of X Y Z axis and the temperature of sampled point respectively, and every group of data are stored in the data storage cell in 3-axis acceleration sensor.
Microcontroller
The single-chip microcomputer or the arm processor that adopt low-power consumption, communicated and be connected with acceleration sensor module by bus interface.
In addition miniature control module removes to read the data storage cell of acceleration transducer equally with fixed frequency F, according to the public keys in chip and cryptographic algorithm, every group of data are encrypted, and the data storage cell at microcontroller is cached by the data of encrypting simultaneously.And the data of encrypting are sent to data transmission module.
Data transmission module
Support wired and wireless two kinds of communications modes.Wireline interface can be used USB, serial ports, parallel port, the various protocols such as live wire (fire wire).Wave point utilizes radio frequency baseband chip, supports the data transmission of the 100Kbps of remote and low-power consumption.Can adopt bluetooth, infrared, Zigbee and other simple transport protocols.
(2) data reception module
By data receiver and be cached to specified memory region, and notify driver module to read.The transformat of same corresponding data transport module, supports wired and wireless two kinds of communications modes.
(3) driver module
Referring to accompanying drawing 3, it is driver module structural drawing, and driver module structure is mainly divided into three layers: data bus drives; Encrypting and decrypting filtration drive; Human-computer interaction device drives and figure display driver.
Data bus drives
Data bus drives is responsible for sensor acceleration information and interrupt control instruction read and transmit from hardware bus, according to the difference of data transfer mode, be divided into wire transmission and wireless radio frequency transmission, corresponding data bus drives and is respectively wireline equipment driving and the driving of wireless interface receiving end.After reading demodulating data, data bus drives data buffer storage to calculator memory.
Encrypt/decrypt filtration drive
For example, because all data all can carry out encrypting (adopting RSA cryptographic algorithms and key) according to the cryptographic algorithm in hardware microprocessor and public keys, in encrypting and decrypting filtration drive, with corresponding private cipher key, carry out data deciphering, and the data after deciphering are carried out to verification.When data fit requires and data volume reaches while triggering the thresholding sending, send data to static-motion detection block.
Human-computer interaction device drives
After being disposed, the operational order that pattern matching module obtains coupling sends to human-computer interaction device and drives, human-computer interaction device drives the input equipment driving model requirement of following operating system Plays, the general controls interface of application program-oriented method is provided, like this can be on the pattern manipulation interface of computer operating system the function of analog mouse, keyboard and game action identification opertaing device.
Display driver
Action display module is coming from entire motion that static-motion detection block and acceleration of gravity separation module obtain respectively and the accekeration of initial motion, calculate movement velocity and track under cartesian coordinate system, send to display driver, display driver is responsible for showing the motion of human body on computer screen.
(4) data processing module
Static-motion detection block that data processing module comprises and acceleration of gravity separation module, the action that motion recognition system can accurately be identified, all meet human body and start after variable motion again static process by stationary state, this be because meet the exercise data of this process initial, finish the data that two parts all belong to approximate stationary state, middle respectively organize the sampled data that data are the 3-axis acceleration sensors in variable motion.
Referring to accompanying drawing 1.Traditional based on acceleration sensing and gyrostatic motion recognition system in, the technology that detects static motion has larger limitation, be mainly that data due to sensor are subject to the proper vibration of object and the impact of the inherent error of sensor self, cannot whether correct judgement occur to make to user's athletic performance.Native system, aspect the static-motion detection of processing, has fully utilized signal and has processed and machine learning correlation technique, and static-motion state detection can reach more than 90% precision.
Fig. 4 has provided static-motion detection block workflow diagram.As can see from Figure 4, static-motion detection block has two states, and (status identifier is ∏, and ∏=0 represents staticly in advance, and ∏=1, represents to move in advance for pre-stationary state and pre-motion state.Be not to represent that data must be to belong to stationary state or motion state, but as interim system detected state sign).
Driver module is packaged into one group by continuous N frame data, sends to static-motion detection block.When now static-motion detection block detected state ∏ is pre-stationary state, enter Rule of judgment i, if the variance of these group data is greater than threshold value θ, system detected state ∏ enters pre-motion state.The data that now last group of N frame data are organized pre-motion state together with this store buffer memory into, and the data of this section of pre-motion state are walked around to acceleration of gravity separation module, directly send to action display module, notification action display module starts the drafting of motion original state simultaneously, when human body setting in motion, system has been moved without waiting for, just can will move initial direction and Speed display out.
When static-motion detection block state ∏ becomes pre-motion state, (the preceding paragraph has mentioned when entering pre-motion state) jumps to Rule of judgment ii, if data variance is now greater than threshold value θ, or when the mould of the average of data and normal acceleration of gravity g difference is greater than Δ, these data continue to send to buffer memory.If two conditions of this group data do not meet, the mould that interclass variance is less than threshold value θ and data mean value and normal acceleration of gravity g difference is less than Δ, and system enters pre-stationary state.(value of θ and Δ, is by the empirical value that experiment draws to human action, and the 3-axis acceleration sensor of employing is different, and the value of θ and Δ is not identical yet.The BMA150 sensor of Bosch for example, θ herein and Δ are got respectively 0.25 (m/s 2) 2and 2m/s 2)
When entering pre-stationary state, static-motion detection block is carried out last judgement to data length in buffer memory, detect data length and whether be greater than that (the duration of action is greater than T with frequency F in the T time, for example T can get 0.5 second) size of data of sampling, and judge the acceleration amplitude Ω that whether exists the mould of the difference of one group of its average of data and normal acceleration of gravity to be greater than effective exercise in data.If these two conditions are not all satisfied, system empties the data in the middle of buffer memory; If meet two conditions simultaneously, system sends to acceleration of gravity separation module by data, notifies graphics module to wait for the transmission of valid data simultaneously.(Ω is by the empirical value that experiment draws to human action, and the 3-axis acceleration sensor of employing is different, and the value of Ω is not identical yet.The BMA150 sensor of Bosch for example, Ω herein gets 1m/s 2)
Whole static-motion detection block be based in experiment to the analysis design of exercise data characteristic, can detect the human motion that the duration is greater than T, and the vibration of extraneous high-frequency, human vas can be flowed and noise and the unconscious shake of some human bodies filtering from signal of heartbeat.Meanwhile, when entering pre-motion state, with regard to notification action display module, prepare to draw initial motion direction, reached higher real-time.
Acceleration of gravity separation module
Because the data of acceleration transducer collection are comprised of acceleration of gravity and acceleration of motion linear superposition, expect human motion relevant information, need to obtain simple acceleration of motion data.Acceleration of gravity separation module can be realized acceleration of gravity is separated from the data of 3-axis acceleration sensor sampling, obtains simple acceleration of motion data.
Algorithm (one):
The motion that acceleration motion recognition system catches is comprised of 3 d-line motion and three-dimensional spinning motion, make the accurate identification to motion, recognition system will calculate the attitude of track and the every bit of motion, this need to solve a sextuple equation, the data of sensor are comprised of acceleration of gravity vector acceleration of motion vector linear, additive simultaneously, sensor image data and acceleration of gravity vector linearity need to be subtracted each other, just can obtain acceleration of motion vector.
And independent 3-axis acceleration sensor can only be real-time three-dimensional acceleration data are provided, cannot obtain the unique solution of motion, this is also that conventional motion detection system must be used the gyrostatic reason of rotator inertia.In more detail, legacy system need to utilize rotator inertia gyroscope to provide the system space attitude of each sampling instant, thereby acceleration of gravity vector and acceleration of motion vector are separated.
And native system has only adopted single 3-axis acceleration sensor, just can calculate common athletic posture and track, this is because this motion recognition system is mainly for human motion characteristic, has proposed following constraint condition and algorithm:
Constraint condition one: people's joint motions are to accelerate from static process, then decelerate to (referred to herein as the athletic performance unit) of static composition, more complicated motion is also produced by the process repeating above.Therefore system is organized complete athletic performance unit for each and is calculated, the valid data of system acquisition are treated to following form by static motion detection block: the beginning of data and end comprise respectively the data of one group of stationary state, and the middle data of respectively organizing are valid data that in human motion, 3-axis acceleration sensor sampling obtains.
Constraint condition two: human cinology studies have shown that, people's action is naturally to optimize the most labour-saving mode, this is also that reform of nature environment forms.So system is utilized each stationary state data of organizing complete athletic performance starting and ending, and (scalar value and gravity acceleration g are approximate, now only have terrestrial gravitation to act on acceleration transducer), calculating system space attitude that motion starts and finish and being labeled as respectively that attitude starts (Posture_Start) and attitude finishes (Posture_End), the conversion of two kinds of attitudes of system postulation in whole motion is herein that user rotates minimum angle along the rotating shaft of some correspondences, be that human body is issued to identical movement effects in the minimum method of acting, these two of fixed rotating shaft and minimum corners are assumed to be system and solve the sextuple transcendental equation that only has three-dimensional data input, the constraint condition of extra two dimensions is provided, can obtain the solution of sextuple transcendental equation.
Therefore this motion recognition system and method, can only be used 3-axis acceleration sensor just can calculate conventional movement locus and the attitude of human body.
Referring to accompanying drawing 5, the conventional movement locus of human body and attitude that it obtains for using 3-axis acceleration sensor.
When accelerometer horizontal positioned, according to it, measure the direction of accelerating and set up fixed coordinate system O-X iy iz i.When accelerometer attitude changes, coordinate system rotates with accelerometer, obtains O-X jy jz j.At fixed coordinate system O-X iy iz iunder, the measured value of acceleration of gravity equals acceleration of gravity vector at O-X iy iz icoordinate.Obviously the acceleration of gravity of now measuring is g i=(0,0 ,-g) t.When accelerometer is at O-X jy jz jin the time of static under attitude, the gravity acceleration g of measurement j=(a x, a y, a z) t.If by coordinate system O-X jy jz jto O-X iy iz itransformation matrix be
Figure BDA0000141365500000121
according to coordinate transform, have,
R j i = cos ( X i , X j ) , cos ( Y i , X j ) , cos ( Z i , X j ) cos ( X i , Y j ) , cos ( Y i , Y j ) , cos ( Z i , Y j ) cos ( X i , Z j ) , cos ( Y i , Z j ) , cos ( Z i , Z j ) , g j = R j i g i
Obtain like this:
a x a y a z = cos ( X i , X j ) , cos ( Y i , X j ) , cos ( Z i , X j ) cos ( X i , Y j ) , cos ( Y i , Y j ) , cos ( Z i , Y j ) cos ( X i , Z j ) , cos ( Y i , Z j ) , cos ( Z i , Z j ) 0 0 - g
So can obtain like this:
cos ( Z i , X j ) = - a x g , cos ( Z i , Y j ) = - a y g ,
cos ( Z i , Z j ) = - a z g
According to the standard notation of coordinate transform, define one group of parameters R PY angle (α, beta, gamma), represent O-X jy jz jcoordinate system first turns α around its Z axis, then around its Y-axis β, finally around its Z axis γ, obtains O-X iy iz i.Obtain like this by fixed coordinate system O-X jy jz jto O-X iy iz itransformation matrix
Figure BDA0000141365500000131
another be expressed as follows.So can obtain equally a system of equations, solve this equation and can obtain accelerometer attitude.But this solution of equations has many groups.When accelerometer initial attitude and final carriage have separate more, it is very complicated that problem becomes.Therefore, simplification problem, fixedly initial attitude.Be assumed to be horizontal positioned or vertically place.
cos ( α ) cos ( β ) cos ( α ) sin ( β ) sin ( γ ) cos ( α ) sin ( β ) cos ( γ ) + sin ( α ) sin ( γ ) sin ( α ) cos ( β ) sin ( α ) sin ( β ) sin ( γ ) + cos ( α ) cos ( γ ) sin ( α ) sin ( β ) cos ( γ ) - cos ( α ) sin ( γ ) - sin ( β ) cos ( β ) sin ( γ ) cos ( β ) cos ( γ )
In addition, also can think from O-X jy jz jto O-X iy iz iconversion be around O-X jy jz junder a fixed vector k=(k x, k y, k z) t, rotate θ angle and obtain, transformation matrix another kind of method for expressing be:
R ( K , θ ) = k x k x vers ( θ ) sin ( θ ) + cos ( θ ) k y k x vers ( θ ) - k z sin ( θ ) k z k x vers ( θ ) + k y sin ( θ ) k x k y vers ( θ ) + k z sin ( θ ) k y k y vers ( θ ) + cos ( θ ) k z k y vers ( θ ) - k x sin ( θ ) k x k z vers ( θ ) - k y sin ( θ ) k y k x vers ( θ ) + k x sin ( θ ) k z k z vers ( θ ) + cos ( θ )
When known initial attitude, there is separate in the final carriage after matrix equation solves more.Now, to each final carriage, can find a corresponding (k i, θ i), i=1,2 ...
Order: θ j=min{ θ i, i=1,2 ....Accelerometer is by initial attitude process (k j, θ j) conversion obtains final carriage.Can think like this in whole process, conversion is all around k jaxle carries out.So whole rotation process can difference become much around k jthe a succession of low-angle rotation of carrying out.
Algorithm is as follows: the attitude of accelerometer represents with the coordinate system connecting firmly on accelerometer, supposes that initial attitude is T 0, termination attitude is T n.Schematic diagram is referring to accompanying drawing 6.
As can be seen from Figure 6, the acceleration that initial time is measured is g 0=(a x0, a y0, a z0) t≈ (0 ,-g, 0) t.The acceleration that stops constantly measuring is g n=(a xN, a yN, a zN) t.Suppose initial attitude T 0to stopping attitude T ntransformation matrix be stop attitude T nto initial attitude T 0transformation matrix be
Figure BDA0000141365500000142
:
R 0 N = R - 1 N 0
g N = Rg 0 N 0
Suppose to stop attitude T ntransform to initial attitude T 0rPY angle be (α, beta, gamma),
R N 0 = cαcβ , cαsβsγ - sαcγ , cαsβcγ + sαsγ sαcβ , sαsβsγ + cαcγ , sαsβcγ - cαsγ - sβ , cβsγ , cβcγ
a x a y a z = cαcβ , cαsβsγ - sαcγ , cαsβcγ + sαsγ sαcβ sαsβsγ + cαcγ , sαsβcγ - cαsγ - sβ , cβsγ , cβcγ 0 - g 0
Obtain system of equations:
cαsβsγ - sαcγ = - a x g sαsβsγ + cαcγ = - a y g cβsγ = - a z g - - - ( 1 )
This system of equations has separate more, for each group (α, beta, gamma) substitution attitude matrix of system of equations
Figure BDA0000141365500000152
it is inverted, obtain matrix
Figure BDA0000141365500000153
Suppose by initial attitude T 0transform to attitude T nbe equivalent to around T 0the interior fixedly vector of unit length k=(k of coordinate system x, k y, k z) trotate θ angle and obtain,
R 0 N = k x k x versθ + cθ , k y k x versθ - k z sθ , k z k x versθ + k y sθ k x k y versθ + k z sθ , k y k y versθ + cθ , k z k y versθ - k x sθ k x k z versθ - k y sθ , k y k z versθ + k x sθ , k z k z versθ + cθ = n x , o x , a x n y , o y , a y n z , o z , a z
Obtain following system of equations:
n x + o y + a z = ( k x 2 + k y 2 + k z 2 ) versθ + 3 cθ
⇒ cos θ = 1 2 ( n x + o y + a z - 1 )
So obtain:
sin θ = ± 1 2 ( o z - a y ) 2 + ( a x - n z ) 2 + ( n y - o x ) 2
tan θ = ± ( o z - a y ) 2 + ( a x - n z ) 2 + ( n y - o x ) 2 n x + o y + a z - 1
Limit θ ∈ (0,180 °), can try to achieve θ, further obtain:
k x = o z - a y 2 sin θ , k y = a x - n z 2 sin θ , k z = n y - o x 2 sin θ
Because equation exists ill solution situation, in reality, system requirements θ departs from 0 and 180 °, and this is because equation accurate Fast Convergent now.
The solution of system of equations (1) has many groups, and each group is separated to (α i, β i, γ i), can obtain one group of unique (k i, θ i).?
Figure BDA0000141365500000164
corresponding (the k that exists j, θ j).
If in the acceleration information that accelerometer obtains in each sampling, the influence value of acceleration of gravity is followed successively by g i=(a xi, a yi, a zi) t, i=0,2 ... N.During each sampled point, the attitude of accelerometer is T i, i=0,2 ... N, from T 0to initial attitude T itransformation matrix be
Figure BDA0000141365500000165
obviously
Figure BDA0000141365500000166
(unit matrix).?
Figure BDA0000141365500000167
Utilize (k j, θ j), estimate each transformation matrix
Figure BDA0000141365500000168
here the method adopting is to assert R 0 i = R ( k j , i N θ j ) .
At each sampled point, the acceleration collecting is A i=(A xi, A yi, A zi) t, i=0,2 ... N
Remove after the impact that gravity produces on each axle, acceleration of motion is a i'=a i-g i.A now i' be at attitude T iunder information, need to be transformed into initial attitude T 0under, at each sampled point, the acceleration information under initial attitude is:
a i 0 = R a i ′ 0 i = R 0 i ( a i - g i ) = R a i - g 0 0 i
As shown in Figure 7, from the entire motion data of static-motion detection block in acceleration of gravity separation module by twice use.First be used to calculate minimum corner and the corresponding rotor shaft direction of motion, obtain the attitude transition matrix of each data acquisition sampling point
Figure BDA0000141365500000171
utilize afterwards
Figure BDA0000141365500000172
calculate acceleration of gravity at the component of X/Y/Z axle, from the entire motion data from static-motion detection block, each sampling number is according to [a x, a y, a z] middle separated, obtain the acceleration information in actual complete human body motion process, finally utilize the acceleration information in actual complete human body motion process, through an integrating meter, calculate movement velocity, then calculate movement locus through an integrating meter.Utilize simultaneously
Figure BDA0000141365500000173
the distribution situation of calculating the acceleration of gravity that acceleration of gravity produces with terrestrial attraction at the component of X/Y/Z axle, calculates each data acquisition sampling point spatial attitude of equipment constantly.Acceleration, speed, displacement in final actual complete human body motion process, together with the spatial attitude of equipment, formed entire motion data jointly.
Algorithm (two):
Except above-mentioned algorithm (), separated the data that also can acceleration of gravity be gathered from sensor by other algorithms.
By static-motion detection block detect motion start after, first the data-at-rest before motion being started is as initialized first group of stationary posture μ 1, and with the sensing data of this attitude μ 1, as gravity acceleration g 1 component (gx1 at x/y/z axle when the attitude μ 1, gy1, gz1), and 3-axis acceleration data (axi, ayi in shorter set time next, azi) remove the component (gx1 of gravity acceleration g 1 x/y/z axle now, gy1, gz1)
(Axi,Ayi,Azi)=(axi,ayi,azi)-(gx1,gy1,gz1);
(Axi, Ayi, Azi) is interior during this period of time acceleration of motion numerical value, calculates movement velocity and track, and mates with limited group of movement instruction in the middle of pattern match database, draws one group of definite direction of motion α 1 (kx1, ky1, kz1).
(Axj,Ayj,Azj)=(axj,ayj,azj)-(gx2,gy2,gz2);
When static-motion detection block detects motion and finishes, the stationary posture when finishing is as second group of stationary posture μ 2, and by the 3-axis acceleration sensor data of this attitude μ 2, as gravity acceleration g 2 component (gx2 at x/y/z axle when the attitude μ 2, gy2, gz2), and the 3-axis acceleration data (axj in the shorter set time before motion is finished, ayj, azj), remove acceleration of gravity (gx2, gy2, gz2)
(Axj, Ayj, Azj) obtains interior during this period of time acceleration of motion numerical value, movement velocity and track, and again mate with limited group of movement instruction in the middle of pattern match database, show that another organizes definite direction of motion α 2 (kx2, ky2, kz2).
After calculating two groups of front and back direction of motion α 1 and α 2, calculate the transition matrix Tr of α 1 to α 2,
(kx2,ky2,kz2)=(kx1,ky1,kz1)*Tr;
In motion, start, to finishing total M sampled point, the transformation matrices Tr of direction to be assigned as to M part Tri, (Tri) m=Tr, calculates each sampled point spatial attitude μ i of equipment constantly.
The μ i obtaining with Tri, transforms correction to every bit acceleration of motion in entire motion data, obtains finally obtaining entire motion acceleration information, through an integrating meter, calculates movement velocity, then calculates movement locus through an integrating meter.。
Acceleration, speed, displacement in final actual complete human body motion process, the spatial attitude μ i together with equipment, has formed entire motion data jointly.
(5) pattern matching module:
Referring to Fig. 8, it is pattern matching module.The entire motion data that the utilization of pattern matching module is imported into after processing.According to computer patterns matching theory, pattern match module is carried out matching degree calculating and is inquired about and set up mapping in operational order database and movement velocity track data storehouse, obtain motion action pattern corresponding in operational order database, and provide operational order to application program.
Demand for somatic sensation television game application, solution in the present invention can be by the speed calculating and trace information, by data, being trained and tested the priori data obtaining to form matching database, is limited group of motion action in scene of game by speed and trajectory map.Such as waving arm, jettisoning in the game of: sports class, step, touch the patterns such as ball; The patterns such as the aiming in first person shooting game, shooting, under the prerequisite that does not change the traditional logic of games and flow process, the motion of people's four limbs, head and torso portion is carried out to Tracking Recognition, thereby realize without button, real-time, real somatic sensation television game, experience.
For anthropomorphic type machine people, control the demand of application, can train and test the priori data obtaining by data and form matching database, human action is mapped as to robot manipulation's instruction, such as: carry arm, wave arm, fall arm etc., solution of the present invention can be simplified the volume of opertaing device greatly, strengthen mutual fluency and the emulation of controlling, make people for the control ability of robot and experience greatly and improve.
For haptic interaction application, the present invention can be used for acquisition operations terminal angle information, and the attitude information calculating is mapped in virtual scene, carries out dynamic real time collision detection with virtual scene, realizes real-time haptic interaction.
For traditional personal computer desktop application scene, the present invention can realize the control function of mouse in two dimensional surface and 3 D stereo visual field, not only can substitute the operating function of existing conventional mouse completely, and more adapt to the application demand of following 3 D stereo desktop environment.
(6) action display module
Referring to accompanying drawing 9, it is action display module.Action display module has two parallel data processing modules: real-time pre-action display module and complete action display module, corresponding input data are respectively from the pre-exercise data of static-motion detection block, and entire motion speed, the track data of acceleration of gravity separation module.
In real time pre-action display module is that exercise data that static motion detection block is entered to last group of data-at-rest after pre-motion state and current group simply goes acceleration of gravity to process (to suppose the original state in motion, acceleration of gravity is constant in the distribution of three axle X/Y/Z, the acceleration information value that is about to X/Y/Z under stationary state is above the component on three axles as gravity acceleration g, the acceleration information receiving is deducted to the component on three axles of gravity acceleration g), computing velocity, track obtains the direction of first motion, and data are sent to display driver to start drawing.The object of design is like this, and when user uses equipment setting in motion, the direction of initial motion and speed can show, and without data, will wait until after complete release, through acceleration of gravity separation module, processes and could show.Give like this user's experience effect of a kind of approximate real-time of user.
Complete action display module is responsible for the acceleration information of acceleration of gravity separation module, according to sampling time interval, calculating speed and movement locus, and the data that calculate are sent to display driver, and in three-dimensional animation, draws and rebuild user's motion.
Programmable system application interface (on Fig. 1)
Referring to Fig. 1, the system architecture that the present invention is designed and algorithm solution, in the face of developer provides programmable system application interface, possess good extendability and application.Only need be for application scenarios, set up pattern match database, and provide hardware plan, any competent developer all can be convenient to use this interface and programmes, be used for developing types of applications (somatic sensation television game, robot telepilot, 3D desktop control etc.), thereby the present invention possesses good commercial application prospect.
In conjunction with above-mentioned description, we can obtain beneficial effect of the present invention, can locate accurately and identify the action of human body, in game control, robot control, computer desktop operation, provide action recognition easily, the data acquisition transport module of this recognition system only adopts 3-axis acceleration sensor, avoid using volume that gyroscope brings and the restriction of cost, and in real-time and precision, all reached good effect.
Major technique in the present invention is these points:
1, non-gyroscope removes acceleration of gravity algorithm
(1) valid data signal based on 3-axis acceleration sensor, by the minimum optimized algorithm of moving corner, solve one section of complete action from start to end in process, the minimum angles of rotating around certain direction, and utilize the direction vector of axle and the size of corner solve, rotative component is separated on each sampled point, the attitude of every bit and acceleration of gravity are set up to corresponding mapping, remove the impact of acceleration of gravity on signal under different attitudes, obtain acceleration of motion information accurately, then calculate speed and the track of motion.
(2) valid data signal based on 3-axis acceleration sensor, before motion is started, data-at-rest after end is as two groups of stationary posture initial and that finish, and by the data of this attitude, the acceleration information closing in the shorter set time is removed to acceleration of gravity, acceleration of motion numerical value, movement velocity and track in obtaining during this period of time, and mate with the movement instruction of limited quantity in the middle of pattern match database, draw definite direction of motion.Before and after calculating, after two groups of direction of motion, system is cut apart the variation of direction and is revised each spot speed and track in entire motion data, obtains movable information.
(2) static motion detection algorithm:
Acceleration signal is carried out to matched filtering processing, the correspondence of Rule of judgment I/II in continuous data based Fig. 4 is used, it is the detection that Rule of judgment I triggers motion initial state, Rule of judgment II triggers the detection of motion done state, avoided slightly trembling and the interference of the intrinsic vibrations of object of staff, thus the algorithm of identification static detection and action start-stop.
The concrete application of acceleration motion recognition system of the present invention and method is described below.
Game action identification equipment:
The present invention can be in computer game or family game machine game, the identification of two dimension and three-dimensional motion.When user makes the action of simulation of real scenes, there is the action that the game action identification equipment of the acceleration action recognition technology of non-gyroscope technology makes user and rebuild out by calculating on computers, and set up mapping with the steering order in game.
For two dimensional motion identification in game, choosing for playing card in snipsnapsnorum for example, user can be worn on equipment the back of the hand top, when the translation of user left and right, can select the playing card of holding in hand in the middle of playing, when user wishes to get while maybe needing to choose the playing card of appointment, user only needs fast moving forward or backward to wear the hand of equipment, can allow computing machine identify corresponding operation.This mode is closer to the hand motion of playing cards in real scene.
For three-dimensional motion, identify, the racked swing for example playing tennis, user can be worn on equipment the back of the hand top, and can select to hold tennis racket or other any objects, when user makes once complete racked swing according to the prompting of game picture, game action identification equipment is separated the valid data in the process of swinging the bat by static-motion detection block, and obtains the relevant informations such as complete trajectory that user brandishes racket, speed through system-computed.Pattern matching module, according to movement velocity, trace information, calculates direction, strength and the rotation of batting.
The equipment with 3D mouse function:
Traditional mouse is by machinery or optics, to resolve on two dimensional surface, obtains the translation of user on horizontal plane.The mouse device with the acceleration action recognition technology of non-gyroscope technology, has pinpoint function in three dimensions.When user by the hand of holding equipment in three dimensions during some direction motions, the cursor of mouse also can move thereupon.For traditional two-dimensional operation interface, equipment and system can be converted into three-dimensional motion the projection of two dimensional surface, the action of clicking for mouse right and left key, user can or move up and down in the direction perpendicular to two dimensional surface by quick whipping palm, just can realize corresponding click function.
Meanwhile, the mouse with the acceleration action recognition technology of non-gyroscope technology can not look like traditional machinery or optical mouse, is subject to the restriction of surface in contact.The mouse with the technology of the present invention can, on any surface, be controlled the cursor of mouse of computer desktop even in the air.
Robot motion control inputs equipment:
For anthropomorphic type machine people, control the demand of application, user can wear the arm of robot motion control inputs equipment by movement, human action is mapped as to robot manipulation's instruction, such as: carry arm, wave arm, fall arm etc.When user wants the major beat of robot to control, no longer need to input the instruction of large amount of complex, only need to make corresponding action, just can make consistent complicated arm action by control.The robot motion control inputs equipment with the technology of the present invention, with respect to traditional solutions such as 6 dimension mechanical drive input equipments, can greatly simplify the volume of opertaing device, strengthen mutual fluency and the emulation of controlling, make people for the control ability of robot and experience greatly and improve.
It will be apparent to one skilled in the art that in the present invention and can carry out numerous modifications and variations, and do not depart from the spirit and scope of the present invention.Therefore, the invention is intended to covering and drop on the modifications and variations of the present invention in claims and equivalent scope thereof.

Claims (16)

1. an action identification method, comprises the following steps:
By 3-axis acceleration sensor, gather the valid data signal of an action;
Determine the stationary state data of the starting and ending of this action;
The stationary state data of the valid data signal gathering based on 3-axis acceleration sensor and the starting and ending of this action, by removing acceleration of gravity separation algorithm, acceleration of gravity is separated from the data of 3-axis acceleration sensor sampling, obtained the acceleration of motion data of action; And
Acceleration of motion data based on this action calculate speed and the track of this action;
The wherein said acceleration of gravity separation algorithm that goes comprises:
Solve described action from start to end in process, the minimum angles of the corner that the direction vector of the axle of described action and this axle rotate around certain direction;
The direction vector of the axle that utilization solves and the angle of corner, be on average separated to rotative component on each sampled point; And
The pose of every bit and acceleration of gravity are set up to corresponding mapping, remove the impact of acceleration of gravity on signal under different positions and pose, obtain acceleration of motion information accurately;
Or, described in go acceleration of gravity separation algorithm to comprise:
Valid data signal based on 3-axis acceleration sensor, before motion is started, the stationary state data after finishing are as two groups of stationary posture initial and that finish;
Utilize the data of described two groups of static attitudes that the acceleration information closing in the shorter set time is removed to acceleration of gravity, obtain interior during this period of time acceleration of motion numerical value, movement velocity and track;
Above-mentioned acceleration of motion numerical value, movement velocity and track are mated with the movement instruction of limited quantity in the middle of pattern match database, draw definite direction of motion; And
Two groups of front and back direction of motion based on calculating, cuts apart the variation of direction and revises each spot speed and track in entire motion data, obtains movable information.
2. according to the method for claim 1, the stationary state data of the valid data signal of wherein said action and the starting and ending of action have following form: the beginning of data and end comprise respectively the data of one group of stationary state, and the middle data of respectively organizing are valid data that in human motion, 3-axis acceleration sensor sampling obtains.
3. according to the process of claim 1 wherein that the step of stationary state data of the described starting and ending of determining this action further comprises static-motion detection step, for detection of the pre-static and pre-motion state of action.
4. according to the method for claim 3, wherein said static-motion detection step comprises:
When action is pre-stationary state, continuous N frame data are packaged into one group;
The variance that judges these group data is greater than predetermined threshold value θ;
If the variance of these group data is greater than predetermined threshold value θ, make detected state enter pre-motion state, the data that last group of N frame data are organized to pre-motion state together with this store buffer memory into, and the data of this section of pre-motion state are directly sent to calculate speed and the track of this action;
When action is pre-motion state, judgement data variance is now greater than predetermined threshold value, or judges whether the mould of the average of data and the difference of normal acceleration of gravity is greater than predetermined difference DELTA;
When the variance of these data is less than predetermined threshold value θ, and the mould of the difference of data mean value and normal acceleration of gravity is less than predetermined difference DELTA, makes detected state enter pre-stationary state.
5. according to the method for claim 4, wherein said static-motion detection step further comprises:
When detected state enters pre-stationary state, data length in buffer memory is carried out to last judgement, detect the size whether data length is greater than the data of sampling with frequency F in the T time, and judge in data whether exist the mould of the difference of one group of its average of data and normal acceleration of gravity to be greater than effective exercise amplitude Ω;
If these two conditions are not all satisfied, the data in the middle of buffer memory are emptied;
If meet two conditions simultaneously, send data and by going acceleration of gravity separation algorithm that the acceleration of gravity in data is separated.
6. a motion recognition system, comprising:
Data acquisition transport module, it comprises 3-axis acceleration sensor, for sending the valid data signal of an action of 3-axis acceleration sensor collection;
Driver module, for by the data-signal buffer memory sending from described data acquisition transport module, and receives the data from data processing module, for display driver and human-computer interaction device's driving;
Data processing module, it comprises acceleration of gravity separation module, described data processing module is for determining the stationary state data of the starting and ending of the corresponding action of 3-axis acceleration sensor, and the stationary state data of the starting and ending of the valid data signal gathering based on 3-axis acceleration sensor and this action, by acceleration of gravity separation module, acceleration of gravity is separated from the data of 3-axis acceleration sensor sampling, obtain the acceleration of motion data of action, and the acceleration of motion data based on this action calculate speed and the track of this action, and data are sent to described driver module,
Wherein said acceleration of gravity separation module,
Solve described action from start to end in process, the minimum angles of the corner that the direction vector of the axle of described action and this axle rotate around certain direction;
The direction vector of the axle that utilization solves and the angle of corner, be on average separated to rotative component on each sampled point; And
The pose of every bit and acceleration of gravity are set up to corresponding mapping, remove the impact of acceleration of gravity on signal under different positions and pose, obtain acceleration of motion information accurately;
Or, described acceleration of gravity separation module,
Valid data signal based on 3-axis acceleration sensor, before motion is started, the stationary state data after finishing are as two groups of stationary posture initial and that finish;
Utilize the data of described two groups of static attitudes that the acceleration information closing in the shorter set time is removed to acceleration of gravity, obtain interior during this period of time acceleration of motion numerical value, movement velocity and track;
Above-mentioned acceleration of motion numerical value, movement velocity and track are mated with the movement instruction of limited quantity in the middle of pattern match database, draw definite direction of motion; And
Two groups of front and back direction of motion based on calculating, cuts apart the variation of direction and revises each spot speed and track in entire motion data, obtains movable information.
7. motion recognition system according to claim 6, the stationary state data of the valid data signal of wherein said action and the starting and ending of action have following form: the beginning of data and end comprise respectively the data of one group of stationary state, and the middle data of respectively organizing are valid data that in human motion, 3-axis acceleration sensor sampling obtains.
8. motion recognition system according to claim 6, wherein said data processing module further comprises static-motion detection block, for detection of the pre-static and pre-motion state of action.
9. motion recognition system according to Claim 8, wherein said static-motion detection block,
When action is pre-stationary state, continuous N frame data are packaged into one group;
The variance that judges these group data is greater than predetermined threshold value θ;
If the variance of these group data is greater than predetermined threshold value θ, make detected state enter pre-motion state, the data that last group of N frame data are organized to pre-motion state together with this store buffer memory into, and the data of this section of pre-motion state are directly sent to calculate speed and the track of this action;
When action is pre-motion state, judgement data variance is now greater than predetermined threshold value, or judges whether the mould of the average of data and the difference of normal acceleration of gravity is greater than predetermined difference DELTA;
When the variance of these data is less than predetermined threshold value θ, and the mould of the difference of data mean value and normal acceleration of gravity is less than predetermined difference DELTA, makes detected state enter pre-stationary state.
10. according to the motion recognition system of claim 9, wherein said static-motion detection block further comprises,
When detected state enters pre-stationary state, data length in buffer memory is carried out to last judgement, detect the size whether data length is greater than the data of sampling with frequency F in the T time, and judge in data whether exist the mould of the difference of one group of its average of data and normal acceleration of gravity to be greater than effective exercise amplitude Ω;
If these two conditions are not all satisfied, the data in the middle of buffer memory are emptied;
If meet two conditions simultaneously, send data and by going acceleration of gravity separation algorithm that the acceleration of gravity in data is separated.
11. according to the motion recognition system of claim 6, and wherein said data acquisition transport module further comprises:
Microprocessor, it removes to read the data storage cell of 3-axis acceleration sensor with fixed frequency F, according to public keys and cryptographic algorithm, every group of data are encrypted simultaneously, and the data storage cell by the data of encrypting at microcontroller is cached, then the data of encrypting are sent to data transmission module;
Data transmission module, the data that it receives from microprocessor, adopt wireless or wired mode transmission data.
12. according to the motion recognition system of claim 6, and wherein said motion recognition system further comprises:
Data reception module, for receiving the data from data transmission module, and sends it to driver module.
13. according to the motion recognition system of claim 6, wherein said driver module further comprises encrypt/decrypt filtration drive module, cryptographic algorithm based in microprocessor and public keys are decrypted received data, and the data after deciphering are carried out to verification, when data volume reaches the thresholding that triggers transmission, send data to static-motion detection block.
14. according to the motion recognition system of claim 6, and wherein said motion recognition system further comprises:
Pattern matching module, for receiving the acceleration of motion data from acceleration of gravity separation module, calculate speed and the space tracking of action, in operational order database and movement velocity track data storehouse, carry out matching degree calculating and inquire about and set up mapping, obtain motion action mode data corresponding in operational order database, and send it to driver module.
15. according to the motion recognition system of claim 14, and wherein said motion recognition system further comprises:
Action display module, it comprises two parallel data processing modules, real-time pre-action display module and complete action display module, receive respectively the pre-exercise data from static-motion detection block, and entire motion speed, the track data of acceleration of gravity separation module, for direction of motion and the speed of display action.
16. according to the motion recognition system of claim 15, and wherein said driver module further comprises:
Human-computer interaction device's driver module, for receiving the motion action mode data from pattern matching module, follows the input equipment driving model requirement of operating system Plays, and the general controls interface of application program-oriented method is provided;
Driver module, for receiving direction of motion and the rate signal from the action of described action display module, for drive the demonstration of moving on display screen.
CN200980161332.5A 2009-07-07 2009-07-07 Acceleration motion identify method and system thereof Active CN102667672B (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2009/000770 WO2011003218A1 (en) 2009-07-07 2009-07-07 Acceleration motion identify method and system thereof

Publications (2)

Publication Number Publication Date
CN102667672A CN102667672A (en) 2012-09-12
CN102667672B true CN102667672B (en) 2014-04-02

Family

ID=43428719

Family Applications (1)

Application Number Title Priority Date Filing Date
CN200980161332.5A Active CN102667672B (en) 2009-07-07 2009-07-07 Acceleration motion identify method and system thereof

Country Status (2)

Country Link
CN (1) CN102667672B (en)
WO (1) WO2011003218A1 (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103902015A (en) * 2014-04-08 2014-07-02 苏州本控电子科技有限公司 Handheld remote controller with power saving function and power saving method thereof
CN105866473A (en) * 2016-02-24 2016-08-17 安徽华米信息科技有限公司 Motor vibration acceleration measurement method and apparatus thereof
CN107865662A (en) * 2017-10-19 2018-04-03 张滇 A kind of method and device for identifying limb action
CN107976559A (en) * 2017-10-11 2018-05-01 常州信息职业技术学院 Acceleration of gravity method is filtered out based on rest point detection
CN108992073A (en) * 2014-09-04 2018-12-14 乐益训公司 Information terminal device, motion capture system and motion capture method

Families Citing this family (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103685401B (en) * 2012-09-17 2019-03-29 联想(北京)有限公司 Information switching method, terminal device and Information Exchange System
CN103076884B (en) 2013-02-07 2015-03-25 泽普互动(天津)科技有限公司 Data acquisition method and data acquisition device for motion recognition, and motion recognition system
WO2015081546A1 (en) * 2013-12-05 2015-06-11 华为终端有限公司 Method and apparatus for determining acceleration of vehicle
KR20170019347A (en) * 2014-05-30 2017-02-21 닛토덴코 가부시키가이샤 Device and method for classifying the activity and/or counting steps of a user
CN105630195B (en) * 2014-10-28 2019-12-27 欧姆龙健康医疗事业株式会社 Motion recognition device, portable motion detection apparatus, and motion recognition method thereof
JP6521055B2 (en) * 2015-03-20 2019-05-29 株式会社リコー Display device, display control method, display control program and display system
CN104898831A (en) * 2015-05-08 2015-09-09 中国科学院自动化研究所北仑科学艺术实验中心 Human action collection and action identification system and control method therefor
CN106618584B (en) * 2015-11-10 2019-11-22 北京纳通科技集团有限公司 A method of for monitoring user's lower extremity movement
CN105664454B (en) * 2016-04-11 2019-02-01 深圳市酷浪云计算有限公司 The method and apparatus for realizing sports equipment tachometric survey
CN106371587A (en) * 2016-08-28 2017-02-01 深圳市爱华兴模具有限公司 Simple and effective gesture identification method
CN106491138B (en) * 2016-10-26 2019-04-09 歌尔科技有限公司 A kind of motion state detection method and device
CN107036568A (en) * 2017-06-01 2017-08-11 中国计量大学 Space large scale track detection device and method
CN109758154B (en) * 2019-01-09 2022-02-25 北京卡路里信息技术有限公司 Motion state determination method, device, equipment and storage medium
CN110721473B (en) * 2019-10-10 2022-10-04 深圳市瑞立视多媒体科技有限公司 Object throwing method, device, equipment and computer readable storage medium
CN111449681B (en) * 2020-04-08 2023-09-08 深圳开立生物医疗科技股份有限公司 Shear wave imaging method, device, equipment and readable storage medium
CN112075940A (en) * 2020-09-21 2020-12-15 哈尔滨工业大学 Tremor detection system based on bidirectional long-time and short-time memory neural network
CN112767782B (en) * 2021-01-19 2022-08-19 武汉理工大学 Intelligent pointer system for detecting emotion of teacher in real time
CN114041723A (en) * 2021-11-18 2022-02-15 苏州精源创智能科技有限公司 Dust collector motion sensor module and method for detecting motion state of dust collector
CN114176576B (en) * 2021-12-11 2024-05-24 江苏智恒文化科技有限公司 Method for identifying human motion state based on acceleration

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101317188A (en) * 2006-02-22 2008-12-03 索尼株式会社 Body motion detection device, body motion detection method, and body motion detection program
CN201203853Y (en) * 2008-05-28 2009-03-04 上海悦微堂网络科技有限公司 Body sense remote-control input game device

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1759529A4 (en) * 2004-04-30 2009-11-11 Hillcrest Lab Inc Free space pointing devices and method
EP1970005B1 (en) * 2007-03-15 2012-10-03 Xsens Holding B.V. A system and a method for motion tracking using a calibration unit
KR20100038279A (en) * 2007-07-06 2010-04-14 소니 가부시끼가이샤 Input device, controller, control system, control method, and hand-held device

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101317188A (en) * 2006-02-22 2008-12-03 索尼株式会社 Body motion detection device, body motion detection method, and body motion detection program
CN201203853Y (en) * 2008-05-28 2009-03-04 上海悦微堂网络科技有限公司 Body sense remote-control input game device

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103902015A (en) * 2014-04-08 2014-07-02 苏州本控电子科技有限公司 Handheld remote controller with power saving function and power saving method thereof
CN108992073A (en) * 2014-09-04 2018-12-14 乐益训公司 Information terminal device, motion capture system and motion capture method
CN108992073B (en) * 2014-09-04 2022-03-18 乐益训公司 Information terminal device, motion capture system, and motion capture method
CN105866473A (en) * 2016-02-24 2016-08-17 安徽华米信息科技有限公司 Motor vibration acceleration measurement method and apparatus thereof
CN105866473B (en) * 2016-02-24 2019-06-04 安徽华米信息科技有限公司 The measurement method and device of motor vibrations acceleration
CN107976559A (en) * 2017-10-11 2018-05-01 常州信息职业技术学院 Acceleration of gravity method is filtered out based on rest point detection
CN107865662A (en) * 2017-10-19 2018-04-03 张滇 A kind of method and device for identifying limb action

Also Published As

Publication number Publication date
WO2011003218A1 (en) 2011-01-13
CN102667672A (en) 2012-09-12

Similar Documents

Publication Publication Date Title
CN102667672B (en) Acceleration motion identify method and system thereof
US9229540B2 (en) Deriving input from six degrees of freedom interfaces
US20160098095A1 (en) Deriving Input from Six Degrees of Freedom Interfaces
US8933931B2 (en) Distributed asynchronous localization and mapping for augmented reality
CN102580314B (en) Obtaining input for controlling execution of a game program
US7826641B2 (en) Apparatus and method for determining an absolute pose of a manipulated object in a real three-dimensional environment with invariant features
US9317108B2 (en) Hand-held wireless electronic device with accelerometer for interacting with a display
CN201514612U (en) Three-dimensional dynamic positioning equipment
US20130010071A1 (en) Methods and systems for mapping pointing device on depth map
WO2017020766A1 (en) Scenario extraction method, object locating method and system therefor
CN109643014A (en) Head-mounted display tracking
CN107533369A (en) The magnetic tracking of glove fingertip with peripheral unit
US20140009384A1 (en) Methods and systems for determining location of handheld device within 3d environment
CN109313495A (en) Fusion inertia hand held controller is inputted with the six degree of freedom mixed reality tracked manually
CN201431466Y (en) Human motion capture and thee-dimensional representation system
CN106796453A (en) Projecting apparatus is driven to generate the experience of communal space augmented reality
CN104225897A (en) Motion analysis method and motion analysis device
CN101579238A (en) Human motion capture three dimensional playback system and method thereof
CN102257830A (en) Tracking system calibration with minimal user input
JP7546116B2 (en) Systems and methods for augmented reality - Patents.com
US8555205B2 (en) System and method utilized for human and machine interface
CN102221890A (en) Free space directional force feedback device
CN108434726A (en) Automatic topognosis generates system
CN108037827A (en) The virtual objects throwing emulation mode and its system of Virtual actual environment
CN105359054A (en) Locating and orienting device in space

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
ASS Succession or assignment of patent right

Owner name: YAN WENWEN

Free format text: FORMER OWNER: HAN ZHENG

Effective date: 20121101

C41 Transfer of patent application or patent right or utility model
COR Change of bibliographic data

Free format text: CORRECT: ADDRESS; FROM: 100088 HAIDIAN, BEIJING TO: 100022 CHAOYANG, BEIJING

TA01 Transfer of patent application right

Effective date of registration: 20121101

Address after: 100022 Beijing city Chaoyang District Shifoying dongsihuan morning homes 102-2-1801

Applicant after: Yan Wenwen

Address before: 11 100088 floor, Beihang University, Beijing, Haidian District 251

Applicant before: Han Zheng

C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
ASS Succession or assignment of patent right

Owner name: ZEPP INTERACTION (BEIJING) TECHNOLOGY CO., LTD.

Free format text: FORMER OWNER: HAN ZHENG

Effective date: 20150625

Owner name: HAN ZHENG

Free format text: FORMER OWNER: YAN WENWEN

Effective date: 20150625

C41 Transfer of patent application or patent right or utility model
TR01 Transfer of patent right

Effective date of registration: 20150625

Address after: 100080, room 5086, Shen Chang building, No. 51, Zhichun Road, Beijing, Haidian District

Patentee after: Zep interactive (Beijing) Technology Co.,Ltd.

Address before: 11 100191 floor, Beihang University, Beijing, Haidian District 251

Patentee before: Han Zheng

Effective date of registration: 20150625

Address after: 11 100191 floor, Beihang University, Beijing, Haidian District 251

Patentee after: Han Zheng

Address before: 100022 Beijing city Chaoyang District Shifoying dongsihuan morning homes 102-2-1801

Patentee before: Yan Wenwen

ASS Succession or assignment of patent right

Owner name: ZEPU HUDONG (TIANJIN) TECHNOLOGY CO., LTD.

Free format text: FORMER OWNER: ZEPP INTERACTION (BEIJING) TECHNOLOGY CO., LTD.

Effective date: 20150901

C41 Transfer of patent application or patent right or utility model
TR01 Transfer of patent right

Effective date of registration: 20150901

Address after: 300300 645JJ72, air support center, 1 air way, Tianjin Airport Economic Zone

Patentee after: Zepu interactive (Tianjin) Technology Co.,Ltd.

Address before: 100080, room 5086, Shen Chang building, No. 51, Zhichun Road, Beijing, Haidian District

Patentee before: Zep interactive (Beijing) Technology Co.,Ltd.

TR01 Transfer of patent right

Effective date of registration: 20180831

Address after: 100000 2, No. 23, 23 building, 8 Northeast Road, Haidian District, Beijing.

Patentee after: Beijing Shunyuan Kaihua Technology Co.,Ltd.

Address before: 300300 aviation industry support center 1, Bao Hang Road, Tianjin Airport Economic Zone, 645JJ72

Patentee before: Zepu interactive (Tianjin) Technology Co.,Ltd.

TR01 Transfer of patent right