[go: up one dir, main page]
More Web Proxy on the site http://driver.im/

CN104476544A - Self-adaptive dead zone inverse model generating device of visual servo mechanical arm system - Google Patents

Self-adaptive dead zone inverse model generating device of visual servo mechanical arm system Download PDF

Info

Publication number
CN104476544A
CN104476544A CN201410601411.6A CN201410601411A CN104476544A CN 104476544 A CN104476544 A CN 104476544A CN 201410601411 A CN201410601411 A CN 201410601411A CN 104476544 A CN104476544 A CN 104476544A
Authority
CN
China
Prior art keywords
module
control
mechanical arm
dead
dead zone
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201410601411.6A
Other languages
Chinese (zh)
Inventor
刘治
王福杰
宋路露
杨智斌
章云
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong University of Technology
Original Assignee
Guangdong University of Technology
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong University of Technology filed Critical Guangdong University of Technology
Priority to CN201410601411.6A priority Critical patent/CN104476544A/en
Publication of CN104476544A publication Critical patent/CN104476544A/en
Pending legal-status Critical Current

Links

Landscapes

  • Feedback Control In General (AREA)
  • Control Of Position Or Direction (AREA)

Abstract

The invention discloses a self-adaptive dead zone inverse model generating device of a visual servo mechanical arm system. The visual servo mechanical arm system is composed of a visual servo controller, a visual module, a motion control module, a driving module, a six-degree-of-freedom mechanical arm, a torque feedback module, a speed and position collecting module and a detecting module. The self-adaptive dead zone inverse model generating device of the visual servo controller is used for eliminating dead zone non-linear constraint and comprises a dead zone inverse model module, a self-adapting module and an operating module, wherein the dead zone inverse model module is used for structuring a smooth dead zone nonlinear inverse model; the self-adapting module adjusts estimated dead zone parameters through self-adaptive laws and transmits the parameters into the dead zone inverse model module to change the parameters of the inverse model; by means of the signal communication of the modules, a closed-loop control system can be formed inside the visual servo mechanical arm system. The self-adaptive dead zone inverse model generating device of the visual servo mechanical arm system can effectively eliminate the influence of the dead zone nonlinear restraint and achieve high image tracing precision.

Description

A kind of adaptive dead zone inversion model generating means of visual servo mechanical arm system
Technical field
The present invention relates to a kind of adaptive dead zone inversion model generating means of visual servo mechanical arm system, belong to visual servo mechanical arm system renovation technique on the input signals.
Background technology
The research of robot starts from 20 middle of century, and it grows up along with the development of automation and computer technology and atomic exploitation.Robot is in from simple to complexity always, from single to various, in development process from rudimentary to senior, along with the development of electronics technologies, the computing ability of computer is greatly improved with various sensor application in robot system, most of robots working environment is pre-set, so once any change occurs working environment, just need to reset robot system.So just strongly limit the range of application of industrial robot.In order to change this situation, robot is made to adapt to the environment of various change, people by various external sensor as sense of touch, distance, power feel and vision sensor be applied in robot control system, in order to provide extensively abundant information to robot without the need to carrying out contact type measurement to environment, and then making robot have the wider scope of application and higher performance, people are robot introducing vision sensor.Among the vision servo system research of mechanical arm, the Intelligent Control Strategy between robotic vision sensor and actuator is with a wide range of applications, and has become a study hotspot.So-called visual servo, the target position information obtained by vision sensor is exactly as feedback, thus the robot control system P of construction location closed loop.。Visual servo carrys out control motion by automatic acquisition and evaluating objects image.In a word, visual servo is exactly the principle utilizing machine vision, carries out fast processing to image feedback information, and provides position control signal fast according to processing the information obtained, and forms the robot controlling of position closed loop.
Early 1970s, people start computer vision and robot servo's combine with technique.Shirai and Inoue is the scholar the earliest vision being applied to robot system.The visual servo mode that they adopt is the position that the image information collected by vision system calculates estimating target, and this is a kind of visual spatial attention mode of static state.The connection of vision and robot system is open loop, so the positioning precision of robot is relevant with vision system precision and robot precision.Wherein, vision system precision is mainly subject to the impact of vision calibration error and resolution ratio.And robot precision is main and joint position sensor accuracy, robot inverse move
Learn the factors such as model accuracy, joint control algorithm, backlash and robot flexibility relevant.According to the difference of feedback information, visual servo is mainly divided into visual servo based on image and location-based visual servo two class.Based on the visual servo of image directly with the image error of calculation, pass to the motion that vision controller carrys out planning robot.This method does not need the position calculating target, insensitive to the pose of robot, but the design difficulty of controller is larger.Location-based visual servo calculates the position of target according to the pose of image and robot self, and vision controller carrys out the motion of planning robot according to target location.The advantage of this method is the signal feeding back to vision controller is position signalling, and interior ring controller needs is also position signalling, and therefore the design of vision controller realizes all relatively easy.But the method needs the three-dimensional information of computed image, obtain the space coordinates of target, meanwhile, the location-dependent query of target is in the pose of robot and video camera, more responsive to the calibrated error of robot and video camera.
But current key issue is: first, general band visual servo mechanical arm system all needs to demarcate camera, but camera calibration is a loaded down with trivial details and job for inefficiency, although there have been many methods to be used to the demarcation of vision system, the cost of camera calibration is still very high.The process asked for external parameter and the inner parameter of video camera is the demarcation of video camera.The operation principle of vision system is exactly obtain two-dimensional image information from video camera, calculates the geological informations such as the shape of object in three-dimensional environment, position, and rebuilds three-dimensional body thus.On two dimensional image, the position of every bit is relevant to the geometric position of this body surface respective point in three dimensions.This correlation is decided by video camera imaging geometrical model, and the parameter of geometrical model is also called camera parameters, mainly comprises outer parameter and intrinsic parameter.Its China and foreign countries' parameter refers to that camera coordinates ties up to the expression in reference frame, and intrinsic parameter then mainly comprises the amplification coefficient of imaging plane coordinate to image coordinate, the image coordinate, distortion coefficients of camera lens etc. of optical axis center point.Camera calibration provides contacting between professional camera and non-measured video camera.And so-called non-measured video camera refers to that its inner parameter is completely unknown, part the unknown or in principle uncertain such class video camera.Camera calibration is exactly the inside and outside parameter being obtained video camera by calibration experiment; Second, because gear is difficult to the loss with service time and number of times of complete compact occlusion and machinery, various non-linear factor can be there is in the moment input of mechanical arm system, the effect that not only greatly can affect control more can cause servo-drive system unstable, and wherein more common is exactly the constraint of input dead-time voltage.When driver provides input torque for motor, the dead-time voltage existed shows as engaged gears and occurs overlapping, when certain limit moment of resistance can be applied on motor accurately, but when moment exceeds dead band threshold values, show as the defeated moment be applied on motor and present threshold values characteristic, keep the input maximum in dead band, control performance is acutely declined and even can cause instability.
Summary of the invention
The object of the invention is to the adaptive dead zone inversion model generating means considering a kind of visual servo mechanical arm system that above-mentioned visual servo mechanical arm control system proposes by dead-time voltage effect of constraint value on the input signals.
Technical scheme of the present invention is: the adaptive dead zone inversion model generating means of visual servo mechanical arm system, includes Visual servoing control device (1), vision module (2), motion-control module (3), driver module (4), sixdegree-of-freedom simulation (5), torque-feedback module (6), speed (7) forms with station acquisition module (8) and detection module (9), Visual servoing control device (1) is by computer control unit (15), control signal generating unit (11), adaptive dead zone inversion model generating means (12), self adaptation camera calibration device (13), and communication unit (14) forms, it is characterized in that, the error signal of the image path formation of the real image track that Visual servoing control device (1) reception graphics processing unit (23) obtains and expectation, the position signalling gathered by station acquisition module (7), the rate signal gathered by speed acquisition module (8), the torque signals gathered by torque-feedback module (6), by Computing control unit (15) computing, information exchange is carried out by self adaptation camera calibration device (13) on-line proving camera by communication unit (14) (21) between servo vision controller (1) and vision module (2), dead band is built inverse and act on control signal by adaptive dead zone inversion model generating means (12), transmitted control signal to control module (3) by control signal generating unit (11), motion-control module (3) modulation (PWM) ripple moves in driver module (4) drive motors driver mechanical arm (5), detect current of electric, speed and the positional information in driver module (4) by detection module (9), and feedback and motion-control module (3) realize closed-loop control, the image coordinate of vision module (2) harvester mechanical arm (5) End features point the input of feeding back in controller (1), form the closed-loop control of the Visual servoing control system of band dead-time voltage constraint.
Above-mentioned adaptive dead zone inversion model generating means (12), comprises adaptation module (121), dead band inversion model module (122), operation control module (123); Adaptation module (121) comprises adaptive law memory (1211), deadzone parameter adjusted value memory (1212), deadzone parameter initial value storing value (1213); Dead band inversion model module (122) comprises parameter storing value (1221), power amplifier (1222), Piezoelectric Driving (1223), threshold values circuit (1224), circuit for generating (1225); Operation control module (123) comprises operand store (1231) (1234), integration module (1232), multiplication and division computing module (1233), plus and minus calculation module (1234).
In above-mentioned adaptive dead zone inversion model generating means (12), the parameter storage (1221) in dead band inversion model module (122) accepts the data transmitted by communication unit (14), operand store (1231), obtains the precompensation parameter vector of dead band inversion model and then regulation and control power amplification circuit (1222) put on the magnitude of voltage that electrical verification drives (1223), threshold values circuit (1224) utilizes voltage signal to carry out switch control rule to circuit for generating (1225), and the control signal for deadband eliminating non-linear effects that dead band inversion model module (122) produces is sent in control signal generating unit (11) by last circuit for generating; Deadzone parameter adjusted value memory (1212) and parameter storage (1221) carry out camera precompensation parameter and dead band information exchange simultaneously.
In above-mentioned adaptive dead zone inversion model generating means (12), the adaptive law memory (1211) in adaptation module (121) stores the programming code of adaptive law, can be expressed as by mathematical form:
β ^ · j = - Λ β j - 1 ω ^ j s q j
Wherein for the precompensation parameter vector of dead band inversion model derivative, for positive definite symmetric matrices, for dead space arrangements parameter prediction value, for joint velocity error, for the territory reference angular velocities relevant to vision system, for angular speed; Aforesaid parameter is for be delivered in adaptive law memory (1211) by parameter storage (1221) by deadzone parameter adjusted value memory (1212); At the system cloud gray model initial stage, by deadzone parameter initial value memory (1213) by initial information transfer in operand store (1234); After system cloud gray model, the data will carrying out calculating by adaptive law memory (1211) and deadzone parameter adjusted value memory (1212) are delivered in operand store (1234).
In above-mentioned adaptive dead zone inversion model generating means (12), the data received are carried out calculus, multiplication and division plus and minus calculation by integration module (1232), differential module (1232), multiplication and division computing module (1233) and plus-minus module (1233) by the operand store (1234) in operation control module simultaneously, then by calculate after data stored in operand store (1231), then transmit and parameter storage (1221) in.
Above-mentioned adaptive dead zone inversion model generating means (12) needs to be connected with self adaptation camera calibration device (13) with communication unit (14) by bus, parameter variable values in adaptive law memory (1211) is that vision module (2) is delivered to the position signalling and rate signal that gather in the data of controller and station acquisition module (8), speed acquisition module (7), and the parameter storage (1211) in dead band inversion model module (122) also stores the signal that torque-feedback module (6) is transmitted; The moment generation signal of deadband eliminating non-linear effects is produced by dead band inversion model (122).
In the visual servo mechanical arm system of above-mentioned band dead-time voltage constraint, Visual servoing control device (1) is communicated by communication unit (14) (21) with vision module (2), the model parameter of self adaptation camera calibration device (13) online Prediction vision module (2), set up the independent deep vision model of a non-demarcation, and the image that camera unit (24) is taken is undertaken processing the real image track obtaining characteristic point in real time by graphics processing unit (23) and Operations Analysis (22).
In the visual servo mechanical arm system of above-mentioned band dead-time voltage constraint, Visual servoing control device (1) receives the image error formed by input picture trajectory signal and the real image trajectory signal that obtained after image procossing by vision system, the joint of mechanical arm angle that receiving position acquisition module (8) and speed acquisition module (7) obtain, joint velocity, terminal position, receive the moment variations of moment after dead-time voltage module gathered by torque-feedback module (6), realize the collection to the positional information of mechanical arm, the movement locus of quantification machine mechanical arm, and the mechanical arm positional information expected directly is passed to motion-control module.
In the visual servo mechanical arm system of above-mentioned band dead-time voltage constraint, motion-control module (3) adopts dsp controller to realize Three-loop control and PWM controls; The most outer shroud of described Three-loop control is the position control ring realized by position control (31), a middle ring is the speeds control ring realized by speeds control (32), the current regulator of innermost ring for being realized by Current Control (33), described dsp controller communicates with control signal generating unit.
In the visual servo mechanical arm system of above-mentioned band dead-time voltage constraint, driver module (4) accepts the PWM modulation signal that PWM control (34) sends, motor (42) (43) of driver (41) rotating band dead band constraint, Electric Traction transmission device (44) also drags sixdegree-of-freedom simulation (5) motion thus.
In the visual servo mechanical arm system of above-mentioned band dead-time voltage constraint, what torque-feedback module (6) gathered driver (41) to put on motor without the moment of dead band constraint and the motor speed after the constraint of dead band, realizes the feedback of dead band constraint to Visual servoing control device (1).
In the visual servo mechanical arm system of above-mentioned band dead-time voltage constraint, detection module (9) realizes detecting and provides the closed loop feedback signal of Three-loop control, comprises QEP circuit (91) and frequency measurement circuit (92), photoelectric encoder (93), A/D converter (94), current sensor (95), the pulse signal transmission that photoelectric encoder (93) on machine shaft exports is to QEP circuit (91) and frequency measurement circuit (92), pulse signal obtains position feed back signal through QEP circuit (91) process, and the position control ring (31) sent in motion-control module (3), pulse signal is through frequency measurement circuit process, obtain feedback speed signal, and the rate control module (32) sent in motion-control module (3), current sensor (95) detects machine winding current, and obtain its digital current signal by A/D converter (94), sent to the current regulator (33) in motion-control module (3) again.
In the visual servo mechanical arm system of above-mentioned band dead-time voltage constraint, the characteristic point that sixdegree-of-freedom simulation (5) multiplely can be taken by camera unit (24) at end mark, graphics processing unit (23) detects, the image coordinate of this characteristic point is obtained by vision module (2).
The visual servo mechanical arm structure that the present invention adopts trick to be separated, namely camera is arranged on the fixed position being convenient to observe mechanical arm tail end characteristic point, by image path image transfer being extracted characteristic point to graphics processing unit of taking pictures.Fully take into account the problem of camera calibration in addition, by self adaptation camera calibration device online Prediction vision mode, decrease the complicated workload that calibration for cameras produces.Simultaneously the present invention also fully take into account mechanical arm system when face lose nonlinear restriction input, utilize adaptive dead zone inversion model generating means deadband eliminating nonlinear restriction, the adaptive law taked effectively can set up corresponding dead band inversion model.Experiment proves that this method reaches good effect, and the present invention is a kind of function admirable, be easy to build on the computer systems adaptive dead zone inversion model generating means.
Accompanying drawing explanation
The visual servo mechanical arm system the general frame of Fig. 1 band dead-time voltage constraint
Fig. 2 adaptive dead zone inversion model generating means theory diagram
Fig. 3 trick is separated visual servo physical arrangement schematic diagram
The inverse dead-zone model that Fig. 4 builds and the dead-time voltage schematic diagram that input torque passes through
Fig. 5 does not adopt adaptive dead zone inversion model generating means pursuit path schematic diagram
Fig. 6 adopts adaptive dead zone inversion model generating means pursuit path schematic diagram
The control block diagram of Fig. 7 visual servo mechanical arm control system
Detailed description of the invention
The present invention relates to a kind of dead band inversion model generating means of visual servo mechanical arm control system, the adaptive law of design is utilized to carry out the parameter of online Prediction dead-time voltage restricted model, build corresponding dead band inversion model again, can effectively eliminate input signal be tied lower Visual servoing control device controller mechanical arm make its End features point on the image plane progressive tracking expect image path, reach higher image trace precision.Below in conjunction with accompanying drawing and instantiation, the dead band inversion model generating means to the visual servo mechanical arm control system designed by the present invention is described in detail.
Fig. 1 is the visual servo mechanical arm system the general frame of band dead-time voltage constraint.The object designing Visual servoing control device is in FIG: when camera is not demarcated and mechanical arm input torque is subject to like to go nonlinear restriction, the motion of controller mechanical arm enables the projection on the image plane of the characteristic point on mechanical arm tail end follow the tracks of the desired image track of tracing preset.The error signal of the image path formation of the real image track that controller Visual servoing control device reception graphics processing unit obtains and expectation, by the position signalling of station acquisition module acquires, by the rate signal of speed acquisition module acquires, by the torque signals of torque-feedback module acquires, by the computing of Computing control unit, information exchange is carried out by self adaptation camera calibration device on-line proving camera by the communication unit between servo vision controller and vision module, dead band is built inverse and act on control signal by adaptive dead zone inversion model generating means, transmitted control signal to control module by control signal generating unit, motion-control module modulation (PWM) ripple moves in driver module drive motors driver mechanical arm, detect current of electric, speed and the positional information in driver module by detection module, and feedback and motion-control module realize closed-loop control, the image coordinate of vision module harvester mechanical arm End features point the input of feeding back in controller, form the closed-loop control of the Visual servoing control system of band dead-time voltage constraint, controller can according to image feedback, and velocity feedback adjusts controller in time and exports the image trace performance providing the best.
Fig. 7 is the control block diagram of visual servo mechanical arm control system, and this control block diagram is exactly the embodiment of principle installation drawing on controlling of figure mono-.
Fig. 2 is adaptive dead zone inversion model generating means theory diagram.Can obtain the part that Fig. 2 is Visual servoing control device from Fig. 1, the effect of this device is that structure one the dead band inversion model of on-line tuning can eliminate the impact of unbalanced input, to greatest extent also intrinsic input torque.Dead band inversion model module is according to the precompensation parameter vector obtained build dead band inversion model, the adaptive law designed is delivered in operation control module and calculates, according to adaptive law by adaptation module:
β ^ · j = - Λ β j - 1 ω ^ j s q j
Obtain parameter vector continuous corrected parameter vector in the running of system value, i.e. the slope k in dead band r, k land breakpoint h r, h ldiscreet value, the disturbance making the input torque of design can offset non-linear input to greatest extent to bring.
Fig. 3 is that the trick that the present invention adopts is separated visual servo physical arrangement schematic diagram, and camera is installed on the fixed position that is convenient to observe mechanical arm tail end characteristic point, and mechanical arm and camera are connected the exchange of the information of carrying out with computer by bus.Relative to structure camera being arranged on mechanical arm tail end, the structure adopting trick to be separated effectively can reduce the shake because manipulator motion causes camera to take pictures, and the global motion of mechanical arm can be observed clearly, obtain the global information of characteristic point, moving control module for controlling manipulator motion can be sent instructions to by the motion control card of computer.
Fig. 4 be analog input moment by dead band after dead-zone model again by schematic diagram that dead band retrains.Dead-time voltage can be described as:
u d ( t ) = k r ( v d ( t ) - h r ) v d ( t ) ≥ h r 0 h l ≤ v d ( t ) ≤ h r k l ( v d ( t ) - h l ) v d ( t ) ≤ h l
Wherein u d, v dfor dead band exports and input, k r, k l, h r, h lfor constant.Parametrization is carried out to above-mentioned model, and definition β d=[k r, k rh r, k l, k lh l] t, can obtain the dead-zone model after parametrization is: u d ( t ) = - β d T ω d . Wherein
Build a level and smooth dead band inversion model as follows:
v d = u d + k r h r k r δ r ( u d ) + u d + k l h l k l δ l ( u d )
δ r ( u d ) = e u d / e 0 e u d / e 0 + e - u d / e 0
δ l ( u d ) = e - u d / e 0 e u d / e 0 + e - u d / e 0
Wherein v d, u dfor output and the input of inversion model, δ r(u d) and δ l(u d) be continuous print indicator function.Parameter due to dead-zone model is unknown, therefore is the discreet value that can only adopt parameter in design, is also go to build level and smooth dead band inversion model:
v o = u o + k ^ r h ^ r k ^ r δ r ( u o ) + u o + k ^ l h ^ l k ^ l δ l ( u o )
Wherein v oand u odo not estimate output and the input of inversion model.Can find out that the deadband eliminating the effect of constraint value whether inversion model of structure can be maximum depends on parameter from formula above discreet value be enough accurate.Explain the discreet value how application self-adapting rule asks for parameter vector below in detail:
1) according to initiation parameter and the follow-up Input and output measurements of dead band inversion model, defining the dead band inversion model Product-factor estimated is:
Wherein v ofor the output of dead band inversion model, with definition as noted above.
2) angle q, the angular speed of mechanical arm can be collected by acceleration module position module angular acceleration and position x, the tip speed of end if the disarthrial bar of mechanical arm the one is long is l 1, l 2.The Jacobin matrix obtaining mechanical arm is J (q (t)):
J ( q ( t ) ) = - l 1 * sin ( q ( 1 ) ) - l 2 / sin ( q ( 2 ) ) 0 l 1 * cos ( q ( 1 ) ) l 2 * sin ( q ( 2 ) ) 0 0 1 1 0 0 1
Wherein q (1), q (2), q (3) are the 1st in q, the 2nd, the 3rd element, in like manner according to the image coordinate y=[u, v] collected t, desired image track y d=[u d, v d] t, and the precompensation parameter matrix that self adaptation camera calibration device transmits picture depth independence interaction matrix can be constructed for once form:
A ^ ( t ) = m ^ 1 T - u * m ^ 3 T m ^ 2 T - v * m ^ 3 T
Wherein for matrix the one the second the third lines.And then following parameter matrix can be obtained
Q = A ^ ( t ) * J ( q ( t ) )
According to the terminal position information collected, can obtain camera relative to the degree of depth of estimating of projection plane is:
z ^ c ( t ) = m ^ 3 T * x
Define the territory reference picture speed of the plane of delineation below, according to image error Δ y=y-y d, have territory reference picture speed to be:
y · r = y · d ( t ) - λ * Δy
And then following parameter matrix can be obtained be:
F ^ yr = c z ^ ( t ) * y · r
3) from above-mentioned parameter matrix, we can further the domain of definition with reference to joint velocity for:
q · r = R ^ + * F ^ yr
Wherein for generalized inverse, therefore joint velocity error vector can be obtained
4) according to the definition of appealing and the variate-value collected, the discreet value adaptive law about deadzone parameter vector can be constructed:
β ^ · = - Λ β - 1 ω ^ s q
Wherein Λ βfor positive definite symmetric matrices, can be passed data in operation control module by the adaptive law of appealing and carry out computing, obtain value, then have dead band inversion model module by constructing dead band inversion model.
So far, we have completed the structure of dead band inversion model, it should be noted that several steps of appeal complete in the inversion model generating means of adaptive dead zone, by the information exchange between each module, effectively can estimate deadzone parameter, guarantee that the control moment designed can be applied in mechanical arm accurately, the non-linear impact brought in deadband eliminating.We verify the performance of the adaptive dead zone inversion model generating means of design by experiment below.The image path of following the tracks of is chosen as follows:
y d ( t ) = 40 * sin ( 0.2 * t ) + 30 - 40 * cos ( 0.2 * t ) - 17
It is β that the deadzone parameter chosen estimates initial value d0=[1 ,-4,1 ,-4] t.
Fig. 5 is not for adopt adaptive dead zone inversion model generating means pursuit path schematic diagram.Wherein red curve is real image track, the blue image path curve for expecting.Can find out that actual track is difficult to follow the tracks of desired trajectory, there is larger image error, embody the performance impact that dead-time voltage constraint produces visual servo mechanical arm system, be especially necessary so a design adaptive dead zone inversion model generating means seems.
Fig. 6 is for have employed adaptive dead zone inversion model generating means pursuit path schematic diagram.Clearly can see that actual path just follows the tracks of desired trajectory rapidly in the incipient stage, at follow-up phase progressive tracking desired trajectory especially, embody the superperformance of the adaptive dead zone inversion model generating means except design.

Claims (13)

1. an adaptive dead zone inversion model generating means for visual servo mechanical arm system, includes Visual servoing control device (1), vision module (2), motion-control module (3), driver module (4), sixdegree-of-freedom simulation (5), torque-feedback module (6), speed (7) forms with station acquisition module (8) and detection module (9), Visual servoing control device (1) is by computer control unit (15), control signal generating unit (11), adaptive dead zone inversion model generating means (12), self adaptation camera calibration device (13), and communication unit (14) forms, it is characterized in that, the error signal of the image path formation of the real image track that Visual servoing control device (1) reception graphics processing unit (23) obtains and expectation, the position signalling gathered by station acquisition module (7), the rate signal gathered by speed acquisition module (8), the torque signals gathered by torque-feedback module (6), by Computing control unit (15) computing, information exchange is carried out by self adaptation camera calibration device (13) on-line proving camera by communication unit (14) (21) between servo vision controller (1) and vision module (2), dead band is built inverse and act on control signal by adaptive dead zone inversion model generating means (12), transmitted control signal to control module (3) by control signal generating unit (11), motion-control module (3) modulation (PWM) ripple moves in driver module (4) drive motors driver mechanical arm (5), detect current of electric, speed and the positional information in driver module (4) by detection module (9), and feedback and motion-control module (3) realize closed-loop control, the image coordinate of vision module (2) harvester mechanical arm (5) End features point the input of feeding back in controller (1), form the closed-loop control of the Visual servoing control system of band dead-time voltage constraint.
2. adaptive dead zone inversion model generating means (12) according to claim 1, it is characterized in that, device comprises adaptation module (121), dead band inversion model module (122), operation control module (123); Adaptation module (121) comprises adaptive law memory (1211), deadzone parameter adjusted value memory (1212), deadzone parameter initial value storing value (1213); Dead band inversion model module (122) comprises parameter storing value (1221), power amplifier (1222), Piezoelectric Driving (1223), threshold values circuit (1224), circuit for generating (1225); Operation control module (123) comprises operand store (1231) (1234), integration module (1232), multiplication and division computing module (1233), plus and minus calculation module (1234).
3. adaptive dead zone inversion model generating means (12) according to claim 1, it is characterized in that the parameter storage (1221) in dead band inversion model module (122) accepts the data transmitted by communication unit (14), operand store (1231), obtain the precompensation parameter vector of dead band inversion model and then regulation and control power amplification circuit (1222) put on the magnitude of voltage that electrical verification drives (1223), threshold values circuit (1224) utilizes voltage signal to carry out switch control rule to circuit for generating (1225), and the control signal for deadband eliminating non-linear effects that dead band inversion model module (122) produces is sent in control signal generating unit (11) by last circuit for generating; Deadzone parameter adjusted value memory (1212) and parameter storage (1221) carry out camera precompensation parameter and dead band information exchange simultaneously.
4. adaptive dead zone inversion model generating means (12) according to claim 1, it is characterized in that the adaptive law memory (1211) in adaptation module (121) stores the programming code of adaptive law, can be expressed as by mathematical form:
β ^ . j = - Λ β j - 1 ω ^ j s q j
Wherein for the precompensation parameter vector of dead band inversion model derivative, for positive definite symmetric matrices, for dead space arrangements parameter prediction value, for joint velocity error, for the territory reference angular velocities relevant to vision system, for angular speed; Aforesaid parameter is for be delivered in adaptive law memory (1211) by parameter storage (1221) by deadzone parameter adjusted value memory (1212); At the system cloud gray model initial stage, by deadzone parameter initial value memory (1213) by initial information transfer in operand store (1234); After system cloud gray model, the data will carrying out calculating by adaptive law memory (1211) and deadzone parameter adjusted value memory (1212) are delivered in operand store (1234).
5. adaptive dead zone inversion model generating means (12) according to claim 1, it is characterized in that the data received are carried out calculus, multiplication and division plus and minus calculation by integration module (1232), differential module (1232), multiplication and division computing module (1233) and plus-minus module (1233) by the operand store (1234) in operation control module simultaneously, then by calculate after data stored in operand store (1231), then transmit and parameter storage (1221) in.
6. adaptive dead zone inversion model generating means (12) according to claim 1, it is characterized in that in Visual servoing control device (1), adaptive dead zone inversion model generating means (12) needs to be connected with self adaptation camera calibration device (13) with communication unit (14) by bus, only can obtain from claim 4, parameter variable values in adaptive law memory (1211) is data and the station acquisition module (8) that vision module (2) is delivered to controller, the position signalling gathered in speed acquisition module (7) and rate signal, parameter storage (1211) in dead band inversion model module (122) also stores the signal that torque-feedback module (6) is transmitted, the moment generation signal of deadband eliminating non-linear effects is produced by dead band inversion model (122).
7. the visual servo mechanical arm system of band dead-time voltage constraint according to claim 1, it is characterized in that above-mentioned Visual servoing control device (1) is communicated by communication unit (14) (21) with vision module (2), the model parameter of self adaptation camera calibration device (13) online Prediction vision module (2), set up the independent deep vision model of a non-demarcation, and the image that camera unit (24) is taken is undertaken processing the real image track obtaining characteristic point in real time by graphics processing unit (23) and Operations Analysis (22).
8. the visual servo mechanical arm system of band dead-time voltage constraint according to claim 1, it is characterized in that above-mentioned Visual servoing control device (1) receives the image error formed by input picture trajectory signal and the real image trajectory signal that obtained after image procossing by vision system, the joint of mechanical arm angle that receiving position acquisition module (8) and speed acquisition module (7) obtain, joint velocity, terminal position, receive the moment variations of moment after dead-time voltage module gathered by torque-feedback module (6), realize the collection to the positional information of mechanical arm, the movement locus of quantification machine mechanical arm, and the mechanical arm positional information expected directly is passed to motion-control module.
9. the visual servo mechanical arm system of band dead-time voltage constraint according to claim 1, is characterized in that above-mentioned motion-control module (3) adopts dsp controller to realize Three-loop control and PWM controls; The most outer shroud of described Three-loop control is the position control ring realized by position control (31), a middle ring is the speeds control ring realized by speeds control (32), the current regulator of innermost ring for being realized by Current Control (33), described dsp controller communicates with control signal generating unit.
10. the visual servo mechanical arm system of band dead-time voltage constraint according to claim 1, it is characterized in that above-mentioned driver module (4) accepts PWM and controls (34) PWM modulation signal of sending, motor (42) (43) of driver (41) rotating band dead band constraint, Electric Traction transmission device (44) also drags sixdegree-of-freedom simulation (5) motion thus.
The visual servo mechanical arm system of 11. band dead-time voltage constraints according to claim 1, what it is characterized in that above-mentioned torque-feedback module (6) gathers driver (41) to put on motor without the moment of dead band constraint and the motor speed after the constraint of dead band, realizes the feedback of dead band constraint to Visual servoing control device (1).
The visual servo mechanical arm system of 12. band dead-time voltage constraints according to claim 1, it is characterized in that above-mentioned detection module (9) realizes detecting and provides the closed loop feedback signal of Three-loop control, comprise QEP circuit (91) and frequency measurement circuit (92), photoelectric encoder (93), A/D converter (94), current sensor (95), the pulse signal transmission that photoelectric encoder (93) on machine shaft exports is to QEP circuit (91) and frequency measurement circuit (92), pulse signal obtains position feed back signal through QEP circuit (91) process, and the position control ring (31) sent in motion-control module (3), pulse signal is through frequency measurement circuit process, obtain feedback speed signal, and the rate control module (32) sent in motion-control module (3), current sensor (95) detects machine winding current, and obtain its digital current signal by A/D converter (94), sent to the current regulator (33) in motion-control module (3) again.
The visual servo mechanical arm system of 13. band dead-time voltage constraints according to claim 1, it is characterized in that the characteristic point that above-mentioned sixdegree-of-freedom simulation (5) multiplely can be taken by camera unit (24) at end mark, graphics processing unit (23) detects, the image coordinate of this characteristic point is obtained by vision module (2).
CN201410601411.6A 2014-10-23 2014-10-23 Self-adaptive dead zone inverse model generating device of visual servo mechanical arm system Pending CN104476544A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201410601411.6A CN104476544A (en) 2014-10-23 2014-10-23 Self-adaptive dead zone inverse model generating device of visual servo mechanical arm system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201410601411.6A CN104476544A (en) 2014-10-23 2014-10-23 Self-adaptive dead zone inverse model generating device of visual servo mechanical arm system

Publications (1)

Publication Number Publication Date
CN104476544A true CN104476544A (en) 2015-04-01

Family

ID=52751215

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201410601411.6A Pending CN104476544A (en) 2014-10-23 2014-10-23 Self-adaptive dead zone inverse model generating device of visual servo mechanical arm system

Country Status (1)

Country Link
CN (1) CN104476544A (en)

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104858168A (en) * 2015-04-28 2015-08-26 国家电网公司 Water washing robot aiming system and method based on laser ranging and image recognition
CN104950683A (en) * 2015-06-23 2015-09-30 广东工业大学 Self-adaptive gap inverse model generating device for visual servo manipulator system
CN104942809A (en) * 2015-06-23 2015-09-30 广东工业大学 Mechanical arm dynamic fuzzy approximator based on visual servo system
CN106406097A (en) * 2016-11-08 2017-02-15 长春工业大学 Distributed adaptive coordinated control method for multi-manipulator systems
CN106602971A (en) * 2015-10-20 2017-04-26 沈阳新松机器人自动化股份有限公司 Motor control method, device and system
CN106926234A (en) * 2015-12-29 2017-07-07 哈尔滨恒誉名翔科技有限公司 A kind of REbot-V-6R robot arm devices
CN109588400A (en) * 2019-01-03 2019-04-09 甘肃农业大学 A kind of electricity drive formula pesticide spraying machinery arm and control method
CN111037557A (en) * 2019-12-20 2020-04-21 扬州哈工科创机器人研究院有限公司 System and control system for mechanical arm LED display deduction
CN114043484A (en) * 2021-11-29 2022-02-15 青岛理工大学 Vision-based simulation learning system and method for industrial robot assembly
CN114072256A (en) * 2019-06-26 2022-02-18 富兰卡爱米卡股份有限公司 System for input on a robotic manipulator
WO2022138340A1 (en) * 2020-12-21 2022-06-30 ファナック株式会社 Safety vision device, and safety vision system

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS618236A (en) * 1985-05-16 1986-01-14 Fujitsu Ltd Moving body control unit
CN101612062A (en) * 2008-06-26 2009-12-30 北京石油化工学院 Method for navigating and positioning multi-joint arm mechanical sensing type ultrasonic image
CN201814653U (en) * 2010-01-15 2011-05-04 广东工业大学 Self-adapting filter of master-slave minimally invasive surgery robot system
US20120022690A1 (en) * 2010-07-22 2012-01-26 Kabushiki Kaisha Toshiba Robot control apparatus
CN103066909A (en) * 2013-01-14 2013-04-24 杭州电子科技大学 Control method and yarn constant tension control system of proportional-integral-derivative (PID) controller with dead zone
CN103684179A (en) * 2013-12-17 2014-03-26 清华大学 Compensation device and compensation method of current filtering and dead zone of permanent magnet synchronous motor
CN103963065A (en) * 2013-01-24 2014-08-06 发那科株式会社 Electric hand having force sensor
CN104216284A (en) * 2014-08-14 2014-12-17 浙江工业大学 Limit time cooperative control method of mechanical arm servo system

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS618236A (en) * 1985-05-16 1986-01-14 Fujitsu Ltd Moving body control unit
CN101612062A (en) * 2008-06-26 2009-12-30 北京石油化工学院 Method for navigating and positioning multi-joint arm mechanical sensing type ultrasonic image
CN201814653U (en) * 2010-01-15 2011-05-04 广东工业大学 Self-adapting filter of master-slave minimally invasive surgery robot system
US20120022690A1 (en) * 2010-07-22 2012-01-26 Kabushiki Kaisha Toshiba Robot control apparatus
CN103066909A (en) * 2013-01-14 2013-04-24 杭州电子科技大学 Control method and yarn constant tension control system of proportional-integral-derivative (PID) controller with dead zone
CN103963065A (en) * 2013-01-24 2014-08-06 发那科株式会社 Electric hand having force sensor
CN103684179A (en) * 2013-12-17 2014-03-26 清华大学 Compensation device and compensation method of current filtering and dead zone of permanent magnet synchronous motor
CN104216284A (en) * 2014-08-14 2014-12-17 浙江工业大学 Limit time cooperative control method of mechanical arm servo system

Cited By (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104858168A (en) * 2015-04-28 2015-08-26 国家电网公司 Water washing robot aiming system and method based on laser ranging and image recognition
CN104950683A (en) * 2015-06-23 2015-09-30 广东工业大学 Self-adaptive gap inverse model generating device for visual servo manipulator system
CN104942809A (en) * 2015-06-23 2015-09-30 广东工业大学 Mechanical arm dynamic fuzzy approximator based on visual servo system
CN106602971B (en) * 2015-10-20 2019-10-11 沈阳新松机器人自动化股份有限公司 Motor control method, apparatus and system
CN106602971A (en) * 2015-10-20 2017-04-26 沈阳新松机器人自动化股份有限公司 Motor control method, device and system
CN106926234A (en) * 2015-12-29 2017-07-07 哈尔滨恒誉名翔科技有限公司 A kind of REbot-V-6R robot arm devices
CN106406097A (en) * 2016-11-08 2017-02-15 长春工业大学 Distributed adaptive coordinated control method for multi-manipulator systems
CN106406097B (en) * 2016-11-08 2019-05-14 长春工业大学 The distributed self-adaption control method for coordinating of Multi-arm robots
CN109588400B (en) * 2019-01-03 2021-11-02 甘肃农业大学 Electrically-driven pesticide spraying mechanical arm and control method
CN109588400A (en) * 2019-01-03 2019-04-09 甘肃农业大学 A kind of electricity drive formula pesticide spraying machinery arm and control method
CN114072256A (en) * 2019-06-26 2022-02-18 富兰卡爱米卡股份有限公司 System for input on a robotic manipulator
CN114072256B (en) * 2019-06-26 2024-05-31 富兰卡爱米卡股份有限公司 System for input on robotic manipulator
CN111037557A (en) * 2019-12-20 2020-04-21 扬州哈工科创机器人研究院有限公司 System and control system for mechanical arm LED display deduction
CN111037557B (en) * 2019-12-20 2022-07-22 扬州哈工科创机器人研究院有限公司 System and control system for mechanical arm LED display deduction
WO2022138340A1 (en) * 2020-12-21 2022-06-30 ファナック株式会社 Safety vision device, and safety vision system
JP7427115B2 (en) 2020-12-21 2024-02-02 ファナック株式会社 Anshin Vision Device and Anshin Vision System
CN114043484A (en) * 2021-11-29 2022-02-15 青岛理工大学 Vision-based simulation learning system and method for industrial robot assembly
CN114043484B (en) * 2021-11-29 2023-10-03 青岛理工大学 Vision-based imitation learning system and method for industrial robot assembly

Similar Documents

Publication Publication Date Title
CN104476544A (en) Self-adaptive dead zone inverse model generating device of visual servo mechanical arm system
CN105009014B (en) Improved robot manipulating task instrument
CN104942809B (en) The mechanical arm dynamic fuzzy of view-based access control model servo-drive system approaches device
CN107562048B (en) Dynamic obstacle avoidance control method based on laser radar
US11340614B2 (en) Robot and method and apparatus of controlling movement of transport robot
CN110001840B (en) Two-wheeled self-balancing vehicle motion control method based on visual sensor under various road conditions
CN103781603A (en) Control method and control device
CN112904890A (en) Unmanned aerial vehicle automatic inspection system and method for power line
Choi et al. Enhanced SLAM for a mobile robot using extended Kalman filter and neural networks
CN104950683A (en) Self-adaptive gap inverse model generating device for visual servo manipulator system
Sergiyenko et al. Sliding mode observer based fault identification in automatic vision system of robot
Karthik et al. Dual Mode PID Controller for Path Planning of Encoder Less Mobile Robots in Warehouse Environment
CN105345824A (en) Self-adaption hysteresis eliminating device of visual servo mechanical arm
Bascetta et al. Two-time scale visual servoing of eye-in-hand flexible manipulators
Pandey et al. Real time navigation strategies for webots using fuzzy controller
CN113031002A (en) SLAM running car based on Kinect3 and laser radar
CN206493338U (en) A kind of self-balancing of recordable displacement and the mechanical arm of avoidance
CN114415655B (en) Improved SLAM-based navigation control method for inspection robot
CN110285803A (en) Chassis localization method, device, equipment and computer readable storage medium
Nikitenko et al. Single robot localisation approach for indoor robotic systems through integration of odometry and artificial landmarks
Marques et al. Autonomous robot for mapping using ultrasonic sensors
Takahashi et al. Vehicle state estimation by moving horizon estimation considering occlusion and outlier on 3d static cameras
CN108344412A (en) A kind of Navigation System for Mobile Robot and method
Koay et al. Compensating intermittent delayed visual feedback in robot navigation
Hanna et al. A novel control-navigation system-based adaptive optimal controller & EKF localization of DDMR

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20150401

WD01 Invention patent application deemed withdrawn after publication