[go: up one dir, main page]
More Web Proxy on the site http://driver.im/

CN113247519A - Intelligent loading and unloading device and method for visual control - Google Patents

Intelligent loading and unloading device and method for visual control Download PDF

Info

Publication number
CN113247519A
CN113247519A CN202110520368.0A CN202110520368A CN113247519A CN 113247519 A CN113247519 A CN 113247519A CN 202110520368 A CN202110520368 A CN 202110520368A CN 113247519 A CN113247519 A CN 113247519A
Authority
CN
China
Prior art keywords
assembly
position information
unit
execution module
goods
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202110520368.0A
Other languages
Chinese (zh)
Inventor
谢晖
李茂�
王爽
张银
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Dajie Intelligent Technology Guangdong Co ltd
Original Assignee
Dajie Intelligent Technology Guangdong Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Dajie Intelligent Technology Guangdong Co ltd filed Critical Dajie Intelligent Technology Guangdong Co ltd
Priority to CN202110520368.0A priority Critical patent/CN113247519A/en
Publication of CN113247519A publication Critical patent/CN113247519A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B65CONVEYING; PACKING; STORING; HANDLING THIN OR FILAMENTARY MATERIAL
    • B65GTRANSPORT OR STORAGE DEVICES, e.g. CONVEYORS FOR LOADING OR TIPPING, SHOP CONVEYOR SYSTEMS OR PNEUMATIC TUBE CONVEYORS
    • B65G1/00Storing articles, individually or in orderly arrangement, in warehouses or magazines
    • B65G1/02Storage devices
    • B65G1/04Storage devices mechanical
    • B65G1/137Storage devices mechanical with arrangements or automatic control means for selecting which articles are to be removed
    • B65G1/1371Storage devices mechanical with arrangements or automatic control means for selecting which articles are to be removed with data records
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B65CONVEYING; PACKING; STORING; HANDLING THIN OR FILAMENTARY MATERIAL
    • B65GTRANSPORT OR STORAGE DEVICES, e.g. CONVEYORS FOR LOADING OR TIPPING, SHOP CONVEYOR SYSTEMS OR PNEUMATIC TUBE CONVEYORS
    • B65G2203/00Indexing code relating to control or detection of the articles or the load carriers during conveying
    • B65G2203/02Control or detection
    • B65G2203/0208Control or detection relating to the transported articles
    • B65G2203/0233Position of the article
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B65CONVEYING; PACKING; STORING; HANDLING THIN OR FILAMENTARY MATERIAL
    • B65GTRANSPORT OR STORAGE DEVICES, e.g. CONVEYORS FOR LOADING OR TIPPING, SHOP CONVEYOR SYSTEMS OR PNEUMATIC TUBE CONVEYORS
    • B65G2203/00Indexing code relating to control or detection of the articles or the load carriers during conveying
    • B65G2203/04Detection means
    • B65G2203/041Camera
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B65CONVEYING; PACKING; STORING; HANDLING THIN OR FILAMENTARY MATERIAL
    • B65GTRANSPORT OR STORAGE DEVICES, e.g. CONVEYORS FOR LOADING OR TIPPING, SHOP CONVEYOR SYSTEMS OR PNEUMATIC TUBE CONVEYORS
    • B65G2203/00Indexing code relating to control or detection of the articles or the load carriers during conveying
    • B65G2203/04Detection means
    • B65G2203/042Sensors

Landscapes

  • Engineering & Computer Science (AREA)
  • Mechanical Engineering (AREA)
  • Warehouses Or Storage Devices (AREA)

Abstract

The invention is suitable for the technical field of handling equipment, and provides an intelligent handling device and method for visual control, wherein the intelligent handling device for visual control comprises: the loading and unloading box module is internally provided with an accommodating space and a goods shelf and is mainly used for storing goods; the visual module is used for acquiring the assembling position information and estimating the assembling position information through the data model; the assembly execution module is used for grabbing, transporting, adjusting the height and outputting goods; the position sensor is arranged on the assembly execution module and used for sensing the distance between the assembly execution module and the goods shelf and obtaining a measured distance; and the control unit is used for receiving the assembly position information, reasoning the assembly position information, acquiring an assembly target position, analyzing the measured distance and the assembly target position and correcting the measured distance and the assembly target position. The invention has the advantages that: the loading and unloading device has the advantages of accurate loading, high loading and unloading efficiency and good safety.

Description

Intelligent loading and unloading device and method for visual control
Technical Field
The invention belongs to the technical field of loading and unloading equipment, and particularly relates to an intelligent loading and unloading device and method for visual control.
Background
With the development of science and technology, the manufacturing industry and the transportation industry have been developed rapidly, the loading and unloading equipment is a common auxiliary device in the manufacturing industry, and at present, the loading and unloading equipment is basically controlled manually in a factory, and the loading and unloading of goods are realized by adjusting a loading and unloading vehicle. The loading and unloading work is usually repeated and simple operation, so that the attention of an operator is not concentrated, and further, the accuracy of the operation process is insufficient and the loading and unloading efficiency is low; meanwhile, the actual demand position and the loading and unloading position are inaccurate in the actual use process, and the randomness of operation is increased.
Disclosure of Invention
The embodiment of the invention aims to provide an intelligent loading and unloading device and method for visual control, and aims to solve the problem of insufficient precision.
The invention is thus realized, a vision-controlled intelligent handling device, comprising:
the loading and unloading box module is internally provided with an accommodating space and a goods shelf and is mainly used for storing goods;
the visual module is used for acquiring the assembling position information and estimating the assembling position information through the data model; the method comprises the steps of establishing point cloud data through stored digital position information on a cloud workshop map, and estimating assembly position information through comparing the stored map data;
the assembly execution module is used for grabbing, transporting, adjusting the height and outputting goods;
the position sensor is arranged on the assembly execution module, senses the distance between the assembly execution module and the goods shelf by utilizing a laser calibration technology and obtains a measured distance, namely the actual distance between the execution module and the goods shelf;
and the control unit is used for receiving the assembly position information, carrying out reasoning fitting on the assembly position information by utilizing the trained neural network, obtaining the assembly target distance, analyzing the measured distance and the assembly target position and correcting the measured distance and the assembly target position.
Another object of the present invention is to provide a vision-controlled intelligent loading and unloading method, including:
the method comprises the steps that firstly, a visual module acquires assembly position information on a loading and unloading box module, an assembly target point is calibrated, and an assembly position point, namely assembly position information, is estimated by using a least square method by using a stored cloud workshop map and combining position information between the target point and an execution module acquired by the visual module;
secondly, the control unit receives the assembly position information, performs rational fitting on the assembly position information by using the trained neural network, performs reasoning on the assembly position information and acquires an assembly distance;
step three, the control unit compares the estimated distance with the assembling distance;
step four, judging results are consistent, and controlling an assembly execution module to grab the goods;
fifthly, judging that the results are inconsistent, sensing the distance between the assembly execution module and the goods shelf by the position sensor to obtain a measured distance, correcting the position of an assembly target by the control unit through the measured distance, and controlling the assembly execution module to grab goods;
and step six, the assembly execution module moves the assembly target point and transfers and loads the goods into the loading and unloading box module.
The automatic grabbing, conveying and outputting are carried out through the assembly execution module, the automatic loading and unloading of goods are achieved, manual operation is avoided, the working efficiency is improved, goods damage caused by improper operation is avoided, and the loading and unloading safety is improved. The control unit is used for controlling and correcting the position, so that the loading accuracy is improved. The invention has the advantages that: the loading and unloading device has the advantages of accurate loading, high loading and unloading efficiency and good safety.
Drawings
FIG. 1 is a block diagram of a process for visually controlling an intelligent handler according to an embodiment of the present invention;
fig. 2 is a flowchart of a method for intelligent handling of visual control according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
Specific implementations of the present invention are described in detail below with reference to specific embodiments.
As shown in fig. 1, a flow chart of a visually controlled intelligent handling apparatus according to an embodiment of the present invention includes:
the loading and unloading box module is internally provided with an accommodating space and a goods shelf and is mainly used for storing goods;
the visual module is used for acquiring the assembling position information and estimating the assembling position information through the data model; the method comprises the steps of establishing point cloud data through stored digital position information on a cloud workshop map, and estimating assembly position information through comparing the stored map data;
the assembly execution module is used for grabbing, transporting, adjusting the height and outputting goods;
the position sensor is arranged on the assembly execution module, senses the distance between the assembly execution module and the goods shelf by utilizing a laser calibration technology and obtains a measured distance, namely the actual distance between the execution module and the goods shelf;
and the control unit is used for receiving the assembly position information, carrying out reasoning fitting on the assembly position information by utilizing the trained neural network, obtaining the assembly target distance, analyzing the measured distance and the assembly target position and correcting the measured distance and the assembly target position.
In the embodiment of the invention, a visual module is started to obtain the assembly position information on a loading and unloading box module, an assembly target point is calibrated, and the distance between an assembly execution module and the assembly target point is estimated; the control unit receives the assembly position information, infers the assembly position information to obtain an assembly target position, the position sensor senses the distance between the assembly execution module and the goods shelf and obtains a measured distance, the control unit analyzes and corrects the measured distance and the assembly target position and controls the assembly execution module to grab goods, and the assembly execution module moves an assembly target point and transfers and loads the goods into the loading and unloading box module.
As a preferred embodiment of the invention, the assembly execution module travels through the rail, so that the traveling stability of the assembly execution module is increased, the assembly execution module is convenient to grab and transfer and position, and the unsmooth operation caused by poor stability is avoided. The track is a ground type moving guide rail, so that the gravity is converted into friction force through assembling the execution module, and the walking stability is improved.
As a preferred embodiment of the present invention, the shelf is a truss type shelf, thereby increasing the amount of goods placed.
As a preferred embodiment of the present invention, the vision module includes a camera, a position calibration unit, and a position estimation unit; the camera shoots the goods shelf to obtain assembly position information, the assembly position information is transmitted to the position calibration unit, the position calibration unit calibrates the position of the goods shelf which is not loaded to obtain calibration position information, meanwhile, the calibration position information is sent to the position estimation unit, the position estimation unit estimates the calibration position information through the data model to obtain an estimated distance, and the estimated distance is the distance between the assembly execution module and the calibration position obtained through the position estimation unit.
As a preferred embodiment of the invention, the assembly execution module comprises a mechanical assembly vehicle, an automatic pushing unit and a mechanical lifting unit; the mechanical assembly vehicle is used for grabbing, transporting and outputting goods; the mechanical lifting unit is connected with the mechanical assembly vehicle and used for driving the assembly vehicle to lift; and the automatic pushing unit is used for driving the assembly execution module to walk. The goods are placed at the appointed position, the mechanical lifting unit drives the mechanical assembly vehicle to lift to enable the height of the mechanical assembly vehicle to be consistent with the goods, the mechanical assembly vehicle finishes grabbing of the goods, the automatic pushing unit drives the goods to move to the assembly target position, and the mechanical assembly vehicle finishes goods output and transfers the goods to the goods shelf. M in the attached drawings refers to the general name of a motor in the mechanical assembly vehicle and is the power output of the mechanical assembly vehicle.
As a preferred embodiment of the present invention, a distance sensor is provided on the assembly execution module, and the distance sensor is used to determine whether the assembly target position and the shelf are in the same straight line. If the goods are loaded on the same straight line, the goods are output, and if the goods are not on the same straight line, the adjustment is carried out.
As a preferred embodiment of the invention, the automatic pushing unit is provided with a rotating speed sensor, and the loading speed of the assembly execution module can be evaluated through the rotating speed sensor, so that the speed is limited before the assembly execution module reaches the assembly target position, the assembly time is shortened, and the accuracy of assembly positioning is improved.
As a preferred embodiment of the invention, the position sensor is a laser type position sensor, and the laser type position sensor is used for sensing the distance between the assembly execution module and the goods shelf, so that the sensing is accurate and the accurate positioning is convenient. The measured distance, namely the distance between the assembly execution module and the goods shelf is obtained through the induction of the position sensor, so that the accurate conveying distance is obtained. The measurement distance is a distance between the assembly execution module and the shelf, and the movement and the advancement of the assembly execution module can be corrected by measuring the distance.
As another preferred embodiment of the invention, the control unit comprises a working data storage unit, a knowledge base, an inference unit and a parameter correction unit; the working data storage unit is connected with the knowledge base, the working data storage unit transmits the assembling position information to the knowledge base, the knowledge base transmits the assembling position information to the reasoning unit, the reasoning unit analyzes the assembling position information according to the knowledge base data, the parameter correcting unit conducts reasoning on the analyzed assembling position information and obtains the assembling distance, the assembling distance is that the assembling position information is used as original data, the trained fuzzy neural network model is used for conducting reasoning on the knowledge base data so as to obtain the distance between the assembling execution module and the calibration position, and the intelligentization of assembling is achieved.
As shown in fig. 2, an embodiment of the present invention further provides a visually controlled intelligent loading and unloading method, including:
the method comprises the steps that firstly, a visual module acquires assembly position information on a loading and unloading box module, an assembly target point is calibrated, and an assembly position point, namely assembly position information, is estimated by using a least square method by using a stored cloud workshop map and combining position information between the target point and an execution module acquired by the visual module;
secondly, the control unit receives the assembly position information, performs rational fitting on the assembly position information by using the trained neural network, performs reasoning on the assembly position information and acquires an assembly distance;
step three, the control unit compares the estimated distance with the assembling distance;
step four, judging results are consistent, and controlling an assembly execution module to grab the goods;
fifthly, judging that the results are inconsistent, sensing the distance between the assembly execution module and the goods shelf by the position sensor to obtain a measured distance, correcting the position of an assembly target by the control unit through the measured distance, and controlling the assembly execution module to grab goods;
and step six, the assembly execution module moves the assembly target point and transfers and loads the goods into the loading and unloading box module.
The intelligent loading and unloading device based on visual control is provided, automatic grabbing, conveying and outputting are carried out through the assembly execution module, automatic loading and unloading of goods are achieved, manual operation is avoided, working efficiency is improved, goods damage caused by improper operation is avoided, and loading and unloading safety is improved. The control unit is used for controlling and correcting the position, so that the loading accuracy is improved.
The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents and improvements made within the spirit and principle of the present invention are intended to be included within the scope of the present invention.

Claims (10)

1. A visually controlled intelligent handling device, comprising:
the loading and unloading box module is internally provided with an accommodating space and a goods shelf and is mainly used for storing goods;
the visual module is used for acquiring the assembling position information and estimating the assembling position information through the data model;
the assembly execution module is used for grabbing, transporting, adjusting the height and outputting goods;
the position sensor is arranged on the assembly execution module and used for sensing the distance between the assembly execution module and the goods shelf and obtaining a measured distance;
and the control unit is used for receiving the assembly position information, reasoning the assembly position information, acquiring an assembly target position, analyzing the measured distance and the assembly target position and correcting the measured distance and the assembly target position.
2. The visually controlled intelligent handling device of claim 1, wherein the assembly execution module travels via a track.
3. A visually controlled intelligent handling device according to claim 2, wherein said track is a ground-based moving rail.
4. The intelligent handling device of claim 1, wherein the vision module comprises a camera, a position calibration unit, a position estimation unit; the camera shoots the goods shelf to obtain the assembly position information, and transmits the assembly position information to the position calibration unit; the position calibration unit is connected with the camera, calibrates the position of the unloaded goods shelf to obtain calibration position information, and simultaneously sends the calibration position information to the position estimation unit; the position estimation unit is connected with the position calibration unit and estimates the calibration position information through the data model.
5. The intelligent visually controlled loading and unloading device according to any one of claims 1 to 4, wherein the assembly execution module comprises an assembly vehicle unit, an automatic pushing unit and a lifting unit; the assembly vehicle unit is used for grabbing, transporting and outputting goods; the lifting unit is connected with the assembly vehicle unit and used for driving the assembly vehicle to lift; and the automatic pushing unit is used for driving the assembly execution module to walk.
6. The intelligent visually controlled loading and unloading device according to claim 1, wherein the assembly execution module is provided with a distance sensor for determining whether the assembly target position is in the same straight line with the shelf.
7. The intelligent visually controlled handling device of claim 1, wherein the automatic pushing unit is provided with a rotation speed sensor for transmitting speed data.
8. A visually controlled intelligent handling device according to claim 1, wherein said position sensor is a laser type position sensor.
9. A visually controlled intelligent handling device according to claim 1, wherein said control unit comprises a working data storage unit, a knowledge base, an inference unit, a parameter modification unit; the working data storage unit is connected with the knowledge base, the working data storage unit transmits the assembling position information to the knowledge base, the knowledge base transmits the assembling position information to the reasoning unit, the reasoning unit analyzes the assembling position information according to the knowledge base data, and the parameter correcting unit corrects the analyzed assembling position information.
10. A vision-controlled intelligent handling method is characterized by comprising the following steps:
starting a vision module to acquire assembling position information on a loading and unloading box module, calibrating an assembling target point, and estimating the distance between an assembling execution module and the assembling target point;
the control unit receives the assembly position information, and infers the assembly position information to acquire an assembly target position;
the position sensor senses the distance between the assembly execution module and the goods shelf and obtains a measured distance;
the control unit analyzes and corrects the measured distance and the assembly target position, and controls the assembly execution module to grab the goods;
and the assembly execution module moves the assembly target point and transfers and loads the goods into the loading and unloading box module.
CN202110520368.0A 2021-05-13 2021-05-13 Intelligent loading and unloading device and method for visual control Pending CN113247519A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110520368.0A CN113247519A (en) 2021-05-13 2021-05-13 Intelligent loading and unloading device and method for visual control

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110520368.0A CN113247519A (en) 2021-05-13 2021-05-13 Intelligent loading and unloading device and method for visual control

Publications (1)

Publication Number Publication Date
CN113247519A true CN113247519A (en) 2021-08-13

Family

ID=77181574

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110520368.0A Pending CN113247519A (en) 2021-05-13 2021-05-13 Intelligent loading and unloading device and method for visual control

Country Status (1)

Country Link
CN (1) CN113247519A (en)

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100121480A1 (en) * 2008-09-05 2010-05-13 Knapp Systemintegration Gmbh Method and apparatus for visual support of commission acts
CN104067182A (en) * 2011-09-09 2014-09-24 西姆伯蒂克有限责任公司 Storage and retrieval system case unit detection
CN108152823A (en) * 2017-12-14 2018-06-12 北京信息科技大学 The unmanned fork truck navigation system and its positioning navigation method of a kind of view-based access control model
CN207932436U (en) * 2017-12-08 2018-10-02 武汉万集信息技术有限公司 A kind of regional warehouse cargo accumulation statistical management device
CN109264275A (en) * 2018-09-20 2019-01-25 深圳蓝胖子机器人有限公司 Intelligent repository management method, device and storage medium based on robot
CN111301911A (en) * 2019-11-14 2020-06-19 广州键宇货架有限公司 Visual logic control method for stacker
CN111908155A (en) * 2020-09-10 2020-11-10 佛山科学技术学院 Automatic loading and unloading system of container robot
CN112027469A (en) * 2020-10-14 2020-12-04 河南中烟工业有限责任公司 Tunnel stacker and three-dimensional goods shelf space position monitoring system
CN112429456A (en) * 2020-11-20 2021-03-02 深圳市海柔创新科技有限公司 Exception handling method, device, equipment and system for goods taken out and storage medium

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100121480A1 (en) * 2008-09-05 2010-05-13 Knapp Systemintegration Gmbh Method and apparatus for visual support of commission acts
CN104067182A (en) * 2011-09-09 2014-09-24 西姆伯蒂克有限责任公司 Storage and retrieval system case unit detection
CN207932436U (en) * 2017-12-08 2018-10-02 武汉万集信息技术有限公司 A kind of regional warehouse cargo accumulation statistical management device
CN108152823A (en) * 2017-12-14 2018-06-12 北京信息科技大学 The unmanned fork truck navigation system and its positioning navigation method of a kind of view-based access control model
CN109264275A (en) * 2018-09-20 2019-01-25 深圳蓝胖子机器人有限公司 Intelligent repository management method, device and storage medium based on robot
CN111301911A (en) * 2019-11-14 2020-06-19 广州键宇货架有限公司 Visual logic control method for stacker
CN111908155A (en) * 2020-09-10 2020-11-10 佛山科学技术学院 Automatic loading and unloading system of container robot
CN112027469A (en) * 2020-10-14 2020-12-04 河南中烟工业有限责任公司 Tunnel stacker and three-dimensional goods shelf space position monitoring system
CN112429456A (en) * 2020-11-20 2021-03-02 深圳市海柔创新科技有限公司 Exception handling method, device, equipment and system for goods taken out and storage medium

Similar Documents

Publication Publication Date Title
US9333654B2 (en) Robot parts assembly on a workpiece moving on an assembly line
EP2718777B1 (en) Method for automatically calibrating vehicle parameters
CN109987550B (en) Calibration method and storage medium for high-position forklift and returning storage container
CN108344986B (en) Automatic verification system and verification method for handheld laser range finder
CN108007451B (en) Method and device for detecting position and posture of cargo carrying device, computer equipment and storage medium
CN108469826B (en) Robot-based map generation method and system
US20200150664A1 (en) Unmanned transport vehicle, method of controlling unmanned transport vehicle, and storage medium
KR101656105B1 (en) Unit for instrumenting tunel construction environment, management system with the unit, and method for controlling the system
CN110039539B (en) Method, computer readable medium and system for carrying operation based on automatic carrying trolley
CN116757350B (en) Unmanned forklift cluster scheduling processing system
EP3838767A1 (en) Damage assessment device for remote controlled inspection of aircrafts
CN108801653A (en) The evaluation tool of floor truck and the assessment method of floor truck
CN113247519A (en) Intelligent loading and unloading device and method for visual control
CN113203419A (en) Indoor inspection robot correction positioning method based on neural network
US20130205610A1 (en) Method and device for determining a lift height of a work machine
CN113601501B (en) Flexible operation method and device for robot and robot
CN118485846A (en) Image recognition-based freight car tail box residual volume calculation method and related equipment
CN215810959U (en) Non-contact equipment running state monitoring device
CN114739328A (en) Sensing device for measuring ground fluctuation and floor flatness measuring robot
CN109665468B (en) Forklift AGV fork lifting speed control method and device
KR20230034390A (en) Calibration of industrial vehicle distance and ranging devices
CN116972973B (en) Full-automatic space spectrum measuring device and method for luminous object
JP2022100437A (en) Information processing device, information processing method, program, and control system
CN217331071U (en) Sensing device for measuring ground fluctuation and floor flatness measuring robot
US11802948B2 (en) Industrial vehicle distance and range measurement device calibration

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20210813

RJ01 Rejection of invention patent application after publication