CN114803570A

CN114803570A - Method and device for determining material grabbing strategy, storage medium and electronic equipment

Info

Publication number: CN114803570A
Application number: CN202210413090.1A
Authority: CN
Inventors: 黄曙光; 杨新杭; 王汝贵; 方海涛; 杨涛
Original assignee: Beijing Huili Intelligent Technology Co ltd
Current assignee: Beijing Huili Intelligent Technology Co ltd
Priority date: 2022-04-20
Filing date: 2022-04-20
Publication date: 2022-07-29
Anticipated expiration: 2042-04-20
Also published as: CN114803570B

Abstract

The embodiment of the disclosure provides a method and a device for determining a material grabbing strategy, a storage medium and an electronic device, wherein the determining method comprises the following steps: determining characteristic information of the unloading ship based on the serial number of the unloading ship; acquiring a material loading state based on the characteristic information; and determining a grabbing strategy based on the material loading state. The embodiment of the disclosure can realize the full-automatic operation of unloading to the material on the cargo ship, especially can keep under the unchangeable condition of former operating system at the grab ship unloader, can be so that need not to be equipped with unnecessary operating personnel on the ship unloader, can be through setting up the task parameter at human-computer interface, issue the instruction of unloading, establish cabin and material heap distribution three-dimensional dynamic database through detection device automatic scanning, rely on intelligent algorithm, automatic control operates, can accurately snatch under the principle of guaranteeing hull safety balance, steady unloading, finally realize the operation of unloading under the full automatic control of intelligence.

Description

Method and device for determining material grabbing strategy, storage medium and electronic equipment

Technical Field

The present disclosure relates to the field of control technology for a dump truck, and in particular, to a method and an apparatus for determining a material grabbing strategy, a storage medium, and an electronic device.

Background

In the prior art, the unloading process of the materials in the cargo ship is often manually realized, and the full-automatic unloading of the materials cannot be realized.

Disclosure of Invention

In view of this, the embodiments of the present disclosure provide a method and an apparatus for determining a material grabbing policy, a storage medium, and an electronic device, so as to solve the problems in the prior art.

In one aspect, the present disclosure provides a method for determining a material grabbing strategy, including: determining characteristic information of the unloading ship based on the serial number of the unloading ship; acquiring a material loading state based on the characteristic information; and determining a grabbing strategy based on the material loading state.

In some embodiments, the obtaining the material loading state based on the characteristic information includes: determining a discharging range based on the characteristic information; acquiring material loading information based on the unloading range; determining a material loading state based on the material loading information.

In some embodiments, the determining a grabbing strategy based on the material loading state includes: determining an optimal target position based on the material loading state; and determining a grabbing track and a returning track based on the optimal target position.

In some embodiments, the optimal target position is determined by: performing digitalization and discretization processing on the stock pile model, and cutting the whole stock pile based on an independent minimum cell; under the principle of ensuring the balance of the ship body, quickly and automatically sequencing all the cells, and recommending a cell group with the highest unloading efficiency as an optimal target position for grabbing by the grab bucket; and automatically updating the shape of the material pile after each grabbing, and recommending the next optimal target position according to the updated shape of the material pile.

In one aspect, the present disclosure provides a device for determining a material grabbing strategy, including: the characteristic determining module is used for determining characteristic information of the unloading ship based on the serial number of the unloading ship; the acquisition module is used for acquiring the material loading state based on the characteristic information; and the strategy determining module is used for determining a grabbing strategy based on the material loading state.

In some embodiments, the obtaining module comprises: the range determining unit is used for determining the unloading range based on the characteristic information; the obtaining unit is used for obtaining material loading information based on the unloading range; and the state determining unit is used for determining the material loading state based on the material loading information.

In some embodiments, the policy determination module comprises: a position determination unit for determining an optimal target position based on the material loading state; and the track determining unit is used for determining a grabbing track and a returning track based on the optimal target position.

In some embodiments, the optimal target position is determined by: performing digitalization and discretization processing on the stock pile model, and cutting the whole stock pile based on an independent minimum cell; under the principle of ensuring the balance of the ship body, quickly and automatically sequencing all the cells, and recommending a cell group with the highest unloading efficiency as an optimal target position for grabbing by the grab bucket; and automatically updating the shape of the material pile after finishing grabbing each time, and recommending the next optimal target position according to the updated shape of the material pile.

In one aspect, the present disclosure provides a storage medium storing a computer program, wherein the computer program is configured to implement the steps of any one of the above methods when executed by a processor.

In one aspect, the present disclosure provides an electronic device, at least comprising a memory and a processor, wherein the memory stores a computer program, and wherein the processor implements the steps of any one of the above methods when executing the computer program on the memory.

The embodiment of the disclosure can realize the full-automatic unloading operation of materials on a cargo ship, especially can keep under the unchangeable condition of former operating system at the grab ship unloader, establish remote control center through setting up the cooperation of full-automatic control unit in the well control room on ground, can make need not to be equipped with unnecessary operating personnel on the ship unloader, can be through setting up the task parameter at human-computer interface, give the ship unloading instruction, establish cabin and stockpile distribution three-dimensional dynamic database through detection device automatic scanning, rely on intelligent algorithm, automatic control operates, can accurately snatch under the principle of guaranteeing hull safety balance, steady unloading, finally realize the ship unloading operation under the full-automatic control of intelligence.

Drawings

In order to more clearly illustrate the embodiments of the present disclosure or the technical solutions in the prior art, the drawings used in the embodiments or the description of the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments described in the present disclosure, and for those skilled in the art, other drawings may be obtained according to the drawings without creative efforts.

Fig. 1 is a schematic structural view of a ship unloader according to an embodiment of the present disclosure;

FIG. 2 is a schematic structural view of a ship unloader of an embodiment of the present disclosure;

fig. 3 is a schematic structural view of a cargo ship according to an embodiment of the present disclosure.

Detailed Description

In order to make the objects, technical solutions and advantages of the embodiments of the present disclosure more clear, the technical solutions of the embodiments of the present disclosure will be described below clearly and completely with reference to the accompanying drawings of the embodiments of the present disclosure. It is to be understood that the described embodiments are only a few embodiments of the present disclosure, and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the described embodiments of the disclosure without any inventive step, are within the scope of protection of the disclosure.

Unless otherwise defined, technical or scientific terms used herein shall have the ordinary meaning as understood by one of ordinary skill in the art to which this disclosure belongs. The use of "first," "second," and similar terms in this disclosure is not intended to indicate any order, quantity, or importance, but rather is used to distinguish one element from another. The word "comprising" or "comprises", and the like, means that the element or item listed before the word covers the element or item listed after the word and its equivalents, but does not exclude other elements or items. The terms "connected" or "coupled" and the like are not restricted to physical or mechanical connections, but may include electrical connections, whether direct or indirect. "upper", "lower", "left", "right", and the like are used merely to indicate relative positional relationships, and when the absolute position of the object being described is changed, the relative positional relationships may also be changed accordingly.

To maintain the following description of the embodiments of the present disclosure clear and concise, a detailed description of known functions and known components have been omitted from the present disclosure.

A first embodiment of the present disclosure relates to a discharging system for performing a discharging operation, and fig. 1 to 2 show a schematic structural view of the discharging system of the embodiment of the present disclosure, which is installed on, for example, a ship unloader 100, the ship unloader 100 being used to grab a material, such as coal, in a hold 201 of a cargo ship 200 into a cargo tank outside the cargo ship 200. The ship unloader 100 herein is generally provided on a quay where the ship 200 is docked, and the ship 200 is stably held at the side of the ship unloader 100 while the unloading work is performed by the unloading system. Furthermore, the hold 201 here may comprise one or more bays 202, the material being stored in part or all of the bays 202, the material being in the form of a pile in the bays 202.

Specifically, as shown in fig. 1 and 2, the discharging system herein includes an executing device 10, a detecting device 20, and a control device 30, the executing device 10 includes a first track 1, a cart 11 is disposed on the first track 1, and the cart 11 can move on the first track 1 in a first direction, which is shown by an arrow in fig. 2 and is the same as the moving direction of the cargo ship 200; the cart 11 is provided with a cross beam 14, the cross beam 14 is provided with a second rail 2, and the directions of the second rail 2 and the first rail 1 are perpendicular to each other.

Further, a trolley 12 is arranged on the second track 2, and the trolley 12 can move on the second track 2 along a second direction which is perpendicular to the first direction; a grab bucket 13 is arranged on the trolley 12, the trolley 12 is connected with the grab bucket 13 through a steel wire rope 131, and the grab bucket 13 is used for grabbing materials in the cabin 202. In this way, after the cargo ship 200 is moved to a predetermined position on the quay side, the cargo ship 200 is kept vertically below the second rail 2 while performing the unloading work by the movement of the cart 11 on the first rail 1, so that the cart 12 reciprocates and performs the work of grabbing the materials in the different bays 202 by the grapple 13.

In addition, in order to avoid collision between the trucks 11 in different ones of the ship unloaders 100 on the rails, a collision prevention device, such as a crash bar, and/or a limit device is provided at the bottom of the truck 11 of each of the actuators 10, thereby achieving collision prevention protection.

In order to accurately detect the position of the cart 11 on the first track 1, an absolute value encoder module and a PLC network communication interface module are provided on the cart 11, and the real-time position of the cart 11 of the ship unloader 100 is transmitted to the control device 30 through the PLC network communication interface module.

Further, RFID verification devices are arranged on the cart 11 and the first track 1, and real-time position data of the cart 11 is accurately corrected through the RFID verification devices. In another embodiment, a collision avoidance sensor is provided on the cart 11 of the ship unloader 100, which acquires a signal and can transmit the signal to the control device 30 to perform a collision avoidance function with the cart on the same track.

Further, the detecting device 20 includes a first detecting device 21 and a second detecting device 22, the first detecting device 21 is disposed on the second rail 2 of the cart 11, and the second detecting device 22 can be disposed at a plurality of predetermined positions, such as the front or rear of the cart 11, the middle of the second rail 2, the upper side of the grab bucket 13, and the like. The control device 30 includes a first control device 31 and a second control device 32 which are connected to each other in a communication manner, the first control device 31 is provided on the cart 11, for example, in a cab on the cross member 14 of the cart 11, and the second control device 32 is provided in a center control room on the ground, for example. The control device 30 may be connected to a control system of the ship unloader 100, and a database may be provided in the control system of the ship unloader 100, and the control system may be, for example, a PLC control system.

In particular, the first detecting device 21 may be a high-precision laser radar, so that, by installing, for example, a high-precision laser radar on the cart 11 of the ship unloader 100, a flat scanning operation may be started on the cargo hold 201 of the cargo ship 200 and the material in the space 202 in the cargo hold 201 before the unloading operation, so that the material in the cargo hold 201 and the space 202 is scanned by the movement of the cart 11. In addition, during each time when the grabbing operation of the grab bucket 13 is completed and the ship is out of the cabin 201, the first detection device 21 can start a transfer mode, acquire image data of the pile profile of the grabbed material, update the image data into the database, automatically analyze the updated pile profile, and immediately generate the next target position grabbed by the grab bucket 13.

The second detecting device 22 is mainly used for implementing a video monitoring auxiliary function under a fully automatic condition, and may be, for example, a component of a video monitoring system of the ship unloader 100, and in one embodiment, the second detecting device 22 may be, for example, a high-definition camera device, which is disposed at a middle portion of the cross beam 14 of the cart 11, above the grab bucket 13, at two ends of the cross beam 14, and the like, and may transmit a collected video signal to the control device 30, specifically, the video signal may be transmitted to the first control device 31 located in the cab and the second control device 32 located in the central control room by means of an optical fiber or a wireless ethernet, so as to be displayed on corresponding monitoring screens.

The second detecting device 22 located at different positions herein can implement various monitoring functions, for example, a high-definition camera device can be disposed at the center position of the cross beam 14 of the cart 11, that is, above the grab bucket 13, and the relative displacement between the hull and the dock of the cargo ship 200 and the full-load condition of the discharge bucket during the unloading process can be intelligently sensed by using an image recognition technology based on machine vision, so as to provide safety for the full-automatic unloading. In addition, high-definition high-speed cameras can be arranged at two ends of the cross beam 14 on the cart 11, so that the pictures collected by the cameras can cover the whole process of the movement of the grab bucket 13. The image recognition technology based on machine vision can be adopted to capture the position and form change of the grab bucket 13 in images and videos, so that the three-dimensional posture of the grab bucket 13 can be known in real time, and front-end data can be provided for the grab bucket posture sensing and the anti-collision cabin.

A second detecting device 22 may be further disposed above the grab bucket 13, for example, a lithium battery may be used to supply power, so as to detect the position and the posture of the grab bucket, and after the second detecting device 22 obtains the position or the posture information of the grab bucket 13, the real-time coordinate position of the grab bucket 13 may be provided to the control device 30 in a wireless communication manner, so as to monitor the safety of the grab bucket in an automatic operation state.

Further, the first control device 31 is configured to implement three-dimensional imaging and modeling based on the acquired stock pile profile information of the material; in the process of realizing three-dimensional imaging, the material pile of the material can be separated from the cabin 201 through analysis and calculation, and an optimized ship unloading strategy can be formed according to a continuous material taking strategy algorithm. The second control device 32 can be arranged on the ground in the central control room, so that not only can maintenance engineers monitor and maintain the intelligent full-automatic system, but also a user can set parameters of the full-automatic ship unloader on an operation terminal to monitor the full-automatic operation of the ship unloader 100.

As described above, the first control device 31 and the second control device 32 are communicatively connected to each other, and specifically, the second control device 32 as a data and control information exchange platform may establish a control signal communication network and a video communication network with the first control device 31 located in a cab, for example, by using a high-speed wireless gateway, thereby realizing reliable communication with high bandwidth and low latency. For this purpose, a data interface software architecture with bidirectional communication and seamless connection may be provided between the first control device 31 and the second control device 32, where the first control device 31 may be an operation terminal used by an operator to set parameters and display an interface, the communication content mainly includes interface parameter input, process start/stop, data display, and the like, and does not involve control requiring high real-time performance such as main mechanism logic control, and the like, and the main mechanism motion control is still in the second control device 32 located in a central control room; the second control device 32 at least includes a main control unit for full-automatic control, and may further include a client, so that the main control unit and the client use an optical fiber communication mode, and still use a heartbeat detection mode, and as long as communication abnormality is found, the main mechanism will be stopped within 100ms, thereby ensuring safety.

Further, the control device 30 further includes communication modules respectively provided in the first control device 31 and the second control device 32, which utilize high-speed network communication to establish a high-speed reliable communication link between the first control device 31, the second control device 32 and the control system of the ship unloader 100. In this way, a communication module of an industrial high-speed network is used to establish a high-speed reliable communication link between the control device 30 and the control system of the ship unloader 100, which is used as a data and control information exchange platform, and a high-speed wireless gateway is used to respectively establish a control communication network and a video communication network between the first control device 31 and the second control device 32, so as to realize reliable communication with high bandwidth and low time delay.

Further, in some embodiments, the communication between the first control device 31 located in the cab and the second control device 32 located in the central control room is implemented in two ways, the first way is, for example, to lay optical cables between the ground connection box of the dock where the ship unloader 100 is installed and the cab, and to wind the optical fiber channel in the cable by using the original upper machine of the ship unloader 100, so as to implement the optical fiber communication between the second control device 32 located on the ground and the first control device 31 located in the cab; and the second method utilizes a pre-established 5G communication network to realize 5G high-speed reliable communication by adding a 5G gateway and related communication equipment. The above two communication modes are mutually standby schemes.

Further, in order to fully utilize the characteristics of lower delay rate and higher safety of the 5G technology and ensure the timeliness and reliability of mass data transmission, the communication content between the first control device 31 and the second control device 32 located in the ground central control room can be classified according to video monitoring data, machine vision data and control data, and divided into three independent network segments, and independent 5G communication gateways are adopted for respective transmission, so that the transmission rate and the transmission quality are improved to the maximum extent.

By adopting the above discharging system, a second embodiment of the present disclosure provides a discharging method, which may adopt, for example, the discharging system of the first embodiment, including:

s101, determining characteristic information of the unloading ship based on the number of the unloading ship.

In this step, the characteristic information of the discharge vessel is determined based on the number of the discharge vessel. Specifically, when the discharge ship 200 is parked at a predetermined position of a dock, the feature information of the discharge ship 200 in the database of the control device 30 can be retrieved by acquiring the serial number of the discharge ship 200, where the serial number of the discharge ship 200 and the feature information of the discharge ship 200 have a corresponding relationship; the number may be, for example, a ship board number or other number for identifying the discharge ship 200, and the characteristic information may be, for example, information such as the type of the discharge ship 200, the size of the discharge ship 200, the position and size of the hold of the discharge ship 200, the number of the slots 202 in the hold 201 of the discharge ship 200, and the like.

Furthermore, after the discharge vessel 200 is docked at a predetermined position at a dock, the discharge system can also automatically perform parameter initialization operations, including, for example, correcting position encoders and the like of the cart 11 and the cart 12 so as to confirm the position of the discharge vessel 200, and the detection device 20 can intelligently review the hull and cabin parameters of the discharge vessel 200 by performing automatic scanning on the discharge vessel 200.

And S102, acquiring a material loading state based on the characteristic information.

After determining the characteristic information of the discharge ship based on the number of the discharge ship in the above step S101, in this step, the material loading state is acquired based on the characteristic information. The material loading state here refers to a state of the bunk 202 of the discharge vessel 200 docked at a quay, which is loaded with material, and a state of material stacking therein. Specifically, the method comprises the following steps:

s201, determining a discharging range based on the characteristic information.

In this step, first, the discharge range is determined based on the characteristic information. Specifically, after acquiring characteristic information such as the size information of the discharge ship 200 and the cabin 201 and the berth 202 of the discharge ship 200, the first detection device 21 is controlled to perform a preliminary scan on the cabin range of the discharge ship 200 to determine the discharge range. The first detecting means 21 may be a laser radar. For example, end position information of the hold 201 of the discharge ship 200 may be acquired based on the characteristic information, and the movement of the cart 11 and the cart 12 is controlled to perform a preliminary scan of the hold 201 portion of the discharge ship 200.

After the preliminary scanning is finished, for example, it may be default that all the slots 202 of the hold 201 loaded with materials belong to the unloading range; of course, the unloading vessel 200 and the schematic diagram of the cabin 201 therein may also be displayed in real time on the human-computer interface of the control device 30, and the user may also determine the unloading range in the schematic diagram, that is, the space 202 where the material is scanned or the scanning range. The discharge range is used for depth scanning to obtain loading information of the material.

In this step, the user can also load the current unloading task. For example, a user can input task data such as a to-be-unloaded cabin space, unloading depth and the like in an interface, issue an unloading instruction in a manual confirmation mode, and start automatic unloading work; for the working condition that multiple machines unload the same ship, the current real-time residual material amount in the cabin 201 can be displayed on a human-computer interface to be used as a decision basis for an operator to manually and automatically coordinate ship unloading scheduling.

And S202, acquiring material loading information based on the unloading range.

After the discharging range is determined based on the characteristic information in the above step S201, the material loading information is acquired based on the discharging range in this step. Specifically, after the discharging range is determined, that is, after the range in which depth scanning is required is determined, i.e., after information such as a start point and an end point of depth scanning is determined, the cart 11 is controlled to automatically run from the start point to the end point of the discharging range for depth scanning. The formation of the travel path can be implemented in any manner.

During the depth scanning, the first detecting device 21 on the cart 11 starts a flat scanning mode to depth-scan the hold 201 in the discharging range of the discharging ship 200 therebelow to obtain the material loading information on the discharging ship 200; the scanning result is represented in the form of point cloud data, and the point cloud data reflects the material loading information.

However, in some embodiments, considering that in severe environments such as a heavy dust concentration, a heavy charcoal moisture, or a rain and fog weather in the cabin of the offloading vessel 200, dust particles, fog drops, water drops, etc. may cause a large interference to the measurement results of, for example, the lidar, in this step, an effective data processing algorithm may be employed to minimize the interference, "ignore" the influence of particles of a small size, and outline the real cabin and stockpile behind the dust, rain, or fog curtain.

In some embodiments, it is considered that the radar can provide very accurate measurement results when weather and environmental conditions are good, but in severe environments such as dusty, humid, rainy days, dust particles, fog drops, water drops and the like can cause great interference to the measurement results of the radar. Dust particles, fog drops, raindrops and the like can be displayed in the continuously changing point cloud data formed by scanning of the laser radar, and the random position and form cause high requirements on a filtering and denoising algorithm. Therefore, a radar data processing algorithm is executed aiming at the point cloud data so as to cope with severe environment influences such as material carbon dust, rain, fog, humid climate and the like, and the method comprises the following steps:

(1) acquiring point cloud data representing material loading information;

(2) and processing the point cloud data by adopting a median filtering algorithm and combining a Gaussian filtering algorithm to obtain a window output value.

Firstly, processing the point cloud data by adopting a median filtering algorithm and a Gaussian filtering algorithm, mainly replacing a value of a sequence center position of the point cloud data with a median, sequencing all data in a window in a preset direction, or arranging the data in an ascending order or a descending order, taking a value in the middle after sequencing as an output value of the window, wherein a value finally applied by the median filtering is a statistical median of all the data, and can eliminate a relatively sharp value in the data, the Gaussian filtering replaces a value of a data point with a weighted average of the point and n data points before and after the point, and takes points far greater than a position distance as fixed end points, so that gaps and end points can be more clearly identified, and the Gaussian filtering can better keep the original appearance of the data.

In order to obtain the optimal linear filter parameter, a wiener filter algorithm may be used to obtain the optimal linear filter parameter based on the minimum mean square error and the minimum mean square error between the output signal of the filter and the desired target signal.

(2) And denoising the window output value, and performing intelligent contour compensation on the point cloud data.

In the step, the system also adopts an average curvature flow filtering algorithm to carry out denoising processing, and carries out intelligent contour compensation on the current point cloud data according to the preorder historical data, so that the contour drawing achieves the optimal smooth and continuous effect. The intelligent screening and compensation algorithms such as effective correlation filtering and contour compensation are adopted to reduce interference to the minimum degree, particles with small sizes are ignored, and the real material contour behind dust, rainwater or a fog curtain is described.

Further, the cabin and the material can be effectively distinguished by processing point cloud data acquired by a laser radar. With the floating of the ship body of the unloading ship 200 in the unloading process, the position change and material shape discrimination of the cabin 201 can be effectively solved. The point cloud data formed by the laser radar comprises data of a cabin profile and a material pile distribution profile, and if the cabin profile and the material pile distribution profile cannot be effectively distinguished and stripped, the grab bucket 13 cannot be guided to accurately work, and even collision danger is caused.

Therefore, in the unloading process, due to the reduction of the materials in the cabin 201 and the influence of the rising tide and the falling tide, the ship body can incline or float, in this case, the influence of the floating of the cabin must be offset, the profile data of the material pile distribution is compensated in real time, for this reason, in the unloading process, due to the reduction of the materials in the cabin 201 and the influence of the rising tide and the falling tide, the ship body can incline or float transversely and longitudinally, the characteristics of the deck and the hatch of the cabin are extracted from the point cloud data, the real-time accurate position of the hatch is obtained, the automatic compensation of the hatch position is realized in the dynamic unloading, and an optimized differential algorithm is specifically adopted to realize the automatic compensation, and the method specifically comprises the following steps:

(1) extracting cabin features from the point cloud data; wherein, the cabin features include, for example, the rib features of the sea side or land side of the unloading ship 200 and the effective features of the deck that are clearly different from the material pile in the cabin, such as the rib presents a straight, continuous and regular profile feature; or the deck presents a smooth, flat, continuous profile feature; the method can also comprise the characteristics of the association relationship between the two profiles, the height position relationship and the like.

(2) According to the cabin characteristics, separating point cloud data corresponding to the materials and the cabin; specifically, after the scanning result in the unloading range is obtained, the scanning result includes point cloud data, and an effective data processing algorithm can be adopted to separate a cabin area from a material area in the point cloud data, so that the distribution condition of the material in the cabin 201 is accurately obtained, and the fluctuation change condition of the material pile in the cabin 201 can be provided in the form of a graphic image to realize a quick visualization effect. The existing software is utilized to realize effective stripping of state characteristics of point cloud data of different objects such as distribution of bulk cargo materials in the cabin, hatches and ship sides and the like based on cabin characteristics.

(3) Acquiring the three-dimensional position of a cabin hatch, and realizing automatic compensation of the hatch position; specifically, after the material pile and the hull part are stripped through software in shape characteristics, for example, the three-dimensional position of the cabin hatch, including the horizontal position, the height and the like of the side, can be monitored in real time through real-time scanning data of the laser radar, and then automatic compensation of the hatch position is realized in dynamic ship unloading (for example, when the hull height changes, the compensation value can be a change value of the hull height), so that effective data support is provided for control of the grab ship unloader.

S203, determining the material loading state based on the material loading information.

After the material loading information is obtained in step S202, a three-dimensional mathematical model of the distribution of the hold 201 and the material pile, that is, a pile model, is automatically constructed by the control device 30. The most important thing in the windrow model here is the establishment of the coordinate system. For example, the bridge grab ship unloader has high efficiency and high mechanism speed, and can be regarded as a complex control system. The automatic control logic of the grab bucket of the original PLC system has strong speciality, and has the independence and the practicability of the basic functions when being used as the basic execution software of the grab bucket motion. The software function of the intelligent control system based on the artificial intelligence technology needs to perform a large amount of calculation and data processing, and also needs to establish a coordinate system based on a three-dimensional space to guide each mechanism to operate according to the coordinates and paths given by the software.

Therefore, the main mechanism position coordinate system, the actuator position coordinate system and the scanning contour coordinate system of the ship unloader 100 are combined into one to form a three-dimensional coordinate system under a full-automatic control system. The accurate positioning and real-time software and hardware correction functions of the encoders of the executing mechanisms (such as the grab bucket lifting, opening and closing, a trolley and a cart) of the grab ship unloader are important foundations for the safe and stable operation of the grab ship unloader, and the unification of the coordinate systems of the position of the main mechanism and the position of the action executing mechanism of the ship unloader lays a software foundation for the anti-collision of the grab bucket and the material spreading baffle.

The ship unloader 100 can accurately control the lifting, opening and closing and trolley mechanisms to execute the motions of quick alignment, grabbing and the like on a target material pile according to the target position coordinate of the falling hopper generated in real time, and meanwhile, the running curve of the grab bucket avoids the danger of collision with a cabin, a discharge hopper of the ship unloader and an auxiliary device. The accurate positioning of each motion executing mechanism and the scanning contour target point is closely related to the normalization processing of each coordinate system, so that the high-reliability automatic control of the whole ship unloading process can be realized under the three-dimensional coordinate system of the normalized intelligent control system.

S103, determining a grabbing strategy based on the material loading state.

After the material loading state is obtained based on the characteristic information through the above step S102, a grasping strategy is determined based on the material loading state in this step. Specifically, when the unloading system automatically unloads the ship in the intelligent control mode, on one hand, the gravity center of the material pile in the cabin is always kept at the centers of the longitudinal axis and the transverse axis of the ship body so as to keep the balance of the ship body, and on the other hand, the unloading efficiency is improved as much as possible. Therefore, the principle of determining the full-automatic grabbing strategy in the step is that the position with the highest unloading efficiency can be automatically found to grab on the basis of ensuring the balance of the ship body or the maximum grabbing amount of each bucket is realized on the premise of ensuring the safe lifting amount.

S301, determining an optimal target position based on the material loading state.

In this step, first, an optimal target position is determined based on the material loading state. The optimal target position refers to the optimal bucket falling position of the grab bucket 13 each time, and the determination of the optimal target position is realized by the following steps:

(1) firstly, performing digitalization and discretization processing on a stock pile model, and cutting the whole stock pile based on an independent minimum cell;

(2) under the principle of ensuring the balance of the ship body, the system quickly and automatically sequences all the cells, and recommends a cell group with the highest unloading efficiency as the optimal target position for grabbing by the grab bucket;

(3) and after each hopper is grabbed, automatically updating the shape of the material pile, and recommending a new optimal target position according to the updated shape of the material pile.

S302, determining a grabbing track and a returning track.

The essence of the fully automatic control of the grabbing by the grab bucket 13 of the ship unloader 100 is that the grab bucket 13 and other mechanisms can be precisely controlled to perform the positioning, grabbing and other movements on the target pile according to the calculated coordinates of the optimal target position, where the coordinate systems of the dock, the fixed facilities of the ship unloader 100 and the like, and the executing mechanisms (such as a trolley, a cart and the like) of the ship unloader 100 and the scanning target (the cabin and the pile of the ship unloader 200) are strictly unified.

Considering that the ship type of the unloading ship 200 is a sea ship, it is characterized by a small hatch and a large belly. In order to reduce the workload of cleaning the cabin, the dynamic cabin-taking function of the grab bucket can be realized, namely, the grab bucket 13 goes deep into the inner side of the hatch deck to grab materials. In this step, the grabbing track and the returning track of the grabbing head 13 need to be determined, that is, the speed of the cart 11 and the speed of the trolley 12 are accurately controlled by using a specific algorithm, so that the grabbing bucket 13 is controlled to fall on the material surface of the concave part in the cabin in the bucket falling process of the grabbing bucket 13, and meanwhile, the damage caused by collision between the steel wire rope 131 and the hatch is avoided as much as possible; meanwhile, after the grab bucket is closed, the grab bucket 13 is moved away from the concave position of the cabin along with the movement of the trolley 12, and after the grab bucket is opened upwards, the grab bucket 13 is restrained from shaking and is slowly lifted, so that the grab bucket is effectively prevented from hooking a hatch in the lifting process.

During normal ship unloading, the grab bucket always keeps a certain safety distance from the edge of the hatch cover of the inner cabin, and the grab bucket is grabbed in a yellow square frame shown in the following figure so as to avoid collision with the cabin and the hatch cover. After the grab bucket is closed, the grab bucket is lifted from the cabin, and can return to the upper part of the grab bucket 13 along a return track calculated in real time (the return process is the same), the running tracks all follow the calculated envelope curve, and the envelope curve keeps a certain safety distance from the spreading baffle, so that the grab bucket 13 is ensured not to collide with the spreading baffle at any time. The machine vision gesture recognition function of the grab bucket 13 simultaneously has intelligent recognition of the ship side and the hatch, and the anti-collision of the grab bucket and the ship side is guaranteed.

The unification of the coordinate systems of the positioning of the actuators (such as a cart, a trolley, etc.) and the contour positioning of the material of the ship unloader 100 herein lays a foundation for the collision prevention of the grab bucket and the ship hull facility.

In addition, in the process of full-automatic ship unloading, as the weight and the buoyancy of the ship body continuously obtain new balance, the ship body may generate irregular displacement (outward movement or deflection) between wharfs due to the tension change of the cable, and the displacement of the ship body exceeds a certain threshold value, so that the judgment logic of a software grabbing point is wrong, and the automatic flow of the system is influenced. The system adopts an image recognition technology based on machine vision, collects the characteristics of the ship body and the wharf edge in the image and realizes the real-time perception of the ship body deviation condition.

In another embodiment, a method for gripping a material is provided, comprising:

s401, responding to the grabbing request, and executing grabbing operation based on the material loading state and the grabbing strategy.

After determining the grabbing strategy based on the material loading state through the above step S103, in this step, in response to a grabbing request, a grabbing operation is performed based on the material loading state and the grabbing strategy. In particular, there are two different offloading strategies with different emphasis points: the method comprises the following steps of balancing a priority strategy and an efficiency priority strategy, allowing a user to select according to requirements before ship unloading, and finally realizing an intelligent layered and separated stack continuous grabbing strategy considering safety and grabbing efficiency, wherein the method specifically comprises the following steps:

s402, acquiring real-time material loading state and grab bucket attitude information.

In the step, the real-time material loading state and the posture information of the grab bucket are obtained in real time. After the grabbing operation is started, the cart 11 automatically moves to the first position of the cabin 201 to be unloaded, the trolley 12 is automatically controlled to move to the second position, and the grab bucket 13 is controlled to lift according to a preset grabbing track, and the opening and closing mechanism moves to the optimal target position to grab materials; after closing the bucket, the grab bucket 13 automatically returns to the discharge bucket along the return track for discharging. In the process, the second detection device 22 obtains the real-time material loading state and the posture information of the grab bucket 13.

For example, a high-definition high-speed camera is installed at a specific position of a ship unloader, and the picture of the camera covers the whole process of the movement of the grab bucket. The system adopts an image recognition technology based on machine vision to capture the characteristics and posture changes of the grab bucket 13 in images and videos, so that the system can know the three-dimensional posture of the grab bucket 13 in real time and provide front-end data for the posture perception of the grab bucket 13 and the anti-collision cabin.

In addition, in the process of full-automatic ship unloading, as the weight and the buoyancy of the ship body constantly obtain new balance, the ship body may generate irregular displacement (outward movement or deflection) between wharfs due to the tension change of the cable, and the displacement of the ship body beyond a certain range causes danger to the full-automatic ship unloading. The system is provided with a high-definition camera on a girder above the wharf edge, and the real-time sensing of the situations of translation, deflection and the like of a ship body is realized by adopting an image recognition technology, so that the ship body is submitted to main control processing.

During full automatic unloading, the discharge hopper of the grab ship unloader is full, and the grab bucket 13 must stop discharging. The system is provided with a high-definition camera, for example, on the cross beam 14 above the discharge hopper, and the intelligent sensing under the working condition that the stored material of the hopper is higher than the grid plate is realized by adopting the image recognition technology and is transmitted to the control device 30 for processing.

And S403, updating the grabbing strategy according to the real-time material loading state and the posture information of the grab bucket.

In this step, during each unloading of the grab bucket 13 from the hold 201, the first detection device 21, for example, a laser radar, starts a sweep mode, and the profile of the pile just after grabbing is updated to the database; and automatically analyzes and generates the next optimal target position grabbed by the grab bucket 13.

Further, for example, after the height of the front material pile is grabbed to be lower than the set height parameter, the cart 11 automatically moves to another position for automatic allocation to continue automatic grabbing and discharging, and in this way, the full-automatic process is ended until the material level of the whole cabin 201 is discharged to the set final discharging depth.

The full-automatic ship unloading mode of this embodiment has proposed higher requirement to the operation gesture monitoring of grab bucket 13, namely when automatic grab material operation, in case grab bucket 13 takes place "fall fight", "twists reverse" phenomenon such as, causes easily wire rope 131 appears the hook bucket body, grab bucket 13 mentions back harmful phenomena such as rock from side to side, easily arouses grab bucket 13 wipes the danger of bumping the discharge hopper barricade. Therefore, two reliable grab bucket attitude detection means can be provided, including grab bucket three-dimensional attitude calculation based on the inertial navigation principle and grab bucket skeleton contour image recognition based on machine vision, and the two are redundant, so that the attitude of the grab bucket is accurately detected in real time, the swing is eliminated in real time, and high-reliability grab bucket closed-loop automatic control is realized.

Further, the connection between the trolley 12 and the grab bucket 13 of the ship unloader 100, for example, in the form of a bridge grab bucket, using the wire rope 131 has flexibility and non-linearity, which causes wind and wave interference in the port to cause certain uncertainty. In the process of grab operation, due to the disturbances caused by the acceleration and deceleration of the trolley 12, the lifting and descending of the grab 13, the wind force action, the friction of the steel wire rope 131 and the like, the swing of the grab 13 is caused, so that the uncontrolled swing of the grab 13 seriously affects the improvement of the operation efficiency; on the other hand, the swing of the grab bucket 13 also increases the structural load of the ship unloader 100, so that the structural fatigue is accelerated, and potential safety hazards are easily generated. However, the manual sway reduction effect is heavily dependent on the personal skills of the operator; in the fully automatic mode of operation, this requires the grab bucket 13 to fall precisely at the optimal target position on the pile and to go back and forth between the unloading of the grab bucket 13 and the target position generated immediately with the grabbing trajectory and the fastest speed. For the actual requirements of the grab bucket 13 on complex swing working conditions and the guarantee of ship unloading efficiency, for this purpose, fast algorithms such as speed and position preview following are adopted to realize the whole-course dynamic anti-swing of the grab bucket, and a dynamic control technology that the full speed occupation ratio of the trolley 11 is higher.

As mentioned above, if the uncontrolled swing of the grapple 13 is not properly controlled, the grabbing cycle time of the grapple 13 will be increased, the ship unloading efficiency will be reduced, and the uncertainty of the control will be increased, however, the key to achieving effective control and efficient operation of the grapple 13 swing is to know the advance position and the lag position of the grapple in real time, thereby achieving closed-loop control, and an efficient sway elimination algorithm.

The semi-automatic software of the general ship unloader effectively utilizes the swing displacement of the grab bucket to the running direction of the trolley through a two-stage acceleration and deceleration mode so as to reduce the running stroke and running time of the trolley and realize the function of eliminating the swing. However, the open-loop control-based sway elimination mode is greatly limited in further expansion and optimization in practical application: the starting and ending points of material grabbing and returning are limited to the same position, and the whole anti-swing of the grab bucket starting from any point and arriving at any point in a coordinate system cannot be realized; the trolley does not reach full speed most of the time, and the whole operation efficiency is influenced.

In this embodiment, to the complicated rocking operating mode of grab bucket and the realistic requirement of guaranteeing the efficiency of unloading a ship, adopt following mode to realize:

(1) firstly, accurately monitoring and realizing closed-loop control based on real-time position accurate positioning and attitude data of the grab bucket 13;

(2) and a speed and position preview following algorithm is adopted to realize the whole-course dynamic anti-swing of the grab bucket starting from any point and arriving from any point in a coordinate system and a dynamic operation strategy with higher full-speed ratio of the trolley.

In addition, the system possesses the automatic function of retrieving of connecing flitch bulk cargo: in the full-automatic ship unloading process, the system is based on the image recognition technology, when the bulk cargo accumulated on the material receiving plate is detected to reach a certain degree, the grabbing operation is automatically suspended, the material receiving plate is lifted up, and the bulk cargo is recovered. After the action is finished, the material receiving plate falls in place again, and the system continues the automatic flow.

The grab ship unloader has to stop discharging if the discharge hopper is full, and in the manual operation mode, the working condition depends on the visual observation of a driver. In the automatic ship unloading process, the system adopts an image recognition technology based on machine vision, and utilizes a deep learning network structure to train a full-load characteristic model of the hopper, so as to realize intelligent perception of full load of the hopper.

Another embodiment of the disclosure provides a method for grabbing a material, which belongs to the technical field of intelligent self-adaption of the unloading system in the process of grabbing a material pile.

This mainly considers that when the discharge system grabs the material in the full-automatic mode, the grab bucket 13 can stably fall on the pile and keep the proper slack of the steel wire rope 131, and too tight results in insufficient material grabbing after bucket closing and reduces the ship unloading efficiency; too loose easily leads to the grab bucket 13 to leave the time of stockpile (that is to say wire rope 131 is by the process of pine becoming tight) long after closing the fill, reduces the efficiency of unloading equally, and when grab bucket 13 fell on the stockpile slope, the rope length of too loose made the grab bucket heeled, more easily arouses the rope to twine the abnormal operating mode of grab bucket, hook bucket body, influences equipment operation safety.

The system selects different bucket falling and bucket lifting strategies according to the material pile profile data below the grab bucket 13 and the torque data of the steel wire rope 131, so that the steel wire rope is kept not loose or tight when the bucket falls, and the grab bucket is kept not to fall; automatically sinking and deeply digging when the bucket is closed; when the bucket is lifted, the lifting acceleration is controlled, and the bucket is stably lifted to avoid impact; the operation safety and the efficiency of snatching of grab bucket are compromise from the execution detail of above-mentioned each link, specifically include:

s501, acquiring the contour information of the material pile at the grabbing position of the grab bucket.

In the step, firstly, the contour shape of the material pile where the grab bucket falling bucket destination is located is obtained from a material pile contour database, the fluctuation condition of the current material pile is obtained, the deceleration distance of the falling bucket is controlled according to the corresponding proportion, and the falling bucket attitude is firstly ensured to be adaptive to the shape of the material pile from the speed control of the falling bucket;

s502, acquiring a real-time torque value of a grab lifting steel wire rope, and determining and outputting grab parameters according to different change rate conditions of a torque value curve, wherein the grab parameters at least comprise a grab falling and stopping instruction.

In this step, the system reads the real-time torque value of the hoisting steel wire rope 131 of the grab bucket 13, and in the bucket falling process, according to the different change rate conditions of the torque value curve, the parameters of the grab bucket are intelligent, wherein the parameters of the grab bucket comprise, for example, outputting a bucket falling shutdown instruction, so that the steel wire rope of the grab bucket is kept in a slightly loose state when the bucket falling is finished.

And S503, based on the grab bucket parameters, realizing the maximum grabbing amount control of the grab bucket.

In this step, when the grab bucket grabs the material, the system utilizes the dead weight of grab bucket automatic sinking deep digging, realizes the biggest snatch volume control of grab bucket, guarantees to snatch efficiency. When the bucket is closed and the whole is lifted, the lifting speed is intelligently changed according to the conditions of different change rates of a lifting torque value curve by the system, soft lifting is realized, and the equipment safety is ensured.

Therefore, selecting different rope releasing strategies according to different material types below the grab bucket 13 is a key for improving the unloading efficiency and the operation safety of the grab bucket, and according to the contour projection shape of the current grabbing point and the gathered tightness detection data of the steel wire rope, firstly, in the process that the grab bucket 13 is placed down and contacts with a material pile, the current state that the grab bucket 13 contacts with the material pile is intelligently sensed, and the steel wire rope of the grab bucket after falling down is kept not loose or tight, and the grab bucket does not fall down; and then, when the grab bucket is closed to take materials, the grab bucket 13 automatically sinks to a certain extent by utilizing the dead weight of the grab bucket, so that deep digging and material taking are realized, the operation safety of the grab bucket is ensured, and the maximum grabbing amount control can be realized.

Further, while operations are depicted in a particular order, this should not be understood as requiring that such operations be performed in the particular order shown or in sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Likewise, while several specific implementation details are included in the above discussion, these should not be construed as limitations on the scope of the disclosure. Certain features that are described in the context of separate embodiments can also be implemented in combination in a single embodiment. Conversely, various features that are described in the context of a single embodiment can also be implemented in multiple embodiments separately or in any suitable subcombination.

Although the subject matter has been described in language specific to structural features and/or methodological acts, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are disclosed as example forms of implementing the claims.

While the present disclosure has been described in detail with reference to the embodiments, the present disclosure is not limited to the specific embodiments, and those skilled in the art can make various modifications and alterations based on the concept of the present disclosure, and the modifications and alterations should fall within the scope of the present disclosure as claimed.

Claims

1. A method for determining a material grabbing strategy is characterized by comprising the following steps:

determining characteristic information of the unloading ship based on the serial number of the unloading ship;

acquiring a material loading state based on the characteristic information;

and determining a grabbing strategy based on the material loading state.

2. The method of claim 1, wherein the obtaining the material loading status based on the characteristic information comprises:

determining a discharging range based on the characteristic information;

acquiring material loading information based on the unloading range;

determining a material loading state based on the material loading information.

3. The method of claim 1, wherein determining a grabbing strategy based on the material loading status comprises:

determining an optimal target position based on the material loading state;

and determining a grabbing track and a returning track based on the optimal target position.

4. The determination method according to claim 3, characterized in that the optimal target position is determined by:

performing digitalization and discretization processing on the stock pile model, and cutting the whole stock pile based on an independent minimum cell;

under the principle of ensuring the balance of the ship body, quickly and automatically sequencing all the cells, and recommending the cell group with the highest unloading efficiency as the optimal target position for grabbing by the grab bucket;

and automatically updating the shape of the material pile after finishing grabbing each time, and recommending the next optimal target position according to the updated shape of the material pile.

5. An apparatus for determining a material grabbing strategy, comprising:

the characteristic determining module is used for determining characteristic information of the unloading ship based on the serial number of the unloading ship;

the acquisition module is used for acquiring the material loading state based on the characteristic information;

and the strategy determining module is used for determining a grabbing strategy based on the material loading state.

6. The apparatus of claim 5, wherein the obtaining module comprises:

the range determining unit is used for determining the unloading range based on the characteristic information;

the obtaining unit is used for obtaining material loading information based on the unloading range;

and the state determining unit is used for determining the material loading state based on the material loading information.

7. The apparatus of claim 5, wherein the policy determination module comprises:

a position determination unit for determining an optimal target position based on the material loading state;

and the track determining unit is used for determining a grabbing track and a returning track based on the optimal target position.

8. The determination apparatus of claim 7, wherein the optimal target position is determined by:

under the principle of ensuring the balance of the ship body, quickly and automatically sequencing all the cells, and recommending a cell group with the highest unloading efficiency as an optimal target position for grabbing by the grab bucket;

9. A storage medium storing a computer program, characterized in that the computer program, when being executed by a processor, carries out the steps of the method according to any one of claims 1 to 4.

10. An electronic device comprising at least a memory, a processor, the memory having a computer program stored thereon, wherein the processor, when executing the computer program on the memory, is adapted to carry out the steps of the method of any of claims 1 to 4.