JP2013159930A - Periphery monitoring device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a periphery monitoring device capable of changing an output form of an alarm between the case that a specific object approaches a work machine and the case that an object other than that approaches the work machine.SOLUTION: A peripheral monitoring device 100 for monitoring the periphery of a shovel 50 includes: an alarm limitation object propriety determination part 202 for determining whether or not an object inside a monitoring area A1 is an alarm limitation object, on the basis of a detection result of an object detector 25 which detects an object inside the monitoring area A1 set around the shovel 50 and a marker image corresponding to a marker MK1 on a work site inside a peripheral image captured by an imaging device 24; and an alarm output control part 203 for controlling the output form of the alarm corresponding to whether or not the object inside the monitoring area A1 is the alarm limitation object.

Description

  The present invention relates to a surrounding monitoring device that monitors the surroundings of a work machine, and more particularly, to a surrounding monitoring device that outputs a warning when a working machine and an object approach each other.

  Conventionally, a monitoring device that issues an alarm when an obstacle enters a monitoring area set around the construction machine and stops the construction machine when the obstacle comes into contact with the construction machine is known ( For example, see Patent Document 1.)

  Also, it is determined whether the obstacle around the work machine is a stationary obstacle or a moving obstacle, and the image corresponding to the stationary obstacle and the image corresponding to the moving obstacle are displayed in different forms on the display monitor. A surrounding monitoring device for displaying is known (for example, see Patent Document 2). This surrounding monitoring apparatus is configured to issue an alarm when a moving obstacle enters within an alarm range set around the work machine.

JP-A-9-158258 JP 2008-163719 A

  However, the monitoring device of Patent Document 1 issues an alarm as long as it enters the monitoring area, regardless of the obstacles.

  Similarly, the surroundings monitoring device disclosed in Patent Document 2 is configured so that when a moving obstacle enters the alarm range, the alarm is only required if the moving obstacle enters the alarm range. It will be emitted.

  As described above, both of the devices described in Patent Documents 1 and 2 always issue an alarm if the obstacle approaches even if the operator already knows the presence of the obstacle, which is bothersome for the operator. Makes you feel.

  SUMMARY OF THE INVENTION In view of the above, an object of the present invention is to provide a surrounding monitoring device that can change a warning output mode when a specific object approaches a work machine and when another object approaches the work machine. And

  In order to achieve the above object, an ambient monitoring device according to an embodiment of the present invention is an ambient monitoring device that monitors the surroundings of a work machine, and is set around the work machine that is mounted on the work machine. Monitoring based on a detection result of an object detection device that detects an object in a monitored area and a marker image corresponding to a marker at a work site in an image captured by an imaging device mounted on the work machine A warning restriction target object determination unit that determines whether or not an object in the area is a warning restriction target; and a warning output mode according to whether or not the object in the monitoring area is a warning restriction target. A warning output control unit for controlling.

  According to the above-described means, the present invention can provide a surrounding monitoring device that can change a warning output mode when a specific object approaches the work machine and when another object approaches the work machine.

It is the schematic of the shovel in which the surroundings monitoring apparatus which concerns on the Example of this invention is mounted. It is a functional block diagram which shows the structure of the surroundings monitoring apparatus which concerns on the Example of this invention. It is a flowchart which shows the flow of a 1st periphery monitoring process. It is a figure which shows the condition of the work site at the time of a periphery monitoring apparatus performing an approach prevention process. It is a flowchart which shows the flow of a 1st determination process. It is a figure which shows the condition of the work site at the time of a surroundings monitoring apparatus performing a 1st determination process. It is a flowchart which shows the flow of a 2nd determination process. It is a figure which shows the condition of the work site at the time of a surroundings monitoring apparatus performing a 2nd determination process. It is a flowchart which shows the flow of a 2nd surroundings monitoring process. It is a figure which shows the condition of the work site at the time of a surroundings monitoring apparatus performing a 2nd surroundings monitoring process.

  Hereinafter, the best mode for carrying out the present invention will be described with reference to the drawings.

  FIG. 1 is a schematic diagram illustrating a configuration example of an excavator 50 that is a work machine on which a surrounding monitoring apparatus according to an embodiment of the present invention is mounted. The upper swing body 3 is mounted on the lower traveling body 1 of the excavator 50 via the swing mechanism 2. A boom 4 is attached to the upper swing body 3, an arm 5 is attached to the tip of the boom 4, and a bucket 6 is attached to the tip of the arm 5. The boom 4, the arm 5, and the bucket 6 constitute a digging attachment, and are hydraulically driven by the boom cylinder 7, the arm cylinder 8, and the bucket cylinder 9, respectively. Further, the upper swing body 3 is provided with a cabin 10 and is mounted with a power source such as an engine. Further, the upper swing body 3 includes an orientation information acquisition device 22 that acquires orientation information related to the orientation of the excavator 50, an imaging device 24 that images the periphery of the excavator 50, and an object that detects an object existing around the excavator 50. A detection device 25 is mounted. A control device 20, a storage device 26, a display device 27, and an audio output device 28 are mounted inside the cabin 10, and a main body position information acquisition device 21 is mounted on the ceiling of the cabin 10. Details of the control device 20, the body position information acquisition device 21, the orientation information acquisition device 22, the imaging device 24, the object detection device 25, the storage device 26, the display device 27, and the audio output device 28 will be described later.

  FIG. 2 is a functional block diagram showing a configuration of the surroundings monitoring apparatus 100 according to the embodiment of the present invention. The surroundings monitoring device 100 includes a control device 20 and is connected to a main body position information acquisition device 21, an orientation information acquisition device 22, an imaging device 24, an object detection device 25, a storage device 26, a display device 27, and an audio output device 28. The

  The control device 20 is a device that controls the operation of the surroundings monitoring device 100, and is, for example, a computer that includes a CPU, a RAM, a ROM, and the like. Specifically, the control device 20 reads programs corresponding to the functional elements of the marker recognition unit 200, the marker decoding unit 201, the warning restriction target object determination unit 202, and the warning output control unit 203 from the ROM and stores them in the RAM. Load the CPU and execute processing corresponding to each functional element.

  The main body position information acquisition device 21 is a device that acquires main body position information relating to the position of the work machine main body. In the present embodiment, the main body position information acquisition device 21 receives a signal output from a GPS satellite via a GPS antenna by a GPS (Global Positioning System) receiver, and is main body position information (for example, latitude, longitude, and altitude). .) Is a GPS device for positioning and calculating. Specifically, the main body position information acquisition device 21 is a GPS device mounted on the ceiling portion of the excavator 50. For example, main body position information corresponding to a reference position (for example, the turning center) of the excavator 50 is obtained. The acquired main body position information is output to the control device 20.

  The orientation information acquisition device 22 is a device that acquires orientation information related to the orientation of the work machine. In the present embodiment, the orientation information acquisition device 22 is a geomagnetic sensor that acquires the orientation (azimuth) of the excavator 50 with the side where the excavation attachment is located as the front side, and outputs the detected orientation information to the control device 20.

  Further, the orientation information acquisition device 22 may be another GPS device mounted at a position on the excavator 50 different from the installation position of the GPS device as the main body position information acquisition device 21. This is because the orientation of the excavator 50 can be specified based on the position information acquired by each of the two GPS devices.

  The imaging device 24 is a device that images the surroundings of the work machine. For example, the imaging device 24 is a camera including an imaging element such as a charge coupled device (CCD) or a complementary metal oxide semiconductor (CMOS). In the present embodiment, the imaging device 24 includes a left side camera 24L that images the left side of the excavator 50, a right side camera 24R that images the right side of the excavator 50, and a rear camera 24B that images the rear side of the excavator 50. . The imaging device 24 outputs the captured image (hereinafter referred to as “ambient image”) to the control device 20.

  The object detection device 25 is a device that detects an object existing around the work machine, and is, for example, a laser range finder, an ultrasonic sensor, a millimeter wave sensor, or the like. In this embodiment, the object detection device 25 includes a left side laser range finder 25L that detects an object that is present on the left side of the excavator 50, and a right side laser range finder 25R that is configured to detect an object that is present on the right side of the shovel 50. including. Note that the object detection device 25 may include a rear laser range finder that detects an object existing behind the excavator 50.

  FIG. 3 is a diagram showing the monitoring area A1 of the object detection device 25. As shown in FIG. 3, the left side laser range finder 25L has a left side monitoring area A1L on the left side of the excavator 50, and the right side laser range finder 25R has a right side monitoring area on the right side of the excavator 50. Has A1R.

  The storage device 26 is a device for storing various types of information, and includes, for example, a hard disk, an optical disk, or a semiconductor memory. In the present embodiment, the storage device 26 is a semiconductor memory installed in the cabin 10.

  The display device 27 is a device that displays various information, and includes, for example, a liquid crystal display, an LED, and the like. In the present embodiment, the display device 27 is a liquid crystal display installed in the cabin 10.

  The audio output device 28 is a device that outputs various information as audio, and includes, for example, a speaker, a buzzer, and the like. In the present embodiment, the audio output device 28 is a speaker installed in the cabin 10.

  Next, various functional elements in the control device 20 will be described.

  The marker recognition unit 200 is a functional element that recognizes a marker image corresponding to a marker at a work site.

  The “marker” is an object having a predetermined geometric shape or pattern, and includes, for example, an AR marker used in AR (Augmented Reality) technology and a two-dimensional code such as a QR code (registered trademark).

  The marker is fixedly installed at a predetermined position on the work site. A marker may be affixed on the wall surface of a building, for example, may be attached to the top of a pile installed at a work site, or may be embedded in the ground while exposing the surface.

  Specifically, the marker recognition unit 200 recognizes a marker image corresponding to the marker in the surrounding image captured by the imaging device 24 using an image processing technique such as pattern matching.

  The marker recognizing unit 200 calculates the distance between the imaging device 24 and the marker based on the size of the recognized marker image, and the imaging device 24 based on the position of the recognized marker image in the surrounding image. Calculate the direction of the marker viewed from. In this case, the marker has a predetermined size.

  The marker decoding unit 201 is a functional element that decodes the content represented by the marker image recognized by the marker recognition unit 200.

  The content represented by the marker image includes, for example, information on the object on which the marker is pasted, information on a predetermined area defined by the marker, and the like.

  The information regarding the object on which the marker is pasted includes, for example, information indicating that the object is a warning restriction target. “Warning restriction target object” is an object in which a warning output mode for preventing contact with a work machine is different from a warning output mode regarding other objects (hereinafter referred to as “warning target”). . Specifically, the surroundings monitoring device 100 issues a warning when the distance between the excavator 50 and the warning object is equal to or less than a threshold value, that is, when the warning object enters the monitoring area A1 of the object detection device 25. Output. On the other hand, the surrounding monitoring device 100 is a case where the distance between the excavator 50 and the warning restricted object is equal to or smaller than the threshold value, that is, the case where the warning restricted object enters the monitoring area A1 of the object detection device 25. Even the warning output is prohibited.

  The information related to the predetermined area defined by the marker includes, for example, the number of markers used to define the predetermined area, position information of the predetermined area (for example, information expressed by latitude and longitude), the size of the predetermined area, and the height Or a depth, a time zone in which a predetermined area is set, an expiration date, or the like. The predetermined area includes, for example, an alarm prohibition area, an alarm restriction area, and the like. In the alarm prohibition area, even if the distance between the object in the area and the work machine is equal to or smaller than the threshold, that is, even if the object enters the monitoring area A1 of the object detection device 25, the output of the warning is prohibited. It is an area to do. The warning restriction area is an area in which a warning is output only when the distance between an object in the area and the work machine is equal to or smaller than a threshold value smaller than a normal threshold value.

  Specifically, the marker decoding unit 201 refers to a table stored in advance in the storage device 26 that holds a correspondence relationship between the marker image and the content represented by the marker image, and displays the content represented by the recognized marker image. Decipher.

  Further, the marker decoding unit 201 stores the decoded contents in the storage device 26 so as to be readable at any time. This is for the determination by the warning restriction target object determination unit 202 described later to be performed without repeatedly recognizing and decoding the marker image. Specifically, the marker decoding unit 201 can read information on the position and range of the object on which the marker is pasted, information on the position and range of the alarm prohibited area, information on the position and range of the alarm restricted area, and the like at any time. Store in the storage device 26. The marker decoding unit 201 may omit storing the decoded contents in the storage device 26. This is because the marker image is recognized and decoded each time the warning restriction target object determination unit 202 performs the determination.

  The marker decoding unit 201 may decode one content based on one marker image, or may decode one content based on a combination of a plurality of marker images.

  The warning restriction target object determination unit 202 is a functional element that determines whether an object that enters the monitoring area A1 of the object detection device 25 is a warning restriction target object or a warning target object.

  Specifically, the warning restriction target object determination unit 202 determines whether the object detection device 25 detects an object in the monitoring area A1 based on the decoding result output from the marker decoding unit 201 or the marker decoding. Based on the decoding result stored in the storage device 26 by the unit 201, it is determined whether or not the object is a warning restriction target. For example, the warning restriction target object determination unit 202 determines that the object is a warning restriction target when the position of the object detected by the object detection device 25 matches the position of the marker decoded by the marker decoding unit 201. judge. Alternatively, when the position of the object detected by the object detection device 25 is included in the warning prohibition area or the warning restriction area decoded by the marker decoding unit 201, the warning restriction target object determination unit 202 determines that the object is a warning restriction target. Judge that it is a thing.

  When it is determined that the detected object is not a warning restriction target, that is, a warning target, the warning restriction target object determination unit 202 warns a predetermined control signal (hereinafter referred to as a “warning permission signal”). Output to the output control unit 203. This is because the warning output control unit 203 can output to the audio output device 28 a control signal for causing the audio output device 28 to output a warning (hereinafter referred to as “warning signal”).

  On the other hand, when it is determined that the detected object is a warning restriction target, the warning restriction target object determination unit 202 does not output a warning permission signal to the warning output control unit 203. This is to prevent the warning output control unit 203 from outputting a warning signal to the audio output device 28.

  Alternatively, when the warning restriction target object determination unit 202 determines that the detected object is a warning restriction target, the warning output control unit 203 outputs a predetermined control signal (hereinafter referred to as a “warning prohibition signal”). May be output. This is to prevent the warning output control unit 203 from outputting a control signal (hereinafter referred to as “warning signal”) for causing the voice output device 28 to output a warning to the voice output device 28. In this case, the warning restriction target object determination unit 202 does not output a warning prohibition signal to the warning output control unit 203 when it is determined that the detected object is not a warning restriction target. This is because the warning output control unit 203 can output a warning signal to the audio output device 28.

  Alternatively, the warning restriction target object determination unit 202 outputs a warning prohibition signal to the warning output control unit 203 when it is determined that the detected object is a warning restriction target, and the detected object is a warning restriction. If it is determined that the object is not an object, a warning permission signal may be output to the warning output control unit 203.

  The warning output control unit 203 is a functional element that controls a warning output mode according to the determination result of the warning restriction target object determination unit 202.

  Specifically, the warning output control unit 203 outputs a warning signal to the audio output device 28 when a warning permission signal is received from the warning restriction target object determination unit 202. On the other hand, the warning output control unit 203 does not output a warning signal to the audio output device 28 when the warning output signal is not received from the warning restriction target object determination unit 202. This is because the object in the monitoring area A1 is a warning restriction target.

  Alternatively, the warning output control unit 203 prohibits the output of the warning signal when receiving the warning prohibition signal from the warning restriction target object determination unit 202, and outputs the warning signal when the warning prohibition signal is not received. Also good.

  Alternatively, the warning output control unit 203 may prohibit the output of the warning signal when the warning prohibition signal is received from the warning restriction target object determination unit 202 and may output the warning signal when the warning permission signal is received. .

  Next, a process in which the surroundings monitoring device 100 monitors the surroundings of the excavator 50 (hereinafter referred to as “first surroundings monitoring process”) will be described with reference to FIG. FIG. 4 is a flowchart showing the flow of the first surrounding monitoring process, and the surrounding monitoring apparatus 100 repeatedly executes the first surrounding monitoring process at a predetermined cycle.

  First, the control device 20 of the surrounding monitoring device 100 determines whether or not an object is detected in the monitoring area A1 based on the output of the object detection device 25 (step S1).

  When the control device 20 determines that an object is detected in the monitoring area A1 (YES in step S1), the warning restriction target object determination unit 202 of the control device 20 determines whether or not the object is a warning restriction target object. Is determined (step S2).

  When it is determined that the object detected in the monitoring area A1 is a warning restriction target (YES in Step S2), the warning restriction target object determination unit 202 warns the warning output control unit 203 of the control device 20. A prohibition signal is output so that the warning output control unit 203 does not output a warning signal to the audio output device 28.

  As described above, since the object that has entered the monitoring area A1 is a warning restriction target, the warning output control unit 203 prohibits the warning output by the audio output device 28 (step S3).

  On the other hand, when it is determined that the object detected in the monitoring area A1 is not a warning restriction target, that is, a warning target (NO in Step S2), the warning restriction target object determination unit 202 is a warning output control unit 203. The warning output control unit 203 can output a warning signal to the audio output device 28.

  Thus, since the object that entered the monitoring area A1 is a warning object, the warning output control unit 203 permits the audio output device 28 to output a warning (step S4).

  Next, referring to FIG. 5 and FIG. 6, a process (hereinafter referred to as “first determination process”) in which the surroundings monitoring apparatus 100 determines whether or not an object that has entered the monitoring area A1 is a warning restriction target object. .). FIG. 5 is a flowchart showing the flow of the first determination process, and the surroundings monitoring apparatus 100 executes the first determination process when an object is detected in the monitoring area A1 by the object detection apparatus 25. . FIG. 6 is a diagram illustrating a situation at the work site when the surroundings monitoring device 100 executes the first determination process. As shown in FIG. 6, at the work site, there are an object OB1 to which the marker MK1 is attached and an object OB2 to which no marker is attached. The pattern of the marker MK1 constitutes a two-dimensional code indicating that an object within a predetermined distance range from the position of the marker MK1, that is, the object OB1 is a warning restriction target. 6A shows a state in which the object OB1 has entered the left side monitoring area A1L, and FIG. 6B shows a state in which the object OB2 has entered the right side monitoring area A1R.

  First, the marker recognition unit 200 of the control device 20 tries to recognize a marker image corresponding to the marker MK1 in the surrounding image output from the imaging device 24 (step S11). Specifically, the marker recognizing unit 200 recognizes a marker image included in the surrounding image by pattern matching.

  The marker recognizing unit 200 calculates the distance between the reference position of the excavator 50 and the marker MK1 based on the recognized size of the marker image. The marker recognizing unit 200 calculates the direction of the marker MK1 viewed from the reference position of the excavator 50 based on the position of the recognized marker image in the surrounding image. Further, the marker recognizing unit 200 is represented by information (for example, latitude and longitude) regarding the position of the marker MK1 based on the calculated distance and direction and the respective outputs of the main body position information acquisition device 21 and the orientation information acquisition device 22. 2D coordinates or 3D coordinates expressed by latitude, longitude, and altitude).

  When the marker recognition unit 200 recognizes the marker image (YES in step S11), the marker decoding unit 201 in the control device 20 decodes the content represented by the marker image. Specifically, the marker decoding unit 201 decodes the content that uses an object within a predetermined distance range from the marker MK1 as a warning restriction target by using the marker image corresponding to the marker MK1. Note that the marker MK1 may have information regarding its own position (for example, two-dimensional coordinates represented by latitude and longitude, or three-dimensional coordinates represented by latitude, longitude, and altitude). Good. In that case, the marker recognizing unit 200 does not need to calculate the distance between the reference position of the excavator 50 and the marker MK1, the direction of the marker MK1 viewed from the reference position of the excavator 50, information on the position of the marker MK1, and the like.

  Here, the warning restriction target object determination unit 202 compares the position of the object detected by the object detection device 25 with the position of the marker MK1 recognized by the marker recognition unit 201 (step S12).

  When the detected position of the object matches the position of the marker MK1 (YES in step S12), that is, in the state shown in FIG. 6A, the warning restriction target object determination unit 202 sets the object OB1 as a warning restriction target. It determines with it being a thing (step S13).

  Note that “when the position of the detected object matches the position of the marker” is the coordinates of the detected object (for example, the coordinates corresponding to the point on the object that minimizes the distance to the excavator 50). Is within the coordinate range defined by the marker.

  On the other hand, when the marker recognizing unit 200 does not recognize the marker image (NO in step S11), or when the detected position of the object does not match the position of the marker MK1 (YES in step S12), that is, FIG. ), The warning restriction target object determination unit 202 determines that the object OB2 is a warning target (step S14).

  With the above configuration, the surroundings monitoring device 100 recognizes a predetermined warning restriction object using the marker MK1, so that the warning restriction object approaches the shovel 50 and the warning object approaches the shovel 50. The warning output mode can be changed depending on the case. As a result, the surroundings monitoring device 100 can prevent a warning from being output frequently even though it is a known obstacle, for example, by excluding a known obstacle from a warning target. It is possible to prevent the operator from feeling troublesome.

  Next, referring to FIG. 7 and FIG. 8, another process (hereinafter, “second determination process”) in which the surroundings monitoring apparatus 100 determines whether or not the object that has entered the monitoring area A1 is a warning restriction target object. ). FIG. 7 is a flowchart showing the flow of the second determination process, and the surroundings monitoring apparatus 100 executes the second determination process when an object is detected in the monitoring area A1. FIG. 8 is a diagram illustrating a situation at the work site when the surroundings monitoring device 100 executes the second determination process. As shown in FIG. 8, markers MK11 to MK15 are fixedly installed at the work site. The markers MK11 to MK15 define warning prohibited areas indicated by hatching in FIG. 8 by imaginary lines connecting adjacent markers. Each of the markers MK11 to MK15 has the same size and the same pattern, and the pattern constitutes a two-dimensional code indicating that the warning prohibited area is defined by a specific number of markers. 8A shows a state in which the object OB1 has entered the left side monitoring area A1L, and FIG. 8B shows a state in which the object OB2 has entered the right side monitoring area A1R.

  First, the marker recognizing unit 200 tries to recognize unrecognized marker images corresponding to the markers MK11 to MK15 in the surrounding image output by the imaging device 24 (step S21). Specifically, the marker recognizing unit 200 recognizes a marker image included in the surrounding image by pattern matching.

  Further, the marker recognition unit 200 calculates the distance between the reference position of the excavator 50 and each of the markers MK11 to MK15 based on the recognized size of the marker image. The marker recognizing unit 200 calculates the directions of the markers MK11 to MK15 viewed from the reference position of the excavator 50 based on the position of the recognized marker image in the surrounding image. Furthermore, the marker recognizing unit 200 calculates information on the positions of the markers MK11 to MK15 based on the calculated distance and direction and the outputs of the main body position information acquisition device 21 and the orientation information acquisition device 22, respectively.

  When the marker recognition unit 200 recognizes an unrecognized marker image (YES in step S21), the marker decoding unit 201 in the control device 20 decodes the content represented by the marker image (step S22). Specifically, the marker decoding unit 201 decodes the content that the warning prohibited area is defined by the five marker images corresponding to the markers MK11 to MK15.

  Thereafter, the marker decoding unit 201 stores information related to the warning prohibited area in the storage device 26 so as to be readable at any time. For example, the marker decoding unit 201 stores, in the storage device 26, a warning prohibited area that is determined using information regarding the calculated positions of the markers MK11 to MK15. When each of the markers MK11 to MK15 holds information regarding the position and range of the warning prohibited area, the marker decoding unit 201 may store the information in the storage device 26 as it is. In that case, the marker recognizing unit 200 includes the distance between the reference position of the excavator 50 and each of the markers MK11 to MK15, the respective directions of the markers MK11 to MK15 viewed from the reference position of the excavator 50, and the respective markers MK11 to MK15. It is not necessary to calculate information on the position of the.

  When the marker recognizing unit 200 does not recognize an unrecognized marker image (NO in step S21), the surroundings monitoring device 100 executes the following step S24 without executing steps S22 and S23.

  Thereafter, the control device 20 refers to the storage device 26 to determine whether or not a warning prohibition area is set (step S24).

  When it is determined by the control device 20 that a warning prohibited area is set (YES in step S24), the warning restriction target object determination unit 202 has an object detected by the object detection device 25 in the warning prohibited area. It is determined whether or not (step S25).

  When it is determined that the detected object exists in the warning prohibited area (YES in step S25), that is, in the state illustrated in FIG. 8A, the warning restriction target object determination unit 202 determines that the object OB1 is the warning restriction target object. (Step S26).

  On the other hand, when it is determined by the control device 20 that the warning prohibited area is not set (NO in step S24), or when it is determined that the detected object does not exist in the warning prohibited area (NO in step S25). That is, in the state shown in FIG. 8B, the warning restriction target object determination unit 202 determines that the object OB2 is a warning target (step S27).

  In the above-described embodiment, the warning prohibited area is set by a plurality of markers, but the warning prohibited area may be set by one marker.

  With the above configuration, the surroundings monitoring device 100 recognizes a warning prohibited area determined in advance using the markers MK11 to MK15, so that an object in the warning prohibited area approaches the excavator 50 and a case outside the warning prohibited area. The warning output mode can be changed when the object approaches the shovel 50. As a result, the surroundings monitoring device 100 can prevent a warning from being output frequently even though it is a known obstacle, for example, by excluding a known obstacle from a warning target. It is possible to prevent the operator from feeling troublesome.

  Next, another process in which the surroundings monitoring device 100 monitors the surroundings of the excavator 50 (hereinafter referred to as “second surroundings monitoring process”) will be described with reference to FIGS. 9 and 10. FIG. 9 is a flowchart showing the flow of the second surrounding monitoring process, and the surroundings monitoring apparatus 100 repeatedly executes the second surrounding monitoring process at a predetermined cycle. FIG. 10 corresponds to FIG. 8A and shows the situation at the work site when the surroundings monitoring device 100 executes the second surroundings monitoring process. As shown in FIG. 10, markers MK11 to MK15 are fixedly installed at the work site. The markers MK11 to MK15 define warning prohibition areas indicated by hatching in FIG. 10 by imaginary lines connecting adjacent markers. Each of the markers MK11 to MK15 has the same size and the same pattern, and the pattern constitutes a two-dimensional code indicating that the warning prohibited area is defined by a specific number of markers. Also, as shown in FIG. 10, a second monitoring area A2, which is another monitoring area by the object detection device 25, is set inside the monitoring area A1. Specifically, a second left side monitoring area A2L is set inside the left side monitoring area A1L, and a second right side monitoring area A2R is set inside the right side monitoring area A1L. FIG. 10 shows a state in which the object OB1 has entered the second left side monitoring area A2L.

  First, the control device 20 determines whether an object is detected in the monitoring area A1 based on the output of the object detection device 25 (step S31).

  When the control device 20 determines that an object is detected in the monitoring area A1 (YES in step S31), the warning restriction target object determination unit 202 determines whether or not the object is a warning restriction target ( Step S32).

  When it is determined that the object detected in the monitoring area A1 is a warning restriction target (YES in step S32), the warning restriction target object determination unit 202 determines whether the object exists in the second monitoring area A2. It is determined whether or not (step S33).

  When it is determined that the object detected by the object detection device 25 exists in the second monitoring area A2 (YES in step S33), the warning restriction target object determination unit 202 sends a warning permission signal to the warning output control unit 203. The warning output control unit 203 can output a warning signal to the audio output device 28. In this case, even if the object that has entered the second monitoring area A2 is a warning restriction target, the warning output control unit 203 allows the voice output device 28 to output a warning (step S34).

  Even when it is determined that the object detected in the monitoring area A1 is not a warning restriction target (NO in step S32), the warning restriction target object determination unit 202 permits the warning output control unit 203 to warn. A signal is output so that the warning output control unit 203 can output a warning signal to the audio output device 28. In this manner, the warning output control unit 203 permits the warning output by the audio output device 28 (step S34).

  On the other hand, when the control device 20 determines that no object is detected in the monitoring area A1 (NO in step S31), or when it is determined that the warning restriction target is not yet in the second monitoring area A2. (NO in step S33), the warning restriction target object determination unit 202 does not output a warning permission signal to the warning output control unit 203, and the warning output control unit 203 outputs a warning signal to the audio output device 28. Do not. As a result, the warning output control unit 203 prohibits the voice output device 28 from outputting a warning.

  With the above configuration, the surroundings monitoring apparatus 100 outputs a warning when the warning restricted object enters the second monitoring area A2 even if the object detected in the monitoring range A1 is the warning restricted object. . In this way, the surroundings monitoring device 100, for example, prevents a warning from being frequently output even though it is a known obstacle, but warns when the known obstacle is further approached. Is output. As a result, it is possible to prevent the known obstacle from coming into contact with the excavator 50 while preventing the operator from feeling troublesome.

  Although the preferred embodiments of the present invention have been described in detail above, the present invention is not limited to the above-described embodiments, and various modifications and substitutions can be made to the above-described embodiments without departing from the scope of the present invention. Can be added.

  For example, in the above-described embodiment, the warning restricted object and the warning prohibited area are set in advance using a marker, but may be set dynamically using a display device 27 and an input device (not shown). Good. Specifically, the operator uses a touch panel that serves as both the display device 27 and the input device to select a partial area of the surrounding image displayed on the touch panel, so that the warning restriction target object and the warning prohibited area are selected. It may be set.

  DESCRIPTION OF SYMBOLS 1 ... Lower traveling body 2 ... Turning mechanism 3 ... Upper turning body 4 ... Boom 5 ... Arm 6 ... Bucket 7 ... Boom cylinder 8 ... Arm cylinder 9 ... Bucket cylinder 10 ... cabin 20 ... control device 21 ... main body position information acquisition device 22 ... direction information acquisition device 24 ... imaging device 24L ... left side camera 24R ... right side Camera 24B ... Rear camera 25 ... Object detection device 25L ... Left side ultrasonic sensor 25R ... Right side ultrasonic sensor 26 ... Storage device 27 ... Display device 28 ... Audio output Device 50 ... Excavator 100 ... Ambient monitoring device 200 ... Marker recognition unit 201 ... Marker decoding unit 202 ... Warning restriction target object determination unit 203 ... Warning Output control unit

Claims (5)

A surrounding monitoring device for monitoring the surroundings of a work machine,
Work in a detection result of an object detection device that detects an object in a monitoring area set around the work machine and mounted on the work machine, and an image captured by an image pickup device mounted on the work machine Based on a marker image corresponding to a marker in the field, a warning restriction target object determination unit that determines whether or not the object in the monitoring region is a warning restriction target;
A warning output control unit that controls a warning output mode according to whether or not an object in the monitoring region is a warning restriction target; and
An ambient monitoring device comprising: The warning output control unit prohibits warning output when an object in the monitoring area is a warning restriction target;
The surroundings monitoring device according to claim 1, wherein: The warning output control unit outputs a warning when a warning restriction target object is included in a predetermined area closer to the work machine included in the monitoring area.
The surrounding monitoring apparatus according to claim 1 or 2, wherein The warning restriction target is an object to which the marker is attached.
The surroundings monitoring device according to any one of claims 1 to 3 characterized by things. The warning restriction target is an object that exists in an area defined by the marker.
The surroundings monitoring device according to any one of claims 1 to 3 characterized by things.

Images