JP2017198508A - Structure degradation inspection device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To allow display of determination made on the inside structure of an inspection target at a randomly hit position in the form of an image.SOLUTION: Information on a hit sound and a captured image which are obtained at the same time are combined based on the times when hit sounds are obtained by hitting an inspection target and times when images are taken, visualized information on the result of analyzing the hit sound and the information on the position where the hit sound was generated by hitting are synthesized in the taken image and are overlapped with the taken image, so that the internal structure at the position where the inspection target is hit can be easily evaluated.SELECTED DRAWING: Figure 8

Description

  The present invention relates to a structure inspection apparatus for inspecting deterioration of a structure, particularly a concrete structure.

Concrete structures such as concrete walls, tunnel walls, and road surfaces, such as concrete structures and asphalt structures, show signs of damage such as cracks and cavities generated in the structure in order to prevent damage due to the progress of deterioration. It needs to be detected early and repaired before deterioration progresses.
Various techniques for detecting signs of damage occurring on the surface of a structure through image analysis have been proposed.

In recent years, such image analysis has begun to be used for nondestructive inspection inside structures.
For example, in Japanese Patent Application Laid-Open No. 2015-158441, the surface of a concrete structure is hit with a hammer or the like, the generated hitting sound is converted into data, and the data of the hitting sound is displayed on an image corresponding to the surface of the concrete structure to be inspected. A data image obtained by imaging is superimposed and displayed.

  In this conventional technique, as shown in FIG. 2 of the prior art, a mesh-like section is set on the surface to be inspected, and a preset hitting point is hit with a hitting means such as a hammer. As shown in FIG. 10 of the prior art, a hitting sound to be analyzed is obtained by hitting with a hitting means having a hitting position control means for hitting in a predetermined route.

That is, in the prior art, a hitting point determined in advance is specified to specify the position where the hit was made, and the hitting sound obtained by hitting the predetermined hitting point is used as the hitting sound. They are linked to dots and displayed superimposed on the surface image of the concrete structure.
In this prior art, hitting points are set and managed in advance, and it is necessary to perform hitting according to the set hitting points, and there is a problem that the inspection takes time and cost.

JP2015-158441

  The present invention has been made in order to solve the above-described problem, and specifies a hit position randomly hit by a user from a shot shot image, and sets the specified hit position in the shot target image. An object of the present invention is to make it possible to display and display information on the determination result of the internal structure of the hitting position obtained from the hitting sound.

The structure inspection apparatus according to the present invention is:
Striking means for striking the inspection object;
A voice input device for obtaining a hitting sound;
A striking time generating means for generating striking time information for specifying the striking time of the striking sound obtained by the voice input device;
The internal structure of the impact position is determined from the impact sound obtained by the voice input device, and includes at least information on the impact time of the impact sound generated by the impact time generating means and information that determines the internal structure of the impact position. A determination result generating means for generating determination result information;
Shooting means for shooting a hitting means for hitting a plurality of positions to be inspected from a specific location and generating information of a shot image including information of a shooting time;
A batting image extraction unit that extracts a batting image having shooting time information corresponding to the batting time information generated by the batting time generation unit from the shooting image generated by the shooting unit;
From the batting image extracted by the batting image extraction means, the position of the batting means is identified as the batting position, and at least information on the shooting time of the batting image and information on the batting position including information identifying the batting position are generated. Striking position generating means to perform,
The information of the determination result generated by the determination result generation means is imaged, and the information of the hitting position having the information of the hitting time of the determination result and the information of the shooting time corresponding to the hitting time is combined, and the information of the hitting position Determination image generating means for generating a determination image including:
A determination result generating unit that generates a determination result image by superimposing a determination image on an image to be inspected obtained by the imaging unit and combining information of the imaged determination result at a required position of the image to be inspected;
And display means for displaying the determination result image generated by the determination result generation means.

The structure inspection apparatus according to the second aspect of the present invention is the above-described invention.
The striking means is a hammer, and on the side opposite to the striking portion of the head, a hammer formed with a marker formed of a material detectable by image analysis is mounted.
The striking position generating means identifies the position of the striking means by detecting a marker from the striking image.

Moreover, the structure inspection apparatus according to the third aspect of the present invention is the above-described invention.
Information generated by the striking time generation means and the determination result generation means is managed in the same table on the database,
The shooting means generates video information,
The striking image extraction means cuts out a still image corresponding to the required striking time from the video information as a striking image, attaches a file name including the shooting time to the striking image file,
The determination image generation means generates the determination image by associating the information in the table on the database with the file name of the hit image.

Moreover, the structure inspection apparatus according to the fourth aspect of the present invention is the above-described invention.
The striking position generating means generates striking position information by acquiring the coordinates of the striking means position in the striking image.

The structure inspection method according to the fifth aspect of the present invention is:
A recording start step for starting the recording of the inspection object from a specific location and for starting recording of the sound,
A striking step of striking the inspection object with a striking means;
An information collecting step for obtaining a shot sound including time information and a shot image including information of a shot position by acquiring a hit sound accompanied by time information by executing the hit step;
An analysis step for performing the impact sound analysis step for analyzing the impact sound and a captured image analysis step for analyzing the captured image in parallel, information on the impact sound, and a captured image of the capture time corresponding to the impact time of the impact sound And a determination image generation step for generating a determination image in which the information on the internal structure based on the analysis of the hitting sound of the hitting position is combined with the information on the hitting position.
A determination result generation step for generating a determination result image obtained by combining the determination image generated in the determination image generation step with the photographed image to be inspected;
A display step for displaying the determination result image generated by the determination result generation step.

The structure inspection method according to the sixth aspect of the present invention is the above-described invention,
The sound analysis step is
A striking time generation step for specifying the striking time of the striking sound;
A determination result generating step for determining the internal structure of the hitting position from the hitting sound and generating at least information on the hitting time and information on the determination result including information for determining the internal structure of the hitting position;
The captured image analysis step
A striking image extraction step for extracting a striking image having shooting time information corresponding to striking time information;
A striking position generation step for identifying the position of the striking means as the striking position from the extracted striking image and generating striking position information including at least information on the shooting time of the striking image and information identifying the striking position. It is characterized by including and.

In the present invention, without setting the hitting position in advance with respect to the inspection target, the result of the determination of the internal structure corresponding to the hitting position can be obtained simply by recording the hitting sound and photographing the inspection target. It can be displayed in a composite with the target captured image.
For this reason, for example, it becomes possible to evaluate the internal structure at the hitting position of the wall surface simply, quickly, and at low cost by simply hitting the wall surface to be inspected by the user at random. ADVANTAGE OF THE INVENTION According to this invention, the test | inspection regarding the deterioration condition of a structure can be implemented effectively.

FIG. 1 is a block diagram of an embodiment of a structure inspection apparatus according to the present invention. FIG. 2 is a photographed image before the start of inspection obtained by the photographing means of FIG. FIG. 3 is an impact image extracted by the structure inspection apparatus of FIG. FIG. 4 is an analysis image showing a state in which the hammer head is detected from the hit image of FIG. FIG. 5 is a position image showing the coordinates of the hammerhead on the analysis image of FIG. FIG. 6 is a determination result image generated by the structure inspection apparatus of FIG. FIG. 7 is an explanatory image showing an example of information generated in the structure inspection apparatus of FIG. FIG. 8 is a flowchart showing the operation of the structure inspection apparatus of FIG.

The present invention includes information on the striking position, including information on the internal structure of the striking position, information on the striking sound not including the striking position information, and information on the shooting time corresponding to the striking time. The information about the captured image including the information on the striking position, not including the internal structure determination information, is correlated with the batting time and the shooting time as a reference, and the determination image obtained by imaging the determination information on the inspection target image is inspected. It is synthesized and displayed at the target hitting position.
In other words, based on the impact time of the impact sound obtained by the impact of the inspection target and the capture time of the captured image, the information of the impact sound and the captured image that are common to both times are combined, and the analysis result of the impact sound is visualized. The information and the information on the hitting position where the hitting sound is generated are synthesized and superimposed on the captured image so that the determination of the internal structure of the hitting position to be inspected can be easily evaluated.

Hereinafter, the present invention will be described with reference to the drawings.
1 is a block diagram of an embodiment of a structure inspection apparatus according to the present invention, FIG. 2 is a photographed image showing the field of view of the photographing apparatus obtained by the photographing means of FIG. 1, and FIG. 3 is a structure inspection apparatus of FIG. FIG. 4 is an extracted hit image, FIG. 4 is an analysis image showing a state in which a hammer head is detected from the hit image of FIG. 3, FIG. 5 is a position image showing the coordinates of the hammer head on the analysis image of FIG. Is a determination result image generated by the structure inspection apparatus in FIG. 1, FIG. 7 is an explanatory image showing an example of information generated in the structure inspection apparatus in FIG. 1, and FIG. 8 is an operation of the structure inspection apparatus in FIG. It is a flowchart which shows.

First, the basic configuration of the present invention will be described with reference to FIG.
In the figure, 1 is a structure inspection apparatus according to the present invention, 10 is a striking means, 110 is a central processing unit for controlling the operation of the structure inspection apparatus 1, and 111 is various inputs for operating the structure inspection apparatus 1. An operation panel to be performed, 112 is a storage means for recording and storing various information, 120 is a voice input means for recording a striking sound, 121 is a striking time generating means, 122 is a determination result generating means, and 130 is hitting a test object The photographing means for photographing the striking means 10, 131 is a striking image extracting means, 132 is a striking position generating means, 140 is a determination image generating means, 141 is a determination result generating means, and 142 is a display device.

The structure inspection apparatus 1 is an apparatus including various elements shown in FIG. 1 and operates based on a control signal of the central processing unit transmitted in response to an input to the operation panel 111 by a user.
The operation panel 111 is a keyboard, for example.

The storage means 112 stores at least temporarily the information obtained for the examination and the generated information in accordance with an instruction from the central processing unit 110, and outputs the stored information as necessary.
In the following description, a part of the input and output operations to the storage means 112 is omitted, but basically, various information in the structure inspection apparatus 1 is stored in the storage means 112. Are handled through.
The display unit 142 is a monitor on which screens necessary for various inputs, acquired information, captured images, generated images, and the like are displayed.

The striking means 10 is a hammer.
In this hammer, a marker formed of a material that can be detected by image analysis is mounted on the opposite side of the hammer head from the hitting portion.

  This marker is mounted when a general-purpose inspection hammer is used for inspection, and is provided for facilitating detection of the hammer head through image analysis to be described later. A color that is clearly different from the color, such as red or orange, is recommended.

A hammer head having an identification function in advance may be used by applying a color for identification to the hammer head.
Further, if a marker that reflects near-infrared light and near-infrared illumination is used and a near-infrared transmission filter is attached to the camera and used, the hitting position can be specified even at night.

The voice input unit 120 is, for example, a microphone.
If the voice input means 120 is a microphone, the voice input means 120 is disposed at a position close to an inspection target (not shown), preferably at a position close to a striking position.

Note that the voice input unit 120 includes a sensor that detects a hitting sound as vibration, and may be, for example, a vibration sensor attached to the surface to be inspected.
The voice recorded by the voice input unit 120 is stored in the storage unit 112.

The striking time generation means 121 detects the striking time when the striking sound was recorded from the sound information of the striking sound recorded via the voice input means 120, identifies the striking time, and obtains the striking time information. Generate.
The determination result generation unit 122 detects the hitting sound from the voice information recorded via the voice input unit 120, and determines the internal structure of the hitting position by acoustic analysis of the detected hitting sound.

  Then, the determination result generating unit 122 specifies the hit time corresponding to the hit sound for which the determination is performed based on the information on the hit time generated by the hit time generating unit 121, and information on the hit time and the hit Information of a determination result including information for determining the internal structure of the hit position where the sound is generated is generated.

The photographing means 130 is a camera that can photograph a moving image.
This imaging means 130 is arranged at a position where an entire inspection object (not shown), for example, an entire inspection area of a concrete wall surface can be imaged, and is not moved during the inspection.

  The photographing means 130 generates information on a photographed image that includes information on the photographing time or is associated with the information on the photographing time, and the generated photographed image (moving image) is stored in correspondence with the information on the photographing time. 112.

  The batting image extracting unit 131 identifies the shooting time information corresponding to the batting time based on the batting time information generated by the batting time generating unit 121, and from among the shooting images generated by the shooting unit 130, An image photographed during the photographing time, that is, a hit image is extracted.

  The striking position generation means 132 analyzes the striking image extracted by the striking image extraction means 131, and the striking image of the position of the striking means 10 included in the striking image, specifically, the marker attached to the hammer head. The coordinates of the middle position are acquired, and the information on the striking position is generated using the coordinates as the striking position.

  The determination image generation unit 140 images the determination result information generated by the determination result generation unit 122 according to the determination result, and information on the hitting time of the determination result and the shooting time corresponding to the hitting time. The information of the hitting position having the information is combined to generate a determination image including the hitting position information.

  This determination image is, for example, an image whose color, size, and the like have been changed according to the superiority or inferiority of the determination result. The higher the degree of deterioration, the higher the visibility and the display of the color and size.

The determination result generation unit 141 superimposes the determination image on the inspection target image obtained by the imaging unit 130, and is imaged at a required position of the inspection target image, that is, a hit position based on the hit position information. A determination result image is generated by combining information of determination result images.
The generated determination result image is displayed on the display unit 142, presented to the user, and provided as a material for inspecting the structure.

Next, based on FIG. 2, operation | movement of the structure inspection apparatus shown in FIG. 1 is demonstrated using the image produced | generated by operation | movement of this apparatus.
When carrying out an inspection using the structure inspection apparatus 1 described above, first, as shown in FIG. 2, the photographing means 130 is placed at a position where an object to be inspected, specifically, at least the entire surface of the concrete wall can be photographed. Install.

During a series of inspections, the imaging device is not moved, and imaging from a certain place is performed.
The batting image extracted by the batting image extraction unit 131 is shown in FIG. 3, for example.
In the present embodiment, the striking position generating means 132 executes two-stage image analysis. First, as shown in FIG. 4, a hammer marker in the striking image is detected, and then, FIG. As shown in FIG. 2, the position of the hammer marker in the hit image is specified as the coordinates on the image.

  As shown in FIG. 6, the determination image generated by the determination result generation unit 141 is a determination generated by the determination image generation unit 140 so that the user or the like does not appear at the hit position of the inspection target. It is a composite of images.

  In the determination result image shown in FIG. 6, a determination image in which the deterioration state of the internal structure of the hitting position is reflected is displayed at the automatically detected hitting position. In addition, it is possible to intuitively determine where deterioration exists and where deterioration has progressed.

Next, handling of information generated by the determination result generation unit 122 and information of a captured image generated by the imaging unit 130 will be described with reference to FIG.
On the left side of FIG. 7, an example of a data sheet related to the determination result generated by the determination result generation unit 122 is shown, and the determination result is managed for each hitting sound.

The determination result includes an impact time (a hit date and time in the figure), a shape distance and a score obtained by analyzing the hit sound.
The shape distance and the score here are matters disclosed in the patent application of Japanese Patent Application No. 2015-18596.

Specifically, the geometric distance here is a new evaluation method of damage determination in the percussion sound inspection of a concrete structure, and indicates a similarity measure called a geometric distance of sound.
This geometric distance is obtained by quantitatively quantifying the similarity of a plurality of sounds, and serves as an index for objectively determining whether or not the concrete is damaged in the hitting sound inspection.
The score indicates the degree of damage derived based on the geometric distance.

In this embodiment, the data obtained from the hitting sound is used as the shape distance and the score, but this data is any data obtained by analyzing the hitting sound as long as it is data for evaluating damage determination. There may be.
On the right side of FIG. 7, a photographed image file generated via the photographing unit 130 is shown.

In this embodiment, the photographing unit 130 photographs a moving image. The photographed moving image is divided at a predetermined interval and stored in the storage unit 112 as a still image file.
This still image file has a shooting time (corresponding to the shooting time in the figure) embedded in the file name.

  The hit image extraction unit 131 associates the determination result with the shot image by extracting a shot image having a shooting time that is the same as or closest to the hit time of the determination result as a hit image.

Next, based on FIG. 8, operation | movement of said structure inspection apparatus 1 is demonstrated.
In addition, since specific operation | movement of each component has already been demonstrated, the description is abbreviate | omitted for details below and it demonstrates focusing on the flow of operation | movement.

  When the structure inspection apparatus 1 is used, first, as already described, the photographing means 130 is arranged, and the user who has the striking means 10 and the voice input means 120 stands close to the inspection target, and the voice input means. Recording by 120 and shooting by the shooting means 130 are started (step S01).

Next, the user sequentially hits the object to be inspected (concrete wall surface in the present embodiment) at appropriate intervals with the hitting means 10 (step S02).
At this time, the user holds the voice input means 120, that is, the microphone, in the hand opposite to the hand that performs the hitting, and is brought close to the hitting means 10 that performs the hitting so that the hitting sound can be reliably picked up and recorded. To do.

  Next, by performing the hit, the voice input means 120 acquires the hit sound accompanied by the time information, and acquires the shot image including the shooting time information and the hit position information via the shooting means 13, and obtains it. These pieces of information are stored in the storage means 112 (step S03).

Next, analysis of the obtained information is started (step S04).
When the analysis of information is started, the impact sound analysis (step S05) and the captured image analysis (step S06) are executed in parallel.

  In the analysis of the striking sound, first, the striking sound is specified from the sound information including the striking sound via the striking time generation means 121, the striking time when the striking sound is generated is identified, and the striking time information is generated ( Step S051)

  Next, the internal structure of the hitting position is determined from the hitting sound via the determination result generating means 122, and information on the result including at least information of the hitting time and information for determining the internal structure of the hitting position is generated ( Step S052).

In the analysis of the shot image, first, a hit image having shooting time information corresponding to the hit time information is extracted via the hit image extracting means 131 (step S061).
Next, the position of the hitting means is specified as the hitting position from the extracted hitting image via the hitting position generating means 132, and includes at least information on the shooting time of the hitting video and information for specifying the hitting position. Information on the hitting position is generated (step S062).

  After the analysis of the impact sound and the analysis of the captured image, the information on the impact sound generated in the determination result generation step is combined with the captured image including the information on the capture time corresponding to the impact time of the impact sound, A determination image including the information on the internal structure of the hit position including the hit position information is generated (step S07).

Next, the determination image generated in the step of generating the determination image is combined with the captured image to be inspected corresponding to the hitting time, and a determination result image is generated (step S08).
Then, the determination result image generated in the step of generating the determination result image is displayed on the display unit 142 (step S09).

  In the present invention, the user can obtain the state inside the structure at the striking position as a visible image only by setting the photographing means 130 and striking the wall surface to be inspected at random. Can be reduced.

  It should be noted that the present invention is not limited to the above-described embodiment. For example, the determination result shown in FIG. 7 and the screen shown in the captured image are not limited to the above-described embodiment, Any information can be used as long as the information and the captured image can be linked.

  In addition, the hitting means may be any type, whether it is a dedicated product or a general-purpose product, as long as it can emit a hitting sound by hitting the inspection target. The mark for detecting the position of the means by image search can be selected as appropriate, such as covering a part of the striking means with a marker having a characteristic color or attaching an adhesive seal.

  The photographing means may use a general-purpose image photographing device for home use or a photographing device built in a mobile device.

  If the user brings the equipment alone and sets it, it will be possible to find defects such as cracks and cavities in the internal structure to be inspected, such as the wall surface, with a very simple operation.

DESCRIPTION OF SYMBOLS 1 Structure inspection apparatus 10 Impact means 110 Central processing unit 111 Operation panel 112 Storage means 120 Voice input means 121 Impact time generation means 122 Determination result generation means 130 Imaging means 131 Impact image extraction means 132 Impact position generation means 140 Determination image generation means 141 Determination Result Generation Unit 142 Display Device

Claims (6)

Striking means for striking the inspection object;
A voice input device for obtaining a hitting sound;
A striking time generating means for generating striking time information for specifying the striking time of the striking sound obtained by the voice input device;
The internal structure of the impact position is determined from the impact sound obtained by the voice input device, and includes at least information on the impact time of the impact sound generated by the impact time generating means and information that determines the internal structure of the impact position. A determination result generating means for generating determination result information;
Shooting means for shooting a hitting means for hitting a plurality of positions to be inspected from a specific location and generating information of a shot image including information of a shooting time;
A batting image extraction unit that extracts a batting image having shooting time information corresponding to the batting time information generated by the batting time generation unit from the shooting image generated by the shooting unit;
From the batting image extracted by the batting image extraction means, the position of the batting means is identified as the batting position, and at least information on the shooting time of the batting image and information on the batting position including information identifying the batting position are generated. Striking position generating means to perform,
The information of the determination result generated by the determination result generation means is imaged, and the information of the hitting position having the information of the hitting time of the determination result and the information of the shooting time corresponding to the hitting time is combined, and the information of the hitting position Determination image generating means for generating a determination image including:
A determination result generating unit that generates a determination result image by superimposing a determination image on an image to be inspected obtained by the imaging unit and combining information of the imaged determination result at a required position of the image to be inspected;
A structure inspection apparatus comprising: display means for displaying a determination result image generated by the determination result generation means. The striking means is a hammer, and on the side opposite to the striking portion of the head, a hammer formed with a marker formed of a material detectable by image analysis is mounted.
The structure inspection device according to claim 1, wherein the hitting position generation unit specifies a position of the hitting unit by detecting a marker from the hitting image. Information generated by the striking time generation means and the determination result generation means is managed in the same table on the database,
The shooting means generates video information,
The striking image extraction means cuts out a still image corresponding to the required striking time from the video information as a striking image, attaches a file name including the shooting time to the striking image file,
The structure inspection apparatus according to claim 1 or 2, wherein the determination image generation means generates a determination image by associating information in the table on the database with the file name of the hitting image.   The structure inspection device according to claim 1, wherein the hitting position generating unit generates hitting position information by acquiring coordinates of the hitting unit position in the hitting image. A recording start step for starting the recording of the inspection object from a specific location and for starting recording of the sound,
A striking step of striking the inspection object with a striking means;
An information collecting step for obtaining a shot sound including time information and a shot image including information of a shot position by acquiring a hit sound accompanied by time information by executing the hit step;
An analysis step for performing the impact sound analysis step for analyzing the impact sound and a captured image analysis step for analyzing the captured image in parallel, information on the impact sound, and a captured image of the capture time corresponding to the impact time of the impact sound And a determination image generation step for generating a determination image in which the information on the internal structure based on the analysis of the hitting sound of the hitting position is combined with the information on the hitting position.
A determination result generation step for generating a determination result image obtained by combining the determination image generated in the determination image generation step with the photographed image to be inspected;
A structure inspection method comprising: a display step for displaying the determination result image generated by the determination result generation step. The sound analysis step is
A striking time generation step for specifying the striking time of the striking sound;
A determination result generating step for determining the internal structure of the hitting position from the hitting sound and generating at least information on the hitting time and information on the determination result including information for determining the internal structure of the hitting position;
The captured image analysis step
A striking image extraction step for extracting a striking image having shooting time information corresponding to striking time information;
A striking position generation step for identifying the position of the striking means as the striking position from the extracted striking image and generating striking position information including at least information on the shooting time of the striking image and information identifying the striking position. The structure inspection method according to claim 5, further comprising: