JP6537134B2 - Equipment loss investigation support device and program - Google Patents

Description

  BACKGROUND OF THE INVENTION Field of the Invention The present invention relates to an industrial loss investigation support device for supporting an operation such as photographing of a research site in an industrial loss investigation.

  As a prior art relevant to this invention, the thing as described in patent documents 1-3 is known. In Patent Document 1, storage means for storing shooting ancillary information acquired by means for inputting characters of the shooting ancillary information necessary for the construction record photograph, work type, position, etc. or communication means etc. and shooting ancillary information A light, small electronic small blackboard such as a mobile phone having a display means to display and a communication means, and time, place, light and dark so that characters etc. can read the photographic ancillary information displayed on the screen of the electronic small blackboard together with the object to be photographed A simplified photographing system using a digital camera is described which has means capable of photographing and storing it as a photographic image regardless of the difference between the two. In this simple photographing system, photographing auxiliary information is displayed on an electronic small blackboard before photographing, and the electronic small blackboard is photographed by a digital camera in a state of being arranged in a photographing target area.

  Patent Document 2 is a digital camera that combines photographed and recorded character information in an arbitrary place of a photographed image, and a keyboard for inputting the photographed and recorded character information, a photographed and recorded format recording unit, and a photographed and recorded format. There is disclosed a digital camera having a photographing and recording input function, which comprises: a synthesizing unit; and character information of a photographing and recording synthesizing unit selected at the time of photographing and a photographing target image are synthesized and recorded. In this digital camera, before photographing the construction site, the photographing record format is displayed on the input screen, and photographing record information such as construction name, construction type, photographing date, etc. is input. Then, before pressing the shutter, specify and arrange the position to combine the shooting record with the shooting target image, and press the shutter to record the shooting date and timetable in official standard time. To be combined with the photographed image and stored (see paragraphs [0022]-[0025] of Patent Document 2 and FIGS. 3 and 4).

  In Patent Document 3, an imaging unit for capturing a main image, a character input unit for inputting character data, a storage unit for storing image data to be a background of the character data, the image data and the character data A sub-image creation unit that creates a sub-image by combining, a display unit that displays the main image, and a sub-image operation unit that arranges the sub-image at an arbitrary position on the main image displayed on the display unit; There is disclosed a digital camera comprising: recording means for recording an image in a state in which the sub image is arranged on the main image. This digital camera is first installed at an architectural civil engineering work site to be photographed before imaging, and the construction contents of the architectural civil engineering construction site are handwritten input to a character input unit using a predetermined pen. Next, a composition for shooting is determined while looking at the display unit, and when the composition is determined, a sub image (electronic small blackboard image) is arranged in the main image. The placement of the sub-image is performed by moving the position by tracing the pad with a fingertip or the like. Then, the shutter (left switch) is pressed to take a picture, and the sub-image (electronic small blackboard image) is combined with the taken image and stored (paragraph [0014]-[Patent Document 3] 0017], Figure 4 and Figure 5).

JP, 2009-65668, A Japanese Patent Laid-Open No. 2003-9067 JP, 2000-217034, A

Ministry of Land, Infrastructure, Transport and Tourism Kinki Regional Development Bureau site section, "Standard specifications for work loss investigation," [online], [March 1, 2015 search] <URL: http://www.kkr.mlit.go.jp /land/siyousyo2.html>

  By the way, in the construction loss survey, the site to be surveyed such as a crack on the wall of a building or building is photographed in a form including a small blackboard with the location to be photographed, the date of photographing, etc. It is obliged to save and submit as an evidence picture (see, for example, non-patent document 1, page 5). At this time, in order to clearly indicate the shooting target part in the photograph, it is required to shoot in a state where the shooting target part is indicated by a pointer or the like.

  Therefore, at the actual construction site, the two workers jointly take pictures of the investigation site, and one worker points the photographing target place with a pointer, and the other worker Needs to take a picture in the form of including a small blackboard and a pointer. Therefore, two workers are always required on site, and there is a problem that work efficiency is bad.

  Then, it is possible to apply the technique of the said patent documents 1-3 in photography. However, since the said patent documents 1-3 are all what synthesize | combines an electronic small blackboard with a picked-up image, the operator who points to an imaging | photography object location with a pointer stick is still required separately from the operator who image | photographs.

  Therefore, an object of the present invention is to provide an industrial loss investigation support device that enables only one worker to carry out a photographing operation of a recorded photograph of an inspection area of an industrial loss investigation.

According to a first aspect of the present invention, there is provided a mobile terminal device including a camera and a touch panel display.
Imaging means for capturing an image by the camera and acquiring an image;
Captured image display means for displaying the captured image captured by the imaging means on the touch panel display;
An instruction mark for indicating an imaging target location on the image on the captured image displayed on the touch panel display is additionally displayed as an instruction mark display layer different from the image layer on which the captured image is displayed Mark display means,
Instruction mark selection moving means for moving the display position of the selected instruction mark in accordance with the input from the touch panel display;
And an image container storage unit configured to store the image layer and the instruction mark display layer displayed on the touch panel display as an image container.

  According to this configuration, the imaging unit images the investigation site by the camera to acquire an image, and the photographed image display unit displays the image on the touch panel display. The indication mark display means superimposes an indication mark on the photographed image displayed on the touch panel display as an indication mark display layer and additionally displays the indication mark, and the indication mark is moved to a desired place by the indication mark selection moving means. Then, the image container storage unit stores the image layer or the like displayed on the touch panel display as a multi-layer image. As a result, at the time of shooting, it is not necessary for an operator other than the photographer to indicate the shooting target location by the support rod. Therefore, it becomes possible to carry out the photographing operation of the record photograph of the investigation site of the work loss investigation by only one worker.

According to a second configuration of the work damage investigation support device in accordance with the present invention, in the first structure, blackboard information for inputting blackboard information including information on a shooting target place related to the work damage investigation and the shooting date Survey information input means for displaying an input screen on the touch panel type display and acquiring blackboard information input by the survey information input screen;
When the photographed image is displayed by the photographed image display means, an electronic small blackboard is displayed on a blackboard information display layer different from the image layer on which the photographed image is displayed, and the survey information is input in the electronic small blackboard An electronic small blackboard display means for displaying blackboard information input by the means;
The image container storage means is characterized in that the image layer, the indication mark display layer and the blackboard information display layer displayed on the touch panel display are stored as an image container.

  According to this configuration, the electronic small blackboard display unit causes the electronic small blackboard to be superimposed on the photographed image and the image container storage unit also stores the electronic small blackboard image as a multi-layer image. As a result, there is no need to place a small blackboard at the site at the time of shooting, and the work efficiency of the inspection for the damage is improved.

  An industrial loss research support program according to the present invention is read and executed by a mobile terminal apparatus provided with a camera and a touch panel display, whereby the mobile terminal apparatus is the industrial loss research support apparatus of the first or second configuration. It is characterized in that it functions as

  As described above, in the equipment failure survey support device of the present invention, after the captured image displayed by the camera and acquired by the imaging device is temporarily displayed on the touch panel display 3 by the captured image display device, the instruction mark display device and By adding the instruction marks on the photographed image by the instruction mark selecting and moving means and storing these as multi-layer images, it is not necessary for the worker to indicate the photographing target location by the support rod at the time of photographing. Therefore, it becomes possible to carry out the photographing operation of the record photograph of the investigation site of the work loss investigation by only one worker.

  In addition, the electronic small blackboard is superimposed and displayed on the photographed image by the electronic small blackboard display means, and the electronic small blackboard image is also stored as a multi-layer image, so that there is no need to place the small blackboard on the site at the time of photographing. , The work efficiency of the inspection of work loss is improved.

It is a block diagram showing the composition of the work loss investigation support device concerning Example 1 of the present invention. FIG. 5 is an ER diagram (Entity Relationship Diagram) showing a data structure of data stored in a data storage unit 12, a survey information storage unit 20, and a user information storage unit 23 in the equipment failure survey support device of FIG. It is a figure showing the display screen displayed on the touch-panel type display 3 in operation | movement in the failure investigation support apparatus of FIG. It is a figure showing the display screen displayed on the touch-panel type display 3 in operation | movement in the failure investigation support apparatus of FIG. It is a figure showing the display screen displayed on the touch-panel type display 3 in operation | movement in the failure investigation support apparatus of FIG. It is a figure showing the display screen displayed on the touch-panel type display 3 in operation | movement in the failure investigation support apparatus of FIG. It is a figure showing the display screen displayed on the touch-panel type display 3 in operation | movement in the failure investigation support apparatus of FIG.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

  FIG. 1 is a block diagram showing the configuration of a maintenance inspection support device according to a first embodiment of the present invention. The equipment failure investigation support device of the present embodiment is constituted by a portable terminal device 1 provided with a camera 2, a touch panel display 3, an SD card drive 4, and a key input device (not shown) such as a key button. This is realized by executing a dedicated application program in the mobile terminal device 1. Specifically, a smartphone, a tablet, a digital camera or the like is used as the mobile terminal device 1.

  The mobile terminal device 1 includes an imaging unit 11, a data storage unit 12, a captured image display unit 13, an instruction mark display unit 14, an instruction mark selection moving unit 15, an image container storage unit 16, an SD card output unit 17, and a data transmission unit 18. The survey information input unit 19, the survey information storage unit 20, the electronic small blackboard display unit 21, the user registration unit 22, the user information storage unit 23, and the login processing unit 24 are provided. Functionally realized by a program.

  The imaging unit 11 captures an image by capturing an image by the camera 2. The data storage unit 12 stores a photographed image acquired by the imaging unit 11, investigation information attached to the photographed image, and the like. The photographed image display unit 13 displays a photographed image acquired by the imaging unit 11 on the touch panel display 3.

  The instruction mark display unit 14 displays an instruction mark for instructing a position to be photographed on the photographed image on the photographed image displayed on the touch panel display 3 and an instruction mark different from the image layer on which the photographed image is displayed. Add and display layers as layers. The instruction mark selection moving unit 15 moves the display position of the selected instruction mark in accordance with the input from the touch panel display 3.

  The survey information input unit 19 displays on the touch panel display 3 a survey information input screen for inputting survey information including information on the shooting target location related to the work loss survey and the shooting date, and the survey information input screen Get the survey information that is input. The survey information storage unit 20 stores the survey information input from the survey information input unit 19. When the photographed image is displayed on the touch panel display 3 by the photographed image display unit 13, the electronic small blackboard display unit 21 displays the small electronic blackboard on the survey information display layer different from the image layer on which the photographed image is displayed. And display the survey information in the electronic small blackboard.

  The image container storage unit 16 stores the image layer and the instruction mark display layer displayed on the touch panel display 3 and the investigation information display layer in the data storage unit 12 as an image container. The SD card output unit 17 encrypts the image container stored in the data storage unit 12 and outputs the encrypted image container to the SD card drive 4. The data transmission unit 18 encrypts and transmits the image container stored in the data storage unit 12 to a management server wirelessly connected via a communication line such as the Internet.

  The user registration unit 22 performs a registration process of a user who uses the maintenance investigation support device of the present embodiment. The user information storage unit 23 stores the information of the user registered by the user registration unit 22. The login processing unit 24 performs login processing of the registered user.

FIG. 2 is an ER diagram (Entity Relationship Diagram) showing the data structure of data stored in the data storage unit 12, the survey information storage unit 20, and the user information storage unit 23 in the equipment failure survey support device of FIG. . The data storage unit 12 includes an image file folder 31 in which the captured image file is stored, a blackboard information table 32 in which information such as contents of the electronic small blackboard, display position, display size, and orientation is stored, and indication mark An instruction mark information table 33 in which information such as position, display size and orientation is stored is stored. The survey information storage unit 20 includes a survey information table 35 in which common information for each item of the construction loss survey is stored, a property information table 36 in which common information for each surveyed property in a certain construction loss survey item is stored, and a certain construction loss A building information table 37 in which common information for each survey target building in a survey property with a survey case is stored, and a survey form information table 38 in which information on a survey form created for each photographed image in an industrial loss survey is stored There is. The user information storage unit 23 stores a user information table 41 in which information on the registered user is stored. Specific fields and relations of each table are as shown in FIG.

  The operation of the equipment loss investigation support device according to the present embodiment configured as described above will be described below. FIGS. 3-7 is a figure showing the display screen displayed on the touch-panel-type display 3 in operation | movement in the damage investigation assistance apparatus of FIG.

  First, the login processing unit 24 displays a login screen as shown in FIG. 3A on the touch panel display 3 as an initial screen. When the user has already registered as a user, the user selects the login button 51 from the touch panel display 3. When the login button 51 is selected, the login processing unit 24 displays a login screen as shown in FIG. 3C on the touch panel display 3, and the login information (e-mail address (user ID) and password) from the user is displayed. Wait for input. When login information is input, the login processing unit 24 authenticates the user with reference to the user information table 41 of the user information storage unit 23, and when it is authenticated, the initial menu screen of FIG. 3D is displayed. indicate.

  On the other hand, the user who has not registered as a user selects the account registration button 52 from the touch panel display 3 on the login screen of FIG. 3A. When the account registration button 52 is selected, the user registration unit 22 displays a user registration screen as shown in FIG. 3B on the touch panel display 3, and user registration information (email address (user ID) from the user). Wait for the input of the password, the user's name and the click of the registration button 53. When the registration button 53 is clicked, the user registration unit 22 additionally registers the user registration information input to the user information table 41 of the user information storage unit 23, and displays the initial menu screen of FIG. 3D.

  When the user clicks the survey start button 54 from the touch panel display 3 on the initial menu screen of FIG. 3 (d), the survey information input unit 19 displays the survey information selection screen of FIG. 4 (a). On the other hand, when the user clicks the survey restart button 55 from the touch panel display 3 on the initial menu screen of FIG. 3D, the survey information input unit 19 displays the survey sheet selection screen of FIG.

  In the survey information selection screen of FIG. 4A, a list of survey information currently registered in the survey information table 35 is displayed. Here, "investigation information" refers to information commonly recorded in the said construction loss investigation for every construction loss investigation project, specifically, the construction name, the investigation name, the investigation division (previous, during, after) ), Contractors, investigators, etc. The user selects the corresponding investigation item from the list of investigation information (selects by clicking the circular radio button 62 displayed at the left end of each column of the list). If the corresponding survey item is not registered, the user selects the setting button 57 displayed at the lower left of the screen. When the setting button 57 is selected, the survey information input unit 19 displays the survey information input screen of FIG. 4B on the touch panel display 3 and waits for the user to input the survey information. The user inputs survey information from the key input device or the touch panel display 3 in each field displayed on the survey information input screen, and clicks a save button 58. When the save button 58 is clicked, the survey information input unit 19 registers the entered survey information as a new record in the survey information table 35, and displays the survey information selection screen of FIG. 4A again.

  When the property information button 60 in the upper part of the screen of FIG. 4 is clicked by the user, the survey information input unit 19 displays the property information selection screen of FIG. 4C on the touch panel display 3. In the property information selection screen, a list of property information currently registered in the property information table 36 is displayed. Here, “property information” refers to common information for each surveyed property in a certain construction loss survey case, and specifically, is information such as a survey name, a property number, and information on the owner of the property. The user selects the corresponding property from the list of property information (selects by clicking the circular radio button 62 displayed at the left end of each column of the list). When the corresponding property is not registered, the user selects the setting button 57 displayed on the lower left of the screen. When the setting button 57 is selected, the survey information input unit 19 displays the property information input screen of FIG. 4D on the touch panel display 3 and waits for the user to input the property information. The user inputs property information into each column displayed on the property information input screen using the key input device or the touch panel display 3, and clicks a save button 58. When the save button 58 is clicked, the survey information input unit 19 registers the input property information in the property information table 36 as a new record, and displays the property information selection screen of FIG. 4C again.

  When the user clicks on the building information button 61 in the upper part of the screen of FIG. 4, the survey information input unit 19 displays the building information selection screen of FIG. 4 (e) on the touch panel display 3. In the building information selection screen, a list of building information currently registered in the building information table 37 is displayed. Here, "building information" refers to common information for each surveyed building in a survey property with a certain construction loss survey case, and specifically, it relates to the owner of the building, the building number, the land owned by the building, and the owner. It is information such as information and survey date. The user selects a building to be examined from the list of building information (selects by clicking the circular radio button 62 displayed at the left end of each column of the list). Further, when the corresponding survey target building is not registered, the user selects the setting button 57 displayed at the lower left of the screen. When the setting button 57 is selected, the survey information input unit 19 displays the building information input screen of FIG. 4F on the touch panel display 3 and waits for the user to input the building information. The user inputs building information into each column displayed on the building information input screen using the key input device or the touch panel display 3, and clicks a save button 58. When the save button 58 is clicked, the survey information input unit 19 registers the input building information in the building information table 37 as a new record, and displays the property information selection screen of FIG. 4 (e) again.

  The user clicks on the survey information button 59, the property information button 60, and the building information button 61 at the top of the screen in FIGS. 4 (a), (c) and (e), as shown in FIGS. Can be freely switched and displayed on the touch panel display 3. When the survey information button 59 is clicked, the survey information selection screen of FIG. 4A is displayed.

  When all of the survey information, the property information, and the building information are selected, the survey information input unit 19 makes it possible to select the blackboard information input button 63 at the right end of the screen upper part of FIG. 4 (a) (c) (e). . Then, when the user clicks the blackboard information input button 63 which has become selectable, the survey information input unit 19 displays the blackboard information input screen of FIG. 5 on the touch panel display 3.

  There are three types of blackboard information input screen shown in Fig. 5 (a), (b) and (c). Fig. 5 (a) is a standard blackboard information input screen, Fig. 5 (b) is an inclined blackboard information input screen, 5 (a) is a horizontal blackboard information input screen. These are alternately displayed by the user clicking the standard blackboard information display button 64, the inclined blackboard information display button 65, and the horizontal blackboard information display button 66 at the lower part of the screen.

  The tilt blackboard information display button 65 is a button for inputting an instruction to display an electronic small blackboard corresponding to a tilt measurement (measurement of a temporal change in tilt such as a pillar or a sill) (see page 4 of Non-Patent Document 1). (Refer to Article 19 (2), (5) etc.) The horizontal blackboard information display button 66 is a button for inputting an instruction to display an electronic small blackboard corresponding to a level measurement (measurement of a change in height with respect to the water mark due to ground settlement) (see page 3 of Non-Patent Document 1 See Article 19 (2)). The standard blackboard information display button 64 is a button for inputting an instruction to display an electronic small blackboard corresponding to other general damage inspections.

  Here, the “blackboard information” is information to be displayed on the electronic small blackboard and information for specifying the position, size, and direction in which the electronic small blackboard is displayed on the photograph to be taken.

  The user inputs blackboard information using the key input device or the touch panel display 3 from these blackboard information input screens, and clicks a save button 67 on the upper right of the screen. When the save button 67 is clicked, the survey information input unit 19 registers the input blackboard information in the blackboard information table 32 as a new record, and displays the survey form selection screen of FIG. 6 again.

  On the survey form selection screen of FIG. 6, a list of survey form information registered in the survey form information table 38 (hereinafter, referred to as "the survey form list") is displayed (FIG. 6 (a)). Here, "survey form information" refers to information to be entered on a survey form created for each photographed image captured in the construction loss survey, and specifically, a survey number, a building number, a photo number, a room name, Information on each part (inner wall, ceiling, etc.), finishing material (mortar, wood, etc.), damage type (cracks, peeling, etc.), etc. The survey form list can be scrolled up and down by the user swiping or flicking the survey form list on the touch panel display 3 with the finger up and down. If there is no record registered in the survey form information table 38, an empty list is displayed as shown in FIG. 6 (b).

  In each column of the survey form list displayed on the touch panel display 3, the thumbnails 70 of the photographed images are displayed on the left side, and a table 71 of the survey form information is displayed on the right side thereof. At the bottom of each column of the survey form list, a whiteboard correction button 72, a re-shooting button 73, and a deletion button 74 are displayed.

  When the user clicks the whiteboard correction button 72 of the field having the survey form list, the survey information input unit 19 reads the blackboard information related to the survey form of the selected field from the blackboard information table 32, and the blackboard information of FIG. Display the input screen. Thereby, the user can correct the blackboard information of the electronic small blackboard of the survey sheet.

  When the user clicks the delete button 74 of the column having the survey form list, the survey information input unit 19 deletes the record of the survey table information related to the survey form of the selected column from the survey form information table 38 and selects it. The photographed image relating to the survey sheet in the column described above is deleted from the image file folder 31.

  When the user clicks the re-shooting button 73 in the column having the survey list, the survey information input unit 19 sets the questionnaire information record in the column as the survey information record currently being selected, and the imaging unit 11 The photographing screen of a) is displayed on the touch panel display 3, and the photographed image according to the survey sheet of the selected field is rephotographed.

  A survey setting button 75, a menu regression button 76, and a photographing start button 77 are displayed at the bottom of the survey list on the survey sheet selection screen of FIG. The investigation setting button 75 is also an end for resetting the investigation information of the photographed image to be photographed from now. When the user clicks the survey setting button 75, the survey information input unit 19 displays the survey information selection screen of FIG. 4A on the touch panel display 3, and transitions to processing such as the input of the survey information described above. The menu regression button 76 is a button that returns to the initial menu screen of FIG. 3 (d), and when the user clicks the menu regression button 76, the survey information input unit 19 displays the initial menu screen of FIG. 3 (d). Display on touch panel display 3. The shooting start button 77 is a button for inputting an instruction to shoot a new image for the damage inspection, and when the user clicks the shooting start button 77, the survey information input unit 19 adds a new form to the survey form information table 38. The survey form information record is added to the survey form information record as the selected survey form information record, and the imaging unit 11 displays the imaging screen of FIG. A picture is taken.

  In the photographing screen of FIG. 7A, the photographed image 80 currently output by the camera 2 is acquired and displayed at the center by the imaging unit 11 and the photographed image display unit 13, and the electronic small blackboard display unit 21 is displayed on the image. However, the electronic small blackboard 81 is displayed on a blackboard information display layer different from the image layer on which the photographed image 80 is displayed, and the blackboard information input by the survey information input unit 19 is displayed in the electronic small blackboard 80. At this time, the electronic small blackboard display unit 21 additionally registers a new record for the electronic small blackboard 81 in the blackboard information table 32. Further, a survey form list display button 82 and a shutter button 83 are displayed on the left side of the photographed image 80 of the photographing screen, and a menu regression button 84 is displayed on the right side of the photographed image 80 of the photographing screen. The menu regression button 84 is a button that returns to the initial menu screen of FIG. 3 (d), as with the menu regression button 76 of FIG. The survey form list display button 82 is a button for returning to the survey form selection screen of FIG. 6, and when the user clicks the survey form list display button 82, the survey information input unit 19 displays the survey form selection screen of FIG. Display on touch panel display 3. The shutter button 83 is a button for fixing the photographed image 80 currently displayed on the photographing screen.

  When the user clicks the shutter button 83, the photographed image display unit 13 acquires the photographed image 80 currently output by the camera 2 by the imaging unit 11, and displays the image fixedly on the photographing screen. At this time, the indication mark display unit 14 displays an indication mark setting screen as shown in FIG. 7B. In the instruction mark setting screen, the photographed image 80 acquired by the imaging unit 11 and the electronic small blackboard 81 described above are superimposed and displayed as a separate layer in the center, and an image save button 92 and an instruction mark addition button are displayed on the left of the photographed image 80 86, an instruction mark deletion button 87, a drawing button 88, and an eraser button 89 are displayed, and a survey form list display button 82, a photographing restart button 90, and a menu regression button 84 are displayed on the right of the photographed image 80.

  The survey form list display button 82 and the menu regression button 84 are the same as in FIG. 7A. Further, the shooting resumption button 90 is a button for releasing the fixation of the shot image 80, and when the user clicks the shooting resumption button 90, the screen returns to the shooting screen of FIG. 7A, and the imaging unit 11 and the imaging unit 11 The captured image 80 currently output by the camera 2 is acquired and displayed on the imaging screen.

  The instruction mark addition button 86 is a button for inputting an instruction to additionally display the instruction mark 91 on the photographed image 80. When the user clicks on the instruction mark addition button 86, the instruction mark display unit 14 sets a new instruction mark 91 on the captured image 80 as an instruction mark display layer different from the image layer on which the captured image 80 is displayed. Add and display superimposed. At the same time, the indication mark display unit 14 adds a record of the indication mark additionally displayed to the indication mark information table 33. Although FIG. 7 shows an instruction mark in the shape of a support rod as an example of the instruction mark 91, in the present invention, the shape of the instruction mark 91 is not particularly limited to the shape of the support rod. Further, the instruction mark display unit 14 additionally displays a new instruction mark 91 each time the instruction mark addition button 86 is clicked. At this time, an instruction mark 91 having a color different from that of the instruction mark 91 already displayed is additionally displayed so as to be distinguishable from the instruction mark 91 already displayed.

  When the user places a finger on the instruction mark 91 displayed on the captured image 80 on the touch panel display 3 and drags it, the instruction mark selection moving unit 15 follows the instruction and places the finger on the instruction selected. The display position of the mark 91 is moved. As a result, the user can move the tip of the instruction mark 91 (the tip of the support bar in FIG. 7B) to the imaging target location in the captured image 80 to clearly indicate the imaging target location in the photograph. For example, when a crack in the inner wall of a building is photographed in the photographed image 80, two indication marks 91, 91 are displayed on the photographed image 80, and these are moved and placed on both ends of the crack to clearly indicate the photographing target location. can do.

  The instruction mark delete button 87 is a button for inputting an instruction to delete an unnecessary one of the instruction marks 91 displayed on the photographed image 80. When the user clicks the instruction mark 91 displayed on the photographed image 80 on the touch panel display 3 that he / she desires to delete to select it, and then clicks the instruction mark delete button 87, the instruction mark display unit 14 is displayed. The display of the selected instruction mark 91 is erased. At the same time, the indication mark display unit 14 deletes the deleted indication mark record from the indication mark information table 33.

  The drawing button 88 is a button for inputting an instruction to additionally display a line drawing on the photographed image 80. When the user clicks the drawing button 88, the instruction mark display unit 14 displays a palette 93 for color selection as shown in FIG. 7C on the display screen of the touch panel display 3. The user is The drawing color is selected by the palette 93, and the user drags the finger on the photographed image 80 on the touch panel display 3 to follow the traced locus, and the indication mark display unit 14 displays the photographed image 80 on the photographed image 80. A free line drawing is additionally displayed as a line drawing display layer different from the image layer on which the photographed image 80 is displayed. The eraser button 89 is a button for inputting an instruction to erase the line drawing additionally displayed on the photographed image 80. When the user clicks the eraser button 89, the instruction mark display unit 14 erases the line drawing displayed on the photographed image 80.

  The image storage button 92 is a button for inputting an instruction to save the photographed image 80 on the touch panel display 3, the electronic small blackboard 81, the instruction mark 91, and the line drawing in the data storage unit 12. When the user clicks the image save button 92, the image container save unit 16 causes the touch panel display 3 to display the save confirmation screen shown in FIG. 7 (d).

  In the save confirmation screen, save buttons 94 and 95 and an edit continuation button 96 are displayed on the touch panel display 3. The save buttons 94 and 95 are buttons for inputting an instruction to save the image layer and instruction mark display layer currently displayed on the touch panel display 3, the blackboard information display layer, and the line drawing display layer in the data storage unit 12.

  When the save button 94 is clicked on the save confirmation screen shown in FIG. 7D, the image container save unit 16 adds a new image number to the current captured image and sets the image number to the survey form information table 38. When the save button 95 is clicked while saving in the image number field, the image container saving unit 16 adds a branch number to the current image number in the current captured image and investigates the image number with branch number The difference is that the image information is stored in the image number field of the vote information table 38. When the save button 94 or 95 is clicked, the image container save unit 16 multiplexes the image layer and the instruction mark display layer, the blackboard information display layer, and the line drawing display layer currently displayed on the touch panel display 3 at that time. A file name is attached to the image file folder 31 of the data storage unit 12 and stored as an image container of the layer image. At this time, the file name is automatically created from information such as shooting time. At this time, the survey information input unit 19 adds the file name of the stored image file to the “image file name” field of the currently selected survey information record of the survey information table 38. And it returns to the imaging | photography screen of Fig.7 (a).

  When the edit continuation button 96 is clicked on the storage confirmation screen of FIG. 7D, the screen returns to the instruction mark setting screen of FIG. 7B without storing the photographed image.

  As described above, in the equipment failure survey support device of the present embodiment, after the captured image 80 captured by the camera 2 and acquired by the imaging unit 11 is once displayed on the touch panel display 3 by the captured image display unit 13, By adding the instruction mark 91 on the photographed image 80 by the mark display unit 14 and the instruction mark selection moving unit 15 and storing them as a multi-layer image, the operator can use the support rod to pick up the photographing target location at the time of photographing. There is no need to point. Therefore, it becomes possible to carry out the photographing operation of the record photograph of the investigation site of the work loss investigation by only one worker.

  In addition, it is necessary to place the small blackboard in the field at the time of photographing by displaying the small electronic blackboard as superimposed on the photographed image 80 by the small electronic blackboard display portion 21 and storing this electronic small blackboard image as a multi-layer image. Work efficiency is improved.

  In the present embodiment, the image stored in the data storage unit 12 and the survey form information stored in the investigation information storage unit 20 can be tampered with the SD card of the SD card drive 4 by the SD card output unit 17. It is encrypted and output for storage. At this time, the authentication information such as the storage date is also encrypted and stored, and the proof ability of the photo data etc. is secured. Also, at the time of shooting, the data transmission unit 18

DESCRIPTION OF SYMBOLS 1 Mobile terminal device 2 Camera 3 Touch panel display 4 SD card drive 11 Imaging unit 12 Data storage unit 13 Captured image display unit 14 Instruction mark display unit 15 Instruction mark selection moving unit 16 Image container storage unit 17 SD card output unit 18 Data transmission Section 19 Survey information input unit 20 Survey information storage unit 21 Electronic small blackboard display unit 22 User registration unit 23 User information storage unit 24 Login processing unit 31 Image file folder 32 Chalkboard information table 33 Instruction mark information table 35 Survey information table 36 Property information Table 37 Building information table 38 Questionnaire information table 41 User information table 51 Login button 52 Account registration button 53 Registration button 54 Investigation start button 55 Investigation restart button 56 List display button 57 Setting button 58 Save button 59 Check information button 60 Property information button 61 Building information button 63 Blackboard information input button 64 Standard blackboard information display button 65 Tilted blackboard information display button 66 Horizontal blackboard information display button 67 Save button 70 Thumbnail of photographed image 71 Table 72 of whiteboard information Correction button 73 Re-shooting button 74 Delete button 75 Survey setting button 76 Menu regression button 77 Shooting start button 80 Shooting image 81 Electronic small blackboard 82 Questionnaire list display button 83 Shutter button 84 Menu regression button 86 Instruction mark addition button 87 Instruction mark deletion Button 88 Drawing button 89 Eraser button 90 Shooting resume button 91 Instruction mark 92 Image save button 93 Palette 94, 95 Save button 96 Edit continue button

Claims (3)

An equipment loss investigation support device for supporting the work related to photography of the investigation site in the equipment loss investigation,
A mobile terminal device comprising a camera and a touch panel display,
Imaging means for capturing an image by the camera and acquiring an image;
Captured image display means for displaying the captured image captured by the imaging means on the touch panel display;
An indication mark indicating an imaging target location on the photographed image is additionally displayed on the photographed image displayed on the touch panel display as an indication mark display layer different from the image layer on which the photographed image is displayed. Instruction mark display means,
Instruction mark selection moving means for moving the display position of the selected instruction mark in accordance with the input from the touch panel display;
And image container storage means for storing the image layer and the instruction mark display layer displayed on the touch panel display as an image container ,
The indication mark display means is configured to add a new indication mark of a color different from the color of the indication mark already displayed on the touch panel display, each time an indication mark addition instruction is input from the touch panel display. Instruction mark adding means additionally displayed on the indication mark display layer of the touch panel display;
In the touch panel display, when any one of the displayed instruction marks is selected, and the instruction mark deletion instruction is input from the touch panel display, the selected instruction mark is displayed on the touch panel display. And an instruction mark deletion unit for deleting the instruction mark display layer from the instruction mark display layer .


A blackboard information input screen for inputting blackboard information including information on the shooting target location related to the work damage investigation and the shooting date is displayed on the touch panel display, and blackboard information input on the survey information input screen is acquired Survey information input means to
When the photographed image is displayed by the photographed image display means, an electronic small blackboard is displayed on a blackboard information display layer different from the image layer on which the photographed image is displayed, and the survey information is input in the electronic small blackboard An electronic small blackboard display means for displaying blackboard information input by the means;
The apparatus according to claim 1, wherein the image container storage unit stores the image layer, the instruction mark display layer and the blackboard information display layer displayed on the touch panel display as an image container. .   A program that causes the portable terminal device to function as the damage investigation support device according to claim 1 or 2 by being read and executed by a portable terminal device including a camera and a touch panel display.