JP2009049518A - Monitoring device, monitoring system, and image search method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To search a target image easily from an image file of a monitoring camera. <P>SOLUTION: The monitoring device comprises an input part 21 connected to a network 10 to which at least one monitoring camera is connected, an image storage part 22 for storing images of the monitoring camera input from the input part, a bookmark editing part 25 for giving a bookmark to an image stored in the image storage part 22, a bookmark storage part 24 for storing the bookmark, and an output part 23 for outputting the image and bookmark. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to a monitoring device using a monitoring camera used in a security system and the like, a monitoring system, and an image search method, and more particularly to a technique for searching for an image of a monitoring camera.

  In a so-called security recorder that records video from a surveillance camera, for example, in order to identify a suspicious person, the recorded video is searched. When searching for the target video, it is common to search at the time when the suspicious person invades or search by the alarm type of the security sensor recorded at the same time when the video is recorded. Also, a huge amount of video from the surveillance camera is recorded.

  FIG. 9 is an example of a so-called time chart showing a temporal flow of a certain video. The scale below the time chart, shown as a bar graph, represents hours in minutes. An alarm (AR) is recorded as a signal indicating the response of the security sensor. As shown in the figure, since the alarm is recorded every time the security sensor reacts with a sound or the like, five alarms (AR) are recorded between 60 minutes and 120 minutes from the start of recording. Two alarms (AR) are also recorded between 180 minutes and 300 minutes.

Therefore, in order to find the target video, for example, an alarm (AR) near the time when the suspicious person seems to have entered is searched. In this case, by searching for the vicinity of the corresponding time before reaching the record that you really want to see, you can further search by alarm (AR), narrow down, and replay some videos to check visually. Can be obtained. Patent Document 1 discloses a system that can record a video of a surveillance camera as a digital signal, and can quickly perform data analysis and image search for analyzing a human flow.
JP 2002-112244 A

In particular, this search method is very inconvenient for the user when it is desired to search for a video once checked in the past at another opportunity and record it in an external recording device or the like.
In addition, it takes a lot of time and labor to search for a target video from a huge volume of video. Furthermore, when a plurality of people search for the same video, all of them repeat the same work, which is very inconvenient for the user.
Therefore, the present invention provides an apparatus, system, and method capable of efficiently searching for a target video from a recorded video and searching for the same video at the next opportunity.

  The present invention provides an input unit connected to a network to which at least one security camera is connected, a video storage unit that stores the video of the security camera input from the input unit, and a bookmark for the video stored in the video storage unit There is provided a monitoring apparatus comprising: a bookmark editing unit that assigns a bookmark; a bookmark storage unit that stores the bookmark; and an output unit that outputs a video and a bookmark.

  According to the present invention, by adding a bookmark to a video that has been searched once, the video can be searched using the bookmark from the next search, so that the video can be searched efficiently.

Hereinafter, an embodiment of the present invention will be described with reference to FIGS.
The present embodiment is characterized in that a bookmark is given when a video of a surveillance camera is searched and a target video is easily searched by searching for a bookmark from the next search. That is, a feature of this embodiment is an apparatus and a method for adding and editing a bookmark to a video recorded by a surveillance camera.

In the present embodiment, when the data recorded in the security recorder is reproduced, the following can be realized by attaching a bookmark to a location required by the user.
(1) The data required by the user is often before and after the alarm, and can cover the points that cannot be covered by the alarm automatically given by the monitoring system. Specifically, necessary images are acquired while discriminating between suspicious persons and customers while viewing the images.
(2) By using a bookmark as a search condition, a search can be performed based on image or audio information actually viewed by the user. That is, a record confirmed by one user as important can be easily searched by another user.
(3) When recording (exporting) recording data to an external recording device, it is possible to specify not a time but a location that the user wants to cut out with a bookmark.
(4) By linking the bookmark with other records, the user can cut out all the records from the associated surveillance camera in the surveillance system.
(5) By displaying a bookmark on the timeline during playback, it is possible to easily jump to a desired location, and to easily specify a start point and an end point when a target video is cut out.

  The overall configuration in the example of the present embodiment will be described below. Next, bookmark editing will be described. There are seven types of bookmark editing: bookmark assignment, deletion, link, search, export, range specification, and movement.

[Overall configuration]
FIG. 1 is a block diagram showing an example of this embodiment. As shown in the figure, a plurality of surveillance cameras (with at least one surveillance camera) cam-1, cam-2, cam-3,..., Cam-n are connected to the network 10. Furthermore, a monitoring device 20 is connected to the network 10. An information input device 50 such as a keyboard and a mouse, a display device 30 such as a liquid crystal display, and an external recording device 40 such as a DVD (Digital Versatile Disc) and a CD (Compact Disc) drive are connected to the monitoring device 20.

  The monitoring device 20 is connected to the input unit 21 for inputting the video of the monitoring cameras cam-1... Cam-n, the video storage unit 22 for storing the video, and the stored video to the display device. Has an output unit 23 for outputting to. The monitoring device 20 is connected to an information input device 50 such as a keyboard and a mouse, and has a bookmark editing unit 25 for editing a bookmark. The monitoring device 20 stores the bookmark edited by the bookmark editing unit 25. A bookmark storage unit 24 is provided. The bookmark storage unit 24 is connected to the output unit 23 via the bookmark editing unit 25, and can display a bookmark when the video is reproduced. Hereinafter, bookmark editing includes creation of a bookmark.

[1. Add bookmark]
FIG. 2 shows an example of a screen displayed on the display device 30 when the monitoring device 20 edits a bookmark. The monitoring device 20 has a playback interface 100 for playing back video and a search interface 110 for searching for video using bookmarks.

  The user takes out a desired video from the video storage unit 22 and plays it back. As shown in FIG. 2, it is assumed that the playback interface 100 is playing back video recorded by the surveillance camera as shown in FIG. The playback video is displayed in a dedicated playback window 101. The playback interface 100 can be operated to perform playback, reverse playback, pause, stop, frame advance, and frame return by the operation button group 102. This operation is performed by a playback button 102a, reverse playback button 102b, pause button 102c, stop button 102d, frame advance button 102e, and frame return button 102f as shown in the figure. A time scale 103 is displayed to indicate the current file position during playback.

  Stopping and pausing only differ in the playback position after stopping, and in both cases, the image being played is in a stationary state during processing. In the case of stop, when playing back again after stopping, playback is started from the beginning of the video file. In the case of pause, the continuation is played from the position where it stopped. The time line 103a of the time scale 103 displays the horizontal axis as time, and the marker 103b moves on the time line 103a simultaneously with the reproduction of the video, thereby displaying the current reproduction position. As shown in the figure, a recorded name 103 c is displayed near the time line 103.

  If the target video is found during playback, the pause button 102c is clicked. In addition, a frame can be selected in units of frames using the frame advance button 102e, the frame return button 102f, and the like.

  When the video to be selected (video start point) is determined, a bookmark is added to the video. When adding a bookmark to the video, the bookmark button 104 is clicked. As a result, the bookmark icon 105a is displayed on the timeline 103a. You can also add comments to bookmarks. When the bookmark button 104 is clicked, a comment window 106 is displayed, and a comment can be written therein. Comments are written in text format. The comment window 106 may be displayed as a pop-up window so as to overlap the screen.

The bookmark is created as a text file, and the created bookmark file is saved in the bookmark saving unit 24. The bookmark includes information such as the file name of the video file, the position of the bookmark on the video file (usually the time), the bookmark name, and a comment. The bookmark name is an identifier for identifying each bookmark when a plurality of bookmarks are created, for example. This identifier may be a number or character data. In the example of FIG. 2, the bookmark name is “BM1”.
In addition to comments, you can also write information about the camera used in the bookmark. Furthermore, it can be associated with other video files.

The bookmark file created in this way is stored in the bookmark storage unit 24.
When editing bookmarks, bookmarks can be attached while the recorded video is being played. Also, when the bookmark button 104 is clicked when the video from the surveillance camera is being played back in real time, video recording can be started from that point, and a bookmark can be added to the beginning of the recording.

[2. Delete bookmark]
Next, bookmark deletion will be described. To delete a bookmark, simply select a bookmark to be deleted and click the bookmark delete button 107. More specifically, FIG. 3 shows a state in which a video file stored as the record 1 is called and reproduced as an example. As shown, two bookmarks BM1 (105a) and BM2 (105b) are assigned to the record 1. For example, when deleting BM2 (105b), BM2 (105b) is selected by clicking a bookmark with BM2 (105b) with the information input device 50 such as a mouse (not shown). When a bookmark is selected, the bookmark icon is highlighted as shown. Next, a bookmark deletion button 106 for deleting the bookmark is pushed. As a result, the clicked bookmark BM2 (105b) can be deleted. That is, when the bookmark deletion button 107 is clicked, information corresponding to BM2 (105b) is deleted from the bookmark file.

[3. Bookmark search]
First, an outline will be described. The search searches for a bookmark file stored in the bookmark storage unit 24. This bookmark file also includes comments. When the corresponding bookmark is found, the video file stored in the bookmark file is taken out from the video storage unit 22. Next, the corresponding video is played from the bookmark file position on the playback interface 100. Thus, by searching for a video file based on the bookmark file, the target video can be efficiently acquired. Next, details of the search will be described.

  The search may be performed by searching with a bookmark or by specifying a time range. When searching by time, the target video is acquired using the bookmark file. First, search using bookmarks will be described. The search is performed on the search screen shown in FIG. The example of FIG. 4 is an example in the case of performing a keyword search based on a comment. As shown in the figure, the “bookmark” selection button 111 is selected. In the bookmark name input field 113, a bookmark to be searched is input. In the example of FIG. 4, the bookmark name input field is blank. However, if a bookmark name is input in the bookmark name input field 113, the search is performed.

  A search keyword is input in the comment search field 120. At this time, a plurality of keywords can be input via a space and searched by a logical operation of the keywords. FIG. 4 shows an example of this case. Nothing is entered in the bookmark name input field 113. In the comment search field 120, the keywords “suspicious person”, “plurality”, and “intrusion” are entered via a space.

  Further, when the search option button 122 is clicked, a search option window 121 is displayed so as to be superimposed on the current screen. In this search option window 121, partial match (so-called or operation) and complete match (so-called and operation) of a plurality of keywords input in the comment search field 120 can be selected. Thereafter, the search button 114 is pressed to start the search.

  As a result of the search, four video files of recording 1 to recording 4 are displayed in the file display area 118 as shown in FIG. When viewing each video, “record” is performed by an operation such as a double click using the information input device 50 such as a mouse. The video is played back by the playback interface shown in FIG.

  In the example of FIG. 4, since perfect match is selected, bookmarks including all keywords in the comment search field 120 are searched. If there is a bookmark link, it is displayed by a link line 123 as shown. In FIG. 4, record 1 and record 2 are linked by BM1 and BM2.

  Next, a method for searching by specifying a time range will be described. When searching in the time range, the date / time input field 112 is entered in the date / time range. In the example of FIG. 4, a range from January 1, 2006 23:03:20 to January 1, 2006 23:50:41 is searched as the time range. The search result is displayed in the file display area 118 as described above.

  When the searched bookmark is selected, the record related to the bookmark is cued and played at the bookmark time. When bookmarks are linked, all related records are cueed at the bookmark time and played simultaneously.

[4. Bookmark link]
In FIG. 2, there is one video to be played back, and a bookmark is assigned to one video file. However, one bookmark can be assigned to a plurality of video files. This is referred to herein as a “bookmark link”. This is performed by the search interface 110 (see, for example, FIG. 4 or FIG. 5).

  Here, a description will be given with reference to FIG. As described above, it can be assumed that the search is performed by time and the search is performed by bookmark name. In either case, the user can arbitrarily determine which search is performed. The example of FIG. 5 is a case where the search is performed by time since the “search range” selection button 111 is selected. When searching by bookmark, a bookmark name is input in the keyword input field 113 as shown in the figure.

  Next, the search button 114 is pushed with the information input device 50. The search result is displayed in the file display area 118. The searched video file is displayed here with the name “Record”. This is because the video of the surveillance camera may be automatically given by a computer or the like, and in this case, the file name may be represented by a very large number of digits (for example, 10 digits). When a plurality of video files are searched, each record 115 is distinguished and displayed as a number as “Record 1”, “Record 2”,. In FIG. 5, a list of “Record 1” to “Record 4” is displayed, and the video length is displayed in a bar format on the side. The bars are displayed so that the times match.

  In FIG. 5, record 1 and record 2 include all videos in the search range. Moreover, BM1 is given to the record 1 as a bookmark. In record 3, the start point of the video is not included in the search range, but the end point is included. In the record 4, the start point of the video is included in the search range, but the end point is outside the search range.

  When linking bookmarks, the target bookmark is first selected and highlighted as shown in FIG. Next, the record to be linked is selected and highlighted (here, “Record 2”, “Record 3”). Thereafter, the link button 116 is pushed by the information input device 50. As a result, the records 2 and 3 are associated with the bookmark (BM1) of the record 1. In this case, bookmarks are not given to record 2 and record 3.

  Next, when searching by time, a plurality of bookmarks may be given within the range of the searched time. The bookmark link in this case will be described. FIG. 6 assumes a case where a search is performed under the same conditions as in FIG. Since the search is based on time, nothing is entered in the bookmark name input field 113 and the comment input field 120.

  Looking at the search results, bookmark 1 (BM1) and bookmark 2 (BM2) are assigned to record 1. Here, it is assumed that the bookmark is linked to bookmark 2 (BM2). Record 2 and record 4 videos exist at the time of bookmark 2 (BM2). However, since there is no video at the time of bookmark 2 (BM2), recording 3 is not associated.

  When associating the bookmark 2 (BM2) with another record, the bookmark 2 (BM2) is first clicked to be highlighted. Next, record 2 and record 4 are clicked to be highlighted. Next, by clicking the link button 116, the bookmark 2 (BM2) is associated with the records 2 and 4, and the bookmark link is completed.

  In this way, even when a plurality of bookmarks are assigned to one record, a plurality of records can be associated with one bookmark. In the example of the present embodiment, the video file to be associated is selected by clicking the record 115. For example, when the bookmark is clicked, the file in which the video exists at the bookmark time (in FIG. 5). Recording 2 may be automatically selected in the case of BM1, and recording 2 and recording 4) in the case of BM2.

  In this way, associating one bookmark with a plurality of records is effective when, for example, a specific area such as a hallway or an entrance hall is monitored by a plurality of monitoring cameras.

[5. Export by bookmark]
In the example of the present embodiment, using a bookmark makes it possible to easily acquire a necessary part in the video. Therefore, for example, when recording (exporting) video on an external medium such as a CD or a DVD, there is an advantage that the operation is simple. This can be performed by the search interface 110 shown in FIGS. 4 and 5, for example. First, a target video is searched and a bookmark is selected (that is, the bookmark is highlighted). Next, the user can output a video file and a bookmark file to the external recording device 40 simply by clicking the export button 108. Thereby, a video and a bookmark file can be recorded on an external medium. The video recorded at this time is recorded with the bookmark as the head of the video file.

  When bookmarks are linked, all related video files are recorded in the external recording device. In addition, when a bookmark is linked, recording can be performed by displaying a list of video files associated with the bookmark and selecting a video file to be recorded in the external recording device. It is also possible to select an arbitrary range and record the video on an external medium. Next, this will be described.

[6. Specify range by bookmark]
In the above-described export using bookmarks, for example, when two bookmarks are assigned to one video file, this is a function used when a video is cut out using these bookmarks as a start point and an end point, respectively. By using this function, it is possible to easily record (export) an image of a specific section to an external recording device. This is done as follows.

  First, as shown in FIG. 5 and FIG. 6, the target video file is searched by the search interface, and the video is played back by the playback interface as shown in FIG. At this time, the bookmark is displayed on the time line 103a of the time scale 103 in the playback interface. In the example of FIG. 7, BM1 (105a) and BM2 (105b) are displayed as bookmarks.

  The user selects two bookmarks BM1 (105a) and BM2 (105b). As a result, each bookmark is highlighted as shown. Next, the user simply clicks the export button 108, and the section video 131 between the two bookmarks BM1 (105a) and BM2 (105b) is recorded in the external recording device.

  Next, a case where there is a bookmark link will be described. In the example of FIG. 8, two bookmarks (BM1 (105a) and BM2 (105b)) are assigned to the record 1 in the search interface. Record 2 is linked to BM1 (105a), and record 2 and record 4 are linked to BM2 (105b).

  In the same manner as described above, first, bookmarks that are the start point and end point of the range to be clipped are selected. In the example of FIG. 8, BM1 (105a) and BM2 (105b) are selected and displayed in reverse video. At this time, among the videos linked to each bookmark, videos within the selected range are also included. That is, in FIG. 8, the section video 131 in the range between the two bookmarks (BM1 (105a) and BM2 (105b)) of the record 1 and the range sandwiched by the link line 123 among the records 2 and 4 The section video 131 is selected.

  Next, by pressing the export button 108, the video in the range between the selected bookmark and the link line 123 can be cut out and exported.

[7. Move bookmark]
Once a bookmark is given, the position can be moved. This can be done with the playback interface 100. The playback interface 100 is shown in FIG. In the playback interface 100, bookmarks BM1 (105a) and BM2 (105b) are displayed on the time scale 103. The bookmark is moved by moving the bookmark on the timeline 103. This movement can be performed by a so-called drag operation using an information input device 50 (see FIG. 1) such as a mouse. When the bookmark is moved to a desired position, the bookmark movement is completed by pressing the bookmark button 104. When the bookmark is linked, the link itself is also changed.

It is a block diagram of the example of one embodiment of the present invention. It is explanatory drawing of the example of the screen at the time of the edit of the bookmark of one embodiment of this invention. It is explanatory drawing of the example of a screen when reproducing | regenerating the image | video to which two bookmarks of one embodiment of this invention are provided. It is explanatory drawing of the example of a screen at the time of the bookmark search of one embodiment of this invention. It is explanatory drawing of the example of a screen when linking a bookmark with the bookmark search interface of one embodiment of this invention. It is explanatory drawing of the example of a screen when linking a bookmark with the bookmark search interface of one embodiment of this invention. It is explanatory drawing of the example of a screen when the range of video cut-out is designated with the bookmark of one embodiment of this invention. It is explanatory drawing of the example of a screen when designating the range of image cut-out when there is a bookmark link according to an embodiment of the present invention. It is an example of the time chart of the image | video in a prior art.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 10 ... Network, 20 ... Monitoring device, 30 ... Display device, 40 ... External recording device, 50 ... Information input device

Claims (6)

An input unit connected to a network to which at least one surveillance camera is connected;
A video storage unit that stores the video of the surveillance camera input from the input unit;
A bookmark editing unit for adding a bookmark to the video stored in the video storage unit;
A bookmark storage unit for storing the bookmark;
An output unit for outputting video and bookmarks;
It is characterized by having
Monitoring device. The video storage unit records video from a plurality of surveillance cameras;
The monitoring device according to claim 1. The bookmark storage unit records bookmarks corresponding to a plurality of videos;
The monitoring device according to claim 2. Connected to an external recording device via the output unit,
The monitoring device according to claim 1. Recording the video output from the surveillance camera;
Associating the video with a bookmark,
The video is searched based on a bookmark,
Video search method. A surveillance system comprising at least one surveillance camera connected to a network and a recording device for recording video of the surveillance camera,
A video input unit connected to the network; a video storage unit for storing the input video of the surveillance camera;
An editing unit for adding a bookmark to the video recorded in the recording device;
A bookmark storage unit for storing the bookmark;
A monitoring system comprising: a video device having an output unit for outputting video and bookmarks connected to the network.

Images