JP5200819B2 - Goods management system - Google Patents

Abstract

Disclosed is a goods management system for enhancing efficiency of inventory work. A goods management system has a camera (140) which can photograph a plurality of storage areas (40) for storing at least one document file (50), respectively, out of a storage shelve (30) which can store a plurality of document files (50), and a database (300) storing an inventory ratio related to confirmation management situation of the plurality of document files (50) stored in the storage shelve (30), wherein the database (300) is accessed by specifying a storage area (40) from a video image photographed by means of the camera (140), an inventory ratio related to the storage area (40) is acquired, a composite image related to a storage area (40) corresponding to the inventory ratio thus acquired is created based on the inventory ratio acquired in this procedure, and then the composite image of the storage area (40) created in this procedure is displayed.

Description

  The present invention relates to an article management system that manages articles to be managed.

  In recent years, a system that combines wireless communication and a head-mounted display device (so-called head mounted display) has been proposed (for example, Patent Document 1).

In this prior art, an operator obtains information on a wireless tag (wireless IC chip) provided on an object (such as a building) via wireless communication, and a transmissive display. Means (head mounted display) are worn on the body. Information is acquired when the wireless tag enters the communication range of the reader due to the movement of the operator, and information on the corresponding object (such as a description of the structure or a photograph) is displayed on the display means to inform the operator. ing.
JP 2004-102835 A

  For example, in an industry such as sales / distribution, inventory is regularly performed by checking the inventory of goods and raw materials to check the quantity. It has already been proposed to carry out inventory by providing a wireless tag to an item to be inventoried and reading information from the wireless tag.

  Here, the stocktaking work is generally a long-time work because a large number of objects are checked. For this reason, the interruption and resumption of the work are repeated, but it is a waste of time and labor to carry out the double inventory for the already inspected object when the work is resumed. Therefore, it is preferable to avoid such extra work as much as possible and improve the inventory work efficiency.

  For example, as described above, when displaying according to the reading result of the wireless tag on the head-mounted display device, if the status of the inventory by the communication with the wireless tag is displayed, the current state of the inventory when performing the inventory is displayed. It should be convenient to see at a glance whether the object that is visible in the inventory has been inventoried or not. However, in the above-described prior art, only the display according to the current reading result from the wireless tag provided on the object is made, and the past reading result for the item to be inventoried and the situation corresponding thereto (inventory completed). No consideration was given to the display of the inventory status.

  An object of the present invention is to provide an article management system capable of visually informing an operator of an inventory status of a target article and improving the inventory work efficiency.

  In order to achieve the above object, the first invention is an imaging means capable of photographing a plurality of storage areas each storing at least one management target article among storage members capable of storing a plurality of management target articles, A database storing inventory information related to the inventory status of the plurality of management target articles stored in the storage member, and the storage area is identified from the video captured by the imaging unit, and the database is accessed. Inventory information acquisition means for acquiring the inventory information related to the inventory information, image generation means for generating a composite image related to the storage area corresponding to the inventory information based on the inventory information acquired by the inventory information acquisition means, and Image display means for displaying a composite image of the storage area generated by the image generation means, and an article radio provided in the article to be managed And an inventory information registration means for accessing the database and registering the corresponding inventory information based on an information reading result via the antenna, and an antenna that reads information by wireless communication. To do.

  In the first invention of the present application, the storage member is provided with a plurality of storage areas, and at least one managed object can be stored in each storage area. The database stores inventory information of each management target article (whether inventory has been completed, inventory has not been completed, etc.).

  At the time of inventorying the stored management target article, the inventory information acquisition unit identifies the storage area in which the management target article is stored by the imaging unit so that the storage information acquisition unit identifies the captured storage area. Inventory information relating to the storage area is acquired. In accordance with the acquired inventory information, the image generation unit generates a composite image related to the storage area, and the image display unit displays the composite image.

  Thereby, the image display means can perform display corresponding to the inventory state relating to the taken storage area. Therefore, for example, whether or not the storage area has already been invented can be clearly and visually notified to the operator. As a result, it is possible to prevent waste of double inventorying of the management target articles and storage areas once inventoryed, so that the inventory work efficiency can be improved. In addition, when acquiring inventory information from the database, the antenna wirelessly communicates with the article wireless tag from the antenna, and based on the result of reading the information, the inventory information registration means accesses the database and registers the inventory information. . As a result, the inventory information of the articles to be managed and the storage area can be automatically registered and updated in the database only by the operator reading information from the wireless tag for articles. As a result, convenience in inventory work can be improved.

  According to a second invention, there is provided area image recognition information storage means for storing recognition information of images of the plurality of storage areas in the storage member in the first invention. The inventory information acquisition means is photographed by the imaging means. First image recognition for identifying the storage area by recognizing the image of the storage area and comparing the recognition result with the recognition information of the image of the storage area stored in the area image recognition information storage means. Means are provided.

  By storing the recognition information of the image of each storage area in the area image recognition information storage means in advance and specifying the storage area by comparison with the stored image recognition information, it is possible to specify the storage area with high accuracy. . Further, by recognizing the video and specifying the storage area, it is not necessary to newly prepare another means for specifying the storage area from the video being shot.

  According to a third invention, in the second invention, the image display means is a display means held on the operator's head so as to be able to give a predetermined visual field including the storage area to the operator's vision. It is characterized by being.

  By using the head-holding display means, the composite image reflecting the inventory information can be displayed in front of the operator's eyes (in a free state) without blocking both hands of the operator, and can be reliably recognized. .

  According to a fourth invention, in the third invention, the display means is a transmissive display means capable of giving a predetermined field of view including a natural image of the storage area to an operator's vision, and the image generation means Is characterized in that the composite image is generated so that the positional relationship matches the natural image of the storage area.

  By using the transmissive display means, the operator can also see the natural image of the storage area. Then, by matching the positional relationship of the composite image with the natural image, it is possible to provide the operator with an image that does not feel uncomfortable.

  According to a fifth aspect of the present invention, in any one of the first to fourth aspects, the antenna transmits information by wireless communication from the wireless tag for articles and the wireless tags for areas provided in each of the plurality of storage areas. The inventory information registration means is readable, and the management target article corresponding to the article wireless tag based on the information read result of the article wireless tag and the area wireless tag via the antenna; The storage area corresponding to the area wireless tag is associated and registered as the inventory information.

  As a result, the operator can simply read the information from the two wireless tags (region wireless tag and article wireless tag) to identify the storage region in which the articles to be managed are stored and register it in the database. can do.

  According to a sixth aspect of the invention, in any one of the first to fourth aspects of the invention, the antenna has a one-to-one correspondence with a direction of communication directivity during the wireless communication with a shooting direction by the imaging unit. The inventory information registration means recognizes an image of the storage area taken by the imaging means when information is read from the article wireless tag by wireless communication using the antenna, and the recognition result and the area A second image recognition unit for specifying the storage area by comparison with image recognition information of the storage area stored in the image recognition information storage unit; and the specified storage area and the article wireless tag The inventory management information is registered in association with the corresponding management target article.

  By specifying the storage area using image recognition, the storage area in which the articles to be managed are stored can be specified without newly providing another wireless tag (area wireless tag) for specifying the storage area. Can be registered in the database. In addition, the storage image identification information of each storage area is stored in advance in the area image recognition information storage means, and the storage area is specified by comparison with the stored image recognition information, thereby specifying the storage area with high accuracy. Can do.

  A seventh invention is characterized in that, in the sixth invention, the second image recognition means is also used in the first image recognition means.

  The same image recognition means can be used for the inventory information registration means and the inventory information acquisition means, and the processing load can be reduced by using one image recognition means for both.

  In an eighth invention according to any one of the first to seventh inventions, the inventory information acquisition means acquires the inventory information related to the storage area in which a plurality of the management target articles are stored, and the image generation means includes: The composite image in a mode according to the number or ratio of the management target articles that have been inventoryed among the plurality of management target articles stored in the storage area based on the inventory information acquired by the inventory information acquisition means. Is generated.

  Thereby, since the operator can visually notify the operator according to the progress of the inventory work, the progress of the work can be surely recognized by the operator. As a result, it is possible to proceed with the subsequent inventory work in accordance with the progress made so far (such as preferentially inventorying delayed areas or completing previously advanced areas). Work efficiency can be improved.

  According to a ninth invention, in any one of the first to eighth inventions, storage information storage means for storing the management object in association with the storage area in which the management object is stored, and the inventory information Storage information determination means for determining whether or not the storage area associated with the management target article matches the storage content of the storage information storage means at the time of registration by the registration means; The composite image is generated so that the storage area determined not to match the stored content by the storage information determination unit is different from the storage area determined to match the stored content. It is characterized by that.

  Thereby, when there is an article stored in a place different from the position where it should be originally stored during the inventory work, the operator can be surely recognized to that effect. As a result, the article can be returned to the original correct position following the inventory work.

  According to the present invention, it is possible to visually notify the operator of the inventory status of the target article and improve the inventory work efficiency.

  Hereinafter, an embodiment of the present invention will be described with reference to the drawings. In this embodiment, the article management system of the present invention is applied to a file management system that manages the storage status (inventory status) of document files in a storage shelf.

  FIG. 1 is a system configuration diagram showing the overall configuration of the file management system of the present embodiment.

  In FIG. 1, a file management system TS includes a reader terminal 100 held by an operator M, a base station 202 capable of transmitting / receiving information to / from the reader terminal 100 via an antenna 201 by wireless communication such as a wireless LAN, It has a database (region image recognition information storage means) 300 connected to this base station 202 via a communication line NW.

  In this example, a large number of storage shelves (storage members) 30 having three storage areas (areas partitioned by shelves) 40 in the vertical direction are installed (only one is shown in the figure). In the area 40, a plurality of document files 50, which are articles to be managed, can be stored and stored.

  An article tag (a radio tag for articles) Tb is affixed to the back cover of each document file 50, and the document file 50 is stored on the front surface of each shelf on which the document file 50 is placed. A region tag (region wireless tag) Ta corresponding to the storage region 40 is affixed (hereinafter, the article tag Tb and the region tag Ta are collectively referred to as a wireless tag T). The file management system TS of the present embodiment is for performing an inventory work for periodically checking the existence and quantity of the document file 50, for example. That is, the document file 50 corresponding to each storage area 40 is preset and registered (as a regular storage position), and for example, the article tag Tb of the document file 50 is detected one by one from the end for each storage area 40. Thus, the existence and quantity of the document file 50 are confirmed.

  The reader terminal 100 includes a display device (image display means) 120 that can give a predetermined field of view FV (see FIG. 7 and the like described later) including a natural image to the vision of the operator M, the article tag Tb, and the region. The antenna 110 that performs wireless communication with the tag Ta in a predetermined communication area (see FIG. 6 and the like to be described later) and the outside world are imaged in a field of view equivalent to the field of view FV of the display device 120 (see FIG. 6 and the like to be described later) A possible camera 140 (imaging means), an operation unit 145 capable of inputting instructions and information from the operator M, wireless communication control via the antenna 110, imaging control by the camera 140, and the display device 120. And a control device 130 that performs display control according to the above. The antenna 110, the display device 120, the camera 140, and the control device 130 are held on the head of the operator M (the camera 140 shown is incorporated in the housing of the control device 130), and the operation unit 145 is connected. It is connected to the control apparatus 130 so that signal transmission is possible via a cord.

  The display device 120 includes a so-called wearable transmissive display that can be worn on the body of the operator M, and the operator M can select an article (an article or person other than the storage shelf 30 or the document file 50, A natural image (including all visible objects that can be visually recognized by the operator M with visible light) is transmitted through the display (not an image generated by the display device 120 but a real image visually recognized by the operator M with the visible light). Thus, the display image generated by the display device 120 can be superimposed on the natural image in the field of view FV. In the present embodiment, a retinal scanning display is used as the display device 120 (details will be described later).

  FIG. 2 is a functional block diagram showing a functional configuration of the reader terminal 100.

  The article tag Tb affixed to the spine of the document file 50 and the area tag Ta affixed to the shelf board of the storage shelf 30 are an IC circuit unit 150 for storing information and a tag connected to the IC circuit unit 150. Each has a RFID circuit element To including an antenna 151.

  The control device 130 accesses the RFID tag circuit element To of the article tag Tb and the area tag Ta via the antenna 110 by wireless communication, and processes a signal read from the RFID tag circuit element To. And a wireless LAN communication unit 132 for performing wireless LAN communication with the base station 202 via the antenna 201, the high-frequency circuit 131, the wireless LAN communication unit 132, the display device 120, the camera 140, and the operation unit 145. A control circuit 133 that controls the reader terminal 100 as a whole, and a storage unit 134 (such as a RAM) that is connected to the control circuit 133 and can read and write information.

  As described above, the display device 120 is a retinal scanning display, and based on a control signal from the control circuit 133 of the control device 130, a display control unit 121 that controls a light source unit 122 and a scanning unit 123, which will be described later, A light source unit 122 having a light source that emits light based on a control signal from the control unit 121 and a wavefront curvature of light emitted from the light source unit 122 based on a control signal from the display control unit 121, and the horizontal and vertical directions And a scanning unit 123 that irradiates the pupil of the operator M with a light beam while changing the incident angle.

  The database 300 includes, for example, a hard disk, a large-capacity memory, and the like. The identification information (hereinafter referred to as tag ID) of each RFID tag circuit element To of the article tag Tb and the area tag Ta, and the tag ID Various information about the corresponding storage area 40 and the management target article (document file 50 in this example) is stored in association with each other (see FIG. 8 described later). This database 300 can transmit / receive information to / from the control circuit 133 of the reader terminal 100 through communication via the communication line NW, the base station 202, and the antenna 201 by wireless LAN. Thereby, when information (tag ID) is read from the article tag Tb or the area tag Ta via the antenna 110 in the reader terminal 100, the database 300 is searched for information related to the tag ID, and the corresponding information is communicated. The reader terminal 100 can acquire or change via the line NW, the base station 202, and the antenna 201.

  In the above description, the database 300 is provided separately from the reader terminal 100. However, the present invention is not limited to this, and the reader terminal 100 may include the database 300.

  FIG. 3 is a functional block diagram illustrating a detailed functional configuration of the display device 120.

  In FIG. 3, the display control unit 121 calculates display image data based on the control signal from the control circuit 133, and controls the intensity modulation signal and the wavefront curvature modulation unit 19 for the R light source 11, the G light source 12, and the B light source 13. A signal and a synchronization signal to the light beam deflection system 20 are generated. These various calculation algorithms are well-known techniques commonly used in the field of computer graphics, and will not be described here. Light emitted from the R, G, and B light sources 11, 12, and 13 is formed into a substantially parallel light beam by the collimating lenses 14a, 14b, and 14c, and then combined by the wavelength selective mirrors 15, 16, and 17 for focusing. The light is incident on one end of the optical fiber 18 by the lens 14d. Light emitted from the other end of the optical fiber 18 is converted into a substantially parallel light beam by the collimator lens 14 e and is incident on the wavefront curvature modulation unit 19. The wavefront curvature modulation unit 19 modulates the wavefront curvature (parallelism) of the incident light beam in accordance with the control signal from the display control unit 121. The outgoing light beam from the wavefront curvature modulation unit 19 enters the light beam deflection system 20. The light beam deflection system 20 irradiates the light beam while changing the incident angle to the pupil of the operator M by a plurality of lenses and a polygon mirror (not shown).

  The display device 120 includes two series of optical systems configured as described above, and supplies light beams to both eyes of the operator M. As a result, the operator M can see the natural image of the article (such as the storage shelf 30 or the document file 50) in the field of view FV through the transmission through the transmissive cover 21 and perform the operation as described above. A display image (composite image) visualized by irradiation of the pupil can be seen superimposed on the natural image in the field of view FV of the display device 120.

  FIG. 4 is a functional block diagram showing a detailed configuration of the high-frequency circuit 131.

  In FIG. 4, a high-frequency circuit 131 accesses information in the IC circuit unit 150 of the RFID circuit element To via the antenna 110, and a control circuit 133 of the reader terminal 100 is connected to the RFID circuit element To. A signal read from the IC circuit unit 150 is processed to read out information, and various commands for accessing the IC circuit unit 150 of the RFID circuit element To are generated.

  The high-frequency circuit 131 includes a transmitter 142 that transmits a signal to the RFID circuit element To via the antenna 110, a receiver 143 that inputs a response wave from the RFID circuit element To received by the antenna 110, and a transmitter / receiver. And a separator 144.

  The transmission unit 142 is a block that generates an interrogation wave for accessing the RFID tag information of the IC circuit unit 150 of the RFID circuit element To. That is, the transmission unit 142 generates a carrier wave having a predetermined frequency by dividing / multiplying the output of the crystal resonator 145A under the control of the control circuit 133 and the crystal resonator 145A that outputs a frequency reference signal. The generated carrier is modulated based on a signal supplied from the control circuit 133 (in this example, based on the “TX_ASK” signal from the control circuit 133), and the Locked Loop (145B) 145B and the VCO (Voltage Controlled Oscillator) 145C. (Amplitude modulation) transmission multiplication circuit 146 (in the case of amplitude modulation, an amplification factor variable amplifier or the like may be used) and the modulated wave modulated by the transmission multiplication circuit 146 is amplified (in this example, from the control circuit 133) Amplification whose amplification factor is determined by the “TX_PWR” signal To and a variable transmission amplifier 147 to generate a desired interrogation wave. The generated carrier wave uses, for example, a frequency in the UHF band (or may be a microwave band or a short wave band), and the output of the variable transmission amplifier 147 is transmitted to the antenna 110 via the transmission / reception separator 144. And supplied to the IC circuit unit 150 of the RFID circuit element To. The interrogation wave is not limited to the signal (modulation wave) modulated as described above, and may be only a carrier wave.

  The reception unit 143 is necessary from the output of the I-phase reception multiplication circuit 148 that multiplies the response wave from the RFID tag circuit element To received by the antenna 110 and the carrier wave and demodulates the I-phase reception multiplication circuit 148. I-phase bandpass filter 149 for extracting only the signal in the band, I-phase reception amplifier 162 that amplifies the output of this I-phase bandpass filter 149, and further amplifies the output of this I-phase reception amplifier 162 to obtain a digital signal I-phase limiter 163 for converting to Q, a Q-phase reception multiplication circuit that multiplies the response wave received from the RFID tag circuit element To by the antenna 110 and the signal whose phase is delayed by 90 ° by the phase shifter 167 172, a Q-phase bandpass filter 173 for extracting only a signal of a necessary band from the output of the Q-phase reception multiplication circuit 172, and this Q-phase A Q-phase receiving signal amplifier 175 for amplifying the output of the command pass filter 173, and a Q-phase limiter 176 which converts the digital signal output of the Q-phase receiving signal amplifier 175 and further amplified. The signal “RXS-I” output from the I-phase limiter 163 and the signal “RXS-Q” output from the Q-phase limiter 176 are input to the control circuit 133 and processed.

  The outputs of the I-phase receiving amplifier 162 and the Q-phase receiving amplifier 175 are also input to an RSSI (Received Signal Strength Indicator) circuit 178 as intensity detecting means, and a signal “RSSI” indicating the intensity of these signals is supplied to the control circuit. 133 is input. As a result, the reader terminal 100 can detect the reception intensity of the signal from the RFID circuit element To during communication with the RFID circuit element To.

  FIG. 5 is a functional block diagram illustrating an example of a functional configuration of the RFID circuit element To. Note that both the article tag Tb and the area tag Ta include the RFID tag circuit element To.

  In FIG. 5, the RFID circuit element To includes the tag antenna 151 that transmits and receives signals without contact with the antenna 110 of the reader terminal 100 as described above, and the IC circuit unit 150 connected to the tag antenna 151. And have.

  The IC circuit unit 150 includes a rectification unit 152 that rectifies the interrogation wave received by the tag antenna 151, a power supply unit 153 that accumulates the energy of the interrogation wave rectified by the rectification unit 152, and uses it as a drive power source. A clock extraction unit 154 that extracts a clock signal from the interrogation wave received by the tag antenna 151 and supplies the clock signal to the control unit 157; a memory unit 155 that can store a predetermined information signal; and a modulation / demodulation connected to the tag antenna 151 And a control unit 157 for controlling the operation of the RFID circuit element To via the memory unit 155, the clock extraction unit 154, the modulation / demodulation unit 156, and the like.

  The modulation / demodulation unit 156 demodulates the interrogation wave received from the antenna 110 of the reader terminal 100 received by the tag antenna 151, modulates the reply signal from the control unit 157, and receives a response wave (tag) from the tag antenna 151. (Signal including ID).

  The clock extraction unit 154 extracts a clock component from the received signal and supplies a clock corresponding to the frequency of the clock component to the control unit 157.

  The control unit 157 interprets the received signal demodulated by the modulation / demodulation unit 156, generates a return signal based on the information signal stored in the memory unit 155, and transmits the return signal to the tag antenna by the modulation / demodulation unit 156. Basic control such as control returned from 151 is executed.

  6A and 6B are diagrams illustrating the positional relationship between the visual field ranges of the display device 120 and the camera 140 and the communication area of the antenna 110 with respect to the reference line-of-sight direction of the display device 120. FIG. 6A is a side view and FIG. ) Represents a top view.

  In FIG. 6A and FIG. 6B, the display device 120 of the reader terminal 100 mounted and held on the head of the operator M has an approximately center of the visual field FV that can be viewed by the operator M through the display device 120. A reference line-of-sight direction X is set. The communication area Ac in which the antenna 110 can wirelessly communicate with the article tag Tb and the area tag Ta is formed in the peripheral area centering on the reference line-of-sight direction X with the antenna 110 as a base point. That is, when the operator M wears the reader terminal 100 on the face, the communication area Ac of the antenna 110 is formed in substantially the same direction as the face of the operator M.

  Specifically, the communication area Ac is formed in a narrow range along one direction due to the directivity of the antenna 110 and overlaps the reference line-of-sight direction X extending from the center of the display device 120 as a base point. Formed. As a result, in a state where the operator M is separated from the storage shelf 30 by an appropriate distance, the field of view FV that the operator M can visually recognize via the display device 120 is limited to a limited area (in the center, in this example). Only the communication area Ac is formed (see the communication area reference circle Ra in FIG. 7 described later).

  As described above, when the operator M wearing the reader terminal 100 positions the reference line-of-sight direction X of the display device 120 on the target wireless tag T by swinging the head or bending and stretching the whole body, the antenna 110 is Wireless communication can be performed with respect to the target wireless tag T.

  In addition, the camera 140 is disposed in the vicinity of the side of the display device 120, and as described above, the outside world can be imaged in the visual field range Va (the range indicated by the alternate long and short dash line in the figure) that is substantially the same as the visual field FV of the display device 120. It has become. That is, the shooting direction of the camera 140 substantially matches the reference line-of-sight direction X in the display device 120 and is associated with the direction of communication directivity in which the communication area Ac of the antenna 110 extends.

  In addition, when communicating with the wireless tag T due to the attitude change of the operator M as described above, in order to smoothly aim and communicate with the target wireless tag T, within the field of view FV of the display device 120, An aiming figure corresponding to the reference line-of-sight direction X may be clearly indicated. FIG. 7 is a diagram showing a case where the aiming graphic is formed on the transmissive cover 21.

  In FIG. 7, the coordinates in the field of view FV are, in this example, configured in an XY coordinate system with the lower left vertex of the substantially rectangular field of view FV as the origin O (0, 0), and the coordinates of the lower right vertex of the field of view FV. Is (100, 0), the coordinates of the upper left vertex are (0, 50), and the coordinates of the upper right vertex are (100, 50). Further, in order to avoid the complexity of the illustration, a natural image that can be visually recognized in the visual field FV in the display device 120 and a display image by the optical system are omitted. In this example, a cross target line Rt is formed at a position that coincides with the reference visual line direction X at the center of the visual field FV, and is coaxial with the center of the cross target Rt and surrounds the outer periphery of the cross target Rt. Thus, a communication area reference circle Ra is formed. This communication area reference circle Ra is arranged so as to substantially coincide with the outer shape of the axial cross section of the communication area Ac of the antenna 110, and when the operator M is separated from the storage shelf 30 by an appropriate distance, The communication area reference circle Ra is large enough to include the target wireless tag T (that is, the communication area Ac is also formed with a corresponding size). The cross target line Rt and the communication area reference circle Ra are standard figures formed in advance on the surface of the transmissive cover 21 that transmits the natural image in the display device 120, and the operator M refers to them as a reader. By moving the terminal 100, the communication area Ac of the antenna 110 can be arranged to overlap the target wireless tag T.

  In this way, the operator M can store an arbitrary wireless tag T in the communication area Ac of the antenna 110 of the reader terminal 100 (in the example shown in FIG. 6, the single item tag Tb is stored). The tag ID of the wireless tag T can be read and detected.

  FIG. 8 is a diagram conceptually illustrating an example of a storage shelf management table that stores various management information corresponding to each storage shelf 30 and the storage area 40 provided therein, and FIG. 9 corresponds to each document file 50. It is a figure which represents notionally an example of the article management table which memorize | stores various management information. These storage shelf management table and article management table are information that is recorded and held in the database 300 (storage information storage means) and managed by the reader terminal 100. In addition, all the content which illustrates tag ID in a figure is described with a hexadecimal number.

  In FIG. 8, the storage shelf management table is provided with storage shelf number items set by serial numbers for the storage shelves 30 that have been registered for management. Further, the storage shelf management table corresponds to each storage shelf number (that is, each storage shelf number). Corresponding to the shelves 30, the storage area number items set in the arrangement order are provided for the storage areas 40 (see FIG. 1 described above) that are provided side by side in the vertical direction in this example. In this example, the storage area number is set by a combination of the number of the storage shelf 30 including the storage area 40 and the ascending order in the direction from the uppermost stage to the lowermost stage of each storage area 40 in the storage shelf 30. (In the example shown, the number of the storage area 40 located at the uppermost stage of the storage shelf 30 with the storage shelf number “1” is “1-1”, and the number of the storage area 40 located at the middle stage is “1-2”. Etc.)

  And corresponding to each storage area number (that is, corresponding to each storage area 40), "area tag ID", "image recognition pattern" (image recognition information), "inventory rate", "inventory date", and An item for storing and holding each “article tag ID” is provided. Among these, “inventory rate” and “inventory date” are items that are changed by the inventory work using the reader terminal 100, and other “storage shelf number”, “storage area number”, and “area tag ID”. , “Image recognition pattern” and “article tag ID” are items of management information fixedly set in advance.

  In “area tag ID”, a tag ID (hereinafter referred to as “area tag ID”) stored in the RFID circuit element To of the area tag Ta attached to each storage area 40 is recorded. .

  In the “image recognition pattern”, an image recognition pattern (image recognition information) is recorded as a parameter representing the appearance characteristics of each storage area 40 as data such as numerical values and vectors. This image recognition pattern can be generated by a known image recognition technique (details are omitted). Then, an image recognition pattern of each storage area 40 reflected in the image acquired from the camera 140 of the reader terminal 100 is generated by the same method, and the image recognition pattern (illustrated) registered in the storage shelf management table in advance is generated. In this example, the storage area 40 in the acquired image (that is, the storage area 40 in the field of view FV) is determined by determining the coincidence (pattern matching) in comparison with the patterns 1, 2, 3,. Can be identified and discriminated. Further, when generating the image recognition pattern of the storage area 40 from the acquired image, it is possible to recognize up to the arrangement coordinates and size of the storage area 40 in the acquired image. For this reason, it is preferable that each storage area 40 has an appearance characteristic or a difference that can be individually identified by the image recognition pattern. Specifically, the appearance characterization includes, for example, a surface such as a region tag Ta that has a difference in the shape or color of the whole or a part of the storage region 40, or is individually attached to the storage region 40. An identification pattern having a characteristic color or figure may be printed and recognized.

  The “inventory rate” includes storage (existence) in the storage area 40 by the reader terminal 100 on the corresponding inventory date among the document files 50 to be stored in the corresponding storage area 40 in advance. It is a parameter item indicating the percentage of confirmed items. In the file management system TS of the present embodiment, as described above, for example, the tag ID (hereinafter referred to as “article tag ID”) from the article tag Tb attached to the document file 50 one by one for each storage area 40 from the end. And the existence and quantity of the document file 50 are confirmed. Therefore, the inventory rate is a parameter indicating the degree of progress until the product tag ID is detected from all the product tags Tb for each storage area 40 during the confirmation operation (inventory).

  In the “article tag ID”, the above-described article tag ID of the article tag Tb attached to the document file 50 (plurality) that is set and registered in advance as the one to be originally stored in the corresponding storage area 40 is recorded. Yes.

  In FIG. 9, the article management table is provided with an “article tag ID” item for storing the article tag ID of the article tag Tb attached to each document file 50, and corresponding to each article tag ID (that is, Corresponding to each document file 50, items of “inventory status”, “inventory date”, “area tag ID (A)”, and “area tag ID (B)” are provided. Among these, “inventory state”, “inventory date”, and “area tag ID (B)” are items that are changed by the inventory work using the reader terminal 100, and other “article tag ID” and “ The “area tag ID (A)” is an item of management information that is fixedly set in advance.

  In the “item tag ID”, the item tag ID stored in the RFID circuit element To of the item tag Tb attached to each document file 50 is recorded.

  The “inventory status” is an item for recording whether or not the corresponding document file 50 is detected by the inventory operation of the reader terminal 100. The items of “inventory status”, “inventory date”, and “area tag ID” in this article management table are items that can be reset at the same time as “inventory date” in the storage shelf management table (note that the inventory rate is also reset at the same time) When an article tag ID is detected by a subsequent inventory operation of the reader terminal 100, the content of the inventory state corresponding to the article tag ID is “uninvented” ( The content immediately after the reset) is changed to “Inventory completed”. Further, the date when the stocktaking is performed is recorded in the item “inventory date”, and the region tag ID corresponding to the storage region 40 in which the article tag ID is detected is included in the item “region tag ID (B)”. To be recorded.

  In the “area tag ID (A)”, the area tag ID of the area tag Ta corresponding to the storage area 40 that is preset and registered as a storage location where the corresponding document file 50 should be stored is recorded. The correspondence between the contents of the “area tag ID (A)” item and the contents of the “article tag ID” item in the article management table (in this case, one-to-one) is shown in the “storage shelf management table shown in FIG. This matches the correspondence (in this case, multiple-to-one) with the content of the “article tag ID” item and the content of the “area tag ID” item.

  The operator M can know the management state of each document file 50 by acquiring information on each item in the article management table.

  In this example, the distinction between the article tag ID and the area tag ID is made by comparing the entire data contents with partial data at predetermined positions (in the example shown, the contents of the first 4 bits; “8” is an area tag ID and “F” is an article tag ID).

  FIG. 10 is a flowchart showing a control procedure executed by the control circuit 133 of the reader terminal 100. In this example, this flow is started after the power to the reader terminal 100 is turned on or when an instruction operation is input via the operation unit 145 (START position).

  First, in step S <b> 5, it is determined whether or not an input operation instructing to initialize (reset) recording / data related to the inventory work is performed from the operator M via the operation unit 145. If an operation for instructing initialization is not input, the determination is not satisfied, and the process directly proceeds to step S100 described later.

  On the other hand, if an operation to instruct initialization is input in step S5, the determination is satisfied, and the routine goes to the next step S10. In step S10, the database 300 is accessed, all items of “inventory rate” and “inventory date” in the storage shelf management table, and all “inventory status”, “inventory date”, and “area tag” in the item management table. The contents of the item “ID (B)” are initialized. Specifically, all inventory ratios are set to 0%, all inventory states are set to “uninvented”, and all “inventory date” and “area tag ID (B)” items are set to an unfilled state. Then, the process proceeds to step S100 described later.

  In step S <b> 100, the storage area 40 shown in the acquired image from the camera 140, that is, the natural image of the field of view FV that the operator M is looking through the display device 120 is recognized and specified. A display display process for displaying an information image corresponding to the inventory rate on the arrangement of the storage area 40 in the field of view FV is executed (see FIG. 11 described later).

  Next, the process proceeds to step S15, and it is determined whether or not an input operation instructing the operator M to read and detect the article tag ID of the article tag Tb and the area tag ID of the area tag Ta is performed via the operation unit 145. To do. If an operation to instruct detection is input, the determination is satisfied, and the routine goes to the next Step S200.

  In step S200, the tag ID (article tag ID or area tag ID) of the wireless tag T (any one of the article tag Tb or the area tag Ta) existing in the communication area Ac by wireless communication via the antenna 110 is set. An ID detection registration process is performed for detecting and reading, and calculating / changing the inventory rate of the corresponding storage area 40 and changing other information based on the detection result (see FIG. 12 described later). Then, the process proceeds to the next step S20. On the other hand, if the detection instruction operation is not input in the determination in step S15, the determination is not satisfied and the process proceeds to step S20 as it is.

  In step S20, it is determined whether or not the operator M has performed an instruction operation for ending the inventory work via the operation unit 145. If the end operation has been performed, the determination is satisfied, and this flow is ended as it is. On the other hand, if the end operation has not been performed, the determination is not satisfied and the process returns to step S100 and the same procedure is repeated.

  FIG. 11 is a flowchart showing a detailed procedure of the display display process executed in step S100 in FIG. In FIG. 11, first, in step S105, an image at that time is acquired from the camera 140. As described above, the acquired image from the camera 140 is substantially the same as the natural image that the operator M is viewing through the display device 120 at that time.

  Next, the process proceeds to step S110, where the image acquired in step S105 is analyzed by a known image recognition process (pattern recognition process), and an image recognition pattern of the storage area 40 shown in the acquired image is extracted and generated. .

  Then, the process proceeds to the next step S115, and it is determined whether or not the image recognition pattern of at least one storage area 40 has been extracted from the acquired image by the procedure of step S110. If no image recognition pattern of the storage area 40 can be extracted, the determination is not satisfied, that is, the natural image of the storage area 40 is not sufficiently reflected in the field of view FV that the operator M is viewing. This is the end of this flow.

  On the other hand, if at least one image recognition pattern of the storage area 40 has been extracted, the determination is satisfied, that is, a natural image of the storage area 40 in which the inventory rate information should be displayed in the field of view FV that the operator M is viewing. Is considered to be reflected, and is reflected in the next step S120.

  In step S120, the image recognition pattern of the storage area 40 extracted from the acquired image in step S110 is compared with the image recognition pattern of each storage area 40 stored in the storage shelf management table of the database 300, and consistency is determined. to decide. In the next step S125, the storage area 40 in the acquired image is identified / recognized which storage area 40 is registered in the storage shelf management table (which area tag ID corresponds).

  Next, the process proceeds to step S130, and the inventory rate corresponding to the storage area 40 in the acquired image identified and recognized in step S125 is acquired from the storage shelf management table.

  The process proceeds to the next step S135, and the arrangement coordinates and the size of the arrangement area of each of the specified storage areas 40 in the acquired image from the camera 140 (that is, in the field of view FV of the display device 120) are calculated. This is a calculation process performed in association with the image recognition process in step S110 (or may be calculated together in step S110).

  Next, the process proceeds to step S140, and the inventory rate information corresponding to each storage area 40 obtained in step S130 is arranged according to the arrangement coordinates and the size of the arrangement area 40 calculated in step S135. Create the displayed image. In this example, an operator M creates a display image that displays information on the corresponding inventory ratio in an arrangement that overlaps the arrangement area of each storage area 40 that can be viewed as a natural image in the field of view FV of the display device 120. (See FIG. 13 and the like described later).

  Then, the process proceeds to the next step S145, and the display image data created in step S140 is output to the display control unit 121 of the display device 120. As a result, the display device 120 can supply and display the luminous flux of the display image to both eyes of the operator M. Then, this flow ends.

  FIG. 12 is a flowchart showing a detailed procedure of the ID detection registration process executed in step S200 in FIG.

  In FIG. 12, first, in step S205, wireless communication is performed with the wireless tag T existing in the communication area Ac via the antenna 110, and the tag ID (article tag ID or area tag ID) is read.

  Thereafter, in step S215, it is determined whether or not the tag ID read in step S205 is a region tag ID. In this example, as described above, refer to the contents of the first 4 bits of the item tag ID and the region tag ID (“8” is the region tag ID and “F” is the item tag ID; see FIGS. 8 and 9). This can be easily determined.

  If the read tag ID is an area tag ID, the determination is satisfied, and the area tag ID is stored as the target area tag ID in step S220, and this flow is terminated. The contents of the target area tag ID are maintained without being changed until another area tag ID is read next time, for example, and all the article tag IDs read during that period are the target area tag ID ( That is, it is regarded as the article tag ID read in the storage area 40 corresponding to the area tag ID read at the end until that time).

  On the other hand, when the read tag ID is the article tag ID in the determination in step S215, the determination is not satisfied, and the process proceeds to the next step S225.

  In step S225, the article management table of the database 300 is accessed, and the management information corresponding to the article tag ID read in step S205 is changed. Specifically, the content of the “inventory status” item corresponding to the detected article tag ID is set to “inventory completed” (if it is already the case, it remains the same), and the “inventory date” item is set. The date of the current day is recorded, and the area tag ID of the content of the target area tag ID (the area tag ID read last up to that point) is recorded in the item “area tag ID (B)”.

  Next, the process proceeds to step S230, and the inventory rate of the corresponding target area tag ID is calculated. Specifically, first, the storage shelf management table of the database 300 is accessed, and all the article tag IDs registered in the “article tag ID” item corresponding to the target area tag ID are acquired. In the article management table, the ratio of the acquired inventory tag IDs whose corresponding inventory status is “inventory completed” is calculated, and this is used as the inventory ratio.

  In step S235, the storage shelf management table of the database 300 is accessed, and the management information corresponding to the target area tag ID at that time is changed / updated. Specifically, the content of the “inventory rate” item corresponding to the target area tag ID is changed to the value calculated in step S230 (the value is maintained or increased), and the “inventory date” item Record the date of the day. Then, this flow ends.

  FIG. 13 is a diagram illustrating an example of the field of view FV of the display device 120 that combines and displays the natural image of the storage shelf 30 and the inventory rate information of each storage area 40. A portion outside the field of view FV of the display device 120 that is not actually visible to the operator M due to the shape of the storage shelf 30 or the like is indicated by a dotted line.

  In the example shown in FIG. 13, the corresponding inventory ratio is displayed in a bar graph and percentage notation extending in the horizontal direction at a position overlapping the arrangement area of each storage area 40 in the visual field FV. If at least one storage area 40 is included in the field of view FV, the corresponding inventory ratio information is always displayed in an overlapping manner regardless of the arrangement coordinates in the field of view FV of the storage area 40. In this example, in the storage area 40 where the inventory rate does not reach 100%, the existence of all the document files 50 stored therein has not yet been confirmed.

  Thus, in the visual field FV of the display device 120, the natural image of the object (storage area 40) for displaying information and the composite image of the information (inventory ratio) corresponding to each individually are superimposed and displayed. The operator M can recognize the content of the display information in association with each information display object correctly. In this example, as the information to be displayed on the display image in the field of view FV, the name of the storage area 40, the name of the uninvented document file 50, and the like may be appropriately added and displayed in addition to the inventory rate.

  In the above, the procedure of step S105, step S110, step S120, step S125, and step S130 in the flow of FIG. 11 functions as an inventory information acquisition unit, of which step S105, step S110, step S120, and step S125. This procedure functions as the first image recognition means. Further, the procedure of step S140 functions as an image generation unit. Further, the procedure of the entire flow of FIG. 12 functions as inventory information registration means.

  As described above, in the present embodiment, when the stored document file 50 is inventoried, the storage area 40 in which the document file 50 is stored is photographed by the camera 140 to capture the captured storage area 40. The inventory rate for the specified storage area 40 is acquired from the storage shelf management table of the database 300. A composite image relating to the storage area 40 is generated according to the acquired inventory rate, and the composite image is displayed on the display device 120. Then, the display device 120 performs display corresponding to the inventory rate relating to the captured storage area 40.

  As a result, for each storage area 40, the operator M is informed of whether the corresponding document files 50 have all been inventoried, or the ratio of the inventoried document files 50 (inventory ratio). On the other hand, it can be clearly distinguished visually. As a result, since it is possible to prevent the document file 50 and the storage area 40 once stocked from being double-checked and managed again, it is possible to improve the stocktaking work efficiency.

  In this embodiment, the image recognition pattern of each storage area 40 is stored in advance in the storage shelf management table, and the stored image recognition pattern and the image recognition pattern of the storage area 40 extracted from the acquired image from the camera 140 are stored. By specifying the storage area 40 by comparison with the above, it is possible to specify the storage area with high accuracy. Further, by identifying the storage area 40 by recognizing the video image, it is not necessary to newly prepare another means for specifying the storage area 40 from the video being shot.

  In this embodiment, in particular, by using the display device 120 as a head-holding type display unit, a composite image reflecting the inventory information such as the inventory rate can be made free without closing both hands of the operator M (free. (In a state) can be displayed in front of the eyes of the operator M, and can be surely recognized.

  In this embodiment, in particular, the operator M can also see a natural image of the storage area 40 by using the display device 120 configured by a transmissive display. Then, by matching the positional relationship of the composite image with the natural image, it is possible to provide the operator M with an image that does not feel uncomfortable.

  Note that the display device 120 used in the above embodiment includes a natural image (including a sighting figure on the transmissive cover 21) obtained through the transmissive cover 21 and a composite visualized by the optical system as described above. Although the transmissive display is configured to be displayed on the operator M by superimposing the image, the present invention is not limited to this. That is, instead of the natural image, a display device of a non-transmissive display that displays an image taken by the camera 140 by superimposing an inventory rate or the like to form a composite image may be used. In this case, as shown in FIG. 14 corresponding to FIG. 3, instead of the transmissive cover 21, display means such as a liquid crystal panel 23 (non-transmissive type) is provided in the display device 120 </ b> A and displayed on the liquid crystal panel 23. A function equivalent to that of the above embodiment can be obtained.

  In this embodiment, in particular, wireless communication is performed with respect to the article tag Tb from the antenna 110, and based on the article tag ID read thereby, the article management table of the database 300 is accessed and corresponding management information is recorded. . As a result, the management information of the document file 50 and the storage area 40 can be automatically registered and updated in the database 300 only by the operator M reading the item tag ID for the item tag Tb. As a result, convenience in inventory work can be improved.

  In this embodiment, in particular, the operator M only reads the area tag ID of the area tag Ta and subsequently reads the article tag ID of each article tag Tb, and the document file 50 corresponding to the article tag ID is obtained. And the storage area 40 corresponding to the area tag ID can be associated with each other. As a result, the storage area 40 in which the corresponding document file 50 is stored can be specified as the current storage area and recorded in the article management table of the database 300.

  In this embodiment, in particular, the inventory rate information corresponding to the degree of progress of the inventory work can be visually distinguished and displayed for each storage area 40 to the operator M, so that the progress of the work can be indicated by the operator M. Can be surely recognized. As a result, it is possible to proceed with the subsequent inventory work in accordance with the progress made so far (priority confirmation of the delayed location or completion of the advanced location, etc.). Work efficiency can be improved.

  In this embodiment, in particular, the storage area 40 having a relatively high inventory rate is displayed in a display mode different from the storage area 40 having a relatively low inventory rate (in the example of FIG. By generating a composite image so that the percentage is displayed), the storage area 40 in which the inventory work progresses quickly (or has already been completed) is visually distinguished from the other storage areas 40, and the operator M is notified. That can be surely recognized. As a result, for example, the storage area 40 in which the inventory work progresses quickly (that is, the inventory rate is high) is displayed less conspicuous than the other storage areas 40, so that the place where the work progress is delayed is preferentially detected and confirmed. The inventory work efficiency can be further improved.

  In addition, as a display mode of the inventory ratio in the composite image, in addition to the bar graph and the aspect displayed as a percentage (see FIG. 13 above) shown in the example of the above embodiment, for example, the density corresponding to the inventory ratio as shown in FIG. The masking area 40 may be displayed so as to cover the storage area 40 (in the illustrated example, the first and second storage areas 40 from the top). In this case, the storage area 40 where the progress of the inventory work is fast is covered with high-density masking, and the display is less conspicuous than the other storage areas 40, so that the place where the work progress is delayed is preferentially detected and confirmed. And so on. Further, for example, as shown in FIG. 16, display is performed so as to cover dark masking only for the storage area 40 where the inventory rate exceeds a relatively high threshold (for example, about 90%), and the inventory rate is the above threshold. For the storage area 40 that is less than the value, masking is not displayed at all, and only the presence / absence of the need for the inventory work may be emphasized.

  Further, as shown in FIG. 9, the area tag ID corresponding to the storage area 40 in which each document file 50 is stored is registered in the “area tag ID (A)” item of the article management table. Yes. Referring to this, it is determined whether or not the contents of the “area tag ID (B)” item recorded corresponding to the document file 50 match the contents of the “area tag ID (A)” item (stored) Information determination means). In this case, as shown in FIG. 17, only the document file 50 determined to match is stored in the storage area 40 (see the middle section in FIG. 17) including the document file 50 determined not to match both contents. A composite image is generated so that the inventory rate information is displayed in a manner different from the storage area 40 that is stored (in this example, the text “CAUTION!” Is also displayed for alerting). May be.

  Thereby, when there is a document file 50 stored in a storage area 40 different from the storage area 40 that should be stored at the time of inventory work, the operator M can be surely recognized to that effect. As a result, the document file 50 can be returned to the original correct position following the inventory work.

  Further, as the display device 120, in addition to the wearable transmissive display (or non-transmissive display) used in the above-described embodiment, as shown in FIG. A portable (that is, non-wearable) liquid crystal panel unit 147 that displays a composite image obtained by combining the above may be provided as a display device.

  In the above embodiment, the retinal scanning display is used as the display device 120 that is a wearable transmissive display. However, other display devices 120 may be used.

  FIG. 19 is a diagram conceptually illustrating a configuration of a reflective head mounted display which is an example of another display device.

  The display device 180 of this example includes an image display unit 181 that displays a generated image, a half mirror 182 that transmits visible light and reflects light of a specific wavelength or band, and these image display units. And a housing 183 including a half mirror 182. In this display device 180, the operator M can see the natural image in the field of view FV through the half mirror 182, and the image data displayed on the image display unit 181 based on the control of the control circuit 133 is displayed. Reflecting to the operator M side by the half mirror 182, it is possible to superimpose image data (composite image) on the natural image in the visual field FV. Even when the display device 180 having such a configuration is used, the same effects as those of the above-described embodiment and the like can be obtained.

  Furthermore, the storage area in which the document file in which the article tag ID is detected by wireless communication is stored may be specified by image recognition. That is, in the above embodiment, the article tag ID corresponding to each document file 50 is detected by wireless communication, and the area tag ID corresponding to the storage area 40 in which the document file 50 is stored is detected by wireless communication. However, this is not a limitation. That is, for example, the storage area 40 in which the document file 50 is stored may be specified by image recognition. Hereinafter, the modification is demonstrated using FIG.

  In this modification, although not shown in particular, the area tag Ta is not affixed to each storage area 40 provided in the storage shelf 30, and all the storage areas 40 are identified only by image recognition and identified using the storage area numbers. To do. Therefore, the item “area tag ID” in the storage shelf management table of FIG. 8 in the above embodiment is omitted, and “area tag ID (A)” and “area tag ID (B)” of the article management table shown in FIG. In place of the item, the “area number (A)” item in which the storage area number of the storage area to be originally stored is recorded, and the “area number ( B) "item is provided.

  FIG. 20 is a flowchart showing an example of the procedure of ID detection registration processing executed in the present modification, and corresponds to FIG.

  In the flow of FIG. 20, the procedure of step S215 and step S220 in the flow of FIG. 12 is basically omitted. Instead, step S212, step S214, step S216, step S218, step S222, and step S224 are omitted. The difference is that the procedure is added. Among these, the procedure of step S212, step S214, step S216, step S218, and step S222 is exactly the same as the procedure of step S105, step S110, step S115, step S120, and step S125 in the flow of FIG. This is a procedure for identifying and recognizing the storage area 40 in the image acquired from the camera 140 by image recognition.

  In the next step S224, the storage area number of the storage area recognized at the center position of the acquired image (that is, the position overlapping the cross target Rt and the communication area reference circle Ra in the field of view FV) is stored as the target area number. This target area number is a variable equivalent to the target area tag ID in the above embodiment, and the storage area number of the storage area 40 storing the document file 50 of the article tag ID detected by wireless communication in step S205 is stored. Is done.

  Then, step S225 ′, step S230 ′, step S235 ′ (contents are handled in place of the area tag ID instead of the area tag ID), which are almost the same as the procedures in steps S225, S230, and S235 in the flow of FIG. Only this is different) and this flow is finished.

  Thus, in this modification, the storage area 40 recognized at the center position of the field of view FV is specified by image recognition, and the document file 50 corresponding to the article tag ID detected by wireless communication is currently stored in the storage area 40. The stored storage area is recorded in the “area number (B)” item of the article management table. In this case, the procedure of step S212, step S214, step S218, and step S222 in the flow of FIG. 20 functions as the second image recognition means, and the procedure of the entire flow of FIG. Functions as a registration means.

  In the article management system of the present modification as described above, the same effect as that of the above embodiment can be obtained, and the actual storage area can be specified using image recognition, so that the storage area 40 can be specified. Even without newly providing another area tag Ta, the storage area in which the document file 50 is stored can be specified by image recognition and recorded in the database 300. Further, since the image recognition pattern of each storage area 40 is stored in advance in the storage shelf management table of the database 300 and the storage area 40 is specified by comparison with the stored image recognition pattern, the storage area specification with high accuracy is performed. It can be performed. Further, the image recognition process (steps S212 to S222) during the ID detection registration process and the image recognition (steps S105 to S125) during the display display process are performed in substantially the same procedure (in other words, the same process). By using the image recognition means, it is possible to reduce the impossibility of processing.

  In addition, in the above, the arrow shown in each figure of FIGS. 2-5, FIG. 14, etc. shows an example of the flow of a signal, and does not limit the flow direction of a signal.

  In addition, the flowcharts shown in FIGS. 10, 11, 12, and 20 do not limit the present invention to the procedure shown in the above-described flow, and the procedure can be added without departing from the spirit and technical idea of the invention. You may delete or change the order.

  In addition to those already described above, the methods according to the above-described embodiments and modifications may be used in appropriate combination.

  In addition, although not illustrated one by one, the present invention is implemented with various modifications within a range not departing from the gist thereof.

1 is a system configuration diagram illustrating an overall configuration of a file management system according to an exemplary embodiment. It is a functional block diagram showing the functional structure of a reader terminal. It is a functional block diagram showing the detailed functional structure of a display apparatus. It is a functional block diagram showing the detailed structure of a high frequency circuit. It is a functional block diagram showing an example of a functional composition of a RFID circuit element. It is the side view and top view showing the arrangement | positioning relationship of the visual field range of a display apparatus and a camera, and the communication area of an antenna with respect to the reference | standard gaze direction of a display apparatus. It is a figure showing the sighting figure currently printed on the transparent cover among the visual fields visually recognizable inside a display apparatus. It is a figure which represents notionally an example of the storage shelf management table which memorize | stores various management information corresponding to each storage shelf and the storage area | region with which they are provided. It is a figure which represents notionally an example of the article management table which memorize | stores various management information corresponding to each document file. It is a flowchart showing the control procedure of the inventory work performed by the control circuit of a reader terminal. It is a flowchart showing the detailed procedure of the display display process performed in step S100 in FIG. It is a flowchart showing the detailed procedure of the ID detection registration process performed in step S200 in FIG. It is a figure showing an example of the visual field of the display which combined and displayed the natural image of a storage shelf, and the information of the inventory rate of each storage area. It is a functional block diagram showing the detailed functional structure of the display apparatus comprised with a non-transmissive display. It is a figure showing the 1st modification of the visual field of the display which combined and displayed the natural image of the storage shelf, and the information of the inventory rate of each storage area. It is a figure showing the 2nd modification of the visual field of the display which combined and displayed the natural image of the storage shelf, and the information of the inventory rate of each storage area. It is a figure showing the 3rd modification of the visual field of the display which combined and displayed the natural image of the storage shelf, and the information of the inventory rate of each storage area. It is a system block diagram showing the whole structure of the reader terminal provided with the portable liquid crystal panel unit as a display apparatus. It is a figure which represents notionally the structure of the reflection type head mounted display which is an example of another display apparatus. It is a flowchart showing the detailed procedure of the ID detection registration process performed in the modification which specifies the present storage area by image recognition.

Explanation of symbols

30 Storage shelf (storage member)
40 Storage area 50 Document file (managed article)
100 Reader terminal 110 Antenna 120 Display device (image display means)
120A display device (image display means)
130 control device 140 camera (imaging means)
145 Operation unit 147 Liquid crystal panel unit (image display means)
180 display device (image display means)
300 Database Ac Communication area FV Field of view M Operator Tb Article tag (wireless tag for article)
Ta area tag (area radio tag)

Claims (9)

Imaging means capable of photographing a plurality of storage areas each storing at least one management target article among storage members capable of storing a plurality of management target articles;
A database storing inventory information related to the inventory status of the plurality of management target articles stored in the storage member;
Inventory information acquisition means for specifying the storage area from the video imaged by the imaging means, accessing the database, and acquiring the inventory information relating to the storage area;
Based on the inventory information acquired by the inventory information acquisition means, an image generation means for generating a composite image relating to the storage area corresponding to the inventory information;
Image display means for displaying a composite image of the storage area generated by the image generation means;
An antenna that reads information by wireless communication with respect to an article wireless tag provided in the article to be managed;
An article management system comprising inventory information registration means for accessing the database and registering the corresponding inventory information based on a result of reading information via the antenna. An area image recognition information storage means for storing image recognition information of the plurality of storage areas in the storage member;
The inventory information acquisition means includes:
The storage area is identified by comparing the recognition result with the recognition information of the storage area image stored in the area image recognition information storage means. The article management system according to claim 1, further comprising first image recognition means for performing. The image display means includes
3. The article management system according to claim 2, wherein the article management system is a display unit that is held on the operator's head so that a predetermined visual field including the storage area can be given to the operator's vision. The display means includes
Transmissive display means capable of giving a predetermined field of view including a natural image of the storage area to the vision of the operator;
The image generating means includes
The article management system according to claim 3, wherein the composite image is generated so that a positional relationship with a natural image of the storage area matches. The antenna is
Information can be read by wireless communication from the wireless tag for articles and the wireless tags for areas provided in each of the plurality of storage areas,
The inventory information registration means includes:
Based on information read results of the article wireless tag and the area wireless tag via the antenna, the management target article corresponding to the article wireless tag, and the storage area corresponding to the area wireless tag; The item management system according to any one of claims 1 to 4, wherein the inventory management information is registered as the inventory information. The antenna is
The direction of communication directivity during the wireless communication is associated one-to-one with the shooting direction by the imaging means,
The inventory information registration means includes:
The image of the storage area taken by the imaging means when the information is read from the article wireless tag by wireless communication by the antenna is image-recognized, and the recognition result is stored in the area image recognition information storage means. A second image recognition means for specifying the storage area by comparison with the recognition information of the image of the storage area;
The associated storage area and the management target article corresponding to the article wireless tag are associated with each other and registered as the inventory information. Goods management system. The article management system according to claim 6, wherein the second image recognition unit is also used in the first image recognition unit. The inventory information acquisition means includes:
Obtaining the inventory information relating to the storage area storing a plurality of the management target articles;
The image generating means includes
Based on the inventory information acquired by the inventory information acquisition means, the composite image is selected in a mode according to the number or ratio of the management target articles that have been inventoryed among the plurality of management target articles stored in the storage area. The article management system according to claim 1, wherein the article management system is generated. Storage information storage means for storing the management object in association with the storage area in which the management object is to be stored;
Storage information determination means for determining whether the storage area associated with the management target article matches the storage content of the storage information storage means at the time of registration by the inventory information registration means;
The image generating means includes
Generating the composite image so that the storage area determined not to match the stored content by the storage information determination unit is different from the storage area determined to match the stored content. The article management system according to any one of claims 1 to 8, wherein

Images