JP4256434B2 - Method and device for testing packaged medicine - Google Patents

Description

  The present invention automatically detects whether or not a packaged medicine (a medicine composed of tablets and capsules (in other words, a medicine excluding powders and granules)) is a correct medicine. The present invention relates to a method and a drug inspection device.

  In a pharmacy of a hospital or a clinic, a medicine prescribed for each patient is usually packaged by a medicine packaging device so as to be suitable for each dose. Such drug packaging work is performed by a pharmacist, either directly or under the supervision of a pharmacist, by a nurse or the like by hand or using a packaging machine, or automatically by a drug packaging device. It has been broken.

  Usually, drugs prescription based on prescriptions, when manually packaged, will result in missed packaging due to accidental inclusion of unprescription drugs in individual sorting drug drawers. There are cases where it occurs, and in spite of the correct medicine being contained in the medicine withdrawal for sorting, there is a case where erroneous packaging is made due to human error.

  On the other hand, when the medicine is packaged using the medicine packaging device, the correct medicine is contained in the sorting medicine drawer, but when the medicine is automatically conveyed from the drawer and packaged, the tablet or Drugs such as capsules pop out and are not carried into the bag, which may cause miss-packaging of the drug. For this reason, after collating whether the packaged medicine is packaged according to the prescription, so-called drug inspection, it is delivered to the patient.

  By the way, in such a medicine inspection work, the packaged medicine and the prescription must be compared, and the actually packed medicine for each package must be checked visually with the medicine listed in the prescription list. Therefore, it is a time-consuming and complicated work, and causes a long waiting time at the pharmacy window.

  Therefore, as one method for solving this problem, a tablet packaging device is provided with a printer that prints prescription data, and the prescription content display unit formed separately from the divided packaging unit of the medicine packaging by the printer is used for the tablet type and tablet. The number and patient name etc. are printed, and the prescription content display section with the tablet type, the number of tablets and the patient name, etc. printed can be seen at the time of drug examination, so that the drug can be examined without looking at the prescription list one by one (See, for example, Patent Document 1).

However, in the method of Patent Document 1, since the printing speed of the printer is slower than the packaging speed of the medicine, and the prescription content display portion printed by the printer is provided in the packaging bag, the packaging is performed until the printing process is completed. Processing cannot be completed, resulting in a decrease in packaging speed. Therefore, as another prior art that increases the packaging speed, a tablet packaging device that automatically attaches a transponder that stores packaging information to the medication packaging, and the medicine packaging that is packaged by the tablet packaging device. The tablet dispensing device includes a plurality of tablet feeders that store a plurality of types of tablets and a tablet feeder that stores a transponder, and is discharged from the tablet feeder. Device for separating and packaging tablets and transponders, an antenna for transmitting / receiving the transponder packaged by the packaging device, and a reader / writer, while the drug counter has a transmitter / receiver for the transponder Antenna, a transponder reader / writer, and an output terminal for displaying the reception result. The package information including the drug data and the patient's recognition data is written in the package, and the transponder in which the package information is written is connected to the package containing the drug and inserted into the package that does not contain the drug. When the medicine package attached with the transponder is inspected, a transmission request signal is transmitted to the medicine package, and the packaging information transmitted by the request signal is read and displayed based on the read data. There has been proposed a medicine packaging apparatus that collates the packaging information displayed on the apparatus with the packaged medicine (for example, see Patent Document 2).
Japanese Examined Patent Publication No. 3-35181 Japanese Patent No. 3634024

  However, the device described in Patent Document 2 includes a medicine inspection device that collates medicines packaged in the medicine packaging device, and lacks versatility, which makes the device large.

  The present invention has been made in view of the above points, and the apparatus is small and can be manufactured at a relatively low cost. In addition to the medicine packaged by the medicine packaging apparatus, the apparatus can be packaged and packaged manually. It is an object of the present invention to provide a drug inspection method and a drug inspection device capable of collating drugs that have only been (packed) using a device.

In order to solve the above-mentioned problems, the method for testing a packaged medicine according to the present invention determines whether or not a medicine composed of tablets or capsules packaged according to each dose is a medicine as prescribed. Colors are taken of the medicine in each transparent bag in which the medicine is packaged for each dose, and image processing is performed for each medicine to determine the length in the major axis direction, the length in the minor axis direction, and the area. Calculate based on the number of pixels, calculate the RGB density value for each pixel, and compare it with the reference image data of each medicine prescribed for each dose. A method for testing a packaged drug for checking whether a packaged drug matches a drug according to a prescription ,
a) The image processing is performed by converting a color image into a binarized image, extracting edges from the binarized images of the respective drugs, performing labeling, then cutting out the labeled areas in order, and labeling the images of the respective drugs A step of calculating the length in the major axis direction, the length in the minor axis direction, and the area based on the number of pixels, and b) in the state where the adjacent medicines are in contact, the pixels of each medicine in contact are A step of gradually scraping, returning to a state before scraping the pixel after separation, and specifying the shape of each medicine .

  According to the method for testing a packaged drug according to the present invention having the above-described configuration, reference image data in which a drug to be taken at one time is prescribed by a prescription, a major axis length (major axis), and a minor axis length Whether or not the length (minor axis), area, and color match each other is checked, and the correctness of the medicine packaged in each transparent bag is judged. .

As described in claim 2, the silhouette of the medicine in the bag is photographed from the back side of each bag by another camera, and the silhouette image of each medicine photographed by the another camera is grayscale. Conversion to a binarized image, and if there is a contact location among adjacent drugs, a contraction process is performed to scrape one pixel at a time from the outer periphery of the binarized image of the drug, and the pixel after separation To restore the original shape of the drug by returning to the state before shaving, extract the edge from the binarized image of each drug, perform the labeling, the major axis length of each drug, the minor axis length, The area is calculated based on the number of pixels to identify the shape, and the color-captured image is calculated for each pixel with RGB density values, and the shape data of these drugs and only the hue data of the drugs or the same hue Data and Upon fused by superimposing a color image data including the indicia, text, by comparison with the reference image data for the individual drugs formulated once every dose fraction was packing in each clear plastic bag Whether or not the medicine matches the medicine on the prescription can be collated.

  According to the method for testing a packaged drug according to claim 2 having the above-described configuration, in reference image data in which a drug to be taken at one time is prescribed by a prescription, a major axis, a minor axis, an area, and a color Whether or not they match each other is checked, and the correctness of the packaged medicine in each transparent bag is determined. In addition to the effects of high drug testing accuracy and less chance of error, there are the following effects . That is, in the case of imaging with a camera from a single direction using a non-reflective light source, it may be difficult to specify the shape depending on the color of the medicine, even if the irregular reflection of the bag is reduced to some extent. This is because the amount of light from the light source cannot be increased more than necessary because of irregular reflection on the bag surface. That is, if the shape extraction threshold is fixed assuming a specific hue, it is not effective for other hues. As a solution to this, for example, it is conceivable to use a plurality of threshold values for extracting the shape of the medicine. However, since the state of irregular reflection changes depending on the position of the medicine in the bag, the shape of the medicine can be specified reliably. Is not limited. However, according to this method, the silhouette image of the drug is obtained by taking a picture from the back side where the parallel light is irradiated on the front side of the bag, so that not only the hue of the drug but also the irregular reflections and the stamps and characters attached to the drug The shape of the drug can be reliably identified without being influenced by the image, and it is grayscaled for the silhouette image and captured as black or gray. Long diameter and short diameter). Since the color image on the front side is overlaid on the basis of the coordinates in the image frame, color information including the hue data of the drug is obtained for each drug along with the shape information.

  In particular, with regard to the shape of the drug, 1) since the drug is cut out from the silhouette image, it is not affected by multidirectional irregular reflection on the bag surface, and, for example, contracts near 8 compared with the case of using a color image. The process functions more effectively, and it is possible to extract the exact shape of each drug. 2) Letters or inscriptions on the drug are not affected by shape extraction. 3) It is possible to extract one shape such as a capsule-like medicine having a plurality of colors irrespective of the hue. 4) The shape can be extracted without being affected by various hues of the drug.

In order to solve the above-mentioned problems, the medicine dispensing device according to the present invention (Claim 3) is a medicine composed of tablets or capsules packaged according to each dose, as a medicine as prescribed. An apparatus for detecting a packaged medicine for checking whether or not there is an imaging unit comprising a camera arranged on the front side of the packaged medicine and an illuminator that irradiates light on the front side of the packaged medicine And a moving means for moving the imaging unit relative to a single dose on a transparent bag in which the drug is packaged for each dose, and for each dose of the drug by the camera. Color shooting , converting the color image into a binarized image, extracting the edge from the binarized image of each drug, and after labeling, cut out the labeled area in order, for each drug image labeled, Long axis direction length, short axis direction length, area Calculation based on the number of pixels specifies the shape of each drug, and color image data including the hue data of each drug by calculating the RGB density value for each pixel of the color photographed image and the drug When the shape data is merged and the image is taken in a state where the medicine in the bag is in contact, the contacted pixels of the medicine are gradually scraped from the outer peripheral side, and after being separated, before the pixels are shaved To each state, the image processing / calculation means for specifying the shape of the medicine, and the medicine data for each dose calculated by the image processing / calculation means, each medicine prescribed for each dose By comparing with the reference image data, it is provided with a determining means for collating whether or not the medicine packaged in each transparent bag matches the medicine according to the prescription.

  According to the packaged drug testing device according to the present invention having the above-described configuration, the packaged medicine is photographed for each batch, the size and area of each drug are determined, and the hue of RGB is 255. Since it is specified by the gradation (concentration value), the accuracy of drug inspection is high, and the correctness of the packaged medicine can be accurately determined. Moreover, since the imaging unit intermittently moves relative to the packaged medicine transparent bag, and the image is processed and compared with the reference data, the verification operation does not take time. Since the drug can be examined efficiently, the waiting time of the patient in front of the pharmacy can be greatly shortened, and the work load on the pharmacist can be greatly reduced.

5. The other camera disposed on the back side with respect to the packaged medicine and the silhouette of the packaged medicine taken from the back side with the other camera as defined in claim 4, and the silhouette images are grayscale. If the adjacent drug is in contact with each other, the contraction process is performed, and after separation, the state before the contraction process is restored and the length in the major axis direction, the length in the minor axis direction, and the area are set to the number of pixels for each drug. In addition to specifying the shape of each drug by calculation based on the color image data including the hue data of each drug by calculating the RGB density value for each pixel of the color photographed image and the shape data of the drug And image processing / calculation means for fusing them .

  According to the medicine inspection device for packaged medicine according to claim 4, the medicines packaged for each time are photographed from the front side and the back side, and the shape of each medicine is measured by silhouette images photographed from the back side. The shape is determined by determining the area and the hue is specified with a gradation (density value) of RGB of 255 by a color image taken from the front side, and the color image on the front side and the shape image converted to gray scale on the back side are imaged. Since superimposition is based on the coordinates in the frame, the drug data in which the hue information and shape information of the drug are fused ensures that the individual drugs are not affected by irregular reflection on the bag surface or the markings or characters attached to the drug. The obtained drug accuracy is high and the correctness of the packaged drug can be accurately determined. Moreover, since the imaging unit intermittently moves relative to the packaged medicine transparent bag, and the image is processed and compared with the reference data, the verification operation does not take time. Since the drug can be examined efficiently, the waiting time of the patient in front of the pharmacy can be greatly shortened, and the work load on the pharmacist can be greatly reduced.

  According to the fifth aspect of the present invention, the reference image data of the medicine is obtained by taking a color photograph of the medicine contained in the first (first) transparent bag among the medicines packaged, It may be automatically registered based on the medicine data calculated by processing.

  As described in claim 6, the reference image data of the medicine is obtained by taking a color image from the front side of the medicine put in the first bag among the medicines packaged from the front side and from the back side. It may be automatically registered on the basis of medicine data obtained by fusing silhouette data obtained by capturing a silhouette image and processing both images.

  According to these (Claim 5 or Claim 6), it is only necessary to confirm whether the medicine contained in the first bag among the transparent bags in which the packaged medicine is packaged is in accordance with the prescription, After that, the drug inspection work is automatically performed.

  The reference image data of the medicine is created so as to coincide with the medicine data calculated by color photographing with the camera and image processing based on the medicine database of the medicine packaging device. It may be automatically registered based on the medicine data.

  This is convenient because the reference image data can be created using the drug database used in the drug packaging device, and there is no need for manual confirmation.

  As described in claim 8, the imaging unit continuously collates while moving intermittently for each dose on a transparent bag in which the medicine is packaged, and it is determined that the medicine is missed. There are two types: continuous drug detection mode that stops movement and warns on the bag, and sequential drug detection mode that checks each dose and requests the user's instructions for verification of the next dose regardless of the verification result Mode.

  By providing the two modes in this way, the user can select a convenient one according to the quantity of the sachet and perform the drug inspection work.

  The image display means for displaying the medicine as a color image when the unnecessary medicine is packaged or the necessary medicine is insufficient as a result of the collation, The display means can be provided with warning means for displaying the contents of the collation result as a message and warning by voice.

  As described in claim 10, when an incorrect medicine is packaged as a result of collation, the wrong medicine and the necessary medicine are respectively displayed in color images and collated with the image display means. Warning means for displaying the contents of the result in a message and warning by voice can be provided.

  By configuring as in the ninth or tenth aspect, an unnecessary or insufficient medicine can be confirmed together with a message on the image display means, and the collation result can be heard by voice, so that an operation error is unlikely to occur.

The medicine-packaging method and medicine-testing device according to the present invention have the following excellent effects. That is,
The device is small and can be manufactured at a relatively low cost. In addition to the medicine packaged by the drug packaging device, it is packaged manually, or only packaging (bagging) is performed using a packaging machine. In addition to being versatile and capable of collating drugs, we photograph the drugs that are packaged for each batch, determine the size and area of each drug, and specify the colors with RGB gradations of 255, The accuracy of collation is high, the correctness of the packaged medicine in each transparent bag can be accurately judged, and the image is taken while the imaging unit moves intermittently on the transparent bag of the packaged medicine. Since it is processed and collated against the reference data, it does not take much time for collation, and it is possible to efficiently examine the drug, so the waiting time of the patient in front of the pharmacy can be greatly shortened, and the work load of the pharmacist etc. Can be reduced.

  DESCRIPTION OF THE PREFERRED EMBODIMENTS Embodiments of a packaged drug testing device according to the present invention will be described below together with a drug testing method based on the drawings.

  FIG. 1 is a perspective view showing an embodiment of a medicine inspection device for packaged medicine.

  The drug detection device 1 of this example is based on the premise that the medicine packed in the first bag of the continuous transparent bag is correct, and the medicine packed in the subsequent bag matches the medicine in the first transparent bag. It is a specification to check whether to do. Therefore, the user needs to collate the medicine in the first transparent bag in advance with a prescription. Further, in the case of a bag having a patient name part at one end of the bag as shown in FIG. 2A, the medicine in the transparent bag needs to be moved away from the name part.

  As shown in FIG. 1, the drug inspection device 1 is a packaged medicine bag having a configuration in which an endless conveyor belt 2 is stretched between pulleys at both longitudinal ends of a main body 3 and conveyed by a drive motor (not shown). A feeding mechanism (moving means) is provided. A portal frame 3a is integrally formed at the distal end of the main body 3, and an imaging unit 4 including a color image capturing camera and an illuminator is mounted downward on the portal frame 3a. The camera is a digital camera, and the illuminator is a non-reflective illuminator in which LEDs are arranged in a ring shape. With this illuminator, irradiation of the light of the non-reflective light source from almost right above the transparent bag of the packaging medicine can be eliminated to some extent on the bag surface. A touch panel display device 5 is provided at an intermediate position in the longitudinal direction of the main body 3. The display device 5 has two functions as a display device for displaying a shortage medicine or an incorrect medicine and an operation panel (touch panel). An ON / OFF switch 6 is provided on the side base end side of the main body 3. Reference numeral 7 in FIG. 1 is a control unit (CPU), and image processing / calculation means and determination means are included in the control section 7. Reference numeral 8 denotes a program storage unit.

  Here, the procedure of the medicine inspection operation for the packaged medicine according to the above embodiment will be described based on the flowchart of FIG.

  1) Turn on the switch 6 and set (place) the first transparent bag containing the medicine to be packed in a fixed position on the conveyor belt 2. Here, Fig.5 (a) is a flowchart which shows the test procedure of a packaging medicine. In FIG. 5A, when the power is turned on (step 1), the application of the drug inspection program is started (step 2). Then, when the drug inspection operation is started (step 3), the presence or absence of registration is confirmed for the patient name, medication time (morning, noon, evening) and transparent bag contents (pitch, number of bags). If it is not registered (NO), registration processing (step 13) such as the pitch of the bags in which the medicine is packaged, the number of bags, the patient name, and the medication time is performed (step 13). (Step 14).

  2) If YES in step 3, the user presses the check button or continuous check button on the touch panel of the display device 5 as shown in FIG. In this example, it is assumed that the continuous check button has been pressed (step 4).

  3) When the conveyor belt 2 rotates and the first transparent bag moves below the imaging unit (photographing unit 4) of the portal frame 3a, it is detected by a near-infrared sensor (not shown), and the conveyor belt 2 rotates. Stops.

  4) Here, the camera takes an image while irradiating the medicine in the transparent bag with a non-reflective illuminator (non-reflective light source) (step 5), and takes it as a color image (bitmap image, FIG. 2 (b)) (step 6) .

  5) Detect RGB density values (255 gradations) for each drug and create a color template. Further, the color image is subjected to image processing to be converted into a binarized image (FIG. 2C). Further, an edge is extracted from the binarized image of each medicine (FIG. 2 (d)) and labeling is performed.

  6) The labeled regions are cut out in order, and the lengths of the major axis L and the minor axis S are calculated by the number of pixels for each labeled drug image (FIG. 2E). Since the dimensional error of the shape at the time of manufacture of a medicine is 0.5 mm, it can be adapted to this accuracy. Further, the area of the image is calculated by the total number of pixels for each medicine in the region, and a shape template is created. The color / shape reference template is stored in the disk (control unit 7) in Excel format and automatically registered (step 7).

  7) Next, when the conveyor belt 2 rotates and moves one bag length, the second of the bag moves below the imaging part of the portal frame 3a, and is detected by a near infrared sensor (not shown). The rotation of the belt 2 stops. Here, the processing of 4) to 6) is performed for the second bag (step 8 to step 10).

8) For all drugs in the second bag, it is verified whether the label (drug) v satisfies the condition (matches the reference template) and the number of labels (drugs) matches (step 11). That means
(Subscript ... M: Indicates drug reference data, C: Indicates drug data in the second bag)
If the two match, the display device 5 displays “correctly packed” as shown in FIG. 3A, and the collation result is reported as “correctly packed” by voice (step 12). ).

  9) After that, for the drugs in the 3rd and 4th in order, check whether the label (medicine) v satisfies the condition (matches the reference template) and the number of labels (medicine) matches. Then, the verification result is reported, and the drug inspection operation is completed for all the drugs in the bag (steps 8 to 12).

 10) On the other hand, if there is a bag that does not satisfy the conditions in the above-described drug inspection operation, the bag is stopped under the imaging unit of the portal frame 3a until the continuous check button displayed on the display device 5 is pressed. Is interrupted.

a) When the number of labels is the same but the condition of v is not satisfied,
The packaged medicine is displayed, and unnecessary medicine and missing medicine are displayed and blinked. A voice is given to warn that “the type of drug is different” (FIG. 3B).

b) When there are not enough labels
Display the packaged medicine, display the missing medicine, and blink. A warning is made by voice that “the medicine that is displayed / flashing is insufficient” (FIG. 3C).

c) When there are many labels
Display the packaged medicine, display unnecessary medicine and blink. A warning is given by voice that “there is an unnecessary medicine” (FIG. 3D).

  In the case of performing the drug inspection work by pressing the (single) check button, if the bag to be tested stops under the imaging unit of the portal frame 3a, the bag is moved until the check button displayed on the display device 5 is pressed. Will be interrupted, so it is necessary to press the check button every time the drug test is completed.

  By the way, an image may be taken in a state where the packaged medicine is in contact in a transparent bag. In this case, as shown in FIGS. 4A to 4C, the contacted (polymerized) pixels of each drug are gradually scraped from the outer peripheral side and contacted when separated (FIG. 4C). Recognize that And when each medicine is circular, for example, it returns to the state before shaving the pixels, and creates a square (FIG. 4 (d)) in which each circle is inscribed with respect to each center point. A circle inscribed in each square in a separated state is created, and the shape of each drug is formed (FIG. 4 (e)). For ease of explanation, the case where the shape of the drug is circular has been illustrated, but the shape of the drug should be specified in the same way for shapes having a major axis (major axis) and a minor axis (minor axis) such as an ellipse. Can do.

  By the way, in the said Example, it was made to move each bag containing the packed medicine to the lower part of the imaging part of the portal frame 3a by the conveyor belt 2. You may make it perform a medicine inspection operation | movement by moving the imaging | photography unit 4 which consists of a camera and LED illuminator with respect to a bag along a bag.

  FIGS. 6 to 8 show another embodiment of the drug inspection device or method according to the present invention. FIG. 6 is a perspective view showing a second embodiment of the imaging unit in the drug inspection device 1 and upper and lower cameras. It is a top view which shows the image of the chemical | medical agent each image | photographed.

  As shown in FIG. 6, the photographing unit 4 ′ in this example includes a digital camera 41 that is installed above a bag containing a packaged medicine, a digital camera 42 that is installed below, and an upper camera. And an illuminator 43 that irradiates the parallel light rays downward. As the illuminator 43, for example, a flat dome illuminator which is a kind of indirect illumination is used. Although illustration is omitted, by using a white translucent diffuse plate for photographing from below, there is no difference in the amount of light between the central part and the peripheral part, and a silhouette image can be taken clearly. The processing of an image photographed in color by the upper digital camera 41 is the same as that in the above embodiment except that the image processing for separation when an adjacent medicine is in contact is omitted, and the description thereof will be omitted.

  Each medicine imaged by the lower digital camera 42 is imaged as a gray or black silhouette image under parallel light illumination by the illuminator 43. In the case of a silhouette image as well, as in the case of photographing with the upper digital camera 41, the medicine packaged as shown in FIG. 7 is three-dimensionally adjacent (contacted) in a nested state in a transparent bag. In this case, an 8-neighbor contraction process is performed as shown in FIG. In other words, if the silhouette image of a drug is cut from the outer peripheral side by one pixel at a time in the vertical, left, right, diagonally right, or diagonally left directions, and the contact points of adjacent drug images are separated, the adjacent drugs actually contact each other It is determined that Then, after separation, that is, after separation, the original shape of the medicine is restored by returning to the state before the pixels are shaved. For example, when the medicine is circular, create a square (Fig. 4 (d)) in which each circle is inscribed with each center point as a reference, and create a circle inscribed in each square with each of them separated. Then, the shape of each drug is set (FIG. 4E). This image processing is as described above. However, unlike the color image captured by the upper digital camera 41, the shape of the medicine composed of a monochrome (grayscale) image is all regardless of the hue. The color is gray (ideally black), and the hue can be specified with one threshold. In addition, the stamps and characters attached to the medicine are ignored (for the shape of the medicine). Therefore, for example, even in a two-color capsule medicine, the whole is gray, and the shape can be extracted (specified) by the same (common) threshold value.

  Specifically, color photography is performed by the lower camera 42 through a diffuser plate in a state where parallel rays are irradiated from above. Then, the silhouette image of the medicine is converted into a gray scale, and a binarized image is obtained in relation to the background. At this time, it is necessary to determine an optimum threshold value, but the relationship of luminance between the threshold value, the drug, and the background needs to be drug> threshold> background. In the second embodiment, the threshold value is set to 180. In this state, the shape of the two-color capsule medicine can be specified as a single region. In the above embodiment, the upper side represents the front side of the bag, and the lower side represents the back side of the bag. The camera 41 and the illuminator 43 are placed in one horizontal direction across the bag, and the camera 42 is placed in the horizontal direction across the bag. It is also possible to arrange them on the other side.

  In this way, if shape extraction (specification) of each medicine in the bag is confirmed by the binarized image of gray (medicine) and white (background), the shape information (data) of each confirmed medicine is Based on the position (coordinate value) of the orthogonal coordinates in the image frame of each medicine, the hue information (RGB luminance value) of each medicine is also obtained by superimposing the color image obtained first. The drug information is the same as that in the first embodiment in which the shape information of the drug and the hue information are combined. After that, it is the same as in the case of the first embodiment that the drug information obtained for each drug in the bag is checked against the reference information of the drug. In the drug inspection method of the present embodiment, the color image obtained by photographing with the upper digital camera 41 is separated (separated) when the above-mentioned packaged medicine is imaged in a contacted state in a transparent bag. ) Is not required. This is because it is only necessary to obtain the hue information of the medicine (information including the stamps and characters attached to the medicine, if any) on the image captured by the upper digital camera 41. The shape information of the medicine is obtained from the lower digital camera 42. It is because it obtains from the silhouette image image | photographed by this.

  Next, the procedure of the medicine inspection operation for the packaged medicine according to the second embodiment will be described with reference to the flowchart of FIG.

  1) Turn on the switch 6 and set (place) the first transparent bag containing the medicine to be packed in a fixed position on the conveyor belt 2. In FIG. 5A, when the power is turned on (step 1), the application of the drug inspection program is started (step 2). Then, when the drug inspection operation is started (step 3), the presence or absence of registration is confirmed for the patient name, medication time (morning, noon, evening) and transparent bag contents (pitch, number of bags). If it is not registered (NO), registration processing (step 13) such as the pitch of the bags in which the medicine is packaged, the number of bags, the patient name, and the medication time is performed (step 13). (Step 14).

  2) If YES in step 3, the user presses the check button or continuous check button on the touch panel of the display device 5 as shown in FIG. In this example, it is assumed that the continuous check button has been pressed (step 4).

  3) When the conveyor belt 2 rotates and the first transparent bag moves below the imaging unit (photographing unit 4) of the portal frame 3a, it is detected by a near-infrared sensor (not shown), and the conveyor belt 2 rotates. Stops.

  4 ') Here, the upper camera 41 picks up the medicine in the transparent bag while irradiating the parallel light with the parallel light irradiation type illuminator (step 5), and as a color image (bitmap image, FIG. 2 (b)) Capture (step 6).

  At the same time, the lower camera 42 images silhouettes of individual drugs in the bag through the diffuse plate and captures them as color silhouette images.

  5) For the above color image, the density value of RGB (255 gradations) is detected for each drug, and the hue is specified. At the same time, the saturation or the saturation / lightness is also specified, and the color is specified.

  5 ′) On the other hand, the color silhouette image is converted to a binarized image (FIG. 2C) by performing gray scale processing. In addition, there are cases where images are taken in a state where adjacent medicines are in contact with each other as shown in FIG. 7 in a transparent bag. In this case, the medicine is subjected to an eight-neighbor contraction process as shown in FIG. From the binarized image, each pixel is scraped from the outer peripheral side in the vertical, left, right, right diagonal, and left diagonal directions, and it is determined that the drug is in contact when the contact points of the adjacent drug images are separated. . Then, after separation, the original shape of the medicine is restored by returning to the state before the pixels are cut. Further, an edge is extracted from the binarized image (including the image whose shape is restored) of each medicine (FIG. 2D), and labeling is performed.

  6) The labeled regions are cut out in order, and the lengths of the major axis L and the minor axis S are calculated by the number of pixels for each labeled drug image (FIG. 2E). Further, the area of the image is calculated by the total number of pixels for each medicine in the region, and the shape is specified.

  6 ′) Then, based on the coordinates in the image frame, the color information and the shape information for each medicine are overlapped to create the color / shape information for each medicine.

  A color / shape template is created for the medicine in the first bag. The color / shape reference template is stored in the disk (control unit 7) in Excel format and automatically registered (step 7).

  7) Next, when the conveyor belt 2 rotates and moves one bag length, the second of the bag moves below the imaging part of the portal frame 3a, and is detected by a near infrared sensor (not shown). The rotation of the belt 2 stops. Here, the processes 4) to 6 ′) are performed on the second bag (step 8 to step 10).

  Other work procedures are the same as those in the first embodiment, and the description thereof is omitted.

It is a perspective view which shows the Example of the medicine inspection apparatus of the packaging medicine which concerns on this invention. (A) is a front view showing a packaged medicine bag, and (b) to (e) are a color image, a binarized image, an edge extraction image, and a label image. (A)-(d) is each screen which shows the display mode of a collation result. (A)-(c) represents the process of gradually scraping the pixel of each drug that has been contacted (polymerized) from the outer peripheral side, and (d) and (e) are the process of restoring by the inscribed circle and the circle of the restored drug. It is explanatory drawing showing a shape. (A) is a flow chart showing the procedure for testing a packaged medicine, and (b) is a registration screen, a comparison master image, a verification result screen by a single check, and a verification result screen by a continuous check. It is the top view which shows the perspective view which shows 2nd Example of the imaging | photography unit in the medicine inspection apparatus 1, and the image of the chemical | medical agent each image | photographed with the up-and-down camera. It is explanatory drawing about the three-dimensional adjacent (contact) state of the adjacent chemical | medical agent. It is explanatory drawing which shows the 8 vicinity contraction process of the chemical | medical agent of a position, and a decompression | restoration aspect.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Drug detection apparatus 2 Conveyor belt 3 Main body 3a Portal frame 4. 4 'imaging | photography unit 5. Touchscreen type display apparatus 6. ON / OFF switch 7. Control part 8. Program storage part 41.42 Digital camera 43 Parallel light irradiation type illuminator

Claims (10)

Each transparent bag in which the medicine is packaged for each dose is used to check whether the medicine consisting of tablets or capsules packaged according to each dose is as prescribed. Color images of the drugs inside, image processing for each drug and calculate the length in the major axis direction, the length in the minor axis direction, the area based on the number of pixels, and calculate the RGB density value for each pixel, By comparing with the reference image data of each medicine prescribed for each dose, it is possible to check whether or not the medicine packaged in each transparent bag matches the medicine prescribed in the prescription. A method of drug testing,
The image processing converts a color image into a binarized image, extracts edges from the binarized image of each drug, performs labeling, cuts out the labeled area in order, and for each labeled drug image Calculating the major axis length, minor axis length, and area based on the number of pixels;
When an image is taken with the medicine in the bag in contact, the pixels of each medicine in contact are gradually scraped from the outer peripheral side, returned to the state before the pixels are shaved after being separated, and the shape of the medicine is changed. And a step of specifying the medicine.
The silhouette of the medicine in the bag is photographed from the back side of each bag with another camera, and the silhouette image of each medicine photographed with the other camera is converted into a grayscale image to be a binarized image. If there is a contact point among the adjacent drugs, the contraction process is performed to scrape the pixels one by one from the outer peripheral side of the binarized image of the drug, and after returning to the state before scraping the pixels, the drug The original shape of each drug is restored, edges are extracted from the binarized images of each drug, labeled, and the major axis length, minor axis length, and area of each drug are calculated based on the number of pixels. The color image of the color photographed image is calculated for each pixel, and the shape data of the medicine and the hue data of the medicine alone or the color data including the same hue data and imprint / character are determined. The data packaged in each transparent bag matches the prescription drugs by superimposing the data and fusing them with each other and comparing them with the reference image data of each drug prescribed for each dose. The method for testing a packaged drug according to claim 1, wherein collation is performed as to whether or not to perform .
A packaged drug testing device for checking whether a drug consisting of tablets or capsules packaged according to each dose is a drug as prescribed,
An imaging unit comprising a camera arranged on the front side with respect to the packaging medicine and an illuminator that irradiates light on the front side of the packaging medicine ,
A moving means for moving the imaging unit relative to each dose once on a transparent bag in which the medicine is packaged for each dose;
The medicine for each dose is taken with the camera in color, the color image is converted into a binarized image, the edges are extracted from the binarized image of each medicine, and after labeling, the labeled area is For each medicine image cut out and labeled in order, the major axis length, minor axis length, and area are calculated based on the number of pixels to identify the shape of each medicine, When RGB image density values are calculated for each pixel, color image data including the hue data of each medicine and the shape data of the medicine are fused, and further, the medicine in the bag is imaged in contact with the image. Is an image processing / calculation means for gradually removing the pixels of each contacted drug from the outer peripheral side, returning to a state before the pixels are removed after being separated, and specifying the shape of the drug ,
By comparing the drug data for each dose calculated by this image processing / calculation means with the reference image data for each drug prescribed for each dose, the packaging in each transparent bag And a determination means for collating whether or not the prescribed medicine matches the medicine according to the prescription. The other camera disposed on the back side with respect to the packaging medicine;
The silhouette of the packaged medicine is photographed from the back side with the other camera, the silhouette images are grayscaled, and if the adjacent medicines are in contact, they are shrunk and separated before being shrunk. For each medicine, the major axis length, the minor axis length, and the area are calculated based on the number of pixels to identify the shape of each medicine, and the color-captured image is taken for each pixel. The image processing / calculating means for calculating the RGB density values and fusing the color image data including the hue data of each drug and the shape data of the drug, respectively . Package medicine drug testing device. , The reference image data of the medicine is automatically registered on the basis of the medicine data calculated by color-taking the medicine put in the first bag among the medicines packaged and processing the image. The device for testing a packaged drug according to claim 3 or 4, wherein the device is a test drug.   The reference image data of the medicine is obtained by taking a color image from the front side and taking a silhouette image from the back side of the medicine put in the first bag among the packaged medicines. 5. The packaged drug testing device according to claim 4, wherein the drug testing apparatus is automatically registered based on drug data obtained by fusing both data calculated in this manner.   The reference image data of the medicine is automatically based on the medicine data created so as to coincide with the medicine data calculated by color imaging and image processing with the camera based on the medicine database of the medicine packaging device. The device for testing a medicine for packaging according to claim 3 or 4, wherein the device is registered.   The imaging unit continuously collates while moving intermittently for each dose on a transparent bag in which the medicine is packaged, and stops moving on the bag determined to be a medicine miss and warns. It has two types of modes: a continuous drug check mode and a sequential drug check mode that matches each dose and requests the user's instructions for the next dose check regardless of the check result. 5. A medicine inspection device for packaged medicine according to claim 3 or 4.   As a result of collation, when unnecessary medicine is packaged or when necessary medicine is insufficient, the image display means for displaying the medicine as a color image, and the contents of the collation result are messaged to the image display means. 5. The medicine inspection apparatus for packaged medicine according to claim 3 or 4, further comprising warning means for displaying the voice and warning by voice.   As a result of the collation, when the wrong medicine is packaged, an image display means for displaying the wrong medicine and the necessary medicine in color images respectively, and the content of the collation result is displayed as a message in the image display means, and 5. The medicine inspection device for packaged medicine according to claim 3, further comprising warning means for warning by voice.