EP3109623B1 - Medicine packet inspection apparatus and method - Google Patents
Medicine packet inspection apparatus and method Download PDFInfo
- Publication number
- EP3109623B1 EP3109623B1 EP16176217.4A EP16176217A EP3109623B1 EP 3109623 B1 EP3109623 B1 EP 3109623B1 EP 16176217 A EP16176217 A EP 16176217A EP 3109623 B1 EP3109623 B1 EP 3109623B1
- Authority
- EP
- European Patent Office
- Prior art keywords
- medicine
- medicine packet
- light
- packet
- color
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 239000003814 drug Substances 0.000 title claims description 551
- 229940079593 drug Drugs 0.000 title claims description 88
- 238000007689 inspection Methods 0.000 title claims description 62
- 238000000034 method Methods 0.000 title claims description 24
- 239000003086 colorant Substances 0.000 claims description 53
- 230000000295 complement effect Effects 0.000 claims description 2
- 238000010586 diagram Methods 0.000 description 6
- 230000006870 function Effects 0.000 description 4
- 238000004590 computer program Methods 0.000 description 3
- 230000002950 deficient Effects 0.000 description 3
- 238000001514 detection method Methods 0.000 description 3
- 229920001621 AMOLED Polymers 0.000 description 1
- 208000017667 Chronic Disease Diseases 0.000 description 1
- 206010020772 Hypertension Diseases 0.000 description 1
- 238000007792 addition Methods 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 206010012601 diabetes mellitus Diseases 0.000 description 1
- 230000003203 everyday effect Effects 0.000 description 1
- 230000001631 hypertensive effect Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000002360 preparation method Methods 0.000 description 1
- 238000007789 sealing Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/84—Systems specially adapted for particular applications
- G01N21/88—Investigating the presence of flaws or contamination
- G01N21/89—Investigating the presence of flaws or contamination in moving material, e.g. running paper or textiles
- G01N21/892—Investigating the presence of flaws or contamination in moving material, e.g. running paper or textiles characterised by the flaw, defect or object feature examined
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/0002—Inspection of images, e.g. flaw detection
- G06T7/0004—Industrial image inspection
- G06T7/0008—Industrial image inspection checking presence/absence
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/84—Systems specially adapted for particular applications
- G01N21/88—Investigating the presence of flaws or contamination
- G01N21/95—Investigating the presence of flaws or contamination characterised by the material or shape of the object to be examined
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61J—CONTAINERS SPECIALLY ADAPTED FOR MEDICAL OR PHARMACEUTICAL PURPOSES; DEVICES OR METHODS SPECIALLY ADAPTED FOR BRINGING PHARMACEUTICAL PRODUCTS INTO PARTICULAR PHYSICAL OR ADMINISTERING FORMS; DEVICES FOR ADMINISTERING FOOD OR MEDICINES ORALLY; BABY COMFORTERS; DEVICES FOR RECEIVING SPITTLE
- A61J7/00—Devices for administering medicines orally, e.g. spoons; Pill counting devices; Arrangements for time indication or reminder for taking medicine
- A61J7/0076—Medicament distribution means
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/01—Arrangements or apparatus for facilitating the optical investigation
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/84—Systems specially adapted for particular applications
- G01N21/88—Investigating the presence of flaws or contamination
- G01N21/95—Investigating the presence of flaws or contamination characterised by the material or shape of the object to be examined
- G01N21/9508—Capsules; Tablets
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/56—Cameras or camera modules comprising electronic image sensors; Control thereof provided with illuminating means
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30108—Industrial image inspection
Definitions
- medicine is given to a patient according to a prescription from a doctor in a hospital or a pharmacy.
- the transfer unit 110 may sequentially locate the medicine packets at the photographing unit 120 one by one. More specifically, the transfer unit 110 may locate one medicine packet of the medicine packet bundle at the photographing unit 120 so that the medicine packet is inspected, and stop transfer of the medicine packet bundle during inspection. After inspection, the transfer unit 110 may transfer the medicine packet bundle so that the next medicine packet is located at the photographing unit 120.
- the photographing unit 120 may photograph the medicine packet plural times corresponding to lights of different colors in a manner, in which the photographing unit 120 executes first photographing when the lighting unit 130 provides first light, executes second photographing when the lighting unit 130 provides second light of a different color from the first light, and executes third photographing when the lighting unit 130 provides third light of a different color from the first and second lights.
- the lighting unit 130 provides light to the medicine packet. More specifically, the lighting unit 130 may be implemented as a backlight or light emitting elements having a predetermined shape. For example, if the lighting unit 130 is implemented as a backlight, the backlight may be disposed at a position opposing the position of the photographing unit 120. For example, as exemplarily shown in FIGS. 2 to 3B , if the photographing unit 120 is disposed on the front surface of the medicine packet, the lighting unit 130 may be disposed on the rear surface of the medicine packet. In this case, the lighting unit 130 may emit light from the rear end of the medicine packet toward the photographing unit 120. Such a disposition shape will be described later with reference to FIGS. 2 to 3B .
- the lighting unit 120 may be implemented as general light emitting elements as well as the above-described backlight, or be implemented as a structure in which the backlight and the light emitting elements are combined. Such a case will be described later with reference to FIGS. 4A to 4D .
- the controller 140 controls the lighting unit 130 to sequentially provide lights of different colors to the medicine packet.
- the controller 140 may control the lighting unit 130 to sequentially provide lights of different colors to the medicine packet in a manner in which the lighting unit 130 provides first light, provides second light of a different color from the first light after provision of the first light, and provides third light of a different color from the first and second lights after provision of the second light.
- the controller 140 may receive the images acquired by photographing the medicine packet from the photographing unit 120, detect the kinds and number of the medicines from the received images, and judge whether or not medicines matching medicine prescription information are packed in the medicine packet by comparing the detected kinds and number of the medicines with the medicine prescription information.
- controller 140 may control the lighting unit 130 to sequentially emit first light having the same color as the color of text printed on the surface of the medicine packet and second light of a color different from the color of the first light.
- the controller 140 may control the lighting unit 130 to emit light of the pre-input color.
- the controller 140 may judge that the first medicine, the second medicine, the third medicine, the fourth medicine and the fifth medicine are present in the medicine packet.
- the number of frequency of providing light and the number of frequency of photographing are limited and thus a time taken for medicine packet inspection may be reduced in a general inspection process, and additional inspection is executed if a result of inspection does not coincide with medicine prescription information, thereby improving accuracy in inspection.
- controller 140 may be also referred to as a "processor”.
- the transfer unit 110 may include entrance rollers 111 and exit rollers 112.
- FIG. 3A is a perspective view illustrating a transfer unit 110, a photographing unit 120 and a lighting unit 130 of a medicine packet inspection apparatus 250' in accordance with one embodiment of the present invention.
- the medicine packet bundle P is placed in parallel with the ground, the photographing unit 120 is disposed at the lower end of a medicine packet and the lighting unit 130 is located at the upper end of the medicine packet, the disclosure of the present invention is not limited thereto.
- the medicine packet bundle P may be placed vertical to the ground, the photographing unit 120 may be located at the left side of a medicine packet and the lighting unit 130 may be located at the right side of the medicine packet.
- a first subsidiary lighting unit 136 may be a ring-shaped light element, which is disposed around the medicine packet 10, and emit light in the direction toward the medicine packet 10. Further, in implementation, a polarizing member may be disposed between the first subsidiary lighting unit 136 and the medicine packet 10.
- a second subsidiary lighting unit 137 emits light from an area above the medicine packet 10 toward the medicine packet 10.
- the second subsidiary lighting unit 137 may have a dome shape so as to uniformly irradiate the medicine packet 10 with light.
- a second polarizing member 138 may be disposed between the second subsidiary lighting unit 137 and the medicine packet 10.
- FIG. 5A shows a plurality of images 310, 320 and 330 acquired by photographing a medicine packet, in which a first medicine 311, a second medicine 312, a third medicine 313, a fourth medicine 314, a fourth medicine 315, a sixth medicine 316 and a seventh medicine 317 are packed, under lights of different colors three times.
- the second medicine 312, the fourth medicine 314, the fifth medicine 315, the sixth medicine 316 and the seventh medicine 317 are clearly displayed so as to be detectable, but the first medicine 311 and the third medicine 313 are not clearly displayed so as to be undetectable.
- the controller 140 may generate a new image 340 by combining the photographed images 310, 320 and 330.
- a medicine packet inspection apparatus 100" may further include a sensor unit 150.
- lights of different colors are sequentially provided to a medicine packet (Operation S1120).
- lights of different colors may be sequentially provided to the medicine packet in a manner in which first light is provided, second light of a different color from the color of the first light is provided after provision of the first light, and third light of a different color from the colors of the first and second lights is provided after provision of the second light.
- a medicine packet inspection apparatus in accordance with one embodiment of the present invention sequentially provides lights of different colors to a medicine packet so as to photograph the medicine packet and may thus accurately recognize medicines in the medicine packet.
Landscapes
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- General Physics & Mathematics (AREA)
- Life Sciences & Earth Sciences (AREA)
- Physics & Mathematics (AREA)
- Chemical & Material Sciences (AREA)
- Analytical Chemistry (AREA)
- Pathology (AREA)
- Immunology (AREA)
- Biochemistry (AREA)
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Animal Behavior & Ethology (AREA)
- Public Health (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Veterinary Medicine (AREA)
- Quality & Reliability (AREA)
- Textile Engineering (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- Medical Preparation Storing Or Oral Administration Devices (AREA)
- Mechanical Engineering (AREA)
- Medicinal Chemistry (AREA)
- Pharmacology & Pharmacy (AREA)
- Investigating Materials By The Use Of Optical Means Adapted For Particular Applications (AREA)
Description
- The present invention relates to a medicine packet inspection apparatus and method and, more particularly, to a medicine packet inspection apparatus which sequentially provides lights of different colors and photographs a medicine packet plural times corresponding to the lights of different colors so as to raise accuracy in packet inspection and a medicine packet inspection method using the same.
- In general, medicine is given to a patient according to a prescription from a doctor in a hospital or a pharmacy.
- Patients with a chronic disease periodically take the same medicine set over a long period of time. For example, a hypertensive patient or a diabetic patient should take the same medicine set every day for one month to three months or more. In this case, the patient is prescribed a large amount of medicines at once.
- A unit of prescribed medicines, which should be taken at a time, is accommodated in a medicine packet, one side of which is opened. Thereafter, by sealing the opened side of the medicine packet, preparation of the medicine packet, in which medicines are packed, is completed.
- Here, a plurality of medicine packets is continuously connected to form a medicine packet bundle. More specifically, a dose of medicine is automatically packed in a medicine packet and medicine packets are continuously connected, thus forming a medicine packet bundle.
- In order to secure accuracy in medicines taken by a patient, operation to inspect whether or not some of prescribed medicines are omitted from a medicine packet, whether or not a medicine packet includes medicines which are not prescribed, whether or not a medicine packet includes a number of medicines exceeding the prescribed number of medicines, etc., is carried out.
- Among methods of inspecting medicine packets, there is a method of photographing a medicine packet, detecting medicines from an acquired image, and judging whether or not the medicine packet is defective by comparing the detected medicines to medicine prescription information. Particularly, such a method may reduce a time taken to inspect medicine packets, if a large amount of medicines is prescribed at once, thus being widely used.
- However, medicines have various colors. Therefore, if there is a medicine having a similar color to the color of the background of an acquired image, the medicine may not be precisely distinguished from the acquired image and thus judgment as to whether or not a medicine packet containing the medicines is defective may fail.
- Further, if text is printed on a medicine packet and the text and medicines overlap, the medicines may not be precisely distinguished due to presence of the text and thus judgment as to whether or not a medicine packet containing the medicines is defective may fail.
-
WO 2014/119994 A1 discloses a method for inspecting packages using polychromatic light on the first side using light with different wavelength on the second side. -
US 2010/045976 A1 discloses an inspection device and a method wherein interconnected, substantially flat bags are provided, in which bags objects are present which are set vibrating, after which one or more images of the objects in the bag are recorded. - Therefore, the present invention has been made in view of the above problems, and it is an object of the present invention to provide a medicine packet inspection apparatus which sequentially provides lights of different colors and photographs a medicine packet plural times corresponding to the lights of different colors so as to raise accuracy in packet inspection, and a medicine packet inspection method using the same.
- In accordance with an aspect of the present invention, the above and other objects can be accomplished by the provision of a medicine packet inspection apparatus according to claim 1.
- In accordance with another aspect of the present invention, there is provided a medicine packet inspection method according to claim 11. Further features of the method and apparatus are defined in the respective dependent claims.
- The above and other objects, features and other advantages of the present invention will be more clearly understood from the following detailed description taken in conjunction with the accompanying drawings, in which:
-
FIG. 1 is a block diagram illustrating the configuration of a medicine packet inspection apparatus in accordance with one embodiment of the present invention; -
FIG. 2 is a perspective view illustrating a transfer unit and a photographing unit of an inspection unit in accordance with one embodiment of the present invention; -
FIG. 3A is a perspective view illustrating a transfer unit, a photographing unit and a lighting unit of a medicine packet inspection apparatus in accordance with one embodiment of the present invention; -
FIG. 3B is a front view illustrating a transfer unit, a photographing unit and a lighting unit of a medicine packet inspection apparatus in accordance with another embodiment of the present invention; -
FIGS. 4A to 4D are views illustrating disposition types of a transfer unit, a photographing unit and a lighting unit in accordance with other embodiments of the present invention; -
FIGS. 5A and5B are views, each of which illustrates a process of inspecting a medicine packet using a plurality of images in accordance with one embodiment of the present invention; -
FIG. 6 is a view illustrating photographing of a medicine packet by providing light having the same color as the color of text in accordance with one embodiment of the present invention; -
FIG. 7 shows images acquired by photographing a medicine packet plural times corresponding to lights of different colors in accordance with one embodiment of the present invention; -
FIGS. 8 to 10 are block diagrams illustrating the configurations of medicine packet inspection apparatuses in accordance with other embodiments of the present invention; and -
FIG. 11 is a flowchart illustrating a medicine packet inspection method in accordance with one embodiment of the present invention. - Hereinafter, one embodiment of the present invention will be described in detail with reference to the accompanying drawings.
-
FIG. 1 is a block diagram illustrating the configuration of a medicine packet inspection apparatus in accordance with one embodiment of the present invention. - With reference to
FIG. 1 , a medicinepacket inspection apparatus 100 includes atransfer unit 110, a photographingunit 120, alighting unit 130, and acontroller 140. - The
transfer unit 110 transfers medicine packets in which medicines are packed. More specifically, in order to inspect the medicine packets in which medicines are packed, thetransfer unit 110 may transfer a medicine packet bundle, in which the medicine packets are continuously connected, to the photographingunit 120. - Further, the
transfer unit 110 may sequentially locate the medicine packets at the photographingunit 120 one by one. More specifically, thetransfer unit 110 may locate one medicine packet of the medicine packet bundle at the photographingunit 120 so that the medicine packet is inspected, and stop transfer of the medicine packet bundle during inspection. After inspection, thetransfer unit 110 may transfer the medicine packet bundle so that the next medicine packet is located at the photographingunit 120. - The photographing
unit 120 photographs the medicine packet. More specifically, the photographingunit 120 photographs the medicine packet transferred to the photographingunit 120 by thetransfer unit 110 and thus acquire images to detect the number and kinds of medicines packed in the medicine packet. - The photographing
unit 120 photographs the medicine packet plural times corresponding to lights of different colors under the control of thecontroller 140. More specifically, when thelighting unit 130 sequentially provides a plurality of lights of different colors to the medicine packet, the photographingunit 120 photographs the medicine packet plural times corresponding to the lights of different colors. - For example, the photographing
unit 120 may photograph the medicine packet plural times corresponding to lights of different colors in a manner, in which the photographingunit 120 executes first photographing when thelighting unit 130 provides first light, executes second photographing when thelighting unit 130 provides second light of a different color from the first light, and executes third photographing when thelighting unit 130 provides third light of a different color from the first and second lights. - The
lighting unit 130 provides light to the medicine packet. More specifically, thelighting unit 130 may be implemented as a backlight or light emitting elements having a predetermined shape. For example, if thelighting unit 130 is implemented as a backlight, the backlight may be disposed at a position opposing the position of the photographingunit 120. For example, as exemplarily shown inFIGS. 2 to 3B , if thephotographing unit 120 is disposed on the front surface of the medicine packet, thelighting unit 130 may be disposed on the rear surface of the medicine packet. In this case, thelighting unit 130 may emit light from the rear end of the medicine packet toward the photographingunit 120. Such a disposition shape will be described later with reference toFIGS. 2 to 3B . - The
lighting unit 120 may be implemented as general light emitting elements as well as the above-described backlight, or be implemented as a structure in which the backlight and the light emitting elements are combined. Such a case will be described later with reference toFIGS. 4A to 4D . - The
lighting unit 130 provides lights of different colors to the medicine packet under the control of thecontroller 140. For example, thelighting unit 130 may provide a plurality of lights of different colors to the medicine packet in a manner in which thelighting unit 130 provides first light, provides second light of a different color from the first light after provision of the first light, and provides third light of a different color from the first and second lights after provision of the second light. Here, the different colors may be contrasting colors, and at least one of the different colors may be the same as the color of the medicine or be complementary to the color of the medicine. - The
lighting unit 130 may be implemented as a plurality of light emitting elements. If thelighting unit 130 is implemented as light emitting elements, thelighting unit 130 may include a first light emitting element to emit light of a first color and a second light emitting element to emit light of a second color. For example, thelighting unit 130 may include a light emitting element to emit red light and a light emitting element to emit blue light. Here, the light emitting elements may be elements to emit light of a specific color, i.e., various types of elements including an incandescent light, a fluorescent light, a CCFL, an LED, an OLED, an AMOLED, etc. - Further, although this embodiment describes the
light emitting unit 130 as including two kinds of light emitting elements, thelight emitting unit 130 is not limited thereto. For example, thelighting unit 130 may include a first light emitting element to emit light of a first color, a second light emitting element to emit light of a second color, a third light emitting element to emit light of a third color, a fourth light emitting element to emit light of a fourth color, and a fifth light emitting element to emit light of a fifth color. - If the
lighting unit 130 is implemented as light emitting elements, one light emitting element corresponding to each color may be used or a plurality of light emitting elements corresponding to each color may be used. For example, thelighting unit 130 may include a plurality of light emitting elements to emit light of a first color and a plurality of light emitting elements to emit light of a second color. Although this embodiment describes that light emitting elements, each of which emits light of one color, one light emitting element may form thelighting unit 130 if the light emitting element may emit light of a plurality of colors. - The
controller 140 controls thelighting unit 130 to sequentially provide lights of different colors to the medicine packet. For example, thecontroller 140 may control thelighting unit 130 to sequentially provide lights of different colors to the medicine packet in a manner in which thelighting unit 130 provides first light, provides second light of a different color from the first light after provision of the first light, and provides third light of a different color from the first and second lights after provision of the second light. - Further, the
controller 140 controls the photographingunit 120 to photograph the medicine packet plural times corresponding to a plurality of lights of different colors. More specifically, when thelighting unit 130 sequentially provides a plurality of lights of different colors to the medicine, thecontroller 140 may control the photographingunit 120 to photograph the medicine packet plural times corresponding to the lights of different colors. - The
controller 140 judges whether or not medicines matching medicine prescription information are packed in the medicine packet using a plurality of images acquired by photographing the medicine packet under the lights of different colors. - More specifically, the
controller 140 may receive the images acquired by photographing the medicine packet from the photographingunit 120, detect the kinds and number of the medicines from the received images, and judge whether or not medicines matching medicine prescription information are packed in the medicine packet by comparing the detected kinds and number of the medicines with the medicine prescription information. - Further, the
controller 140 may control thelighting unit 130 to sequentially emit first light having the same color as the color of text printed on the surface of the medicine packet and second light of a color different from the color of the first light. - For example, if the color of the text printed on the surface of the medicine packet is black, the
controller 140 may control thelighting unit 130 to emit black light and then to emit light of at least one color differing from black after emission of black light. - In this case, when a user pre-inputs the color of the text printed on the surface of the medicine packet using an input unit (not shown) of the medicine
packet inspection apparatus 100, thecontroller 140 may control thelighting unit 130 to emit light of the pre-input color. - Further, the medicine
packet inspection apparatus 100 may include a sensor unit (not shown). The sensor unit (not shown) may detect the color of the text printed on the surface of the medicine packet, and thecontroller 140 may control thelighting unit 130 to emit light having the same color as the detected color of the text. - The
controller 140 may detect medicines from the respective acquired images and judge whether or not medicines matching the medicine prescription information are packed in the medicine packet by combining the detected medicines. - More specifically, the
controller 140 may detect medicines packed in the medicine packet from each of the acquired respective images. Further, if a specific medicine is not detected from a first image and the specific medicine is detected from a second image, thecontroller 140 may combine a result of detection from the first image and a result of detection from the second image and thus judge that the specific medicine is present in the medicine packet. - For example, if a first medicine, a second medicine, and a fourth medicine are detected from the first image and the first medicine, the second medicine, a third medicine and a fifth medicine are detected from the second image acquired using light of a different color from the color of light for the first image, the
controller 140 may judge that the first medicine, the second medicine, the third medicine, the fourth medicine and the fifth medicine are present in the medicine packet. - In this case, if the medicine prescription information includes the first medicine, the second medicine, the third medicine, the fourth medicine and the fifth medicine, the
controller 140 may judge that medicines matching the medicine prescription information are packed in the medicine packet. - The
controller 140 may combine a plurality of images, detect medicines from an image acquired by combining the images, and judge whether or not medicines matching the medicine prescription information are packed in the medicine packet. - For example, the
controller 140 may generate a third image by combining the first image in which the first medicine, the second medicine and the fourth medicine are distinguished, and the second image in which the first medicine, the second medicine, the third medicine and the fifth medicine are distinguished. Then, thecontroller 140 may detect the first medicine, the second medicine, the third medicine, the fourth medicine and the fifth medicine from the third image. - Therefore, the
controller 140 may judge that the first medicine, the second medicine, the third medicine, the fourth medicine and the fifth medicine are present in the medicine packet. - In this case, if the medicine prescription information includes the first medicine, the second medicine, the third medicine, the fourth medicine and the fifth medicine, the
controller 140 may judge that medicines matching the medicine prescription information are packed in the medicine packet. - If any medicines matching the medicine prescription information are not packed in the medicine packet, the
controller 140 controls thelighting unit 130 to provide light of a color differing from the lights of different colors. For example, if, as a result of photographing the medicine packet using first light of a first color, second light of a second color and third light of a third color and comparing the photographed images with the medicine prescription information, it is judged that medicines in the medicine packet do not coincide with the medicine prescription information, thecontroller 140 may control thelighting unit 130 to provide fourth light of a fourth color and fifth light of a fifth color. - In this case, the
controller 140 controls the photographingunit 120 to additionally photograph the medicine packet corresponding to the lights of different colors. For example, corresponding to provision of the fourth light of the fourth color and the fifth light of the fifth color by thelighting unit 130, thecontroller 140 may control the photographingunit 120 to execute fourth photographing and fifth photographing of the medicine packet. - Thereby, the number of frequency of providing light and the number of frequency of photographing are limited and thus a time taken for medicine packet inspection may be reduced in a general inspection process, and additional inspection is executed if a result of inspection does not coincide with medicine prescription information, thereby improving accuracy in inspection.
- Meanwhile, the
controller 140 may be also referred to as a "processor". - Further, the
controller 140 may control the overall operation of the medicinepacket inspection apparatus 100. -
FIG. 2 is a perspective view illustrating thetransfer unit 110 and the photographingunit 120 of aninspection unit 250 in accordance with one embodiment of the present invention. - With reference to
FIG. 2 , thetransfer unit 110 may includeentrance rollers 111 andexit rollers 112. - A medicine packet bundle P in which medicine packets are continuously connected enters the photographing
unit 120 by rotation of theentrance rollers 111 and exits the photographingunit 120 by rotation of theexit rollers 112. - More specifically, the
entrance rollers 111 may include anupper entrance roller 111a contacting the upper part of a medicine packet and alower entrance roller 111b contacting the lower part of the medicine packet, and the medicine packet bundle P may enter the photographingunit 120 by rotation of theupper entrance roller 111a and thelower entrance roller 111b. - The
exit rollers 112 may include anupper exit roller 112a contacting the upper part of a medicine packet and alower exit roller 112b contacting the lower part of the medicine packet, the medicine packet bundle P may exit the photographingunit 120 by rotating theupper exit roller 112a and thelower exit roller 112b. - When the medicine packet enters the photographing
unit 120, operation of theentrance rollers 111 and theexit rollers 112 is stopped so as to photograph the medicine packet and, when the photographingunit 120 finishes photographing of the medicine packet, theentrance rollers 111 and theexit rollers 112 start to operate so that a medicine packet located at the next position of the photographed medicine packet is located at the photographingunit 120. - The photographing
unit 120 is disposed between theentrance rollers 111 and theexit rollers 112. The photographingunit 120 is located under the medicine packet bundle P and may thus photograph the medicine packet. - Since the width and length of the photographing
unit 120 correspond to the width and length of the medicine packet, the photographingunit 120 may photograph medicine packets one by one. However, the disclosure of the present invention is not limited thereto and the photographingunit 120 may be implemented to have a sufficient size to simultaneously photograph two or more medicine packets. -
FIG. 3A is a perspective view illustrating atransfer unit 110, a photographingunit 120 and alighting unit 130 of a medicine packet inspection apparatus 250' in accordance with one embodiment of the present invention. - With reference to
FIG. 3A , thelighting unit 130 may be disposed opposite the photographingunit 120. For example, as exemplarily shown inFIG. 3A , the photographingunit 120 may be located under the medicine packet bundle P and thelighting unit 130 may be located at the opposite side of the medicine packet bundle P. That is, thelighting unit 130 may be located at a position on the medicine packet bundle P corresponding to the photographingunit 120. - Although this embodiment describes that the medicine packet bundle P is placed in parallel with the ground, the photographing
unit 120 is disposed at the lower end of a medicine packet and thelighting unit 130 is located at the upper end of the medicine packet, the disclosure of the present invention is not limited thereto. For example, the medicine packet bundle P may be placed vertical to the ground, the photographingunit 120 may be located at the left side of a medicine packet and thelighting unit 130 may be located at the right side of the medicine packet. - Further, although this embodiment describes that the photographing
unit 120 is disposed at the lower end of a medicine packet and thelighting unit 130 is disposed at the upper end of the medicine packet, the disclosure of the present invention is not limited thereto. For example, the photographingunit 120 may be disposed at the upper end of a medicine packet and thelighting unit 130 may be disposed at the lower end of the medicine packet. - The
lighting unit 130 may have a width and a length corresponding to the width and length of the photographingunit 120. Further, thelighting unit 130 may provide light in a direction toward the medicine packet and the photographingunit 120. Therefore, thelighting unit 130 may uniformly provide light throughout an area photographed by the photographingunit 120. -
FIG. 3B is a front view illustrating atransfer unit 110, a photographingunit 120 and alighting unit 130 of a medicinepacket inspection apparatus 250" in accordance with another embodiment of the present invention. - With reference to
FIG. 3 , thelighting unit 130 and the photographing unit 20 face each other across from a medicine packet photographed by the photographingunit 120. -
FIGS. 4A to 4D are views illustrating shapes of lighting units in accordance with other embodiments of the present invention. More specifically,FIG. 4A is a view illustrating a lighting unit to which a ring-shaped subsidiary lighting unit is added,FIG. 4B is a top view of the lighting unit ofFIG. 4A ,FIG. 4C is a view illustrating a lighting unit to which a subsidiary lighting unit disposed in the opposite direction of the lighting unit is added, andFIG. 4D is a view illustrating a lighting unit to which both subsidiary lighting units shown inFIGS. 4A and4C are added. With reference toFIGS. 4A and 4B , thelighting unit 130 may emit light from an area below amedicine packet 10 in a direction toward themedicine packet 10. Here, in order to uniformly emit light to themedicine packet 10, a firstpolarizing member 131 may be disposed between thelighting unit 130 and themedicine packet 10. Although the above-described embodiments illustrate thelighting unit 130 as being disposed under themedicine packet 10, thelighting unit 130 may be disposed on themedicine packet 10 in implementation. - A first
subsidiary lighting unit 136 may be a ring-shaped light element, which is disposed around themedicine packet 10, and emit light in the direction toward themedicine packet 10. Further, in implementation, a polarizing member may be disposed between the firstsubsidiary lighting unit 136 and themedicine packet 10. - In implementation, the first
subsidiary lighting unit 136 may emit light having the same color as light from thelighting unit 130 while interworking with thelighting unit 130, or emit light of a different color as light from thelighting unit 130. For example, if thelighting unit 130 is capable of emitting green light and the firstsubsidiary lighting unit 136 is capable of emitting red light, thecontroller 140 may control thelighting unit 130 alone to emit light when green light is required, and control the firstsubsidiary lighting unit 136 alone to emit light when red light is required. Further, thecontroller 140 may control thelighting unit 130 to emit green light and control the firstsubsidiary light unit 136 to emit red light when yellow light is required, thereby allowing yellow light to be emitted to themedicine packet 10 by mixing of green light and red light. - With reference to
FIG. 4C , thelighting unit 130 emits light from an area below themedicine packet 10 in the direction toward themedicine packet 10. Here, the firstpolarizing member 131 may be disposed between thelighting unit 130 and themedicine packet 10 so as to uniformly irradiate the medicine packet with light. Although the embodiment describes thelighting unit 130 as being disposed under the medicine packet, the medicine packet may be disposed on the medicine packet in implementation. - A second
subsidiary lighting unit 137 emits light from an area above themedicine packet 10 toward themedicine packet 10. Here, the secondsubsidiary lighting unit 137 may have a dome shape so as to uniformly irradiate themedicine packet 10 with light. Further, in order to uniformly disperse light, a secondpolarizing member 138 may be disposed between the secondsubsidiary lighting unit 137 and themedicine packet 10. - In implementation, the second
subsidiary lighting unit 137 may emit light having the same color as light from thelighting unit 130 while interworking with thelighting unit 130, or emit light of a different color as light from thelighting unit 130. - With reference to
FIG. 4D , thelighting unit 130 emits light from an area below themedicine packet 10 in the direction toward themedicine packet 10. - The first
subsidiary lighting unit 136 may be a ring-shaped light element, which is disposed around themedicine packet 10, and emit light in the direction toward themedicine packet 10. - The second
subsidiary lighting unit 137 emits light from an area above themedicine packet 10 in a direction toward the medicine packet. - If the
lighting unit 130, the firstsubsidiary lighting unit 136 and the secondsubsidiary lighting unit 137 emit lights to themedicine packet 10, threelighting units lighting unit 130, the firstsubsidiary lighting unit 136 and the secondsubsidiary lighting unit 137 may simultaneously emit lights of different colors (for example, green light, red light and blue light) and thus irradiate themedicine packet 10 with light of a different color (white light) through light mixing. - Although the above embodiment describes two subsidiary lighting units as being additionally used, three or more subsidiary lighting units may be additionally used in actual implementation.
-
FIGS. 5A and5B are views, each of which illustrates a process of inspecting a medicine packet using a plurality of images in accordance with one embodiment of the present invention. -
FIG. 5A illustrates a method of judging whether or not medicines matching medicine prescription information are packed in a medicine packet by detecting medicines from each of a plurality of images and combining the detected medicines. -
FIG. 5A shows a plurality ofimages first medicine 311, asecond medicine 312, athird medicine 313, afourth medicine 314, afourth medicine 315, asixth medicine 316 and aseventh medicine 317 are packed, under lights of different colors three times. - In this case, the
controller 140 may detect medicines packed in the medicine packet from the photographedimages - Medicines which are detected by the
controller 140 are shown by a solid line, and medicines which are not detected by thecontroller 140 are shown by a dotted line. - The
second medicine 312, thefourth medicine 314, thefifth medicine 315, thesixth medicine 316 and theseventh medicine 317 are detected from thefirst image 310, but thefirst medicine 311 and thethird medicine 313 are not detected from thefirst image 310. - The
first medicine 311, thesecond medicine 312, thethird medicine 313, thefourth medicine 314, thesixth medicine 316 and theseventh medicine 317 are detected from thesecond image 320, but thefifth medicine 315 is not detected from thesecond image 320. - The
first medicine 311, thesecond medicine 312, thethird medicine 313, thesixth medicine 316 and theseventh medicine 317 are detected from thethird image 330, but thefourth medicine 314 and thefifth medicine 315 are not detected from thethird image 330. - In this case, the
controller 140 may judge whether or not medicines matching medicine prescription information are packed in the medicine packet by combining results of detection of the medicines from the threeimages - That is, since the
first medicine 311 is detected from thesecond image 320 and thethird image 330, thecontroller 140 may judge that thefirst medicine 311 is present in the medicine packet. - Since the
second medicine 312 is detected from thefirst image 310, thesecond image 320 and thethird image 330, thecontroller 140 may judge that thesecond medicine 311 is present in the medicine packet. - Since the
fifth medicine 315 is detected from thefirst image 310, thecontroller 140 may judge that thefifth medicine 315 is present in the medicine packet. - By repeating such a process in the case of the
third medicine 313, thefourth medicine 314, thesixth medicine 316 and theseventh medicine 317, thecontroller 140 may judge that thefirst medicine 311, thesecond medicine 312, thethird medicine 313, thefourth medicine 314, thefifth medicine 315, thesixth medicine 316 and theseventh medicine 317 are present in the medicine packet. - In this case, if the medicine prescription information includes the
first medicine 311, thesecond medicine 312, thethird medicine 313, thefourth medicine 314, thefifth medicine 315, thesixth medicine 316 and theseventh medicine 317, thecontroller 140 may judge that medicines matching the medicine prescription information are packed in the medicine packet. - In such a manner, if a specific medicine is detected from an arbitrary image among a plurality of images, it may be judged that the detected specific medicine is present in the medicine packet.
-
FIG. 5B illustrates a method of judging whether or not medicines matching medicine prescription information are packed in a medicine packet by combining a plurality of images and detecting medicines from an image acquired by combining the images. -
FIG. 5B shows a plurality ofimages first medicine 311, asecond medicine 312, athird medicine 313, afourth medicine 314, afifth medicine 315, asixth medicine 316 and aseventh medicine 317 are packed, under lights of different colors three times. - In each image, medicines which are clearly displayed so as to be detectable are shown by a solid line, and medicines which are not clearly displayed are shown by a dotted line.
- In the
first image 310, thesecond medicine 312, thefourth medicine 314, thefifth medicine 315, thesixth medicine 316 and theseventh medicine 317 are clearly displayed so as to be detectable, but thefirst medicine 311 and thethird medicine 313 are not clearly displayed so as to be undetectable. - In the
second image 320, thefirst medicine 311, thesecond medicine 312, thethird medicine 313, thefourth medicine 314, thesixth medicine 316 and theseventh medicine 317 are clearly displayed so as to be detectable, but thefifth medicine 315 is not clearly displayed so as to be undetectable. - In the
third image 330, thefirst medicine 311, thesecond medicine 312, thethird medicine 313, thesixth medicine 316 and theseventh medicine 317 are clearly displayed so as to be detectable, but thefourth medicine 314 and thefifth medicine 315 are not clearly displayed so as to be undetectable. - In this case, the
controller 140 may generate anew image 340 by combining the photographedimages - In the
image 340 acquired by combining theimages first medicine 311, thesecond medicine 312, thethird medicine 313, thefourth medicine 314, thefifth medicine 315, thesixth medicine 316 and theseventh medicine 317 are clearly displayed so as to be detectable. - The
controller 140 may judge whether or not medicines matching medicine prescription information are packed in the medicine packet by detecting medicines from thenew image 340 acquired by combining theimages - That is, since the
first medicine 311, thesecond medicine 312, thethird medicine 313, thefourth medicine 314, thefifth medicine 315, thesixth medicine 316 and theseventh medicine 317 are detected from theimage 340, thecontroller 140 may judge that thefirst medicine 311, thesecond medicine 312, thethird medicine 313, thefourth medicine 314, thefifth medicine 315, thesixth medicine 316 and theseventh medicine 317 are present in the medicine packet. - In this case, if the medicine prescription information includes the
first medicine 311, thesecond medicine 312, thethird medicine 313, thefourth medicine 314, thefifth medicine 315, thesixth medicine 316 and theseventh medicine 317, thecontroller 140 may judge that medicines matching the medicine prescription information are packed in the medicine packet. -
FIG. 6 is a view illustrating photographing of a medicine packet by providing light having the same color as the color of text in accordance with one embodiment of the present invention. - With reference to
FIG. 6 , amedicine packet 350 contains a plurality of medicines. Further,text 351 "ABC" is printed on the surface of themedicine packet 350. - If the
medicine packet 350 is photographed under the condition that medicines in themedicine packet 350 overlap thetext 351 printed on themedicine packet 350, the outlines of the medicines are not properly detected and, consequently, medicine recognition may fail. - Therefore, if the
medicine packet 350 is photographed using light of a color which is the same as or similar to the color of thetext 351 printed on themedicine packet 350 as a background color, an image 360 from which thetext 351 is removed may be acquired. - The
controller 140 may control thelighting unit 130 to sequentially emit first light having the same color as the color of the text printed on a medicine packet and at least one second light of a color different from the color of the first light. - For example, when the color of the text is black, the
controller 140 may control thelighting unit 130 to emit first light of black. - After emission of the first light from the
lighting unit 130, thecontroller 140 may control thelighting unit 130 to emit light of colors other than black. For example, thelighting unit 130 emits black light and then emits red light. - The second light may have one or more colors. For example, the
lighting unit 130 may emit black light having the same color as the text, emit red light after emission of black light and then emit blue light after emission of red light. -
FIG. 7 shows images acquired by photographing a medicine packet plural times corresponding to lights of different colors in accordance with one embodiment of the present invention. - If the medicine packet is photographed on a white background, there is a possibility that white medicines may not be detected clearly.
- If the medicine packet is photographed on a green background, there is a possibility that medicines having a color similar to green may not be detected clearly.
- Further, since text is printed on the medicine packet, there is a possibility that medicines may not be detected clearly due to presence of the text.
- Therefore, by photographing the medicine packet plural times using white light, green light and black light having the same color as the color (black) of the text, medicines having colors other than white may be clearly detected from an
image 910 acquired by photographing the medicine packet under white light, medicines having colors other than colors similar to green may be clearly detected from animage 920 acquired by photographing the medicine packet under green light, and animage 930 from which the text is removed may be acquired by the photographing the medicine packet under black light, thereby allowing medicines to be clearly detected regardless of presence of the text. -
FIG. 8 is a block diagram illustrating the configuration of a medicine packet inspection apparatus in accordance with a further embodiment of the present invention. - With reference to
FIG. 8 , a medicinepacket inspection apparatus 100" may further include asensor unit 150. - A
transfer unit 110, a photographingunit 120, alighting unit 130, and acontroller 140 of the medicinepacket inspection apparatus 100" in accordance with this embodiment may execute the same functions as those described inFIG. 1 . - The
sensor unit 150 may detect the color of text printed on the surface of a medicine packet and transmit the detected color to thecontroller 140. - In this case, the
controller 140 may control thelighting unit 130 to emit light having the same color as the detected color of the text. -
FIG. 9 is a block diagram illustrating the configuration of a medicine packet inspection apparatus in accordance with another embodiment of the present invention. - With reference to
FIG. 9 , a medicinepacket inspection apparatus 100" may include atransfer unit 110, a photographingunit 120, alighting unit 130, acontroller 140 and astorage unit 160. - The
transfer unit 110, the photographingunit 120, thelighting unit 130, and thecontroller 140 of the medicinepacket inspection apparatus 100" in accordance with this embodiment may execute the same functions as those described inFIG. 1 . - The
controller 140 may deduce pattern information of respective medicines by receiving and analyzing images of the medicines which a medicine packet may contain. - In this case, the pattern information of medicines may include the sizes, amounts, shapes, colors, symbol marks, weights and thicknesses of the medicines.
- The
controller 140 may store the deduced pattern information of the respective medicines in thestorage unit 160. - When the photographing
unit 120 acquires images by photographing the medicine packet, thecontroller 140 may judge whether or not medicines matching medicine prescription information are packed in the medicine packet by analyzing patterns of the acquired images and comparing the analyzed patterns with the pattern information of medicines stored in thestorage unit 160. - A barcode containing medicine prescription information may be printed on the medicine packet, and a barcode recognition unit (not shown) of the medicine
packet inspection apparatus 100" may scan the barcode to detect the medicine prescription information. In this case, thecontroller 140 may store the detected medicine prescription information in thestorage unit 160. Further, thecontroller 140 may judge whether or not medicines matching medicine prescription information are packed in the medicine packet by comparing medicines detected from a plurality of acquired images with the medicine prescription information stored in thestorage unit 160. - Further, if medicine prescription information is input by a user, the medicine prescription information may be stored in the
storage unit 160. -
FIG. 10 is a block diagram illustrating the configuration of a medicine packet inspection apparatus in accordance with yet another embodiment of the present invention. - With reference to
FIG. 10 , a medicinepacket inspection apparatus 100"' may include atransfer unit 110, a photographingunit 120, alighting unit 130, acontroller 140 and auser interface 170. - The
transfer unit 110, the photographingunit 120, thelighting unit 130, and thecontroller 140 of the medicinepacket inspection apparatus 100"' in accordance with this embodiment may execute the same functions as those described inFIG. 1 . - The
controller 140, if medicines detected from a plurality of images do not coincide with medicine prescription information, may inform the user of non-coincidence through theuser interface 170. - Further, the
user interface 170 may receive medicine prescription information from the user or receive information regarding the color of text printed on a medicine packet. - Further, the
user interface 170 may provide information regarding the operating state of the medicinepacket inspection apparatus 100"' to the user, and receive a user command to control operation of the medicinepacket inspection apparatus 100"'. -
FIG. 11 is a flowchart illustrating a medicine packet inspection method in accordance with one embodiment of the present invention. - With reference to
FIG. 11 , medicine packets in which medicines are packed are transferred (Operation S1110). More specifically, in order to inspect the medicine packets in which medicines are packed, a medicine packet bundle in which the medicine packets are continuously connected may be transferred. - Thereafter, lights of different colors are sequentially provided to a medicine packet (Operation S1120). For example, lights of different colors may be sequentially provided to the medicine packet in a manner in which first light is provided, second light of a different color from the color of the first light is provided after provision of the first light, and third light of a different color from the colors of the first and second lights is provided after provision of the second light.
- Thereafter, the medicine packet is photographed plural times corresponding to the lights of different colors (Operation S1130). More specifically, when a plurality of lights of different colors is sequentially provided to the medicine packet, the medicine packet may be photographed plural times corresponding to the lights of different colors.
- Although all elements constituting the embodiments of the present invention are combined into one assembly, or are combined into one assembly and operated as the assembly, the disclosure of the present invention is not limited thereto. That is, one or more of all elements may be selected, combined into one assembly and operated as the assembly within the scope of the invention. Further, all elements may be respectively implemented as independent hardware, or some or all of the elements may be selectively combined and implemented by a computer program having a program module to execute the functions of the combined elements in one or plural hardware.
- Codes and code segments constituting the computer program may be easily deduced by those skilled in the art of the present invention. Such a computer program may be stored in non-transitory computer readable media and read and executed by computers, thereby implementing the embodiments of the present invention.
- Here, non-transitory computer readable media do not mean media which store data for a short period of time, such as a register, a cache, a memory, etc., but mean media which semipermanently store data and are readable by apparatuses. More specifically, the above-described programs may be stored in non-transitory computer readable media, such as a CD, a DVD, a hard disk, a Blu-ray disc, a USB, a memory card, a ROM, etc.
- As apparent from the above description, a medicine packet inspection apparatus in accordance with one embodiment of the present invention sequentially provides lights of different colors to a medicine packet so as to photograph the medicine packet and may thus accurately recognize medicines in the medicine packet.
- Although the preferred embodiments of the present invention have been disclosed for illustrative purposes, those skilled in the art will appreciate that various modifications, additions and substitutions are possible, without departing from the scope of the invention as disclosed in the accompanying claims.
Claims (14)
- A medicine packet inspection apparatus (100) comprising:a transfer unit (110) configured to transfer medicine packets containing medicines;a photographing (120) unit configured to photograph each medicine packet;a lighting unit (130) configured to provide light to the medicine packet (10); anda controller (140) configured to control the lighting unit (130) to sequentially provide lights of different colors to the medicine packet (10) and to control the photographing unit (120) to photograph the medicine packet (10) plural times corresponding to the lights of different colors,wherein the controller (140) configured to judge whether or not medicines matching medicine prescription information are packed in the medicine packet (10) using a plurality of images acquired by photographing the medicine packet (10) under the lights of different colors,characterized in thatthe controller is configured so that if medicines matching the medicine prescription information are not packed in the medicine packet, an additional inspection is executed, wherein:it controls the lighting unit (130) to provide light of a further different color different from the colors of the lights of different colors; andit controls the photographing unit (120) to additionally photograph the medicine packet corresponding to the light of the further different color.
- The medicine packet inspection apparatus (100) according to claim 1, wherein the lighting unit (130) includes a first light emitting element to emit light of a first color and a second light emitting element to emit light of a second color.
- The medicine packet inspection apparatus (100) according to claim 1, wherein the controller (140) controls the lighting unit (130) to sequentially provide first light having the same color as the color of text printed on the surface of the medicine packet and at least one second light of a color different from the color of the first light.
- The medicine packet inspection apparatus (100) according to claim 3, wherein the first light has a color being the same as or complementary to the color of a medicine in the medicine packet.
- The medicine packet inspection apparatus (100) according to claim 1, wherein the controller (140) judges whether or not medicines matching the medicine prescription information are packed in the medicine packet by detecting medicines from the respective images and combining the detected medicines.
- The medicine packet inspection apparatus (100) according to claim 1, wherein the controller (140) judges whether or not medicines matching the medicine prescription information are packed in the medicine packet by combining the images and detecting medicines from an image acquired by combining the images.
- The medicine packet inspection apparatus (100) according to claim 1, wherein the lighting unit (130) is disposed opposite the photographing unit (120) to provide light to the rear surface of the medicine packet.
- The medicine packet inspection apparatus (100) according to claim 1, further comprising a subsidiary lighting unit (130) configured to provide light to the medicine packet.
- The medicine packet inspection apparatus 8100) according to claim 8, wherein the subsidiary lighting unit (130) has a ring shape.
- The medicine packet inspection apparatus (100) according to claim 8, further comprising a polarizing filter disposed between the medicine packet and at least one of the lighting unit (130) and the subsidiary lighting unit (130) .
- A medicine packet inspection method comprising:transferring medicine packets containing medicines (S1110);sequentially providing lights of different colors to each medicine packet (S1120); andphotographing the medicine packet plural times corresponding to the lights of different colors (S1130),wherein the method further comprising judging whether or not medicines matching medicine prescription information are packed in the medicine packet using a plurality of images acquired by photographing the medicine packet under the lights of different colors.characterized in thatif medicines matching the medicine prescription information are not packed in the medicine packet, executing an additional inspection, including:providing light of a further different color different from the colors of the lights of different colors; andadditionally photographing the medicine packet corresponding to the light of the further different color.
- The medicine packet inspection method according to claim 11, wherein, in sequential provision of the lights of different colors (S1120), first light having the same color as the color of text printed on the surface of the medicine packet and at least one second light of a color different from the color of the first light are sequentially emitted.
- The medicine packet inspection method according to claim 11, wherein, in judgment, whether or not medicines matching the medicine prescription information are packed in the medicine packet is judged by detecting medicines from the respective images and combining the detected medicines.
- The medicine packet inspection method according to claim 12, wherein, in judgment, whether or not medicines matching the medicine prescription information are packed in the medicine packet is judged by combining the images and detecting medicines from an image acquired by combining the images.
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020150091488A KR102322987B1 (en) | 2015-06-26 | 2015-06-26 | Medicine packets inspection apparatus and method for inspecting medicine packets |
Publications (3)
Publication Number | Publication Date |
---|---|
EP3109623A2 EP3109623A2 (en) | 2016-12-28 |
EP3109623A3 EP3109623A3 (en) | 2017-01-04 |
EP3109623B1 true EP3109623B1 (en) | 2021-08-04 |
Family
ID=56263559
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP16176217.4A Active EP3109623B1 (en) | 2015-06-26 | 2016-06-24 | Medicine packet inspection apparatus and method |
Country Status (6)
Country | Link |
---|---|
US (1) | US9978136B2 (en) |
EP (1) | EP3109623B1 (en) |
KR (1) | KR102322987B1 (en) |
CN (1) | CN106290383B (en) |
CA (1) | CA2933888A1 (en) |
ES (1) | ES2886893T3 (en) |
Families Citing this family (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR101971319B1 (en) | 2016-05-26 | 2019-04-24 | (주)제이브이엠 | Control apparatus |
WO2018022546A1 (en) * | 2016-07-29 | 2018-02-01 | Regeneron Pharmaceuticals, Inc. | Assembly line with integrated electronic visual inspection |
JP6974595B2 (en) * | 2018-04-03 | 2021-12-01 | 富士フイルム富山化学株式会社 | Drug determination device and drug determination method |
WO2019193912A1 (en) * | 2018-04-03 | 2019-10-10 | 富士フイルム富山化学株式会社 | Drug determination device and drug determination method |
CN110827933A (en) * | 2018-08-14 | 2020-02-21 | 陈玉沛 | Tablet taking assisting method realized by mobile device |
KR102166287B1 (en) * | 2018-11-27 | 2020-10-15 | 신종걸 | Apparatus for Checking Packaging Equipment Automation Machine |
EP3922232B1 (en) * | 2019-02-08 | 2022-11-23 | FUJIFILM Toyama Chemical Co., Ltd. | Medicine identification system, medicine identification device, medicine identification method, and program |
KR102283985B1 (en) * | 2020-03-25 | 2021-07-29 | 신용관 | Method of Inspecting colar Drugs |
CN112357265A (en) * | 2020-11-30 | 2021-02-12 | 红云红河烟草(集团)有限责任公司 | Rubber tube detection device and rubber liquid level control method |
KR20220167613A (en) * | 2021-06-14 | 2022-12-21 | (주)제이브이엠 | Medicine package inspection system |
US12036185B2 (en) * | 2021-07-19 | 2024-07-16 | Optum, Inc. | System and method to count pills |
CN113610851B (en) * | 2021-10-09 | 2021-12-31 | 武汉平桥兄弟包装材料有限公司 | Packaging decoration quality inspection method and system based on machine vision |
Family Cites Families (16)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE4331772C2 (en) * | 1993-09-18 | 1997-09-04 | Laetus Am Sandberg Geraetebau | Device for color detection of objects lying in blister films |
NL1025161C1 (en) * | 2003-08-19 | 2005-07-04 | Global Factories B V | Drug inspection method in large pharmacy, involves grouping number of packs each including several drugs, to form string in association with patient data, and storing scanned image of packs and patient data in memory |
KR100650285B1 (en) * | 2005-05-25 | 2006-11-27 | (주)제이브이엠 | System for inspecting medicine packets |
NL1032492C2 (en) * | 2006-09-14 | 2008-03-17 | Dijkstra Vereenigde Bedrijven | Inspection device. |
US8284305B2 (en) * | 2008-11-26 | 2012-10-09 | Parata Systems, Llc | System and method for acquiring images |
EP2206653A1 (en) * | 2008-12-09 | 2010-07-14 | Uhlmann Pac-Systeme GmbH & Co. KG | Device for checking the filling of cups in a packaging unit |
DE102010030883B4 (en) * | 2009-07-03 | 2018-11-08 | Koh Young Technology Inc. | Apparatus for testing a plate and method therefor |
JP5747150B2 (en) * | 2010-10-05 | 2015-07-08 | パナソニックIpマネジメント株式会社 | Tablet inspection device and tablet inspection method |
WO2012081261A1 (en) * | 2010-12-17 | 2012-06-21 | パナソニック株式会社 | Tablet-inspecting device |
KR20120124234A (en) * | 2011-05-03 | 2012-11-13 | (주)제이브이엠 | Automatic reinspection system and the method of prescription drugs |
US20130188038A1 (en) * | 2011-07-13 | 2013-07-25 | Takanobu Tanimoto | Tablet inspection device and tablet inspection method |
PT2951563T (en) * | 2013-02-04 | 2020-02-28 | Ziuz Holding B V | Method and apparatus for inspecting packages containing medication |
EP2959881A4 (en) * | 2013-02-20 | 2017-03-15 | Yuyama Mfg. Co., Ltd. | Medicine inspection device and system for individually packaging medicine |
US9626752B2 (en) * | 2013-05-22 | 2017-04-18 | Delta Design, Inc. | Method and apparatus for IC 3D lead inspection having color shadowing |
JP6100136B2 (en) * | 2013-09-30 | 2017-03-22 | 富士フイルム株式会社 | Drug recognition apparatus and method |
WO2015152225A1 (en) * | 2014-03-31 | 2015-10-08 | 株式会社湯山製作所 | Medicine photographing device |
-
2015
- 2015-06-26 KR KR1020150091488A patent/KR102322987B1/en active IP Right Grant
-
2016
- 2016-06-22 US US15/189,784 patent/US9978136B2/en active Active
- 2016-06-23 CA CA2933888A patent/CA2933888A1/en active Pending
- 2016-06-24 CN CN201610476220.0A patent/CN106290383B/en not_active Expired - Fee Related
- 2016-06-24 ES ES16176217T patent/ES2886893T3/en active Active
- 2016-06-24 EP EP16176217.4A patent/EP3109623B1/en active Active
Non-Patent Citations (1)
Title |
---|
None * |
Also Published As
Publication number | Publication date |
---|---|
KR20170001467A (en) | 2017-01-04 |
CA2933888A1 (en) | 2016-12-26 |
ES2886893T3 (en) | 2021-12-21 |
US20160379361A1 (en) | 2016-12-29 |
US9978136B2 (en) | 2018-05-22 |
EP3109623A2 (en) | 2016-12-28 |
EP3109623A3 (en) | 2017-01-04 |
KR102322987B1 (en) | 2021-11-09 |
CN106290383A (en) | 2017-01-04 |
CN106290383B (en) | 2019-11-01 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP3109623B1 (en) | Medicine packet inspection apparatus and method | |
US10565545B2 (en) | Drug inspection support apparatus and method | |
JP5888611B2 (en) | Drug inspection device and drug packaging device | |
JP6009888B2 (en) | Drug inspection apparatus and method | |
US20170305589A1 (en) | Inspection assistance system and tablet packaging device | |
JP2019034180A (en) | Medicine inspection device | |
US9218459B2 (en) | Integrated drug management system and method of providing prescription drugs by using the same | |
CN111031995A (en) | Medicine inspection support device, image processing method, and program | |
JP2014221134A (en) | Packaged single-dose-medicament auditing device | |
US10762614B2 (en) | Inspection apparatus, inspection method and computer program product | |
KR102214873B1 (en) | Portable automatic sign inspection system and inspection method using the same | |
JP2022027539A (en) | Type determination device and medicament sorting device | |
JP7375049B2 (en) | Image processing device and method | |
JP6454249B2 (en) | Drug inspection apparatus and method |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE APPLICATION HAS BEEN PUBLISHED |
|
PUAL | Search report despatched |
Free format text: ORIGINAL CODE: 0009013 |
|
AK | Designated contracting states |
Kind code of ref document: A2 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
AX | Request for extension of the european patent |
Extension state: BA ME |
|
AK | Designated contracting states |
Kind code of ref document: A3 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
AX | Request for extension of the european patent |
Extension state: BA ME |
|
RIC1 | Information provided on ipc code assigned before grant |
Ipc: B65B 5/10 20060101ALI20161128BHEP Ipc: B65B 57/10 20060101ALI20161128BHEP Ipc: G01N 21/95 20060101AFI20161128BHEP |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
17P | Request for examination filed |
Effective date: 20170704 |
|
RBV | Designated contracting states (corrected) |
Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
17Q | First examination report despatched |
Effective date: 20180524 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: GRANT OF PATENT IS INTENDED |
|
INTG | Intention to grant announced |
Effective date: 20210203 |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE PATENT HAS BEEN GRANTED |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: REF Ref document number: 1417468 Country of ref document: AT Kind code of ref document: T Effective date: 20210815 |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 602016061493 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: FP Ref country code: IE Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG9D |
|
REG | Reference to a national code |
Ref country code: ES Ref legal event code: FG2A Ref document number: 2886893 Country of ref document: ES Kind code of ref document: T3 Effective date: 20211221 |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: MK05 Ref document number: 1417468 Country of ref document: AT Kind code of ref document: T Effective date: 20210804 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: HR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210804 Ref country code: RS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210804 Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210804 Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210804 Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20211206 Ref country code: NO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20211104 Ref country code: AT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210804 Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20211104 Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210804 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210804 Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210804 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20211105 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210804 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 602016061493 Country of ref document: DE |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SM Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210804 Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210804 Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210804 Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210804 Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210804 Ref country code: AL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210804 |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
26N | No opposition filed |
Effective date: 20220506 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210804 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: NL Payment date: 20220621 Year of fee payment: 7 Ref country code: GB Payment date: 20220623 Year of fee payment: 7 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210804 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: FR Payment date: 20220622 Year of fee payment: 7 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: ES Payment date: 20220719 Year of fee payment: 7 Ref country code: DE Payment date: 20220701 Year of fee payment: 7 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210804 |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
REG | Reference to a national code |
Ref country code: BE Ref legal event code: MM Effective date: 20220630 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20220624 Ref country code: LI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20220630 Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20220624 Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20220630 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20220630 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R119 Ref document number: 602016061493 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: MM Effective date: 20230701 |
|
GBPC | Gb: european patent ceased through non-payment of renewal fee |
Effective date: 20230624 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: NL Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20230701 Ref country code: HU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO Effective date: 20160624 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210804 Ref country code: DE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20240103 Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210804 Ref country code: GB Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20230624 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: FR Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20230630 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: TR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210804 |
|
REG | Reference to a national code |
Ref country code: ES Ref legal event code: FD2A Effective date: 20240802 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210804 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: ES Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20230625 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: ES Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20230625 |