KR101971695B1 - Medication monitoring apparatus and method - Google Patents

Abstract

SUMMARY OF THE INVENTION An object of the present invention is to provide a device and method for monitoring medicines, which can photograph a patient's pre-medication and post-medication actions using a camera, and confirm medication of the patient using the photographed information. To this end, the medication monitoring device according to the present invention comprises a camera for photographing the palm of a patient, photographing a mouth of the patient, or photographing a moving picture of the patient; A control unit for determining whether the patient is using the image transmitted from the camera; And an output unit for outputting information related to the medication of the patient under the control of the control unit.

Description

[0001] MEDICATION MONITORING APPARATUS AND METHOD [0002]

The present invention relates to an apparatus and a method for monitoring a medicament that can confirm whether or not a patient is medicated.

Management is needed to determine whether a chronic ill person needing long-term medication has taken medication at a given time. In this regard, Directly Observed Treatment (DOT) is the most important treatment and the most obvious method.

According to the existing studies, the main causes of overdose, misuse, and misuse of medication are that the patient can not remember the medication time, method, recovery, and precautions. In particular, , And it may be a more serious problem for elderly people or long-term medication patients.

Accordingly, the World Health Organization (WHO) recommends DOT. In the advanced countries such as the US and Japan, the implementation of DOT has dramatically reduced the size of some diseases and improved the cure rate.

However, in order for DOT to be performed properly, it is necessary to systematically manage relevant experts. Therefore, DOT is difficult due to human and economic limitations.

In fact, medical institutions in Korea are limited in the confirmation and guidance of medicines, and they are only at the level of notifying and encouraging medication time and scheduled dates.

Recently, in the field of medical care and healthcare, a smart medication monitoring device and a medication management service based on a medication schedule using a digital medicament combining IT technology are being performed. In addition, various medication assistive devices have been developed and released at home and abroad to help the patient's medication.

As an example, when the medication time is reached, a method of informing the patient of the medication time by sound and light from the lid of the vial is being developed. In this case, the patient's medication is confirmed by whether the lid of the vial is opened or closed, and this can be stored as data. If the lid of the vial does not open after the notification, a function of notifying the patient of the medication by calling the patient through the network of the manufacturer is being developed.

As another example, an automatic discharge-type medication assist device in the form of a cartridge is also being developed. This performs only a simple drug discharge function in which the storage and discharge of the medicine is controlled without any additional action of the patient.

The above-described conventional medication-assistive devices can perform a function of notifying the user of the medication time, but can not accurately grasp whether or not the patient actually took the medication.

SUMMARY OF THE INVENTION An object of the present invention is to provide a device and method for monitoring medicines, which can photograph a patient's pre-medication and post-medication actions using a camera, and confirm medication of the patient using the photographed information.

In order to accomplish the above object, the present invention provides a medication monitoring device comprising: a camera for photographing the palm of a patient, photographing a mouth of a patient, or photographing a moving image of the patient; And an output unit for outputting information related to the medication of the patient under the control of the control unit.

According to the embodiment of the present invention, whether or not the patient has taken the medicine can be judged in real time, and when it is judged that the patient has not taken the medicine, it can be recommended to take the medicine to the patient, Can be substantially managed.

Further, according to the embodiment of the present invention, a camera can be connected to a conventional medication monitoring apparatus already provided, and a program for executing the method according to the present invention can be installed in the medication monitoring apparatus . Therefore, the present invention can reduce the cost burden on patients.

In addition, since the medication monitoring apparatus according to the embodiment of the present invention grasps some of the operations before and after the medication and confirms the medication of the patient, it can judge whether the patient actually took the medication or not .

BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1 is an exemplary view showing a configuration of a medication monitoring apparatus according to the present invention. FIG.
2 is a flow chart of an embodiment showing a method for monitoring medication according to the present invention.
3 is an exemplary view showing palm images taken by the medication monitoring device according to the present invention.
4 is an exemplary view showing an image of a mouth taken by the medication monitoring apparatus according to the present invention;

BRIEF DESCRIPTION OF THE DRAWINGS The advantages and features of the present invention and the manner of achieving them will become apparent with reference to the embodiments described in detail below with reference to the accompanying drawings. The present invention may, however, be embodied in many different forms and should not be construed as being limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art. And is provided to fully convey the scope of the invention to those skilled in the art, and the present invention is defined by the claims. It is to be understood that the terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. In the present specification, the singular form includes plural forms unless otherwise specified in the specification. It is noted that " comprises, " or " comprising, " as used herein, means the presence or absence of one or more other components, steps, operations, and / Do not exclude the addition.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. In the drawings, the same reference numerals are given to the same or similar components, and in the following description of the present invention, Detailed explanations of the detailed description will be omitted when the gist of the present invention can be obscured.

1 is a view illustrating the configuration of a medication monitoring apparatus according to the present invention.

The present invention relates to a device and a method for monitoring a medicament, which can determine the medication of a patient by photographing the medicinal course of the patient with a camera.

1, the drug monitoring apparatus 100 according to the present invention includes a camera 110 for photographing a patient, a control unit 120 for determining whether the patient is using the image transmitted from the camera 110, A storage unit 130 for storing information on medicines taken by the patient, an input unit 140 for receiving various kinds of information, and an output unit 150 for outputting information related to medicines of the patient under the control of the control unit 120. [ .

Meanwhile, the drug monitoring apparatus 100 according to the present invention is configured in the form of a box that opens and closes the lid of the upper part, so that medicines taken by a patient in a box can be stored. In a patient's home where medication management is required, And can be used in place.

The camera 110 may be a camera that is currently in common use. Alternatively, the camera 110 may be a camera in the form of a webcam connected to a USB such as a computer. For example, the camera 110 may be a camera module that can be used by being plugged directly into the main board of the drug monitoring device 100. [

Preferably, the camera 110 may be embodied in the palm of a patient, a mouth, or a location capable of imaging the motion of the patient.

The control unit 120 analyzes an image photographed through the camera 110, for example, a palm image of the patient, a mouth image of the patient, or a moving image including a motion of the patient, and determines whether or not the patient has taken the medicine .

At this time, the medication-monitoring device 100 may further include a weight sensor (not shown) capable of measuring the weight, and the control unit 120 may use the weight sensor to measure the weight of the medicine box, It can be further determined whether or not it has been reduced by the weight of the medicine to be administered. If the weight of the medicine box measured by the weight sensor is reduced, the control unit 120 may store in the storage unit 130 information that the patient has taken medicine out of the medicine box.

The storage unit 130 is a storage unit for storing data, and may be a non-volatile memory. The storage unit 130 may store the type and number of medicines taken by the patient, the time taken for taking the medicines, and the like.

The input unit 140 acquires information input by an administrator (for example, a hospital official such as a doctor or a pharmacist who prescribes medicine to the patient) that manages the medication of the patient or the patient. For example, the input unit 140 may receive the type of medicine, the number, the time for taking the medicine, and the like through the input operation of the patient or the manager.

The input unit 140 may acquire the input information through a physical button such as a button at a predetermined position of the medication monitoring apparatus 100. Alternatively, the input unit 140 may acquire input information through an operation of selecting an icon displayed on the touch screen implemented at a predetermined position of the medication monitoring apparatus 100. [ Alternatively, the input unit 140 may receive input information input from a terminal of a manager that manages the patient's medication administration through a separate wireless communication module.

The output unit 150 may include a speaker, a display, a lamp, and the like mounted at a predetermined position of the drug monitoring apparatus 100. The output unit 150 may transmit various messages to the user through voice, text, or light according to the control of the control unit 120. [

2 is a flowchart illustrating an example of a method for monitoring a medication according to an embodiment of the present invention.

Hereinafter, unless otherwise noted, it is assumed to be operated by the control unit 120 of the medication monitoring apparatus 100.

First, the patient or the administrator can input information on the type and number of medicines to be taken by the patient through the input unit 140. The control unit 120 stores the information input through the input unit 140 into the storage unit 130 (S202). The information about the medicine (the kind and number of medicines) may be input in advance through the input unit 140 by the administrator of the patient and stored in the storage unit 130.

In addition, the patient or the administrator can input information on the time for which the patient should take the medicine through the input unit 140, and the information on the time is stored in the storage unit 130. [

Next, the control unit 120 may output a message to the patient via the output unit 150 that the medicine, such as voice, text, or the like, should be taken when the time for taking the medicine stored in the storage unit 130 comes. For example, the control unit 120 can invite the patient to take the medicine by voice through the speaker. The control unit 120 can inform the patient that it is time to take medicine through a character, an image or an image through the display. Alternatively, the control unit 120 can inform the patient that the time to take the medicine by blinking the lamps of various colors.

When the patient is informed of the time to take the medicine, the patient recognizes that it is time to take the medicine, opens the lid of the medication monitoring apparatus according to the present invention, and takes out the medicine placed inside the medication monitoring apparatus.

At this time, the control unit 120 may provide information on a method and a procedure of the patient taking the medicine through the speaker or the display that constitutes the output unit 150. Accordingly, the patient can take the medicine by referring to the guide provided through the output unit 150.

Then, the control unit 120 drives the camera 110 to capture the palm or mouth of the patient or to capture the motion of the patient as a moving picture (S204).

In addition, the control unit 120 determines whether the patient has taken the medicine using the information photographed by the camera 110 (S206).

Here, the process of photographing the patient (S204) and the process of determining whether the patient has taken the medicine using the photographed information (S206) may be variously changed. Therefore, the processes S204 and S206 will be described in detail with reference to FIGS. 3 and 4. FIG.

If it is determined in step S206 that the patient has taken the medicine, the control unit 120 stores the patient's dose information (S208). At this time, the patient's dose information may be stored in the storage unit 130.

If it is determined in step S206 that the patient has not taken the medicine, the control unit 120 may output a message to the patient through the output unit 150 to recommend taking the medicine to the patient (S210).

In addition, the control unit 120 may store the medication information that the patient has not taken or took the medicine in the storage unit 130. If the control unit 120 can communicate through the network, And transmits the medication information to a terminal used by a manager who manages the patient's medication. At this time, the transmission of the medication information through the network can be performed every predetermined period. Alternatively, the transmission of the medication information through the network can be performed each time medication is performed.

Hereinafter, a process (S204) of photographing a patient (S204) and a process (S206) of determining whether a patient has taken a drug using the photographed information will be described in detail with reference to FIGS. 3 and 4.

3 is an exemplary view showing images of the palm taken by the medication monitoring apparatus according to the present invention. Particularly, FIG. 3 (a) is an illustration showing an image of a palm taken before medication, and FIG. 3 (b) is an illustration showing an image of a palm with a medicament disappearing after medication. 4 is an exemplary view showing an image of a mouth taken by the medication monitoring apparatus according to the present invention.

The control unit 120 may use the palm image of the patient, the mouth image of the patient, or the video of the patient's medication process in the process of determining the patient's medication.

First, a process of determining whether a patient is medically using a palm image of a patient according to an embodiment of the present invention will be described.

First, when the patient removes the medicine from the medication monitoring device and places the medicine on the hand, the camera 110 photographs the palm of the patient on which the medicine is placed, as shown in FIG. 3 (a).

At this time, before the patient performs the above-described operation, the control unit 120 can instruct the patient through the output unit 150 to perform an operation for soliciting medicine as described above.

According to the above instruction, the patient puts the medicine on the palm of the hand, and then places the palm of the medicine placed in front of the camera 110.

At this time, the control unit 120 may output the guidance message through the output unit 150 so that the patient places the palm where the medicine is placed in front of the camera 110. After the guidance message is output, , 30 seconds) has elapsed, the camera 110 can be automatically driven to acquire the photographing information.

When the patient selects the photographing button included in the input unit 140 after outputting the guidance message, the control unit 120 may drive the camera 110 to acquire photographing information.

3 (a) and 3 (b), the control unit 120 displays the area of interest (the palm area of the patient) to be displayed on the camera 110 as a display As shown in FIG. Accordingly, the patient can change the position of the medicine and the position of the palm so that the medicine can be contained in the area output through the display.

Meanwhile, the medication monitoring apparatus 100 according to the embodiment of the present invention may be equipped with a sensor (not shown) capable of recognizing the palm of the user. In this case, the controller 120 can check whether the palm of the patient is positioned in front of the camera 110 through the sensor.

When the controller 120 determines that the palm of the patient is positioned in front of the camera 110 through the sensor, the controller 120 drives the camera 110 to generate an image as shown in FIG. 3 (a).

When the camera 110 is driven to generate photographing information, the control unit 120 analyzes the photographed image and determines whether the medicine is placed on the palm of the patient (S206).

For example, if the control unit 120 determines that at least one tablet is present in the photographed palm image, the controller 120 determines that the patient holds the medicine to take the medicine.

After the medicine taking operation of the patient is performed as described above, the control unit 120 photographs the palm of the patient again through the method as described above. For example, after confirming that the medicine is placed on the palm of the patient, the controller 120 can confirm whether the palm of the patient is re-photographed through the camera 110 for a predetermined period of time.

The control unit 120 analyzes the re-photographed information and determines whether or not there is a grain on the palm.

As a result of the determination, if it is determined that there is no tablet on the palm of the patient, the controller 120 determines that the patient has taken the medicine and stores the related information in the storage unit 130 .

For example, the control unit 120 analyzes the palm image shown in FIG. 3 (a) and the palm image shown in FIG. 3 (b) Can be determined.

Meanwhile, the following processes may be further included in the processes performed in the embodiment of the present invention.

The control unit 120 compares the number and size of the tablets of the palm medicine taken by the camera 110 with the information stored in the storage unit 130 to determine whether the patient correctly selected the medicine to be taken Can be determined. As a remedy, the control unit 120 may additionally determine whether the medicine placed on the palm is correct and the number of the medicine to be taken by the patient when the medication is judged based on the information photographed in step S206 .

For this purpose, the storage unit 130 may store information on the number and size of the pills constituting the medicines taken by the patient. That is, in the storage unit 130, information about drugs to be taken by the patient is constructed in a database.

If it is determined that the patient has not correctly selected the medicine, the control unit 120 may output a message indicating that the medicine type and the number of the medicine are in error through the output unit 150.

Through the above-described additional judgment, the reliability of the drug monitoring apparatus can be improved.

Secondly, a process of determining whether a patient is medication using a mouth image of a patient according to another embodiment of the present invention will be described.

In this case, the camera 110 can photograph only the mouth where the medicine is placed before the patient takes the medicine, and can further photograph the mouth that has lost medicine after the patient takes the medicine.

In other words, when the patient puts the medicine into the mouth and lightly opens the mouth to illuminate the camera 110 with the medicine placed on the tongue, the control unit 120 controls the patient's mouth Acquires an image, and judges whether or not there is medicine in the mouth of the patient by using the acquired mouth image information.

The principle of determining a patient's medication using a mouth image according to another embodiment of the present invention is similar to the principle of determining medication using a palm image of a patient according to an embodiment of the present invention. However, if the patient's medication is judged using the mouth image according to another embodiment of the present invention, since the medication is confirmed to be in the mouth, the patient takes the medication unless the patient spits the medication on purpose Can certainly be confirmed.

Therefore, it is not necessary for the patient to open the mouth again after taking the medicine to identify the empty tongue, thereby making it easier to confirm the medication confirmation procedure, to determine whether the medication is more efficiently judged, Can be increased.

In addition, the type and number of medicines may be further judged in the process of judging medication by using the palm image of the patient, when the patient's medullar image is used.

Third, a process of determining whether a patient is medicinal by using a photographed moving image photographed by a patient in accordance with another embodiment of the present invention will be described.

In this case, the camera 110 can photograph the process from when the patient takes the medicine from the medicine box to when it takes medication.

The control unit 120 may track the patient's face, mouth, or hand area in the moving image to recognize the operation of covering the mouth with the medication as a medication to determine whether the medication is used. This determination can be performed by applying motion recognition and tracking techniques.

Alternatively, the control unit 120 can determine whether the patient is taking medication by checking the action of the patient taking the medicine from the medicine box, the action of putting the medicine into the mouth by the patient, the action of the patient swallowing the medicine in the mouth, .

As described above, the method of confirming the medication based on the motion picture information can determine the medication by using the most information.

The process of determining the medication using the moving image should be performed in front of the camera 110 and the medication of the patient should be displayed on the display unit 150 of the output unit 150. Therefore, there may be inconvenience to the patient. In addition, since the motion recognition and tracking algorithm requires high-performance hardware, it is possible to selectively determine whether to use the motion picture according to the performance of the medication monitoring device.

That is, the medication monitoring method as described above can be selectively applied according to the hardware capabilities of the medication monitoring apparatus to be applied.

As described above, according to the embodiment of the present invention, it can be determined in real time whether the patient has taken the medicine or not, and when it is determined that the patient has not taken the medicine, Medication can be managed substantially.

Further, according to the embodiment of the present invention, a camera can be connected to a conventional medication monitoring apparatus already provided, and a program for executing the method according to the present invention can be installed in the medication monitoring apparatus . Therefore, the present invention can reduce the cost burden on patients.

In addition, since the medication monitoring apparatus according to the embodiment of the present invention grasps some of the operations before and after the medication and confirms the medication of the patient, it can judge whether the patient actually took the medication or not .

While the present invention has been described in connection with what is presently considered to be practical exemplary embodiments, it is to be understood that the invention is not limited to the disclosed embodiments, but, on the contrary, It is to be understood that the invention may be embodied in other specific forms. It is therefore to be understood that the above-described embodiments are illustrative in all aspects and not restrictive. The scope of the present invention is defined by the appended claims rather than the detailed description, and all changes or modifications derived from the scope of the claims and their equivalents should be construed as being included within the scope of the present invention.

Claims (10)

delete A camera for photographing at least one of a palm and a mouth of the patient, or a moving picture of the patient's medication action; And
And a control unit for determining whether the patient is medicated by using the image photographed by the camera,
Wherein the control unit compares an image obtained by primarily photographing the palm of the patient with the camera and an image obtained by photographing the palm of the patient after a predetermined period of time, , And if it is judged that the drug is not placed on the palm of the patient in the secondarily captured image, it is determined that the patient has taken the drug
Medication monitoring device. 3. The method of claim 2,
The control unit compares the number and size of medicines in the palm taken primarily with the number and size of medicines to be taken, and judges whether the medicines are correctly selected. If it is judged that the medicines have not been selected correctly, Print a message that there is an error
Medication monitoring device. A camera for photographing at least one of a palm and a mouth of the patient, or a moving picture of the patient's medication action; And
And a control unit for determining whether the patient is medicated by using the image photographed by the camera,
The control unit captures the process from the time the patient takes the medicine to the time it takes the medication, records the motion of the patient's face, the mouth or the hand area in the moving picture,
Medication monitoring device. delete Inputting information related to a medicament to be taken by a patient;
Informing the patient that the medication should be taken as the medication time comes;
When the predetermined time has elapsed since the time of taking the dose, or when the user requests it, the camera is driven to photograph the palm or mouth of the patient, the motion of the patient is photographed, The method comprising the steps of: And
The method comprising the steps of: storing a patient's dose information when it is determined that the patient has taken the medicament; and recommending the patient to take the medicament if it is determined that the patient has not taken the medicament,
Wherein the step of determining whether the patient is taking the medicine comprises:
The image of the patient's palm was firstly photographed using a camera and the image of the patient's palm was photographed secondarily after a predetermined time had elapsed. In the primary image, the medicine was placed on the palm of the patient In the second image taken, it is judged that the medicine is not placed on the palm of the patient,
How to monitor medication. delete Inputting information related to a medicament to be taken by a patient;
Informing the patient that the medication should be taken as the medication time comes;
When the predetermined time has elapsed since the time of taking the dose, or when the user requests it, the camera is driven to photograph the palm or mouth of the patient, the motion of the patient is photographed, The method comprising the steps of: And
The method comprising the steps of: storing a patient's dose information when it is determined that the patient has taken the medicament; and recommending the patient to take the medicament if it is determined that the patient has not taken the medicament,
The step of determining whether or not the patient is taking the medicament comprises the steps of: capturing the process from the time the patient takes the medicine to the time the medicament is taken, and tracking the patient's face, mouth or hand area in the video, A step of recognizing the operation as a medicament and judging whether the medicament is medicinal or not
How to monitor medication. Inputting information related to a medicament to be taken by a patient;
Informing the patient that the medication should be taken as the medication time comes;
When the predetermined time has elapsed since the time of taking the dose, or when the user requests it, the camera is driven to photograph the palm or mouth of the patient, the motion of the patient is photographed, The method comprising the steps of: And
The method comprising the steps of: storing a patient's dose information when it is determined that the patient has taken the medicament; and recommending the patient to take the medicament if it is determined that the patient has not taken the medicament,
The step of determining whether or not the patient is taking the medicine comprises the steps of capturing the process from the time the patient takes the medicine to the time the patient takes the medication and taking the medicine from the medicine box through the video, A step of inserting a medicine, and an operation of swallowing a medicine in the mouth to determine whether the patient is taking medication or not
How to monitor medication. 10. A method according to any one of claims 6, 8 and 9,
Wherein the step of determining whether the patient is taking the medicament comprises determining whether the patient has correctly selected a medicament to be taken when it is determined that the patient is taking the medicament
How to monitor medication.

Images