KR102150623B1 - Method and system for analyzing baby behavior - Google Patents

Abstract

The present invention relates to a baby behavior analysis system and method thereof, in particular, a method for analyzing baby behavior, in the method for analyzing baby behavior performed by a baby behavior analysis system for monitoring baby behavior, a) through at least one camera device Dividing the input baby detection image into a plurality of sections according to a threshold value set by a user; b) separating the baby body area and the background in each frame within each section and then detecting a motion area in the baby body area; c) setting an ellipse for each baby body part in which motion is detected for the detected motion area, and setting the size of the ellipse based on the size of the motion area; d) Provide a baby behavior management chart that displays the number or size of ellipses that change over time for each section, and a plurality of frames that are larger than a preset upper limit control limit value or smaller than a lower limit control limit value based on the baby behavior management chart Detecting an abnormal behavior section that is an included section; And e) if the abnormal behavior section is not detected, it is determined as a normal behavior section, and when the abnormal behavior section is detected, notifying the baby's abnormal behavior to a parental terminal.

Description

Baby behavior analysis system and its method {METHOD AND SYSTEM FOR ANALYZING BABY BEHAVIOR}

The present invention relates to a baby behavior analysis system and method for analyzing baby behavior from a baby detection image transmitted in real time.

Recently, the baby behavior monitoring system automatically monitors the baby while minimizing the effort of the guardian or caregiver so that the baby's behavior can be immediately informed to the guardian or caregiver.

Among the baby behavior monitoring systems, the sleeping device creates a baby's sleep time by reproducing the sound for a peaceful sleep while stabilizing the baby's mood, but it is composed of a special audio signal storage device, a processing device, an amplifying device and a vocal device. It is important that these sleeping devices output a special audio signal, that is, a sound to create an atmosphere similar to that of the mother (eg, sound in the womb) that increases the sleeping time while keeping the baby emotionally stable.

Among the baby behavior monitoring systems, the baby behavior kit includes at least one timeout defining device, a plurality of stickers, an educational device for a caregiver or babysitter, a plurality of stop signs, and tools such as balls. These baby behavior kits designate items that should not be contacted by the baby in the house or within the baby's activity area, and when the baby touches the item, the baby is immediately protected in the time-out area defined by the time-out definition device. At this time, the baby behavior kit may attach a prohibition sticker to a caregiver or an electric board for a baby sitter that is harmful to the baby.

Meanwhile, the infant monitoring device is capable of bi-directional communication between the baby and the guardian and can transmit audio and video streams, and the guardian-side device includes a receiving device, a microphone device, and a control device for receiving external voices, and The device is manufactured in the form of a necklace and includes a motion sensor, a flash memory storing parental voice data and images, a microphone, and a temperature sensing device. These infant monitoring devices enable communication through microphones worn by parents and infants, and when an infant is detected as a'bang' sound from a bed, it is transmitted to the control device as an emergency signal, and the control device is a microphone or camera. Use to record different sounds, take an image of the child's surroundings, and deliver it to the guardian.

Infant monitoring devices have a problem that may surprise or burden sensitive babies because many devices for observing babies are attached to the infant's body.

As such, the conventional baby behavior monitoring system checks the biological state of the baby, improves emotional stability or sleep time of the baby, and has a problem that may cause discomfort when worn on the body of the baby. In addition, the baby behavior monitoring system uses many devices and sensors to check the baby's status as well as play or record sound, so it processes different data, so the system efficiency is low. There is a problem that it is insufficient to monitor the behavior of a child.

In addition, when several electronic sensors are used among conventional baby behavior monitoring systems, there is a problem that harmful rays may be emitted to the baby, which may be dangerous to the baby's health.

Republic of Korea Patent Registration No. 10-1652977 (Name of invention: baby condition real-time monitoring system)

Republic of Korea Patent Registration No. 10-0791362 (Name of invention: baby sign recognition method, interactive multimedia video realization system and method using the same)

In order to solve the above-described problem, the present invention detects a baby's motion region using a baby detection image input in real time through a camera device according to an embodiment of the present invention, and detects a baby's motion region according to the intensity and size of the motion region. Its purpose is to be able to grasp the normal or abnormal behavior of a person.

However, the technical problem to be achieved by the present embodiment is not limited to the technical problem as described above, and other technical problems may exist.

As a technical means for achieving the above technical problem, a baby behavior analysis method according to an embodiment of the present invention includes a method for analyzing baby behavior performed by a baby behavior analysis system for monitoring baby behavior, a) at least one or more Dividing the baby detection image input through the camera device into a plurality of sections according to a threshold value set by a user; b) separating the baby body area and the background in each frame within each section and then detecting a motion area in the baby body area; c) setting an ellipse for each baby body part in which motion is detected for the detected motion area, and setting the size of the ellipse based on the size of the motion area; d) Provide a baby behavior management chart that displays the number or size of ellipses that change over time for each section, and a plurality of frames that are larger than a preset upper limit control limit value or smaller than a lower limit control limit value based on the baby behavior management chart Detecting an abnormal behavior section that is an included section; And e) if the abnormal behavior section is not detected, it is determined as a normal behavior section, and when the abnormal behavior section is detected, notifying the baby's abnormal behavior to a parental terminal.

In addition, a baby behavior analysis system according to another embodiment of the present invention is a baby behavior analysis system using at least one camera device, comprising: a memory in which a program for performing a real-time baby behavior analysis method for baby movement is recorded; And a processor for executing the program, wherein the processor divides the baby detection image inputted through the camera device into a plurality of sections according to a threshold value set by a user by execution of the program, After separating the baby body area and the background in each frame within each section, a movement area is detected in the baby body area, and an ellipse is set for each baby body area where motion is detected for the detected movement area, and the size of the movement area Set the size of the ellipse on the basis of, and provide a baby behavior management chart that displays the number or size of the ellipses that change over time for each section, and is greater than or lower than a preset upper limit control limit value based on the baby behavior management chart An abnormal behavior section, which is a section containing a plurality of frames smaller than the control threshold, is detected, and if the abnormal behavior section is not detected, it is determined as a normal behavior section, and if the abnormal behavior section is detected, the baby's abnormal behavior is reported to the parental terminal. To inform.

According to the above-described problem solving means of the present invention, the baby's motion is analyzed using video data transmitted in real time from a camera device fixedly installed on the baby's sleeping place or activity place without wearing a separate monitoring device to the baby. And predict your baby's normal or abnormal behavior.

In addition, the present invention can provide a fast, user-friendly and responsive process by immediately reporting the baby's abnormal behavior to a parental terminal when an abnormal behavior of a baby is detected.

1 is a diagram illustrating the configuration of a baby behavior analysis system according to an embodiment of the present invention.
FIG. 2 is a diagram illustrating a configuration of a program processed by a processor, which is a component of FIG. 1.
3 is a flowchart illustrating a method of analyzing baby behavior according to an embodiment of the present invention.
4 is a flowchart illustrating a motion region detection process using a motion detection algorithm according to an embodiment of the present invention.
5 is a diagram illustrating an entire framework of a motion detection algorithm according to an embodiment of the present invention.
6 is a diagram illustrating an overview of an analysis process of a method for analyzing baby behavior according to an embodiment of the present invention.
7 is an exemplary diagram illustrating a baby behavior management diagram in a single section.
8 is an exemplary diagram showing a baby behavior management chart for each section.
9 is an exemplary diagram representing a baby behavior management chart using a 3D graph.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those of ordinary skill in the art can easily implement the present invention. However, the present invention may be implemented in various different forms and is not limited to the embodiments described herein. In the drawings, parts irrelevant to the description are omitted in order to clearly describe the present invention, and similar reference numerals are assigned to similar parts throughout the specification.

Throughout the specification, when a part is said to be "connected" to another part, this includes not only "directly connected" but also "electrically connected" with another element interposed therebetween. . In addition, when a part "includes" a certain component, it means that other components may be further included, and one or more other features, not excluding other components, unless specifically stated to the contrary. It is to be understood that it does not preclude the presence or addition of any number, step, action, component, part, or combination thereof.

The following examples are detailed descriptions to aid understanding of the present invention, and do not limit the scope of the present invention. Accordingly, the invention of the same scope performing the same function as the present invention will also belong to the scope of the present invention.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a diagram illustrating the configuration of a baby behavior analysis system according to an embodiment of the present invention.

Referring to FIG. 1, a baby behavior analysis system 100 according to an embodiment of the present invention includes a communication module 110, a processor 120, a memory 130, and a database 140.

In detail, the communication module 110 provides a communication interface necessary to provide a signal transmitted and received between the baby behavior analysis system 100 and the parental terminal 300 in a data format in connection with a communication network. Furthermore, the communication module 110 may receive a data request from the parental terminal 300 and transmit data as a response thereto.

Here, the communication module 110 may be a device including hardware and software necessary for transmitting and receiving a signal such as a control signal or a data signal through a wired or wireless connection with another network device.

In the memory 130, a program for performing a real-time baby behavior analysis method for baby movement is recorded. In addition, the processor 120 performs a function of temporarily or permanently storing data processed by the processor 120. Here, the memory 130 may include a volatile storage medium or a non-volatile storage medium, but the scope of the present invention is not limited thereto.

The processor 120 controls the entire process of providing a method for analyzing baby behavior in real time. Each step performed by the processor 120 will be described later with reference to FIGS. 2 and 3.

Here, the processor 120 may include all types of devices capable of processing data, such as a processor. Here, the'processor' may refer to a data processing device embedded in hardware having a circuit physically structured to perform a function represented by a code or instruction included in a program. As an example of a data processing device built into the hardware as described above, a microprocessor, a central processing unit (CPU), a processor core, a multiprocessor, and an application-specific integrated (ASIC) circuit) and processing devices such as field programmable gate arrays (FPGAs), but the scope of the present invention is not limited thereto.

The database 140 stores data accumulated while performing the baby behavior analysis method. For example, the database 140 may store specialized data, threshold information, section division, motion region information, notification notification information, and the like.

Meanwhile, the camera device 200 is fixedly installed on an upper surface of a baby sleeping place such as a bed, a baby activity place such as a playroom, and transmits a video stream input for a real-time baby detection image through the communication module 110. ).

In addition, the guardian terminal 300 is a terminal possessed by guardians such as parents, babysitters, caregivers, etc., as a wireless communication device that guarantees portability and mobility, as well as a smart phone, a tablet PC, and a wearable device. (BLE, Bluetooth Low Energy), NFC, RFID, ultrasonic (Ultrasonic), infrared, Wi-Fi (WiFi), can include various devices equipped with communication modules such as LiFi.

Accordingly, the guardian can receive a report on the abnormal behavior of the baby through the guardian terminal 300 and can monitor the baby so that he can observe the baby at any time.

FIG. 2 is a diagram illustrating a configuration of a program processed by a processor that is a part of FIG. 1.

Referring to FIG. 2, the processor 120 includes a section processing module 121, a motion detection module 122, a baby behavior analysis module 123, and a reporting module 124 by executing a program.

The section processing module 121 includes a section selection unit 121a and a baby detection and segmentation unit 121b, and includes a plurality of frames according to a threshold value selected by the user for the baby detection image in the section selection unit 121a The baby's body area and background are separated for each frame based on distance information from the camera device 200 to the location of the baby in the baby detection and segmentation unit 121b. Here, the distance information may be approximately 90 cm, but the present invention is not limited thereto.

In this case, the threshold value T represents the number of frames per section, and may increase or decrease based on user preference for video processing.

The motion detection module 122 includes a motion feature extraction unit 122a, a motion evaluation unit 122b, a data matching unit 122c, and an ellipse setting unit 122d.

The motion feature extraction unit 122a calculates the ratio of the frame to the baby body region, that is, the total pixels of the frame, by dividing the baby body region through the motion detection algorithm, and extracts the motion feature from the divided baby body region. In this case, when the motion feature extraction unit 122a divides the baby's body region, it is possible to save processing time when calculating the region where the baby is lying down or the region where the movement is unique, and thereby, cost can be reduced.

The motion evaluation unit 122b detects a motion region using a motion detection algorithm based on the extracted motion feature. That is, the motion evaluation unit 122b may specify each body part of the baby whose motion is detected in the binary motion estimation frame, which is a result value of the motion detection algorithm, before matching the motion region with specialized data.

The data matching unit 122c matches the movement area with professional data set in the standard size according to the baby body part for each baby age group, and the ellipse setting unit 122d sets an ellipse in the baby body part where the movement is detected. Determine the size of the ellipse based on its size. In this case, the frame in which the motion region is detected may be compared with the background frame using the PSNR value.

Table 1 below shows specialized data, which is a standard size according to baby body parts by age group, but in some cases, specialized data is subdivided so that it can be applied to babies exceeding the standard size for each age group and babies below the standard size for each age group. You may.

[Table 1]

The baby behavior analysis module 123 includes a management chart configuration unit 123a and a baby behavior evaluation unit 123b. The management chart configuration unit 123a configures a baby behavior management chart that provides three-dimensional information on motion intensity, motion diversity value, and time using the number and size of ellipses, and the baby behavior evaluation unit 123b is a baby behavior management diagram Based on, the baby's behavior is evaluated for the abnormal and normal behavioral intervals.

The reporting module 124 includes an alarm detection unit 124a and a notification notification unit 124b, and after detecting an alarm condition when an abnormal behavior section is detected in the alarm detection unit 124a, the notification notification unit 124b Immediately notifies the baby's abnormal behavior notification to the parent's terminal.

3 is a flowchart illustrating a method of analyzing baby behavior according to an embodiment of the present invention.

Referring to FIG. 3, in the method of analyzing baby behavior, a baby detection image is input in real time from a camera device 200 fixed above a baby sleeping place or a baby activity place, and it is input at 20 to 30 frames per second and overlapping frames are prevented. It is processed to be (S310).

The baby behavior analysis method performs section division into T frames according to the threshold value (T) selected by the user (S320), selects a specific section among the divided sections, and then applies a motion detection algorithm to each frame of the section. A motion area for the is detected (S330).

In the baby behavior analysis method, an ellipse is set for each baby body part in which motion is detected for a motion region detected for T frames of a single section, and the size of the ellipse is set based on the size of the motion region (S340).

The baby behavior analysis method configures a baby behavior management chart that displays the number or size of ellipses that change over time for a corresponding section (S350).

The baby behavior analysis method is based on the baby behavior management chart, if the motion intensity or motion diversity value exceeds the preset upper limit control limit value or the lower limit control limit value, in the case of a section including a plurality of frames, it is determined as an abnormal behavior section and then sent to the guardian terminal. Immediately notify the baby's abnormal behavior (S360, S70). However, the baby behavior analysis method determines that the abnormal behavior interval is not detected as a normal behavior interval (S380).

The baby behavior analysis method performs steps S310 to S380 from the first section to the last section to analyze the baby's movements when the baby is sleeping or active, and determine the baby's normal or abnormal behavior based on the baby's behavior management chart. Yes (S390).

4 is a flow chart illustrating a motion region detection process using a motion detection algorithm according to an embodiment of the present invention, and FIG. 5 is a diagram showing an entire framework of a motion detection algorithm according to an embodiment of the present invention.

4 and 5, the motion detection algorithm applies a baby detection image to two consecutive frames (S410, S420), and the first algorithm (S430), the second algorithm (S440), and the third algorithm (S450). Perform.

The first algorithm (S430) calculates the absolute difference between two consecutive frames to calculate the motion change (S431), and applies a threshold value to convert the resulting image into a binary number by suppressing the pixels without motion ( S432). This first algorithm (S430) outputs a motion estimation frame that has been converted into binary (S433).

The second algorithm (S440) performs preprocessing on two consecutive frames (S441), calculates the optical flow between the two consecutive frames, and outputs a motion estimation frame converted into binary (S442, S443). .

The third algorithm S450 compares the last frame with the first frame through background subtraction and outputs the binary-transformed motion estimation frame. At this time, a threshold value of the subtracted image is specified (S451, S452, S453).

The motion detection algorithm integrates the binary motion estimation frames output through the first algorithm (S430), the second algorithm (S440), and the third algorithm (S450) through a logical operation (for example, AND) between binary pixels. Thus, the final motion estimation frame may be calculated (S460 and S470). At this time, the final motion estimation frame, which is a result of the motion algorithm, is extracted as a motion feature.

In this way, the motion detection algorithm may be implemented in a hybrid method in which at least one of the first algorithm S430, the second algorithm S440, and the third algorithm S450 is combined.

Meanwhile, steps S410 to S470 of FIGS. 4 and 5 may be divided into additional steps or may be combined into fewer steps according to an embodiment of the present invention. In addition, some steps may be omitted as necessary, and the order of steps may be changed.

6 is a diagram illustrating an overview of an analysis process of a baby behavior analysis method according to an embodiment of the present invention, and FIG. 7 is an exemplary diagram illustrating a baby behavior management diagram in a single section.

Referring to FIG. 6, in the method of analyzing baby behavior, when a baby detection image is input, only the baby body area can be separated from the background using distance information, and after calculating the ratio of the frame to the baby body area, the baby's body part is moved. Calculate the area.

At this time, each movement area is displayed as an ellipse after matching with the standard size for each baby body part, that is, professional data. At this time, each oval is set so as not to exceed the size of the baby's body part. Such an ellipse is drawn based on a motion area generated within the frame, and the ellipse is not drawn if the baby does not move.

The motion region is calculated using a first algorithm, a second algorithm, and a third algorithm returning a binary motion estimation frame. The binary motion estimation frame includes a motion region (a white region), and the motion region is calculated as a pixel unit area and matched with the specialized data. Therefore, when there is movement in a specific body part, an ellipse is drawn around the pixels of the white area after matching the movement area with professional data so that the size of the ellipse displayed on the body part does not exceed the body part size set in the specialized data. . When two ellipses are displayed in the same area of the pixels of the white area, that is, in the same area of the baby's body but in different motion intensity, the ellipse having the largest area is selected for subsequent processing.

At this time, the equation for drawing an ellipse in the motion region of each frame is as Equation 1 below.

[Equation 1]

cv2.circle (frame, (cX1, cY1), red, (0, 255, 255), 3)

cv2.circle (frame, (cX2, cY2), red, (0, 255, 255), 3)

cv2.circle(frame, (cX3, cY3), red, (0, 255, 255), 3)

Equation 1 above describes drawing an ellipse in Python OpenCV (Open Source Computer Vision) using the center coordinate and radius as an example.In addition to the Python OpenCV method, the ellipse can be drawn through various real-time image processing methods. In Equation 1, the coordinates of the center of the code are ([cX1, cY1], [cX2, cY2], [cX3, cY3]), the radius becomes red, and the rest of the code represents the color of the ellipse and the length of the line.

The baby behavior analysis method composes a baby behavior management chart using the number and size of ellipses.The intensity is displayed in proportion to the size of the ellipse (the size of the moving area), and the diversity is expressed in proportion to the number of ellipses (the number of the moving areas). And, when the number of ellipses in one frame is large, an ellipse with a maximum motion area is selected as a floating target.

As shown in FIG. 7, the baby behavior management chart represents motion behavior during a single section, and points indicated in the chart are displayed based on a motion difference between two consecutive frames of one section.

In the baby behavior management chart, an upper limit control limit value (UCL) and a lower limit control limit value (LCL) are set for notifying the guardian terminal about the abnormal behavior of the baby because the limit is exceeded. The upper control limit value represents a very high intensity and diversity value, and the lower control limit value represents the intensity and diversity value for very low or undetectable motion.

Therefore, in the baby behavior analysis method, when there is a section including a plurality of frames exceeding the upper limit control limit value and the lower limit control limit value of the baby behavior management chart, the corresponding section is displayed as an abnormal behavior section.

8 is an exemplary diagram showing a baby behavior management chart for each section, and FIG. 9 is an exemplary diagram representing a baby behavior management diagram using a 3D graph.

Referring to FIG. 8, in the baby behavior management chart for section 1 and section 2, since the baby's movement is within the upper limit control limit value and the lower limit control limit value, the baby's behavior is in a normal state, and sections 1 and 2 are determined as normal action sections.

In the baby behavior management chart for section 3, since the motion area of the first frame is located at the boundary of the upper control limit value, and the motion areas of the remaining frames in the same section exceed the upper control limit value, section 3 is judged as an abnormal behavioral section. Thus, it immediately notifies the guardian's terminal.

In the baby behavior management chart for section 4, the motion areas of the first frame, the second frame, and the third frame are in a normal state, and the motion areas of the fourth and fifth frames do not pass the lower limit control limit very slightly, but overall, the section 4 Can be determined as a normal behavioral section.

Referring to FIG. 9, when a baby behavior management chart of a single section with respect to time is expressed using a three-dimensional graph, the motion area of each frame is a three-dimensional motion in which the X-axis is the motion intensity, the Z-axis is the motion diversity value, and the Y-axis is time. It is expressed as a point (time (T), intensity (I), diversity (D)) in the coordinate system. The baby behavior management chart is configured for a specific section by displaying motion intensity and diversity values acquired in the selected current section as dots for the currently processed frame.

As shown in Fig. 9, the second point and the third point are in the normal range, but the first point has an intensity value that crosses the upper limit control limit value and the diversity and intensity of the first point do not exceed the lower limit control limit value, The last point is that since the diversity and intensity exceed the upper limit control limit, the corresponding section is an abnormal behavior section and is immediately reported to the guardian's terminal.

The baby behavior analysis method according to an embodiment of the present invention described above may be implemented in the form of a recording medium including instructions executable by a computer, such as a program module executed by a computer. Such recording media include computer-readable media, and computer-readable media may be any available media that can be accessed by a computer, and include both volatile and nonvolatile media, and removable and non-removable media. In addition, computer-readable media includes computer storage media, which are volatile and nonvolatile embodied in any method or technology for storage of information such as computer-readable instructions, data structures, program modules or other data. , Both removable and non-removable media.

The above description of the present invention is for illustrative purposes only, and those of ordinary skill in the art to which the present invention pertains can understand that it is possible to easily transform it into other specific forms without changing the technical spirit or essential features of the present invention. will be. Therefore, it should be understood that the embodiments described above are illustrative in all respects and not limiting. For example, each component described as a single type may be implemented in a distributed manner, and similarly, components described as being distributed may also be implemented in a combined form.

The scope of the present invention is indicated by the claims to be described later rather than the detailed description, and all changes or modified forms derived from the meaning and scope of the claims and their equivalent concepts should be interpreted as being included in the scope of the present invention. do.

100: baby behavior analysis system
110: communication module 120: processor
130: memory 140: database
200: camera device 300: guardian terminal

Claims (16)

In the baby behavior analysis method performed by the baby behavior analysis system for baby behavior monitoring,
a) dividing the baby detection image input through at least one camera device into a plurality of sections according to a threshold value set by a user;
b) separating the baby body area and the background in each frame within each section and then detecting a motion area in the baby body area;
c) setting an ellipse for each baby body part in which motion is detected for the detected motion area, and setting the size of the ellipse based on the size of the motion area;
d) Provide a baby behavior management chart that displays the number or size of ellipses that change over time for each section, and a plurality of frames that are larger than a preset upper limit control limit value or smaller than a lower limit control limit value based on the baby behavior management chart Detecting an abnormal behavior section that is an included section; And
e) if the abnormal behavior section is not detected, it is determined as a normal behavior section, and when the abnormal behavior section is detected, reporting the abnormal behavior of the baby to a parental terminal. The method of claim 1,
The threshold value represents the number of frames per section, baby behavior analysis method. The method of claim 1,
The camera device is fixedly installed on the upper surface of the baby sleeping place or the baby activity place,
In the step a), information on the distance between the location of the baby and the camera device is input in the frame of the first section. The method of claim 3,
In the step b), after detecting the baby body region using the distance information, a background is subtracted from each frame to extract only the baby body region. The method of claim 1,
Step b),
The method of analyzing baby behavior by calculating a ratio of the frame to the baby's body region and detecting a motion region using a motion detection algorithm. The method of claim 5,
The motion detection algorithm,
A first algorithm that estimates binary motion by calculating the absolute difference between a plurality of consecutive frames, a second algorithm that estimates binary motion by calculating the optical flow between a plurality of consecutive frames, the background of the last frame and the first frame After comparing through subtraction, the binary image whose binary motion is estimated through at least one of the third algorithms for estimating the binary motion is integrated into the binary pixels through a logical operation to obtain a motion region including the final motion pixel information. To provide, baby behavior analysis method. The method of claim 6,
The first algorithm or the third algorithm is to apply a threshold value for converting the resulting image to a binary number by suppressing pixel information without motion. The method of claim 1,
The step c),
It stores specialized data set in standard sizes according to baby body parts by baby age group,
Matching the motion area with the specialized data to set an ellipse in a body part of the baby in which motion is detected, and determining the size of the ellipse based on the size of the motion area. The method of claim 8,
The size of the ellipse is determined not to exceed the size of the baby body part, baby behavior analysis method. The method of claim 1,
The step d) generates a baby behavior management chart using the number and size of the ellipses, wherein the baby behavior management chart provides 3D information including information on motion intensity, motion diversity value, and time, How to analyze baby behavior. In the baby behavior analysis system using at least one camera device,
A memory in which a program for performing a real-time baby behavior analysis method for baby movement is recorded; And
And a processor for executing the program,
The processor, by executing the program,
The baby detection image inputted through the camera device is divided into a plurality of sections according to a threshold value set by the user, and the baby body area and the background are separated from each frame in each section, and then a motion area is detected in the baby body area and,
An ellipse is set for each body part of the baby in which motion is detected for the detected motion area, and the size of the ellipse is set based on the size of the motion area,
Provides a baby behavior management chart that displays the number or size of ellipses that change over time for each section, and includes a plurality of frames that are larger than a preset upper limit control limit value or smaller than a lower limit control limit value based on the baby behavior management chart. It detects the abnormal behavior section, which is a section,
If the abnormal behavior section is not detected, it is determined as a normal behavior section, and if the abnormal behavior section is detected, the abnormal behavior of the baby is notified to a parental terminal. The method of claim 11,
The processor,
A section processing module for dividing the baby detection image into sections including a plurality of frames according to the threshold value, and separating the baby body area and background for each frame based on distance information from the camera device to the location of the baby;
Calculate the ratio of the frame to the baby's body area, detect a movement area using a motion detection algorithm, and move by matching the detected movement area with specialized data set in a standard size according to the baby's body area for each baby age group A motion detection module configured to set an ellipse in the sensed body part of the baby and determine a size of the ellipse based on the size of the motion area;
Using the number and size of the ellipses, a baby behavior management chart that provides three-dimensional information about motion intensity, motion diversity value, and time is created, and baby behavior for abnormal and normal behavior sections based on the baby behavior management chart. Behavior analysis module to evaluate the; And
And a reporting module for immediately notifying a baby's abnormal behavior notification to the parental terminal by detecting an alarm condition when the abnormal behavior section is detected. The method of claim 12,
The camera device is fixedly installed on the upper surface of the baby sleeping place or the baby activity place,
The section processing module inputs distance information between the location of the baby and the camera device in the frame of the first section, detects the baby body area using the distance information, and subtracts the background from each frame to the baby body area. That only extracts, baby behavior analysis system. The method of claim 12,
The motion detection module,
A first algorithm that estimates binary motion by calculating the absolute difference between a plurality of consecutive frames, a second algorithm that estimates binary motion by calculating the optical flow between a plurality of consecutive frames, the background of the last frame and the first frame After comparing through subtraction, the binary image whose binary motion is estimated through at least one of the third algorithms for estimating the binary motion is integrated into the binary pixels through a logical operation to obtain a motion region including the final motion pixel information. To provide, baby behavior analysis system. The method of claim 14,
The first algorithm or the third algorithm is to apply a threshold value for converting the resulting image into a binary number by suppressing pixel information without motion. The method of claim 12,
The motion detection module,
Specialized data set in standard sizes according to baby body parts for each baby's age group is stored in the database,
Matching the motion region with the specialized data to set an ellipse in the body part of the baby where the motion is detected, and determining the size of the ellipse based on the size of the motion region.

Images