CN111281358A - Real-time monitoring system of baby robot - Google Patents
Real-time monitoring system of baby robot Download PDFInfo
- Publication number
- CN111281358A CN111281358A CN202010111441.4A CN202010111441A CN111281358A CN 111281358 A CN111281358 A CN 111281358A CN 202010111441 A CN202010111441 A CN 202010111441A CN 111281358 A CN111281358 A CN 111281358A
- Authority
- CN
- China
- Prior art keywords
- module
- infant
- baby
- data
- real
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012544 monitoring process Methods 0.000 title claims abstract description 62
- 238000012545 processing Methods 0.000 claims abstract description 25
- 230000001815 facial effect Effects 0.000 claims abstract description 14
- 230000036760 body temperature Effects 0.000 claims abstract description 9
- 230000000694 effects Effects 0.000 claims abstract description 9
- 208000005346 nocturnal enuresis Diseases 0.000 claims abstract description 8
- 230000002159 abnormal effect Effects 0.000 claims abstract description 5
- 238000001514 detection method Methods 0.000 claims description 26
- 230000000875 corresponding effect Effects 0.000 claims description 22
- 230000009471 action Effects 0.000 claims description 10
- 230000005236 sound signal Effects 0.000 claims description 8
- 230000000007 visual effect Effects 0.000 claims description 8
- 238000005516 engineering process Methods 0.000 claims description 7
- 238000004891 communication Methods 0.000 claims description 6
- 238000006073 displacement reaction Methods 0.000 claims description 6
- 238000000034 method Methods 0.000 claims description 5
- 238000007781 pre-processing Methods 0.000 claims description 5
- 239000002033 PVDF binder Substances 0.000 claims description 4
- 230000002996 emotional effect Effects 0.000 claims description 4
- 229920002981 polyvinylidene fluoride Polymers 0.000 claims description 4
- 230000008569 process Effects 0.000 claims description 4
- 238000006243 chemical reaction Methods 0.000 claims description 3
- 230000001276 controlling effect Effects 0.000 claims description 3
- 238000013527 convolutional neural network Methods 0.000 claims description 3
- 230000029058 respiratory gaseous exchange Effects 0.000 claims description 3
- 230000000903 blocking effect Effects 0.000 claims 1
- 230000000474 nursing effect Effects 0.000 abstract description 2
- 238000010586 diagram Methods 0.000 description 6
- 230000008451 emotion Effects 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 230000008901 benefit Effects 0.000 description 2
- 230000006872 improvement Effects 0.000 description 2
- 208000027418 Wounds and injury Diseases 0.000 description 1
- 238000009529 body temperature measurement Methods 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 230000006378 damage Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 230000036541 health Effects 0.000 description 1
- 208000014674 injury Diseases 0.000 description 1
- 230000004962 physiological condition Effects 0.000 description 1
- 230000035790 physiological processes and functions Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 230000009897 systematic effect Effects 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
Images
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/02—Detecting, measuring or recording pulse, heart rate, blood pressure or blood flow; Combined pulse/heart-rate/blood pressure determination; Evaluating a cardiovascular condition not otherwise provided for, e.g. using combinations of techniques provided for in this group with electrocardiography or electroauscultation; Heart catheters for measuring blood pressure
- A61B5/0205—Simultaneously evaluating both cardiovascular conditions and different types of body conditions, e.g. heart and respiratory condition
- A61B5/02055—Simultaneously evaluating both cardiovascular condition and temperature
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/02—Detecting, measuring or recording pulse, heart rate, blood pressure or blood flow; Combined pulse/heart-rate/blood pressure determination; Evaluating a cardiovascular condition not otherwise provided for, e.g. using combinations of techniques provided for in this group with electrocardiography or electroauscultation; Heart catheters for measuring blood pressure
- A61B5/024—Detecting, measuring or recording pulse rate or heart rate
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/08—Detecting, measuring or recording devices for evaluating the respiratory organs
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01D—MEASURING NOT SPECIALLY ADAPTED FOR A SPECIFIC VARIABLE; ARRANGEMENTS FOR MEASURING TWO OR MORE VARIABLES NOT COVERED IN A SINGLE OTHER SUBCLASS; TARIFF METERING APPARATUS; MEASURING OR TESTING NOT OTHERWISE PROVIDED FOR
- G01D21/00—Measuring or testing not otherwise provided for
- G01D21/02—Measuring two or more variables by means not covered by a single other subclass
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S19/00—Satellite radio beacon positioning systems; Determining position, velocity or attitude using signals transmitted by such systems
- G01S19/01—Satellite radio beacon positioning systems transmitting time-stamped messages, e.g. GPS [Global Positioning System], GLONASS [Global Orbiting Navigation Satellite System] or GALILEO
- G01S19/13—Receivers
- G01S19/14—Receivers specially adapted for specific applications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
- G08B21/02—Alarms for ensuring the safety of persons
- G08B21/0202—Child monitoring systems using a transmitter-receiver system carried by the parent and the child
- G08B21/0205—Specific application combined with child monitoring using a transmitter-receiver system
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
- G08B21/02—Alarms for ensuring the safety of persons
- G08B21/0202—Child monitoring systems using a transmitter-receiver system carried by the parent and the child
- G08B21/0205—Specific application combined with child monitoring using a transmitter-receiver system
- G08B21/0211—Combination with medical sensor, e.g. for measuring heart rate, temperature
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
- G08B21/02—Alarms for ensuring the safety of persons
- G08B21/0202—Child monitoring systems using a transmitter-receiver system carried by the parent and the child
- G08B21/0269—System arrangements wherein the object is to detect the exact location of child or item using a navigation satellite system, e.g. GPS
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B3/00—Audible signalling systems; Audible personal calling systems
- G08B3/10—Audible signalling systems; Audible personal calling systems using electric transmission; using electromagnetic transmission
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
- G10L25/48—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use
- G10L25/51—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use for comparison or discrimination
- G10L25/63—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use for comparison or discrimination for estimating an emotional state
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- H04N7/181—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B2503/00—Evaluating a particular growth phase or type of persons or animals
- A61B2503/04—Babies, e.g. for SIDS detection
Landscapes
- Health & Medical Sciences (AREA)
- Engineering & Computer Science (AREA)
- General Health & Medical Sciences (AREA)
- Physics & Mathematics (AREA)
- Life Sciences & Earth Sciences (AREA)
- Child & Adolescent Psychology (AREA)
- General Physics & Mathematics (AREA)
- Cardiology (AREA)
- Physiology (AREA)
- Heart & Thoracic Surgery (AREA)
- Surgery (AREA)
- Business, Economics & Management (AREA)
- Biophysics (AREA)
- Pathology (AREA)
- Biomedical Technology (AREA)
- Multimedia (AREA)
- Medical Informatics (AREA)
- Molecular Biology (AREA)
- Radar, Positioning & Navigation (AREA)
- Animal Behavior & Ethology (AREA)
- Public Health (AREA)
- Veterinary Medicine (AREA)
- Emergency Management (AREA)
- Pulmonology (AREA)
- Signal Processing (AREA)
- Human Computer Interaction (AREA)
- Remote Sensing (AREA)
- Theoretical Computer Science (AREA)
- Electromagnetism (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Hospice & Palliative Care (AREA)
- Computer Networks & Wireless Communication (AREA)
- Computational Linguistics (AREA)
- Psychiatry (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Acoustics & Sound (AREA)
- Measuring And Recording Apparatus For Diagnosis (AREA)
Abstract
The invention discloses a real-time monitoring system of a baby robot, which comprises a physiological monitoring module, a data acquisition module and a data acquisition module, wherein the physiological monitoring module is used for acquiring real-time data signals of the breath, the heart rate, the body temperature and the bedwetting of a baby through a sensor group; the dynamic analysis module is used for performing combined analysis on the sound emitted by the baby and the facial information when the sound emitted by the baby is detected through the camera group and performing data acquisition on the surrounding environment information; the invention can carry out all-around monitoring on the physiological and real-time states of the baby, form a complete monitoring system, and can carry out corresponding indication processing on corresponding abnormal conditions of the baby, thereby improving the monitoring effect on the baby and more effectively lightening the burden of parents for nursing the baby.
Description
Technical Field
The invention relates to the technical field of baby robots, in particular to a real-time monitoring system of a baby robot.
Background
With the development of society, the population structure of China is changed to a certain extent, young parents cannot care their own children due to busy work, especially for young infants, the parents cannot accompany and care the young parents, and the parents are tired due to long-time infant care.
The existing infant monitoring mode generally comprises two modes of physiological monitoring and real-time state monitoring of an infant, namely monitoring the physiological condition of the infant and monitoring the video of the infant by using a camera, so as to ensure the health or safety of the infant, but the two modes of monitoring do not form a complete monitoring system, do not make better prejudgment on various conditions encountered in the monitoring process and provide corresponding countermeasures, and have some disadvantages, so that a real-time infant robot monitoring system needs to be designed for improving the monitoring effect of the infant.
Disclosure of Invention
Therefore, the invention provides a real-time monitoring system for an infant robot, which solves the problems that the existing infant monitoring mode is not systematic, and can not effectively deal with various conditions and provide corresponding countermeasures.
In order to achieve the above object, an embodiment of the present invention provides the following:
a real-time monitoring system for baby robot comprises,
the physiological monitoring module acquires real-time data signals of the breath, the heart rate, the body temperature and the bed wetting of the baby through the sensor group;
the dynamic analysis module is used for performing combined analysis on the sound emitted by the baby and the facial information when the sound emitted by the baby is detected through the camera group and performing data acquisition on the surrounding environment information;
the position detection module is used for establishing a waypoint database of an infant activity space, realizing infant movement data acquisition by a gpsOne movement positioning technology, forming displacement data and generating three-dimensional positioning of infant position information in real time by combining the displacement data and the waypoint database;
the combination processing module is used for carrying out combination preprocessing on data formed by the physiological monitoring module, the dynamic analysis module and the position detection module and generating an execution signal of an emergency treatment measure;
and the control system is used for connecting the physiological monitoring module, the dynamic analysis module, the position detection module and the combination processing module, carrying out centralized processing on data generated by each module, feeding back the processed signals to the corresponding modules, and storing the data acquired by each module into a database.
As a preferable scheme of the invention, the emergency treatment device further comprises an execution module, the execution module comprises a manipulator for executing emergency treatment measures, and the execution module is connected with the combination processing module, receives an execution signal of the emergency treatment measures and executes corresponding actions, and the execution actions comprise actions of utilizing the manipulator to shield splashes, assist a fallen baby and add or subtract a quilt for the baby.
As a preferable scheme of the invention, the sensor group of the physiological monitoring module comprises a polyvinylidene fluoride piezoelectric film sensor for monitoring the breath and the heartbeat of the baby, a DS18B20 temperature sensor for measuring the body temperature of the baby, and a DHT11 humidity sensor for monitoring whether the baby is bedwetting.
As a preferred aspect of the present invention, the camera group in the dynamic analysis module includes a visual camera based on a convolutional neural network algorithm for capturing facial information of the infant, and a wide-angle camera for collecting surrounding environment data, and the position detection module uses the received collected data of the wide-angle camera to establish a waypoint database.
As a preferred aspect of the present invention, the position detection module combines the received facial information of the infant captured by the visual camera with the gpsone movement positioning technology to determine the movement track of the infant.
As a preferred aspect of the present invention, the dynamic analysis module collects sound signals of a baby through a sound pickup and an audio decoding chip, and performs preprocessing before recognition on the collected sound signals through a DSP chip.
As a preferable scheme of the invention, the position detection module comprises a GPS receiver for importing the coordinate data of the moving range of the baby into an internal storage and establishing a waypoint database.
As a preferred scheme of the present invention, the control system includes an information matching module, a voice broadcasting module, and a wireless communication module;
the information matching module is used for processing the information acquired by the physiological monitoring module, the dynamic analysis module, the position detection module and the combination processing module and performing information matching on the acquired information and the data which is stored in the database and comes from the cloud big data and relates to the abnormal state information of the infant;
the voice broadcasting module comprises an NVC voice chip for storing and controlling the playing of the prompt voice, an amplifier and a loudspeaker for carrying out audio conversion playing on the prompt voice;
and the wireless communication module is used for remotely connecting other terminal equipment and transmitting corresponding prompt information to the terminal equipment.
As a preferred scheme of the present invention, the data collected by the safety monitoring module, the dynamic analysis module, the position detection module and the combination processing module, which are stored in the database of the control system, are used to update, optimize and upgrade the data from the cloud big data in the database.
As a preferred aspect of the present invention, the dynamic analysis module analyzes the collected sound data of the infant and the facial information matched with the sound information in combination to determine the real-time emotional state of the infant and converts the real-time emotional state into a corresponding data signal.
The embodiment of the invention has the following advantages:
the invention can carry out all-around monitoring on the physiological and real-time states of the baby to form a complete monitoring system, can carry out corresponding indication on the corresponding abnormal conditions of the baby to process, improves the monitoring effect on the baby and can more effectively relieve the burden of parents for nursing the baby.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below. It should be apparent that the drawings in the following description are merely exemplary, and that other embodiments can be derived from the drawings provided by those of ordinary skill in the art without inventive effort.
The structures, ratios, sizes, and the like shown in the present specification are only used for matching with the contents disclosed in the specification, so as to be understood and read by those skilled in the art, and are not used to limit the conditions that the present invention can be implemented, so that the present invention has no technical significance, and any structural modifications, changes in the ratio relationship, or adjustments of the sizes, without affecting the effects and the achievable by the present invention, should still fall within the range that the technical contents disclosed in the present invention can cover.
Fig. 1 is a block diagram of a real-time monitoring system for an infant robot according to an embodiment of the present invention;
fig. 2 is a schematic view of a real-time monitoring system for an infant robot according to an embodiment of the present invention;
FIG. 3 is a diagram of a physiological monitor module according to an embodiment of the present invention;
FIG. 4 is a schematic diagram of a dynamic analysis module collecting facial signals according to an embodiment of the present invention;
FIG. 5 is a diagram illustrating a dynamic analysis module collecting a sound signal according to an embodiment of the present invention;
FIG. 6 is a diagram illustrating a position detection module according to an embodiment of the present invention;
FIG. 7 is a diagram of a combination processing module according to an embodiment of the invention.
Detailed Description
The present invention is described in terms of particular embodiments, other advantages and features of the invention will become apparent to those skilled in the art from the following disclosure, and it is to be understood that the described embodiments are merely exemplary of the invention and that it is not intended to limit the invention to the particular embodiments disclosed. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
As shown in fig. 1 to 7, the present invention provides a baby robot real-time monitoring system, including,
the physiological monitoring module acquires real-time data signals of the breath, the heart rate, the body temperature and the bed wetting of the baby through the sensor group;
the dynamic analysis module is used for performing combined analysis on the sound emitted by the baby and the facial information when the sound emitted by the baby is detected through the camera group and performing data acquisition on the surrounding environment information;
the position detection module is used for establishing a waypoint database of an infant activity space, realizing infant movement data acquisition by a gpsOne movement positioning technology, forming displacement data and generating three-dimensional positioning of infant position information in real time by combining the displacement data and the waypoint database;
the combination processing module is used for carrying out combination preprocessing on data formed by the physiological monitoring module, the dynamic analysis module and the position detection module and generating an execution signal of an emergency treatment measure;
and the control system is used for connecting the physiological monitoring module, the dynamic analysis module, the position detection module and the combination processing module, carrying out centralized processing on data generated by each module, feeding back the processed signals to the corresponding modules, and storing the data acquired by each module into a database.
In the invention, a plurality of modules monitor the baby, comprehensively monitor and analyze the physiological state and position of the baby and the emotion and surrounding environment of the baby, comprehensively process monitoring information to generate corresponding execution signals while monitoring the baby, and perform some simple emergency measures.
The invention further forms a complete system for monitoring the infant, and generates an execution signal and an execution action while performing all-around monitoring on the infant.
The device also comprises an execution module, wherein the execution module comprises a manipulator for executing emergency treatment measures, and is connected with the processing module, receives execution signals of the emergency treatment measures and executes corresponding actions, and the execution actions comprise actions of utilizing the manipulator to shield splashes, assisting falling infants and adding or subtracting quilts for the infants.
The control system is used for processing the action of the execution signal and performing simple emergency action, for example, when the dynamic analysis module detects that splashes around are sent to the direction of the baby, the control system receives the information detected by the dynamic analysis module and generates a corresponding emergency signal, and the manipulator generates a shielding action to prevent the baby from being injured; when the baby falls down, the mechanical arm receives an execution signal for assisting, and when the change of the ambient temperature is detected at night, the mechanical arm receives an execution signal for adding or subtracting the quilt for the baby.
The sensor group of the physiological monitoring module comprises a polyvinylidene fluoride piezoelectric film sensor for monitoring the breath and the heartbeat of the baby, a DS18B20 temperature sensor for measuring the body temperature of the baby, and a DHT11 humidity sensor for monitoring whether the baby is bedwetting.
The polyvinylidene fluoride piezoelectric film sensor collects vital sign signals of infants, and heart rate and respiration rate are obtained by adopting wavelet transformation and a time domain peak searching algorithm.
And further processing the digital signal to obtain heartbeat and respiration waveforms, and displaying the waveforms in real time by using labview.
The DS18B20 temperature sensor detects the body temperature of the baby, the temperature measuring range of the sensor is-55 ℃ to +125 ℃, the programmable resolution is 9-12 bits, the corresponding distinguishable temperatures are 0.5 ℃, 0.25 ℃, 0.125 ℃ and 0.0625 ℃, the high-precision temperature measurement can be realized, and the body temperature of the baby can be accurately fed back.
The DHT11 humidity sensor detects the humidity of the lower body of an infant, whether the infant is bed wetting or not can be determined, the accuracy of the sensor can reach +/-5% RH, the humidity range is 20-90% RH, the sensor is small in size, low in power consumption, ultra-fast in response, strong in anti-interference capacity and capable of stably detecting the condition of the infant.
The camera group in the dynamic analysis module comprises a visual camera used for capturing face information of the baby and based on a convolutional neural network algorithm, and a wide-angle camera for collecting surrounding environment data, and meanwhile, the position detection module is used for establishing a waypoint database by using the received collected data of the wide-angle camera.
The wide-angle camera carries out data acquisition to surrounding environment information, not only can detect whether the surrounding environment has the potential danger that produces the injury to the baby to in time feed back information, and the environmental information that detects can be used to establish baby's home range's waypoint coordinate storehouse.
The position detection module combines the received infant facial information captured by the visual camera with gpsone movement location technology to determine an infant movement trajectory.
The visual camera is used for inaccurately capturing facial signals of the baby and determining movement data of the baby, the collected baby movement data is combined with a GPSone movement positioning technology to determine the movement track of the baby, and whether the baby exceeds the coordinate range of the waypoint database is judged.
The dynamic analysis module collects sound signals of the baby through the sound pick-up and the audio decoding chip and pre-processes the collected sound signals before recognition through the DSP chip.
The sound pickup and the audio decoding chip collect and convert sound signals of the baby into digital signals, the DSP chip carries out preprocessing before recognizing the sound digital signals, and the baby face information captured by the visual camera is combined for comprehensive judgment when the sound of the baby is processed.
The position detection module comprises a GPS receiver which is used for importing the coordinate data of the movement range of the baby into an internal storage and establishing a waypoint database.
The GPS receiver is used for receiving the data of the coordinate range of the baby, establishing a waypoint database and combining the GPSone mobile positioning technology to realize indoor and outdoor full-coverage positioning.
The control system comprises an information matching module, a voice broadcasting module and a wireless communication module;
the information matching module is used for processing the information acquired by the physiological monitoring module, the dynamic analysis module, the position detection module and the combination processing module and performing information matching on the acquired information and the data which is stored in the database and comes from the cloud big data and relates to the abnormal state information of the infant;
the information matching module is used for receiving the information sent by each module, performing matching analysis by combining data from the cloud big data in the database, and generating corresponding execution signals to return to each module.
The voice broadcasting module comprises an NVC voice chip for storing and controlling the playing of the prompt voice, an amplifier and a loudspeaker for carrying out audio conversion playing on the prompt voice;
the voice broadcasting module is used for broadcasting reminding for parents of the state of the baby, for example, the baby urinates, cries or exceeds the activity range, the control system sends out corresponding point execution signals, the voice broadcasting module receives the execution signals, and corresponding prompt voice is played.
And the wireless communication module is used for remotely connecting other terminal equipment and transmitting corresponding prompt information to the terminal equipment.
The voice prompt device is used for remotely reminding parents to avoid the situation that the parents are far away and cannot hear prompt voice sent by the voice broadcast module.
The data collected by the safety monitoring module, the dynamic analysis module, the position detection module and the combination processing module, which are stored in the database of the control system, are used for updating, optimizing and upgrading the data from the cloud big data in the database.
The dynamic analysis module is used for determining the real-time emotion state of the baby by analyzing the collected baby sound data and the facial information matched with the sound information in a combined mode and converting the real-time emotion state into a corresponding data signal. To is coming to
The baby is better monitored, the data in the database can be updated by cloud big data, and the data in the database can be updated by combining actual detection data, so that the use experience is better, and the use effect is better.
Although the invention has been described in detail above with reference to a general description and specific examples, it will be apparent to one skilled in the art that modifications or improvements may be made thereto based on the invention. Accordingly, such modifications and improvements are intended to be within the scope of the invention as claimed.
Claims (10)
1. A real-time monitoring system for baby robot is characterized in that it comprises,
the physiological monitoring module acquires real-time data signals of the breath, the heart rate, the body temperature and the bed wetting of the baby through the sensor group;
the dynamic analysis module is used for performing combined analysis on the sound emitted by the baby and the facial information when the sound emitted by the baby is detected through the camera group and performing data acquisition on the surrounding environment information;
the position detection module is used for establishing a waypoint database of an infant activity space, realizing infant movement data acquisition by a gpsOne movement positioning technology, forming displacement data and generating three-dimensional positioning of infant position information in real time by combining the displacement data and the waypoint database;
the combination processing module is used for carrying out combination preprocessing on data formed by the physiological monitoring module, the dynamic analysis module and the position detection module and generating an execution signal of an emergency treatment measure;
and the control system is used for connecting the physiological monitoring module, the dynamic analysis module, the position detection module and the combination processing module, carrying out centralized processing on data generated by each module, feeding back the processed signals to the corresponding modules, and storing the data acquired by each module into a database.
2. The infant robot real-time monitoring system according to claim 1, further comprising an executing module, wherein the executing module comprises a manipulator for executing emergency treatment measures, and the executing module is connected with the combining processing module, receives an executing signal of the emergency treatment measures and executes corresponding actions, and the executing actions comprise actions of blocking splashes, assisting a fallen infant and adding and subtracting a quilt for the infant by using the manipulator.
3. The infant robot real-time monitoring system of claim 1, wherein the sensor group of the physiological monitoring module comprises a polyvinylidene fluoride piezoelectric film sensor for monitoring the respiration and heartbeat of the infant, a DS18B20 temperature sensor for measuring the body temperature of the infant, and a DHT11 humidity sensor for monitoring whether the infant is bedwetting.
4. The infant robot real-time monitoring system according to claim 1, wherein the camera group in the dynamic analysis module comprises a visual camera based on a convolutional neural network algorithm for capturing infant facial information and a wide-angle camera for collecting surrounding environment data, and the position detection module uses the collected data of the received wide-angle camera to establish a waypoint database.
5. The system of claim 1, wherein the position detection module combines the received facial information of the infant captured by the visual camera with a gpsone motion location technique to determine the moving track of the infant.
6. The system as claimed in claim 1, wherein the dynamic analysis module collects sound signals of the infant through a sound pick-up and an audio decoding chip, and pre-processes the collected sound signals before recognition through the DSP chip.
7. The system of claim 1, wherein the position detection module comprises a GPS receiver for importing the coordinates of the range of motion of the infant into an internal memory and establishing a waypoint database.
8. The infant robot real-time monitoring system according to claim 1, wherein the control system comprises an information matching module, a voice broadcasting module and a wireless communication module;
the information matching module is used for processing the information acquired by the physiological monitoring module, the dynamic analysis module, the position detection module and the combination processing module and performing information matching on the acquired information and the data which is stored in the database and comes from the cloud big data and relates to the abnormal state information of the infant;
the voice broadcasting module comprises an NVC voice chip for storing and controlling the playing of the prompt voice, an amplifier and a loudspeaker for carrying out audio conversion playing on the prompt voice;
and the wireless communication module is used for remotely connecting other terminal equipment and transmitting corresponding prompt information to the terminal equipment.
9. The infant robot real-time monitoring system according to claim 1, wherein the data collected by the safety monitoring module, the dynamic analysis module, the position detection module and the combination processing module, which are stored in the database of the control system, are used for updating, optimizing and upgrading the data in the database from the cloud big data.
10. The system of claim 1, wherein the dynamic analysis module combines the collected sound data of the infant and the facial information matched with the sound data to determine the real-time emotional state of the infant and convert the real-time emotional state into a corresponding data signal.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010111441.4A CN111281358A (en) | 2020-02-24 | 2020-02-24 | Real-time monitoring system of baby robot |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010111441.4A CN111281358A (en) | 2020-02-24 | 2020-02-24 | Real-time monitoring system of baby robot |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111281358A true CN111281358A (en) | 2020-06-16 |
Family
ID=71019255
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010111441.4A Pending CN111281358A (en) | 2020-02-24 | 2020-02-24 | Real-time monitoring system of baby robot |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111281358A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112037482A (en) * | 2020-08-31 | 2020-12-04 | 张建春 | Baby intelligence system of nursing at night |
| CN112057075A (en) * | 2020-08-17 | 2020-12-11 | 数智医疗(深圳)有限公司 | Monitoring system and monitoring method |
| CN112263365A (en) * | 2020-10-23 | 2021-01-26 | 中国人民解放军陆军军医大学第一附属医院 | Baby monitoring system |
| CN114710555A (en) * | 2022-06-06 | 2022-07-05 | 深圳市景创科技电子股份有限公司 | Infant monitoring method and device |
| CN115482836A (en) * | 2022-08-05 | 2022-12-16 | 深圳市景创科技电子股份有限公司 | Infant AI monitoring method and device |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070276270A1 (en) * | 2006-05-24 | 2007-11-29 | Bao Tran | Mesh network stroke monitoring appliance |
| CN107169297A (en) * | 2017-05-26 | 2017-09-15 | 上海理工大学 | A kind of health monitoring system based on home and community |
| CN107485521A (en) * | 2017-08-17 | 2017-12-19 | 马妍 | A kind of infantal sleeping capsule cabin |
| CN108769224A (en) * | 2018-05-23 | 2018-11-06 | 厦门波耐模型设计有限责任公司 | Si Qin robots Internet of things system |
| CN108992079A (en) * | 2018-06-12 | 2018-12-14 | 珠海格力电器股份有限公司 | Infant behavior monitoring method based on emotion recognition and voiceprint recognition |
| US20190200222A1 (en) * | 2017-12-22 | 2019-06-27 | Dish Network L.L.C. | Devices, systems, and processes for authenticating devices |
| CN110300946A (en) * | 2017-02-14 | 2019-10-01 | 微软技术许可有限责任公司 | Intelligent assistant |
-
2020
- 2020-02-24 CN CN202010111441.4A patent/CN111281358A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070276270A1 (en) * | 2006-05-24 | 2007-11-29 | Bao Tran | Mesh network stroke monitoring appliance |
| CN110300946A (en) * | 2017-02-14 | 2019-10-01 | 微软技术许可有限责任公司 | Intelligent assistant |
| CN110326261A (en) * | 2017-02-14 | 2019-10-11 | 微软技术许可有限责任公司 | Determine that the speaker in audio input changes |
| CN107169297A (en) * | 2017-05-26 | 2017-09-15 | 上海理工大学 | A kind of health monitoring system based on home and community |
| CN107485521A (en) * | 2017-08-17 | 2017-12-19 | 马妍 | A kind of infantal sleeping capsule cabin |
| US20190200222A1 (en) * | 2017-12-22 | 2019-06-27 | Dish Network L.L.C. | Devices, systems, and processes for authenticating devices |
| CN108769224A (en) * | 2018-05-23 | 2018-11-06 | 厦门波耐模型设计有限责任公司 | Si Qin robots Internet of things system |
| CN108992079A (en) * | 2018-06-12 | 2018-12-14 | 珠海格力电器股份有限公司 | Infant behavior monitoring method based on emotion recognition and voiceprint recognition |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112057075A (en) * | 2020-08-17 | 2020-12-11 | 数智医疗(深圳)有限公司 | Monitoring system and monitoring method |
| CN112037482A (en) * | 2020-08-31 | 2020-12-04 | 张建春 | Baby intelligence system of nursing at night |
| CN112263365A (en) * | 2020-10-23 | 2021-01-26 | 中国人民解放军陆军军医大学第一附属医院 | Baby monitoring system |
| CN112263365B (en) * | 2020-10-23 | 2022-11-04 | 中国人民解放军陆军军医大学第一附属医院 | Baby monitoring system |
| CN114710555A (en) * | 2022-06-06 | 2022-07-05 | 深圳市景创科技电子股份有限公司 | Infant monitoring method and device |
| CN115482836A (en) * | 2022-08-05 | 2022-12-16 | 深圳市景创科技电子股份有限公司 | Infant AI monitoring method and device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111281358A (en) | Real-time monitoring system of baby robot | |
| CN205211106U (en) | Can realize mobile terminal real -time communication's crib monitoring alarm system | |
| CN104966380A (en) | Alarm system and method capable of monitoring accidental tumble of human body | |
| CN105354975A (en) | Infanette monitoring and alarming system capable of real time communication with mobile terminal | |
| CN108024760B (en) | Wearable respiratory disease monitoring facilities | |
| CN109171734A (en) | Human body behavioural analysis cloud management system based on Fusion | |
| US20140091945A1 (en) | System and method for attachment free motion, respiration, heartbeat, and video monitoring | |
| CN201939498U (en) | Portable wireless electrocardio, cardiac sound and breath sound collecting terminal device | |
| CN101569526A (en) | Wearable low-load sleep recording device | |
| CN101627906A (en) | Portable multiparameter health monitoring system | |
| CN105455842A (en) | Intelligent auscultation system | |
| CN105796124A (en) | Mobile cardiophony system based on Internet of Things and method thereof | |
| CN106228015A (en) | A kind of healthy and safe monitor system of intelligent medical based on technology of Internet of things | |
| WO2017210955A1 (en) | Animal heart sound signal acquisition device and acquisition system | |
| Yu et al. | Intelligent wearable system with motion and emotion recognition based on digital twin technology | |
| CN113393936B (en) | Disabled elderly health monitoring system based on end-edge-cloud architecture | |
| CN106264507A (en) | A kind of health monitoring system based on motion capture | |
| CN215458018U (en) | Wearable equipment and musical instrument partner training system with same | |
| CN204274430U (en) | A kind of pregnant woman health environment monitoring device | |
| CN111714100A (en) | Dual-sensing vital sign monitoring system and method | |
| CN204169847U (en) | The long-range respiration monitoring system of Wearable | |
| CN106037712A (en) | Electrocardiogram monitoring alarm system having positioning function | |
| US20240008456A1 (en) | Wearable device for pet | |
| CN212592179U (en) | Intelligent stethoscope for vital sign monitoring | |
| CN107404626A (en) | A kind of video living transmission system based on robot |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200616 |