CN111916203A - Health detection method and device, electronic equipment and storage medium - Google Patents
Health detection method and device, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN111916203A CN111916203A CN202010560847.0A CN202010560847A CN111916203A CN 111916203 A CN111916203 A CN 111916203A CN 202010560847 A CN202010560847 A CN 202010560847A CN 111916203 A CN111916203 A CN 111916203A
- Authority
- CN
- China
- Prior art keywords
- face image
- determining
- distance
- health detection
- hearing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000001514 detection method Methods 0.000 title claims abstract description 63
- 230000036541 health Effects 0.000 title claims abstract description 55
- 210000001747 pupil Anatomy 0.000 claims abstract description 75
- 238000012360 testing method Methods 0.000 claims abstract description 61
- 230000008859 change Effects 0.000 claims abstract description 44
- 238000000034 method Methods 0.000 claims abstract description 13
- 230000002159 abnormal effect Effects 0.000 claims description 19
- 230000015654 memory Effects 0.000 claims description 19
- 238000004891 communication Methods 0.000 claims description 6
- 238000003745 diagnosis Methods 0.000 claims description 5
- 238000007689 inspection Methods 0.000 claims 2
- 210000003128 head Anatomy 0.000 abstract description 10
- 238000010586 diagram Methods 0.000 description 8
- 230000001815 facial effect Effects 0.000 description 8
- 230000009471 action Effects 0.000 description 6
- 208000011755 Hearing abnormality Diseases 0.000 description 4
- 238000004590 computer program Methods 0.000 description 4
- 230000006870 function Effects 0.000 description 4
- 230000004048 modification Effects 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 230000005856 abnormality Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 239000004973 liquid crystal related substance Substances 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 238000013473 artificial intelligence Methods 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 201000010099 disease Diseases 0.000 description 1
- 208000037265 diseases, disorders, signs and symptoms Diseases 0.000 description 1
- 230000008921 facial expression Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 230000010255 response to auditory stimulus Effects 0.000 description 1
- 230000001953 sensory effect Effects 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H50/00—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
- G16H50/20—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for computer-aided diagnosis, e.g. based on medical expert systems
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/12—Audiometering
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/161—Detection; Localisation; Normalisation
- G06V40/166—Detection; Localisation; Normalisation using acquisition arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/18—Eye characteristics, e.g. of the iris
- G06V40/19—Sensors therefor
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H30/00—ICT specially adapted for the handling or processing of medical images
- G16H30/20—ICT specially adapted for the handling or processing of medical images for handling medical images, e.g. DICOM, HL7 or PACS
Landscapes
- Engineering & Computer Science (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Medical Informatics (AREA)
- Physics & Mathematics (AREA)
- Public Health (AREA)
- Biomedical Technology (AREA)
- Multimedia (AREA)
- Life Sciences & Earth Sciences (AREA)
- Theoretical Computer Science (AREA)
- Primary Health Care (AREA)
- Human Computer Interaction (AREA)
- Epidemiology (AREA)
- Pathology (AREA)
- General Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Radiology & Medical Imaging (AREA)
- Biophysics (AREA)
- Heart & Thoracic Surgery (AREA)
- Molecular Biology (AREA)
- Surgery (AREA)
- Animal Behavior & Ethology (AREA)
- Veterinary Medicine (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Databases & Information Systems (AREA)
- Data Mining & Analysis (AREA)
- Ophthalmology & Optometry (AREA)
- Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
Abstract
The application discloses a health detection method and device, electronic equipment and a storage medium, and relates to the technical field of intelligent detection. The specific implementation scheme is as follows: sending a test sound, acquiring a first face image synchronously collected with the sent test sound, and acquiring a second face image collected after the test sound is sent; secondly, identifying the interpupillary distance of the first face image and the second face image respectively; and if the pupil distance change ratio of the second face image relative to the pupil distance of the first face image is greater than a threshold value, determining that the hearing is normal. According to the method, the approximate deflection degree and the deflection direction of the head of the tested user can be obtained according to the change proportion of the interpupillary distance in the images collected at the same time and after the test sound is sent out. Therefore, whether the tested object reflects the test sound can be deduced, so that the hearing of the infant group can be detected, and whether the hearing is normal or not can be determined.
Description
Technical Field
The present application relates to the field of artificial intelligence technologies, and in particular, to the field of intelligent detection technologies, and in particular, to a method and an apparatus for health detection, an electronic device, and a computer-readable storage medium.
Background
At present, in the infant period, whether the hearing of children is normal can be found only by detecting in a hospital. However, when the infant goes to the hospital, the infant is at risk of infecting other diseases, and it is very time-consuming for the parents to find the hospital and make a reservation for the hospital. Therefore, how to detect the hearing of the infant in time to determine whether the hearing of the infant is normal becomes a problem to be solved urgently.
Disclosure of Invention
A health detection method, a health detection device, an electronic device and a storage medium are provided.
According to a first aspect, there is provided a health detection method capable of knowing an approximate degree of deflection of a head of a user to be tested and a direction of deflection from a change ratio of a pupil distance in images acquired while and after a test sound is emitted. Therefore, whether the tested object reflects the test sound can be deduced, so that the hearing of the infant group can be detected, and whether the hearing is normal or not can be determined.
A second aspect of the present application provides a health detection apparatus.
A third aspect of the present application provides an electronic device.
A fourth aspect of the present application provides a non-transitory computer readable storage medium having computer instructions stored thereon.
An embodiment of a first aspect of the present application provides a health detection method, including: emitting a test sound; acquiring a first face image which is acquired synchronously with the emission of the test sound; acquiring a second face image acquired after the test sound is emitted; identifying interpupillary distances of the first face image and the second face image respectively; and if the change ratio of the pupil distance of the second face image relative to the pupil distance of the first face image is greater than a threshold value, determining that the hearing is normal.
According to the health detection method, the test sound is emitted; acquiring a first face image which is acquired synchronously with the emission of the test sound; acquiring a second face image acquired after the test sound is emitted; identifying interpupillary distances of the first face image and the second face image respectively; if the change proportion of the pupil distance of the second face image relative to the pupil distance of the first face image is larger than a threshold value, the hearing is determined to be normal, and the method can acquire the approximate deflection degree and the deflection direction of the head of the tested user according to the change proportion of the pupil distance in the images collected when and after the test sound is sent out. Therefore, whether the tested object reflects the test sound can be deduced, so that the hearing of the infant group can be detected, and whether the hearing is normal or not can be determined.
An embodiment of a second aspect of the present application provides a health detection apparatus, including: the control module is used for emitting a test sound; the first acquisition module is used for acquiring a first face image which is acquired synchronously with the emission of the test sound; the second acquisition module is used for acquiring a second face image acquired after the test sound is emitted; the recognition module is used for respectively recognizing the pupil distance of the first face image and the second face image; and the checking module is used for determining that the hearing is normal if the pupil distance change proportion of the second face image relative to the pupil distance of the first face image is greater than a threshold value.
An embodiment of a third aspect of the present application provides an electronic device, including: at least one camera module; at least one processor in communication with the at least one camera module; and a memory communicatively coupled to the at least one processor; wherein the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the health detection method as described above.
A fourth aspect of the present application is directed to a non-transitory computer readable storage medium storing computer instructions for causing a computer to perform the health detection method as described above.
It should be understood that the statements in this section do not necessarily identify key or critical features of the embodiments of the present disclosure, nor do they limit the scope of the present disclosure. Other features of the present disclosure will become apparent from the following description.
Drawings
The drawings are included to provide a better understanding of the present solution and are not intended to limit the present application. Wherein:
FIG. 1 is a schematic diagram according to a first embodiment of the present application;
FIG. 2 is a schematic diagram according to a second embodiment of the present application;
FIG. 3 is a schematic illustration according to a third embodiment of the present application;
FIG. 4 is a schematic illustration according to a fourth embodiment of the present application;
fig. 5 is a block diagram of an electronic device for implementing a health detection method according to an embodiment of the present application.
Detailed Description
The following description of the exemplary embodiments of the present application, taken in conjunction with the accompanying drawings, includes various details of the embodiments of the application for the understanding of the same, which are to be considered exemplary only. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the present application. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.
The following describes a health detection method, a health detection apparatus, an electronic device, and a storage medium according to embodiments of the present application with reference to the drawings.
Fig. 1 is a schematic diagram according to a first embodiment of the present application. It should be noted that the execution subject of the embodiment of the present application is a health detection apparatus, and the health detection apparatus may be configured in an electronic device, such as a PC (Personal Computer) or a mobile terminal (e.g., a mobile phone, a tablet Computer, and other hardware devices with various operating systems).
As shown in fig. 1, the health detection method is implemented as follows:
In the embodiment of the present application, the health detection device can provide sounds with different frequencies, tones and volumes, such as a soft song for children, a happy pure music for children, and the like.
As an example, while the health detection device emits the test sound, a face image of an infant may be captured by a camera of the health detection device, and the captured face image may be used as the first face image.
It can be understood that, in order to shoot the first face image synchronously collected with the emitted test sound in time, in the embodiment of the present application, before the health detection device emits the test sound, if it is detected that the detected object is not in the shot image, the shooting direction of the camera in the health detection device may be adjusted, and the shot image is collected; and if the detected object is in the shot image, stopping adjusting the shooting direction. For example, a 360-degree rotation monitoring camera can be adopted, the position of the infant is determined through posture and face scanning, if the infant is in the shooting range, the shooting direction of the camera is stopped to be adjusted, and if the infant is not in the shooting range, the shooting direction is continuously adjusted until the infant is in the shooting range.
And 103, acquiring a second face image acquired after the test sound is emitted.
It should be understood that an infant with normal hearing will have the related actions of looking for a sound source, such as a change in facial expression, head rotation, etc., after hearing the test sound. Therefore, in the embodiment of the present application, after the health detection device emits the test sound, the face image of the infant may be captured by the camera, and the captured face image is used as the second face image. It should be noted that the second face image may be one frame or multiple frames, and a continuous multiple frame of the same second face image may be used as one frame of the second face image.
And 104, identifying the interpupillary distance of the first face image and the second face image respectively.
Optionally, respectively performing face key point recognition on the first face image and the second face image to obtain target key points corresponding to the two eyes; taking the distance between target key points corresponding to two eyes in a first face image as the interpupillary distance of the first face image; and taking the distance between the target key points corresponding to the two eyes in the second face image as the interpupillary distance of the second face image.
That is to say, in order to better identify the interpupillary distance between the first face image and the second face image, in the embodiment of the present application, the face key point identification algorithm may be used to perform face key point identification on the first face image and the second face image respectively, so as to obtain the target key points of the two eyes corresponding to the first face image and the second face image, for example, the pupils of the two eyes, and then, the distance between the target key points of the two eyes corresponding to the first face image is measured, and the distance is used as the interpupillary distance of the first face image; and simultaneously, measuring the distance between the target key points corresponding to the two eyes in the second face image, and taking the distance as the interpupillary distance of the second face image.
And 105, if the change ratio of the pupil distance of the second face image relative to the pupil distance of the first face image is larger than a threshold value, determining that the hearing is normal.
In this embodiment of the application, the second face image may be one or more frames, and the interpupillary distance of the second face image may be compared with the interpupillary distance of the first face image by using different methods according to the difference in the number of frames of the second face image.
As an example, when the second face image is a frame, the pupil distance of the second face image can be directly compared with the pupil distance of the first face image, and the pupil distance change proportion of the second face image relative to the pupil distance of the first face image is obtained, because the eyes also rotate when the head of the human body rotates, therefore, the approximate deflection degree and direction of the head of the user to be tested can be known according to the pupil distance change proportion of the second face image relative to the pupil distance change proportion of the first face image, if the pupil distance change proportion of the second face image relative to the pupil distance change proportion of the first face image is greater than a threshold value, the object to be tested can be inferred to make an action of searching for a sound source to the test sound, and then the hearing is determined to be normal. For example, the interpupillary distance of the second face image is greater than that of the first face image, and the increase ratio of the interpupillary distance of the second face image to that of the first face image is greater than a threshold, so that the tested object can be inferred to perform an action of searching for a sound source for the test sound, and then it is determined that the hearing is normal. If the change proportion of the pupil distance of the second face image relative to the pupil distance of the first face image is smaller than or equal to the threshold value, or the pupil distance of the second face image is smaller than or equal to the pupil distance of the first face image, it can be inferred that the tested object does not make an action of searching for the sound source to the test sound, and then the hearing is determined to be abnormal.
As another example, when the second face images are multiple frames, in order to improve the hearing detection accuracy of the infant group, the pupil distance of each frame of the second face image may be compared with the pupil distance of the first face image to obtain a change ratio of the pupil distance of each frame of the second face image relative to the pupil distance of the first face image, and if the change ratio of the pupil distance of each frame of the second face image relative to the pupil distance of the first face image is greater than a corresponding threshold, it may be inferred that the tested object performs an action of searching for a sound source on the test sound, so as to determine that the hearing is normal. If the change proportion of the pupil distance of each frame of second face image relative to the pupil distance of the first face image is not larger than the corresponding threshold value, or the pupil distance of a certain frame of second face image relative to the pupil distance of the first face image is smaller than or equal to the pupil distance of the first face image, the fact that the tested object does not make an action of searching for a sound source for the test sound can be inferred, and then the hearing is determined to be abnormal.
It should be understood that, before comparing the change ratio of the interpupillary distance of the second face image relative to the interpupillary distance of the first face image with the threshold, the threshold may be obtained first.
Optionally, the threshold is determined according to a time difference between a first acquisition time of the first facial image and a second acquisition time of the second facial image. For details, see the description of the following embodiments.
In summary, according to the variation ratio of the pupil distance in the images collected at the same time and after the test sound is emitted, the approximate deflection degree and deflection direction of the head of the tested user can be obtained. Therefore, whether the tested object reflects the test sound can be deduced, so that the hearing of the infant group can be detected, and whether the hearing is normal or not can be determined.
In order to detect the hearing of the infant in time to determine whether the hearing of the infant is normal and improve the accuracy of the hearing detection of the infant, the change ratio of the pupil distance of the second face image relative to the pupil distance of the first face image may be compared with a threshold to determine whether the hearing is normal, in an embodiment of the present application, as shown in fig. 2, fig. 2 is a schematic diagram according to a second embodiment of the present application, before the change ratio of the pupil distance of the second face image relative to the pupil distance of the first face image is compared with the threshold, considering that a human body has a delay time in response to sound, the threshold may be determined according to a time difference between a first acquisition time of the first face image and a second acquisition time of the second face image, so that the accuracy of the threshold may be improved. Before step 105 of the embodiment shown in fig. 1, the following steps may be further included:
In the embodiment of the application, the health detection device can record and store the time when the camera collects the first face image and the second face image, and the collection time of the first face image is used as the first collection time, and the collection time of the second face image is used as the second collection time.
In the embodiment of the application, the second face image may be one frame or multiple frames, and the time difference between the first acquisition time and the second acquisition time may be determined by different methods according to the difference of the number of frames of the second face image, so as to determine the threshold. And the plurality of frames of the same second face images can be used as one frame of the second face image.
As an example, when the second face image is a frame, the difference between the first acquisition time and the second acquisition time may be directly performed to obtain a time difference between the first acquisition time and the second acquisition time, and a threshold is set according to the time difference. Note that, the greater the time difference between the first acquisition time and the second acquisition time, the greater the possibility that the second face image acquired after the test sound is emitted is not a face image of a sound source sought by an infant, and therefore, the greater the threshold value set based on the time difference. For example, the time difference between the first acquisition time and the second acquisition time is 1 second, and a threshold value corresponding to the time difference may be set to be 10%; for another example, the time difference between the first acquisition time and the second acquisition time is 5 seconds, and the threshold may be set to 30% corresponding to the time difference.
As another example, when the second face images are multiple frames, the difference between the first acquisition time and the acquisition time of each frame of the second face image may be performed to obtain a time difference between the first acquisition time and the acquisition time of each frame of the second face image, and according to the time difference, a threshold corresponding to each frame of the second face image may be set. For example, the time difference between the first acquisition time and the acquisition time of the first frame of the second facial image is 1 second, the corresponding threshold value corresponding to the time difference is set to be 10%, the time difference between the first acquisition time and the acquisition time of the third frame of the second facial image is 3 seconds, and the corresponding threshold value corresponding to the time difference is set to be 20%.
In summary, the threshold is determined according to the time difference between the first acquisition time of the first facial image and the second acquisition time of the second facial image, so that the accuracy of the threshold can be improved, further, the pupil distance change ratio of the second facial image relative to the pupil distance change ratio of the first facial image is compared with the threshold, whether the tested object reflects the test sound can be inferred, so as to determine whether the hearing is normal, thereby realizing the detection of the hearing of the infant group, determining whether the hearing of the infant group is normal, and improving the accuracy of the hearing detection of the infant group.
In order to improve usability and feasibility of the embodiment of the present application, in the embodiment of the present application, as shown in fig. 3, fig. 3 is a schematic diagram according to a third embodiment of the present application, in which a change ratio of a pupil distance of a second face image relative to a pupil distance of a first face image is compared with a threshold, and when it is determined that hearing of an infant is abnormal, an abnormal prompt may be sent to a mobile terminal, which is specifically implemented as follows:
And step 304, identifying the interpupillary distance of the first face image and the second face image respectively.
And 305, if the change ratio of the pupil distance of the second face image relative to the pupil distance of the first face image is greater than a threshold value, determining that the hearing is normal.
And step 306, if the change ratio of the interpupillary distance of the second face image to the interpupillary distance of the first face image is smaller than or equal to a threshold value, or the interpupillary distance of the second face image is smaller than or equal to the interpupillary distance of the first face image, determining that the hearing is abnormal.
In the embodiment of the present application, steps 301 to 306 can refer to steps 101 to 105 of the embodiment described in fig. 1, and are not described in detail herein.
And 307, sending an abnormal prompt to the mobile terminal, wherein the abnormal prompt is used for searching and displaying diagnosis and treatment information.
In the embodiment of the application, when hearing abnormality is determined, an abnormality prompt can be sent to the mobile terminal in a message sending mode, and parents of infants can search and display diagnosis and treatment information according to the abnormality prompt.
In summary, according to the variation ratio of the pupil distance in the images collected at the same time and after the test sound is emitted, the approximate deflection degree and deflection direction of the head of the tested user can be obtained. Therefore, whether the tested object reflects the test sound can be deduced, so that the hearing of the infant group can be detected, whether the hearing is normal or not can be determined, and the hearing abnormality prompt can be performed on parents of the infant when the hearing is abnormal.
According to the health detection method, the test sound is emitted; acquiring a first face image which is acquired synchronously with the emission of the test sound; acquiring a second face image acquired after the test sound is emitted; identifying pupil distances of the first face image and the second face image respectively; if the change proportion of the pupil distance of the second face image relative to the pupil distance of the first face image is larger than the threshold value, the hearing is determined to be normal, and the method can acquire the approximate deflection degree and the deflection direction of the head of the tested user according to the change proportion of the pupil distance in the images collected when and after the test sound is sent out. Therefore, whether the tested object reflects the test sound can be deduced, so that the hearing of the infant group can be detected, whether the hearing is normal or not can be determined, and the hearing abnormality prompt can be performed on parents of the infant when the hearing is abnormal.
In order to implement the above embodiments, the present application further provides a health detection apparatus.
Fig. 4 is a schematic diagram according to a fourth embodiment of the present application. As shown in fig. 4, the health detection apparatus 400 includes: a control module 410, a first acquisition module 420, a second acquisition module 430, an identification module 440, and a checking module 450.
The control module 410 is used for emitting a test sound; a first obtaining module 420, configured to obtain a first face image acquired synchronously with emission of the test sound; a second obtaining module 430, configured to obtain a second face image collected after the test sound is emitted; the recognition module 440 is configured to recognize pupil distances of the first face image and the second face image respectively; the checking module 450 is configured to determine that the hearing is normal if the change ratio of the interpupillary distance of the second face image to the interpupillary distance of the first face image is greater than a threshold.
As a possible implementation manner of the embodiment of the present application, the health detection apparatus 400 further includes: and determining a module.
The determining module is used for determining a first acquisition moment of a first face image; determining a second acquisition moment of a second face image; and determining a threshold value according to the time difference between the first acquisition time and the second acquisition time.
As a possible implementation manner of the embodiment of the application, the determining module is specifically configured to determine a threshold corresponding to each frame of the second face image according to a time difference between the first acquisition time and the acquisition time of each frame of the second face image; the checking module 450 is specifically configured to obtain the change ratio of each frame of the second face image; and if the change proportion of each frame of second face image is larger than the corresponding threshold value, determining that the hearing is normal.
As a possible implementation manner of the embodiment of the present application, the determining module is further configured to determine that the interpupillary distance of the second face image is greater than the interpupillary distance of the first face image.
As a possible implementation manner of the embodiment of the present application, the health detection apparatus 400 further includes: and a sending module.
The checking module 450 is configured to determine that the hearing is abnormal if a change ratio of the pupil distance of the second face image to the pupil distance of the first face image is smaller than or equal to a threshold, or the pupil distance of the second face image is smaller than or equal to the pupil distance of the first face image; and the sending module is used for sending an abnormal prompt to the mobile terminal, wherein the abnormal prompt is used for searching and displaying the diagnosis and treatment information.
As a possible implementation manner of the embodiment of the present application, the recognition module 440 is specifically configured to perform face key point recognition on the first face image and the second face image respectively to obtain target key points corresponding to two eyes; taking the distance between target key points corresponding to two eyes in the first face image as the interpupillary distance of the first face image; and taking the distance between the target key points corresponding to the two eyes in the second face image as the interpupillary distance of the second face image.
As a possible implementation manner of the embodiment of the present application, the health detection apparatus 400 further includes: and an adjusting module.
The adjusting module is used for adjusting the shooting direction and acquiring a shot image; and if the detected object is in the shot image, stopping adjusting the shooting direction.
The health detection device of the embodiment of the application emits the test sound; acquiring a first face image which is acquired synchronously with the emission of the test sound; acquiring a second face image acquired after the test sound is emitted; identifying pupil distances of the first face image and the second face image respectively; if the pupil distance change proportion of the second face image relative to the pupil distance of the first face image is larger than the threshold value, the hearing is determined to be normal, and the device can acquire the approximate deflection degree and deflection direction of the head of the tested user according to the change proportion of the pupil distance in the image collected when and after the test sound is sent out. Therefore, whether the tested object reflects the test sound can be deduced, so that the hearing of the infant group can be detected, whether the hearing is normal or not can be determined, and the hearing abnormality prompt can be performed on parents of the infant when the hearing is abnormal.
According to an embodiment of the present application, an electronic device and a readable storage medium are also provided.
Fig. 5 is a block diagram of an electronic device according to an embodiment of the present application. Electronic devices are intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. The electronic device may also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be examples only, and are not meant to limit implementations of the present application that are described and/or claimed herein.
As shown in fig. 5, the electronic apparatus includes: one or more processors 501, memory 502, and interfaces for connecting the various components, including high-speed interfaces and low-speed interfaces. The various components are interconnected using different buses and may be mounted on a common motherboard or in other manners as desired. The processor may process instructions for execution within the electronic device, including instructions stored in or on the memory to display graphical information of a GUI on an external input/output apparatus (such as a display device coupled to the interface). In other embodiments, multiple processors and/or multiple buses may be used, along with multiple memories and multiple memories, as desired. Also, multiple electronic devices may be connected, with each device providing portions of the necessary operations (e.g., as a server array, a group of blade servers, or a multi-processor system). In fig. 5, one processor 501 is taken as an example.
The memory 502, which is a non-transitory computer readable storage medium, may be used to store non-transitory software programs, non-transitory computer executable programs, and modules, such as program instructions/modules (e.g., the control module 410, the first obtaining module 420, the second obtaining module 430, the identification module 440, and the checking module 450 shown in fig. 4) corresponding to the health detection method in the embodiments of the present application. The processor 501 executes various functional applications of the server and data processing by running non-transitory software programs, instructions and modules stored in the memory 502, that is, implements the health detection method in the above method embodiments.
The memory 502 may include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function; the storage data area may store data created from use of the electronic device for health detection, and the like. Further, the memory 502 may include high speed random access memory, and may also include non-transitory memory, such as at least one magnetic disk storage device, flash memory device, or other non-transitory solid state storage device. In some embodiments, memory 502 optionally includes memory located remotely from processor 501, which may be connected to the health-detection electronics over a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The electronic device of the health detection method may further include: an input device 503 and an output device 504. The processor 501, the memory 502, the input device 503 and the output device 504 may be connected by a bus or other means, and fig. 5 illustrates the connection by a bus as an example.
The input device 503 may receive input numeric or character information and generate key signal inputs related to user settings and function control of the health-testing electronic apparatus, such as a touch screen, a keypad, a mouse, a track pad, a touch pad, a pointing stick, one or more mouse buttons, a track ball, a joystick, or other input devices. The output devices 504 may include a display device, auxiliary lighting devices (e.g., LEDs), and haptic feedback devices (e.g., vibrating motors), among others. The display device may include, but is not limited to, a Liquid Crystal Display (LCD), a Light Emitting Diode (LED) display, and a plasma display. In some implementations, the display device can be a touch screen.
Various implementations of the systems and techniques described here can be realized in digital electronic circuitry, integrated circuitry, application specific ASICs (application specific integrated circuits), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs that are executable and/or interpretable on a programmable system including at least one programmable processor, which may be special or general purpose, receiving data and instructions from, and transmitting data and instructions to, a storage system, at least one input device, and at least one output device.
These computer programs (also known as programs, software applications, or code) include machine instructions for a programmable processor, and may be implemented using high-level procedural and/or object-oriented programming languages, and/or assembly/machine languages. As used herein, the terms "machine-readable medium" and "computer-readable medium" refer to any computer program product, apparatus, and/or device (e.g., magnetic discs, optical disks, memory, Programmable Logic Devices (PLDs)) used to provide machine instructions and/or data to a programmable processor, including a machine-readable medium that receives machine instructions as a machine-readable signal. The term "machine-readable signal" refers to any signal used to provide machine instructions and/or data to a programmable processor.
To provide for interaction with a user, the systems and techniques described here can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to a user; and a keyboard and a pointing device (e.g., a mouse or a trackball) by which a user can provide input to the computer. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form, including acoustic, speech, or tactile input.
The systems and techniques described here can be implemented in a computing system that includes a back-end component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such back-end, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local Area Networks (LANs), Wide Area Networks (WANs), and the Internet.
The computer system may include clients and servers. A client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other.
It should be understood that various forms of the flows shown above may be used, with steps reordered, added, or deleted. For example, the steps described in the present application may be executed in parallel, sequentially, or in different orders, and the present invention is not limited thereto as long as the desired results of the technical solutions disclosed in the present application can be achieved.
The above-described embodiments should not be construed as limiting the scope of the present application. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions may be made in accordance with design requirements and other factors. Any modification, equivalent replacement, and improvement made within the spirit and principle of the present application shall be included in the protection scope of the present application.
Claims (16)
1. A health detection method, comprising:
emitting a test sound;
acquiring a first face image which is acquired synchronously with the emission of the test sound;
acquiring a second face image acquired after the test sound is emitted;
identifying interpupillary distances of the first face image and the second face image respectively;
and if the change ratio of the pupil distance of the second face image relative to the pupil distance of the first face image is greater than a threshold value, determining that the hearing is normal.
2. The health detection method according to claim 1, wherein if the ratio of the change in the interpupillary distance of the second face image with respect to the interpupillary distance of the first face image is greater than a threshold value, before determining that the hearing is normal, the method further comprises:
determining a first acquisition time of the first face image;
determining a second acquisition moment of the second face image;
and determining the threshold value according to the time difference between the first acquisition time and the second acquisition time.
3. The health detection method according to claim 2, wherein the second face image is a plurality of frames, and wherein the determining the threshold value according to the time difference between the first acquisition time and the second acquisition time comprises:
determining the threshold corresponding to each frame of the second face image according to the time difference between the first acquisition time and the acquisition time of each frame of the second face image;
if the pupil distance change proportion of the second face image relative to the pupil distance of the first face image is greater than a threshold value, determining that the hearing is normal, including:
acquiring the change proportion of each frame of the second face image;
and if the change proportion of each frame of the second face image is larger than the corresponding threshold value, determining that the hearing is normal.
4. The health detection method as set forth in any one of claims 1-3, wherein the determining that the hearing is normal further comprises:
and determining that the pupil distance of the second face image is larger than that of the first face image.
5. The health detection method as set forth in claim 4, wherein, after the identifying interpupillary distances for the first and second face images, respectively, further includes:
if the change ratio of the pupil distance of the second face image to the pupil distance of the first face image is smaller than or equal to the threshold value, or the pupil distance of the second face image is smaller than or equal to the pupil distance of the first face image, determining that the hearing is abnormal;
and sending an abnormal prompt to the mobile terminal, wherein the abnormal prompt is used for searching and displaying diagnosis and treatment information.
6. The health detection method as claimed in any one of claims 1 to 3, wherein said identifying interpupillary distances for the first and second face images, respectively, comprises:
respectively carrying out face key point recognition on the first face image and the second face image to obtain target key points corresponding to two eyes;
taking the distance between the target key points corresponding to the two eyes in the first face image as the interpupillary distance of the first face image;
and taking the distance between the target key points corresponding to the two eyes in the second face image as the interpupillary distance of the second face image.
7. The health detection method as in any of claims 1-3, wherein prior to said controlling the detection device to emit the test sound, further comprising:
adjusting the shooting direction and collecting a shot image;
and if the detected object is in the shot image, stopping adjusting the shooting direction.
8. A health detection device comprising:
the control module is used for emitting a test sound;
the first acquisition module is used for acquiring a first face image which is acquired synchronously with the emission of the test sound;
the second acquisition module is used for acquiring a second face image acquired after the test sound is emitted;
the recognition module is used for respectively recognizing the pupil distance of the first face image and the second face image;
and the checking module is used for determining that the hearing is normal if the pupil distance change proportion of the second face image relative to the pupil distance of the first face image is greater than a threshold value.
9. The health detection device as in claim 8, wherein said device further comprises:
the determining module is used for determining a first acquisition moment of the first face image; determining a second acquisition moment of the second face image; and determining the threshold value according to the time difference between the first acquisition time and the second acquisition time.
10. The health detection device as claimed in claim 9, wherein the determination module is specifically configured to:
determining the threshold corresponding to each frame of the second face image according to the time difference between the first acquisition time and the acquisition time of each frame of the second face image;
the inspection module is specifically configured to:
acquiring the change proportion of each frame of the second face image;
and if the change proportion of each frame of the second face image is larger than the corresponding threshold value, determining that the hearing is normal.
11. The health detection device as in any of claims 8-10, wherein the determination module is further to,
and determining that the pupil distance of the second face image is larger than that of the first face image.
12. The health detection device as in claim 11, wherein said device further comprises: a sending module;
the inspection module is used for determining that the hearing is abnormal if the change ratio of the interpupillary distance of the second face image relative to the interpupillary distance of the first face image is smaller than or equal to the threshold;
the sending module is used for sending an abnormal prompt to the mobile terminal, wherein the abnormal prompt is used for searching and displaying diagnosis and treatment information.
13. The health detection device as claimed in any one of claims 8-10, wherein said identification module is specifically configured to:
respectively carrying out face key point recognition on the first face image and the second face image to obtain target key points corresponding to two eyes;
taking the distance between the target key points corresponding to the two eyes in the first face image as the interpupillary distance of the first face image;
and taking the distance between the target key points corresponding to the two eyes in the second face image as the interpupillary distance of the second face image.
14. The health detection device as in any of claims 8-10, wherein said device further comprises: an adjustment module;
the adjusting module is used for adjusting the shooting direction and acquiring a shot image; and if the detected object is in the shot image, stopping adjusting the shooting direction.
15. An electronic device, comprising:
at least one camera module;
at least one processor in communication with the at least one camera module; and
a memory communicatively coupled to the at least one processor; wherein,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the health detection method of any of claims 1-7.
16. A non-transitory computer readable storage medium storing computer instructions for causing a computer to perform the health detection method of any one of claims 1-7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010560847.0A CN111916203B (en) | 2020-06-18 | 2020-06-18 | Health detection method, apparatus, electronic device and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010560847.0A CN111916203B (en) | 2020-06-18 | 2020-06-18 | Health detection method, apparatus, electronic device and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111916203A true CN111916203A (en) | 2020-11-10 |
| CN111916203B CN111916203B (en) | 2024-05-14 |
Family
ID=73237969
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010560847.0A Active CN111916203B (en) | 2020-06-18 | 2020-06-18 | Health detection method, apparatus, electronic device and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111916203B (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113347547A (en) * | 2021-04-26 | 2021-09-03 | 南京琅声声学科技有限公司 | Test audio playing method based on sound amplification system and debugging method thereof |
| CN113425292A (en) * | 2021-06-25 | 2021-09-24 | 四川大学华西医院 | Infant hearing screening method and device |
| CN113610205A (en) * | 2021-07-15 | 2021-11-05 | 深圳宇晰科技有限公司 | Two-dimensional code generation method and device based on machine vision and storage medium |
Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2006007632A1 (en) * | 2004-07-16 | 2006-01-26 | Era Centre Pty Ltd | A method for diagnostic home testing of hearing impairment, and related developmental problems in infants, toddlers, and children |
| US20120283594A1 (en) * | 2009-12-15 | 2012-11-08 | Uhlen Inger | Method for determining hearing thresholds |
| WO2013023056A1 (en) * | 2011-08-09 | 2013-02-14 | Ohio University | Pupillometric assessment of language comprehension |
| CN108509905A (en) * | 2018-03-30 | 2018-09-07 | 百度在线网络技术（北京）有限公司 | Health state evaluation method, apparatus, electronic equipment and storage medium |
| US20180368741A1 (en) * | 2017-06-22 | 2018-12-27 | National Tsing Hua University | Hearing diagnosis device and hearing diagnosis method |
| CN109800555A (en) * | 2019-02-22 | 2019-05-24 | 百度在线网络技术（北京）有限公司 | Access control method and device |
| CN109886852A (en) * | 2019-02-27 | 2019-06-14 | 江苏艾什顿科技有限公司 | Face datection recognition capability Training Methodology, device, equipment, medium and system |
| CN109951783A (en) * | 2017-11-06 | 2019-06-28 | 奥迪康有限公司 | For the method based on pupil information adjustment hearing aid configuration |
| US20200129094A1 (en) * | 2017-03-15 | 2020-04-30 | Steven Brian Levine | Diagnostic hearing health assessment system and method |
| US20200151432A1 (en) * | 2018-11-14 | 2020-05-14 | Baidu Usa Llc | Children face distance alert system |
| CN111177453A (en) * | 2020-01-07 | 2020-05-19 | 百度在线网络技术（北京）有限公司 | Method, device and equipment for controlling audio playing and computer readable storage medium |
-
2020
- 2020-06-18 CN CN202010560847.0A patent/CN111916203B/en active Active
Patent Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2006007632A1 (en) * | 2004-07-16 | 2006-01-26 | Era Centre Pty Ltd | A method for diagnostic home testing of hearing impairment, and related developmental problems in infants, toddlers, and children |
| US20120283594A1 (en) * | 2009-12-15 | 2012-11-08 | Uhlen Inger | Method for determining hearing thresholds |
| WO2013023056A1 (en) * | 2011-08-09 | 2013-02-14 | Ohio University | Pupillometric assessment of language comprehension |
| CN103857347A (en) * | 2011-08-09 | 2014-06-11 | 俄亥俄大学 | Pupillometric assessment of language comprehension |
| US20200129094A1 (en) * | 2017-03-15 | 2020-04-30 | Steven Brian Levine | Diagnostic hearing health assessment system and method |
| US20180368741A1 (en) * | 2017-06-22 | 2018-12-27 | National Tsing Hua University | Hearing diagnosis device and hearing diagnosis method |
| CN109951783A (en) * | 2017-11-06 | 2019-06-28 | 奥迪康有限公司 | For the method based on pupil information adjustment hearing aid configuration |
| CN108509905A (en) * | 2018-03-30 | 2018-09-07 | 百度在线网络技术（北京）有限公司 | Health state evaluation method, apparatus, electronic equipment and storage medium |
| US20200151432A1 (en) * | 2018-11-14 | 2020-05-14 | Baidu Usa Llc | Children face distance alert system |
| CN109800555A (en) * | 2019-02-22 | 2019-05-24 | 百度在线网络技术（北京）有限公司 | Access control method and device |
| CN109886852A (en) * | 2019-02-27 | 2019-06-14 | 江苏艾什顿科技有限公司 | Face datection recognition capability Training Methodology, device, equipment, medium and system |
| CN111177453A (en) * | 2020-01-07 | 2020-05-19 | 百度在线网络技术（北京）有限公司 | Method, device and equipment for controlling audio playing and computer readable storage medium |
Non-Patent Citations (3)
| Title |
|---|
| THOMAS KOELEWJIN ET AL: "Effects of attention on the speech reception threshold and pupil response of people with impaier and normal hearing", 《HEARING RESEARCH》, vol. 354, 31 October 2017 (2017-10-31) * |
| 方琼;: "联合听力筛查技术在婴幼儿听力筛查中的临床应用", 白求恩医学杂志, no. 05, 20 October 2019 (2019-10-20) * |
| 李慧等: "新生儿视听同步筛查程序和技术操作", 《听力学及语言疾病杂志》, no. 1, 15 March 2008 (2008-03-15) * |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113347547A (en) * | 2021-04-26 | 2021-09-03 | 南京琅声声学科技有限公司 | Test audio playing method based on sound amplification system and debugging method thereof |
| CN113347547B (en) * | 2021-04-26 | 2022-06-28 | 南京琅声声学科技有限公司 | Test audio playing method based on sound amplification system and debugging method thereof |
| CN113425292A (en) * | 2021-06-25 | 2021-09-24 | 四川大学华西医院 | Infant hearing screening method and device |
| CN113610205A (en) * | 2021-07-15 | 2021-11-05 | 深圳宇晰科技有限公司 | Two-dimensional code generation method and device based on machine vision and storage medium |
| CN113610205B (en) * | 2021-07-15 | 2022-12-27 | 深圳宇晰科技有限公司 | Two-dimensional code generation method and device based on machine vision and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111916203B (en) | 2024-05-14 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111916203B (en) | Health detection method, apparatus, electronic device and storage medium | |
| US9727135B2 (en) | Gaze calibration | |
| US11080554B2 (en) | Methods and systems for implant identification using imaging data | |
| CN113177928B (en) | Image identification method and device, electronic equipment and storage medium | |
| JP7490821B2 (en) | DETECTION METHOD, DETECTION DEVICE, ELECTRONIC DEVICE, STORAGE MEDIUM, AND COMPUTER PROGRAM | |
| CN111966224A (en) | Eye protection mode prompting method and device, electronic equipment and storage medium | |
| CN111695519A (en) | Key point positioning method, device, equipment and storage medium | |
| CN112561963A (en) | Target tracking method and device, road side equipment and storage medium | |
| CN110532999B (en) | Smoking behavior identification method, device and equipment | |
| CN113569671A (en) | Abnormal behavior alarm method and device | |
| CN113534945B (en) | Eyeball tracking calibration coefficient determination method, device, equipment and storage medium | |
| JP2008046801A (en) | Interest trend information output device, interest trend information output method and program | |
| CN112507833A (en) | Face recognition and model training method, device, equipment and storage medium | |
| CN111275121A (en) | Medical image processing method and device and electronic equipment | |
| CN113128436B (en) | Method and device for detecting key points | |
| EP4011296A1 (en) | Guiding system and guiding method for ultrasound scanning operation | |
| CN112150463B (en) | Method and device for determining macula fovea position | |
| CN112270303A (en) | Image recognition method and device and electronic equipment | |
| CN115762772B (en) | Method, device, equipment and storage medium for determining emotional characteristics of target object | |
| US11744462B2 (en) | Head-mounted vision detection equipment, vision detection method and electronic device | |
| CN112735601B (en) | Test method, device and equipment for determining infectious disease close-contact population by using Bluetooth | |
| CN116092616B (en) | Medical data transmission method, device, equipment and storage medium | |
| CN113495976A (en) | Content display method, device, equipment and storage medium | |
| US20190167158A1 (en) | Information processing apparatus | |
| CN117275713A (en) | Detection method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |