CN116019443B - Cardiopulmonary resuscitation chest compression compliance detection system and method - Google Patents
Cardiopulmonary resuscitation chest compression compliance detection system and method Download PDFInfo
- Publication number
- CN116019443B CN116019443B CN202211729849.3A CN202211729849A CN116019443B CN 116019443 B CN116019443 B CN 116019443B CN 202211729849 A CN202211729849 A CN 202211729849A CN 116019443 B CN116019443 B CN 116019443B
- Authority
- CN
- China
- Prior art keywords
- module
- data
- pressing
- compression
- acceleration
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000007906 compression Methods 0.000 title claims abstract description 120
- 230000006835 compression Effects 0.000 title claims abstract description 114
- 238000000034 method Methods 0.000 title claims abstract description 55
- 238000001514 detection method Methods 0.000 title claims abstract description 37
- 238000002680 cardiopulmonary resuscitation Methods 0.000 title claims description 24
- 230000003993 interaction Effects 0.000 claims abstract description 35
- 238000004891 communication Methods 0.000 claims abstract description 22
- 238000005259 measurement Methods 0.000 claims abstract description 17
- 238000005452 bending Methods 0.000 claims abstract description 11
- 238000003860 storage Methods 0.000 claims abstract description 5
- 210000000038 chest Anatomy 0.000 claims description 63
- 238000003825 pressing Methods 0.000 claims description 51
- 230000001133 acceleration Effects 0.000 claims description 44
- 230000008569 process Effects 0.000 claims description 20
- 238000006073 displacement reaction Methods 0.000 claims description 17
- 238000012549 training Methods 0.000 claims description 15
- 210000001562 sternum Anatomy 0.000 claims description 14
- 238000012545 processing Methods 0.000 claims description 13
- 239000000243 solution Substances 0.000 claims description 13
- 238000005070 sampling Methods 0.000 claims description 12
- 210000000707 wrist Anatomy 0.000 claims description 12
- 238000013500 data storage Methods 0.000 claims description 11
- 230000010354 integration Effects 0.000 claims description 11
- 239000013598 vector Substances 0.000 claims description 11
- 238000004364 calculation method Methods 0.000 claims description 10
- 230000033001 locomotion Effects 0.000 claims description 9
- 230000009466 transformation Effects 0.000 claims description 9
- 238000012937 correction Methods 0.000 claims description 8
- 238000010801 machine learning Methods 0.000 claims description 8
- 238000013528 artificial neural network Methods 0.000 claims description 7
- 230000011218 segmentation Effects 0.000 claims description 7
- 238000004458 analytical method Methods 0.000 claims description 6
- 238000012417 linear regression Methods 0.000 claims description 6
- 210000002569 neuron Anatomy 0.000 claims description 5
- ORILYTVJVMAKLC-UHFFFAOYSA-N Adamantane Natural products C1C(C2)CC3CC1CC2C3 ORILYTVJVMAKLC-UHFFFAOYSA-N 0.000 claims description 4
- 230000005540 biological transmission Effects 0.000 claims description 4
- 230000000694 effects Effects 0.000 claims description 4
- 238000010146 3D printing Methods 0.000 claims description 3
- 238000006243 chemical reaction Methods 0.000 claims description 3
- 230000006870 function Effects 0.000 claims description 3
- 238000001746 injection moulding Methods 0.000 claims description 3
- 238000007781 pre-processing Methods 0.000 claims description 3
- 230000001186 cumulative effect Effects 0.000 claims description 2
- 238000007599 discharging Methods 0.000 claims 1
- 238000012804 iterative process Methods 0.000 claims 1
- 238000007789 sealing Methods 0.000 claims 1
- 230000001131 transforming effect Effects 0.000 claims 1
- 238000012795 verification Methods 0.000 claims 1
- 238000011156 evaluation Methods 0.000 abstract description 3
- 230000036544 posture Effects 0.000 description 10
- 238000010586 diagram Methods 0.000 description 7
- 230000006872 improvement Effects 0.000 description 7
- 238000012544 monitoring process Methods 0.000 description 6
- 210000004247 hand Anatomy 0.000 description 4
- 230000002452 interceptive effect Effects 0.000 description 4
- 230000008859 change Effects 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 238000009423 ventilation Methods 0.000 description 3
- 230000006399 behavior Effects 0.000 description 2
- 239000008280 blood Substances 0.000 description 2
- 210000004369 blood Anatomy 0.000 description 2
- 230000000875 corresponding effect Effects 0.000 description 2
- 238000013480 data collection Methods 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 238000002474 experimental method Methods 0.000 description 2
- 230000005484 gravity Effects 0.000 description 2
- 210000000115 thoracic cavity Anatomy 0.000 description 2
- 238000010200 validation analysis Methods 0.000 description 2
- 238000010989 Bland-Altman Methods 0.000 description 1
- 206010008469 Chest discomfort Diseases 0.000 description 1
- 208000010496 Heart Arrest Diseases 0.000 description 1
- 101000827703 Homo sapiens Polyphosphoinositide phosphatase Proteins 0.000 description 1
- 102100023591 Polyphosphoinositide phosphatase Human genes 0.000 description 1
- 206010038669 Respiratory arrest Diseases 0.000 description 1
- 238000013473 artificial intelligence Methods 0.000 description 1
- QVGXLLKOCUKJST-UHFFFAOYSA-N atomic oxygen Chemical compound [O] QVGXLLKOCUKJST-UHFFFAOYSA-N 0.000 description 1
- 238000010009 beating Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 210000000481 breast Anatomy 0.000 description 1
- 230000002490 cerebral effect Effects 0.000 description 1
- 230000002596 correlated effect Effects 0.000 description 1
- 238000002790 cross-validation Methods 0.000 description 1
- 238000009826 distribution Methods 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
- 230000001788 irregular Effects 0.000 description 1
- 238000004898 kneading Methods 0.000 description 1
- 230000007774 longterm Effects 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 230000009347 mechanical transmission Effects 0.000 description 1
- 239000000203 mixture Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 229910052760 oxygen Inorganic materials 0.000 description 1
- 239000001301 oxygen Substances 0.000 description 1
- 230000008447 perception Effects 0.000 description 1
- 230000029058 respiratory gaseous exchange Effects 0.000 description 1
- 230000000717 retained effect Effects 0.000 description 1
- 230000015541 sensory perception of touch Effects 0.000 description 1
- 230000006403 short-term memory Effects 0.000 description 1
- 230000002269 spontaneous effect Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Landscapes
- Percussion Or Vibration Massage (AREA)
Abstract
本发明公开了一种用于胸外按压多维度指标合规性检测系统及方法,所述的辅助系统由设备壳体、橡胶绑带、语音交互模块、惯性测量单元模块、微控制器模块、通信模块、存储模块、触摸与显示模块、电源模块组成;所述的辅助方法包括按压深度检测方法、按压频率检测方法、手臂按压垂直度检测方法和手肘弯曲检测方法,实现对施救者的按压深度、频率、手臂与手肘姿态规范性的评估;本发明通过语音交互的方法,施救者通过语音信息触发和引导本辅助系统的启动和工作状态,系统通过语音信息对施救者进行指导,有效地提高胸外按压的质量,助力规范、精准、高效、智能的胸外按压医疗行为。
The present invention discloses a multi-dimensional indicator compliance detection system and method for chest compression. The auxiliary system is composed of an equipment shell, a rubber band, a voice interaction module, an inertial measurement unit module, a microcontroller module, a communication module, a storage module, a touch and display module, and a power module; the auxiliary method includes a compression depth detection method, a compression frequency detection method, an arm compression verticality detection method, and an elbow bending detection method, so as to realize the evaluation of the compression depth, frequency, and arm and elbow posture normativity of the rescuer; the present invention uses a voice interaction method, and the rescuer triggers and guides the startup and working state of the auxiliary system through voice information, and the system guides the rescuer through voice information, thereby effectively improving the quality of chest compression and facilitating standardized, accurate, efficient, and intelligent chest compression medical behavior.
Description
技术领域Technical Field
本发明属于智慧医疗、人工智能、仪器科学、计算机科学、传感器技术、人机交互技术等交叉领域,更为具体的讲,涉及一种心肺复苏胸外按压合规性检测系统及方法。The present invention belongs to the intersecting fields of smart medical care, artificial intelligence, instrument science, computer science, sensor technology, human-computer interaction technology, etc. More specifically, it relates to a cardiopulmonary resuscitation chest compression compliance detection system and method.
背景技术Background technique
心肺复苏(Cardiopulmonary Resuscitation,CPR)是对心脏骤停和呼吸暂停患者实行救治的一种医学技术,是一项最重要最基本的急救措施。心肺复苏术包含三大主要方面:胸外按压、体外通气、电击除颤。其中,胸外按压贯穿心肺复苏的始终,当心脏停搏后,人工胸外按压帮助患者建立体外循环,维持大脑血氧,并促进血液回流到心脏,帮助患者恢复自主循环,因此,胸外按压在心肺复苏中有着十分重要的作用。Cardiopulmonary Resuscitation (CPR) is a medical technology used to treat patients with cardiac arrest and respiratory arrest. It is the most important and basic first aid measure. Cardiopulmonary resuscitation includes three main aspects: chest compression, external ventilation, and electric defibrillation. Among them, chest compression runs through the entire process of cardiopulmonary resuscitation. When the heart stops beating, artificial chest compression helps the patient establish extracorporeal circulation, maintain cerebral blood oxygen, and promote blood return to the heart, helping the patient to restore autonomous circulation. Therefore, chest compression plays a very important role in cardiopulmonary resuscitation.
根据AHA指南建议,对成年人规范的胸外按压作如下要求:1、按压深度为50~60mm,频率为100~120次/分钟;2、按压后,要进行充分的胸压释放。除此之外,施救者需要保持按压与回弹的时间均衡,避免冲击式按压,按压时,手臂垂直向下施加压力作用于患者胸骨两乳连线中心,避免手肘弯曲与手臂按压倾斜,避免产生揉捻式按压与推挤式按压;According to the AHA guidelines, the following requirements are made for standard chest compressions for adults: 1. The compression depth is 50-60 mm and the frequency is 100-120 times/minute; 2. After compression, the chest pressure should be fully released. In addition, the rescuer needs to keep the compression and rebound time balanced to avoid impact compression. When pressing, the arm should apply pressure vertically downward to the center of the line connecting the patient's sternum and breasts, avoid bending the elbow and tilting the arm to avoid kneading and pushing compressions;
不少研究者认识到胸外按压过程中存在的非规范问题将影响心肺复苏的救治效果,研究并开发胸外按压辅助设备。发明专利CN114983794A设计一种胸外按压辅助设备,其形状为平板结构,内置加速度计和压力传感器,用于在胸外按压时,获取按压深度和胸腔弹性系数;该结构在工作时,需要放置在患者胸部与施救者手掌中间;一定程度上,影响了施救者与患者接触的真实感,获得的始终是按压辅助设备表面材质的触感。发明专利CN114404262A设计了一种穿戴式心肺复苏辅助设备,该设备类似于腕表结构,通过机械传动、齿轮、电机与接近传感器作为基础部件,实现在胸外按压时,评估按压的深度和频率,机械结构传动具有一定的复杂性。因此,为解决现有胸外按压辅助设备对胸外按压医疗行为质量监测维度少、检测设备对施救者存在干扰或引入不适,难以临床应用的问题,开发用于施救人员的穿戴式胸外按压多维度指标合规性检测系统及方法是本领域技术人员需要努力开展的工作。Many researchers have realized that non-standard problems in the process of chest compression will affect the treatment effect of cardiopulmonary resuscitation, and have studied and developed chest compression auxiliary equipment. Invention patent CN114983794A designs a chest compression auxiliary equipment, which is in the shape of a flat structure with a built-in accelerometer and pressure sensor, which is used to obtain the compression depth and chest elastic coefficient during chest compression; when the structure is working, it needs to be placed between the patient's chest and the rescuer's palm; to a certain extent, it affects the rescuer's sense of reality of contact with the patient, and what is obtained is always the touch of the surface material of the compression auxiliary equipment. Invention patent CN114404262A designs a wearable cardiopulmonary resuscitation auxiliary equipment, which is similar to the structure of a watch. It uses mechanical transmission, gears, motors and proximity sensors as basic components to evaluate the depth and frequency of compression during chest compression. The mechanical structure transmission has a certain complexity. Therefore, in order to solve the problems that existing chest compression auxiliary equipment has few dimensions for monitoring the quality of chest compression medical behavior, the detection equipment interferes with or causes discomfort to rescuers, and is difficult to use clinically, it is necessary for technical personnel in this field to develop a wearable chest compression multi-dimensional indicator compliance detection system and method for rescuers.
发明内容Summary of the invention
为解决上述技术问题,本发明提出了一种心肺复苏胸外按压合规性检测系统及方法,针对现有的胸外按压辅助设备采用贴放在患者胸骨,或夹持在施救者左右手中间,或有较复杂的机械结构,无法实现便捷地参与胸外按压辅助,并且存在对施救者的触觉产生干扰,引入不适,影响施救者对肋骨胸骨完好性、准确施力位置的判断,检测信息少,便捷交互性差的缺点。In order to solve the above technical problems, the present invention proposes a cardiopulmonary resuscitation chest compression compliance detection system and method. The existing chest compression auxiliary equipment is placed on the patient's sternum, or clamped between the rescuer's left and right hands, or has a more complex mechanical structure, which cannot realize convenient participation in chest compression assistance, and there is a problem of interfering with the rescuer's tactile sense, causing discomfort, affecting the rescuer's judgment on the integrity of the ribs and sternum and the accurate force application position, and has the disadvantages of less detection information and poor convenient interactivity.
为实现上述目的,本发明采取的技术方案是:To achieve the above object, the technical solution adopted by the present invention is:
本发明提供一种心肺复苏胸外按压合规性检测系统,由中央控制处理模块、惯性测量模块、语音交互模块、触控显示模块、电源模块、通信模块和数据存储模块组成:The present invention provides a cardiopulmonary resuscitation chest compression compliance detection system, which is composed of a central control processing module, an inertial measurement module, a voice interaction module, a touch display module, a power module, a communication module and a data storage module:
所述中央控制处理模块采用低功耗嵌入式微处理器,负责整个系统的逻辑控制、数据运算、算法部署,并与惯性测量模块、语音交互模块、触控显示模块、电源模块、通信模块和数据存储模块进行数据通信;The central control processing module adopts a low-power embedded microprocessor, which is responsible for the logic control, data calculation, and algorithm deployment of the entire system, and performs data communication with the inertial measurement module, voice interaction module, touch display module, power module, communication module, and data storage module;
所述的惯性测量模块是由加速度计、陀螺仪、磁力计构成的集成单元,能够测量系统附着体的三轴惯性数据,包括加速度、角速度、姿态四元数,所述惯性测量模块本身具有数据预处理功能,通过数据传输总线,将实时采集的惯性数据传输给中央控制处理模块,所述语音交互模块由语音交互控制器、咪头和微型扬声器组成;The inertial measurement module is an integrated unit composed of an accelerometer, a gyroscope, and a magnetometer, and can measure the three-axis inertial data of the system attachment, including acceleration, angular velocity, and attitude quaternion. The inertial measurement module itself has a data preprocessing function, and transmits the real-time collected inertial data to the central control processing module through a data transmission bus. The voice interaction module is composed of a voice interaction controller, a microphone, and a micro speaker;
所述的语音交互控制器部署所需要的心肺复苏场景下的语音交互指令和语音模型,语音交互模块通过咪头感知环境中施救者发出的语音指令,并通过微型扬声器给予施救者指导意见与实时反馈校正;The voice interaction controller deploys the required voice interaction instructions and voice models in the cardiopulmonary resuscitation scenario. The voice interaction module senses the voice instructions issued by the rescuer in the environment through the microphone, and gives the rescuer guidance and real-time feedback correction through the micro speaker.
所述的触控显示模块由微型触控屏、触摸驱动与显示驱动电路构成,在胸外按压开始前,通过所述的触控显示模块对辅助系统进行配置,在胸外按压完成后,通过触控显示模块查看按压指标检测统计信息;The touch display module is composed of a micro touch screen, a touch drive and a display drive circuit. Before the start of chest compression, the auxiliary system is configured through the touch display module. After the completion of chest compression, the compression index detection statistics are viewed through the touch display module.
所述的电源模块由电源变换模块、电池和充电模块组成,负责整个系统的供放电;The power module is composed of a power conversion module, a battery and a charging module, and is responsible for the power supply and discharge of the entire system;
所述的通信模块包括有线通信和无线通信,用于将节点的数据传输到网络设备或者PC设备上;数据存储模块用于存储实施采集的IMU数据和胸外按压过程状态数据相关信息。The communication module includes wired communication and wireless communication, which is used to transmit the node data to the network device or PC device; the data storage module is used to store the collected IMU data and chest compression process status data related information.
作为本发明辅助系统进一步改进:所述辅助系统配套壳体与橡胶绑带,所述的壳体由3D打印、注塑、或模具加工而成,壳体对外留出必要的人机交互界面以及接口,并将前述的各个模块封闭安装在壳体内,橡胶绑带用于连接壳体和施救者的手腕。As a further improvement of the auxiliary system of the present invention: the auxiliary system is equipped with a shell and a rubber strap, the shell is made by 3D printing, injection molding, or mold processing, the shell leaves necessary human-computer interaction interfaces and interfaces to the outside, and the aforementioned modules are sealed and installed in the shell, and the rubber strap is used to connect the shell and the rescuer's wrist.
作为本发明辅助系统进一步改进:所述低功耗嵌入式微处理器为单核或多核心处理器。As a further improvement to the auxiliary system of the present invention: the low-power embedded microprocessor is a single-core or multi-core processor.
作为本发明辅助系统进一步改进:所述触控显示模块在施加胸外按压时与语音交互模块配合进行视听反馈。As a further improvement of the auxiliary system of the present invention: the touch display module cooperates with the voice interaction module to provide audio-visual feedback when applying chest compressions.
作为本发明辅助系统进一步改进:所述数据存储模块选择TF存储卡作为外部存储设备。As a further improvement of the auxiliary system of the present invention: the data storage module selects a TF memory card as an external storage device.
本发明提供一种心肺复苏胸外按压合规性检测系统的方法,具体步骤如下:The present invention provides a method for a cardiopulmonary resuscitation chest compression compliance detection system, and the specific steps are as follows:
S1:腕带IMU节点的数据采集和分割,微控制器通过UART通信接口采集IMU输出的数据,分割数据并添加到数据窗口中;S1: Data collection and segmentation of wristband IMU node. The microcontroller collects the data output by IMU through the UART communication interface, segments the data and adds it to the data window;
S2:利用姿态四元数对获得的载体系下的加速度进行坐标变换;S2: Use the attitude quaternion to transform the acceleration of the load system;
S3:选择坐标变换后垂直方向上的加速度,进行梯形数值积分计算,然后将计算结果输入0.3Hz巴特沃斯高通滤波器去除趋势项,获得垂直方向上的速度;S3: Select the acceleration in the vertical direction after coordinate transformation, perform trapezoidal numerical integration calculation, and then input the calculation result into a 0.3 Hz Butterworth high-pass filter to remove the trend term to obtain the velocity in the vertical direction;
S4:对垂直方向上的速度进行分割为按压阶段与回弹阶段的速度曲线段;S4: dividing the velocity in the vertical direction into velocity curve segments of the pressing stage and the rebound stage;
S5:进行按压深度检测,对分割后的按压与回弹阶段的曲线进行梯形数值积分获取按压与回弹阶段的深度;S5: Performing compression depth detection, performing trapezoidal numerical integration on the segmented compression and rebound stage curves to obtain the compression and rebound stage depths;
S6:根据固定的采样率和S4中分割得到的速度曲线的数据点数,可求解获得按压与回弹消耗的时间;S6: According to the fixed sampling rate and the number of data points of the speed curve obtained by segmentation in S4, the time consumed by pressing and rebounding can be obtained;
S7:在假人模型胸腔内安装线性位移传感器,采集假人胸骨受到压迫而实际产生的胸骨凹陷距离;S7: Install a linear displacement sensor in the chest cavity of the dummy model to collect the actual sternum depression distance caused by the compression of the sternum of the dummy;
S8:获得连续的按压位移曲线,基于峰值检测、频域分析进行曲线特征辨识;S8: Obtain a continuous compression displacement curve, and identify the curve features based on peak detection and frequency domain analysis;
S9:根据曲线特征,求解按压与回弹过程中得参考深度、频率和用时;S9: According to the curve characteristics, the reference depth, frequency and time in the pressing and rebounding process are solved;
S10:将S9、S6、S5求解值和参考值进行对比,使用机器学习方法进行误差修正,S10: Compare the solution values of S9, S6, and S5 with the reference values, and use machine learning methods to correct errors.
以获得更加精确的按压深度和频率信息;To obtain more accurate compression depth and frequency information;
S11:将纵摇角作为特征向量,输入长短期记忆人工神经网络LSTM,进行序列辨识,通过手臂按压垂直度检测方法和手肘弯曲检测方法,检测手臂合规性。S11: The pitch angle is used as a feature vector and input into the long short-term memory artificial neural network LSTM for sequence recognition. The arm compliance is detected by the arm pressing verticality detection method and the elbow bending detection method.
作为本发明方法进一步改进,所述步骤S2的利用姿态四元数对获得的载体系下的加速度进行坐标变换的方法如下:As a further improvement of the method of the present invention, the method of using the attitude quaternion in step S2 to perform coordinate transformation on the acceleration obtained under the load system is as follows:
对实施采集的加速度,基于姿态四元数,求解坐标变换到地理坐标系下的三轴加速度,基于如下算法:For the acceleration collected, based on the attitude quaternion, the coordinate transformation to the three-axis acceleration in the geographic coordinate system is solved based on the following algorithm:
pbody=[0,abx,aby,abz]T p body =[0,a bx ,a by ,a bz ] T
pworld=q·pbody·q-1=q·pbody·q*/||q||2 p world =q·p body ·q -1 =q·p body ·q*/||q|| 2
其中,abx,aby,abz分别为IMU载体坐标系下的三轴加速度,pbody为一个虚四元数,描述载体系下的加速度,q是IMU测量得到的世界坐标系下的姿态四元数,pworld是世界坐标系下的加速度四元数,由于其也是一个虚四元数,取其虚部即可得到世界坐标系下的三轴加速度,三轴分别为东北天。Among them, a bx, a by , a bz are the three-axis accelerations in the IMU carrier coordinate system respectively, p body is a virtual quaternion that describes the acceleration in the carrier system, q is the attitude quaternion in the world coordinate system measured by the IMU, and p world is the acceleration quaternion in the world coordinate system. Since it is also a virtual quaternion, taking its imaginary part can obtain the three-axis acceleration in the world coordinate system. The three axes are northeast, south, east, and north.
作为本发明方法进一步改进,所述步骤S5的按压阶段的按压深度检测方法如下:基于如下公式:As a further improvement of the method of the present invention, the pressing depth detection method in the pressing stage of step S5 is as follows: based on the following formula:
其中a’是减去重力加速度后的偏置,anoise是宽频段的测量噪声,A(t),V(t)和D(t)是理想的由运动引起的加速度、速度和位移;Where a' is the offset after subtracting the gravity acceleration, a noise is the wide-band measurement noise, A(t), V(t) and D(t) are the ideal acceleration, velocity and displacement caused by motion;
按压阶段与回弹阶段的速度曲线段,在小段区间内再次进行梯形数值积分,求解得到每一周期中按压与回弹过程的运动位移Distance,由于采样率Sample和上述分割得到的速度序列长度Length可知,因此求解得到按压与回弹过程的用时t与速度v以及每分钟的平均频率f:The velocity curve segments of the pressing stage and the rebound stage are again integrated in a small interval to obtain the motion displacement Distance of the pressing and rebounding process in each cycle. Since the sampling rate Sample and the length of the velocity sequence Length obtained by the above division are known, the time t and velocity v of the pressing and rebounding process and the average frequency f per minute are obtained:
t=Length/Samplet=Length/Sample
v=Distance/tv=Distance/t
其中N为按压累积次数,t1为按压过程用时,t2为回弹过程用时,并引入机器学习回归算法来对按压深度误差进行修正,线性回归模型应用于修正按压深度求解值和参考值之间的误差,考虑有一组数据集{(xi,yi),i=1,2,…,n},其中xi是参考深度,yi是求解深度,线性回归模型基于如下形式:Where N is the cumulative number of compressions, t1 is the time taken for the compression process, and t2 is the time taken for the rebound process. A machine learning regression algorithm is introduced to correct the compression depth error. The linear regression model is used to correct the error between the compression depth solution value and the reference value. Considering a set of data sets {( xi , yi ), i = 1, 2, ..., n}, where xi is the reference depth and yi is the solution depth, the linear regression model is based on the following form:
y=xTβ+εy=x T β+ε
其中ε~N(0,σ2),误差变量σ2和参数向量β需要基于已有的数据集,通过训练与迭代确定其参数。Among them, ε~N(0,σ 2 ), error variable σ 2 and parameter vector β need to be determined based on the existing data set through training and iteration.
作为本发明方法进一步改进,所述步骤S11的手臂按压垂直度检测方法和手肘弯曲检测方法如下:As a further improvement of the method of the present invention, the arm pressing verticality detection method and elbow bending detection method in step S11 are as follows:
为了辨识施救者施压时手臂与手肘合规性,将IMU节点佩戴在施救者手腕,对纵摇角进行连续观测,记录一定时长的规范按压数据,即手臂与水平面夹角在γ1至γ2,γ1和γ2为判断是否合规的阈值;手臂倾斜按压数据,即手臂与水平面夹角在λ1到λ2之间,λ1和λ2为判断是否合规的阈值;手肘弯曲按压数据,即按压过程手肘不保持锁定,手肘夹角弯曲变化并手肘发力,前述获得的数据集将作为特征观测和模型训练数据;In order to identify the compliance of the rescuer's arm and elbow when applying pressure, the IMU node is worn on the rescuer's wrist, the pitch angle is continuously observed, and the standard pressing data for a certain period of time is recorded, that is, the angle between the arm and the horizontal plane is between γ 1 and γ 2 , γ 1 and γ 2 are the thresholds for judging compliance; arm tilt pressing data, that is, the angle between the arm and the horizontal plane is between λ 1 and λ 2 , λ 1 and λ 2 are the thresholds for judging compliance; elbow bending pressing data, that is, the elbow is not locked during the pressing process, the elbow angle changes and the elbow exerts force. The above-mentioned data sets will be used as feature observations and model training data;
使用LSTM对所述的模型训练数据序列的类别进行分类,LSTM能够将当前采样点历史一定时刻内的点集作为输入,挖掘这些连续点集构成的序列所述特征的类别;Use LSTM to classify the categories of the model training data sequence. LSTM can take the point set within a certain historical moment of the current sampling point as input and mine the category of the features of the sequence composed of these continuous point sets;
所述的LSTM神经网络结构由序列输入层、lstm层、全连接层、softmax层和分类层组成;输入层接收输入的序列作为特征向量,将纵摇角作为特征向量时,将输入层个数设为1,lstm层设置隐层层神经元个数,输出模式设置为序列输出。通过全连接层、softmax层与分类层,输出一段序列所属的类别;The LSTM neural network structure is composed of a sequence input layer, an lstm layer, a fully connected layer, a softmax layer and a classification layer; the input layer receives the input sequence as a feature vector. When the pitch angle is used as a feature vector, the number of input layers is set to 1, the number of neurons in the lstm layer is set, and the output mode is set to sequence output. Through the fully connected layer, the softmax layer and the classification layer, the category to which a sequence belongs is output;
使用adam算法进行训练,计算梯度的指数移动平均数、梯度平方的指数移动平均数:Use the adam algorithm for training to calculate the exponential moving average of the gradient and the exponential moving average of the square of the gradient:
其中β1、β2是梯度下降因子和均方梯度下降因子,adam使用移动平均更新网络参数:Among them, β 1 and β 2 are the gradient descent factors and mean square gradient descent factors, and Adam uses moving average to update the network parameters:
在模型训练过程前,调整神经元数量,以及上述算法公式中对应的求解器参数,观察验证集MSE的数值大小以及迭代过程中的MSE曲线图,当MSE不再收敛时,辨识效果即达到最优。MSE衡量预测值和真值标签之间的相同的描述性统计:Before the model training process, adjust the number of neurons and the corresponding solver parameters in the above algorithm formula, observe the value of the MSE of the validation set and the MSE curve during the iteration process. When the MSE no longer converges, the recognition effect is optimal. MSE measures the same descriptive statistics between the predicted value and the true value label:
其中n是特征向量个数,yi与分别为预测值和真实值。Where n is the number of eigenvectors, yi and are the predicted value and the true value respectively.
与现有技术相比,本发明的有益效果为:Compared with the prior art, the present invention has the following beneficial effects:
1.相比于现有的将辅助设备直接放置在患者胸骨上或夹在施救者左右手之间,本发明的辅助系统佩戴在施救者手腕上,不会对施救者的触觉产生干扰与引入不适。1. Compared with the existing method of placing the auxiliary equipment directly on the patient's sternum or clamping it between the rescuer's left and right hands, the auxiliary system of the present invention is worn on the rescuer's wrist, which will not interfere with the rescuer's sense of touch or cause discomfort.
2.所提出的方法中,改进了现有的双重积分求解按压深度方法,并引入算法优化,降低按压深度的求解误差,使得系统的精度能够更加满足50~60mm按压深度测量的需要;2. The proposed method improves the existing double integral method for calculating the compression depth, and introduces algorithm optimization to reduce the error in calculating the compression depth, so that the accuracy of the system can better meet the needs of measuring the compression depth of 50-60 mm;
3.除了实现主流胸外按压辅助设备对按压深度、频率的监测外,本系统在不引入硬件复杂度的前提下,通过在软件方法上引入机器学习,拓展对胸外按压质量信息感知的维度,如增加对施救者手臂手肘上身姿态合规性的监测。3. In addition to realizing the monitoring of compression depth and frequency by mainstream chest compression auxiliary equipment, this system expands the dimension of perception of chest compression quality information by introducing machine learning in software methods without introducing hardware complexity, such as adding monitoring of the compliance of the rescuer's arm, elbow and upper body posture.
4.辅助系统中针对胸外按压场景引入语音交互,施救者通过语音指令控制辅助设备的工作流,辅助设备将实时检测的多维度指标通过语音信息反馈给施救者。语音交互的算法在穿戴式设备端侧实现,无需网络连接。4. Voice interaction is introduced in the auxiliary system for chest compression scenarios. The rescuer controls the workflow of the auxiliary equipment through voice commands, and the auxiliary equipment feeds back the multi-dimensional indicators detected in real time to the rescuer through voice information. The algorithm of voice interaction is implemented on the wearable device side, without the need for network connection.
5.在使用本系统进行胸外按压辅助时,基于学习模式,在心肺复苏假人模型上进行练习,使得本系统的机器学习算法能够学习到不同施救者的按压习惯,基于施救者的手掌厚度、手掌跟弯曲能力等个性化特征进行学习,使得本系统的方法能够更加具有泛化性。5. When using this system to assist chest compression, practice on a cardiopulmonary resuscitation dummy model based on the learning mode, so that the machine learning algorithm of this system can learn the compression habits of different rescuers, and learn based on the rescuer's personalized characteristics such as palm thickness and palm heel bending ability, so that the method of this system can be more generalized.
附图说明BRIEF DESCRIPTION OF THE DRAWINGS
附图1腕带式辅助系统硬件组成示意图;Figure 1 is a schematic diagram of the hardware composition of the wristband-type auxiliary system;
附图2腕带式辅助系统整体结构示意图;Figure 2 is a schematic diagram of the overall structure of the wristband auxiliary system;
附图3使用场景示意图;Figure 3 is a schematic diagram of a usage scenario;
附图4任务与算法框架结构图;Figure 4 shows the task and algorithm framework structure diagram;
附图5一种情况下手臂手肘规范与不规范按压时,对应的纵摇角连续输出的特征曲线图;Figure 5 is a characteristic curve diagram of the continuous output of the corresponding pitch angle when the arm elbow is pressed in a standard and irregular manner under one condition;
附图6按压深度参考标准与本专利提出的深度求解值之间的一致性评价;Figure 6 shows the consistency evaluation between the pressing depth reference standard and the depth solution value proposed in this patent;
附图7辅助系统工作状态流程图。Figure 7 is a flow chart of the auxiliary system working status.
附件说明Attachment Description
1-1、中央控制处理模块;1-2、惯性测量模块;1-3、语音交互模块;1-4、触控显示模块;1-5、电源模块;1-6、通信模块;1-7、数据存储模块;1-8、壳体与橡胶绑带;2-1、交互触摸屏;2-2、壳体;2-3、集成电路板;2-4、橡胶绑带;3-1、患者或假人模型;3-2、施救者;3-3、辅助设备。1-1. Central control processing module; 1-2. Inertial measurement module; 1-3. Voice interaction module; 1-4. Touch display module; 1-5. Power module; 1-6. Communication module; 1-7. Data storage module; 1-8. Shell and rubber strap; 2-1. Interactive touch screen; 2-2. Shell; 2-3. Integrated circuit board; 2-4. Rubber strap; 3-1. Patient or dummy model; 3-2. Rescuer; 3-3. Auxiliary equipment.
具体实施方式Detailed ways
下面结合附图与具体实施方式对本发明作进一步详细描述:The present invention is further described in detail below in conjunction with the accompanying drawings and specific embodiments:
在本申请中,施救者在手腕上佩戴本设备,对需要进行心肺复苏的患者实施胸外按压。虽然患者存在躺在斜坡上的可能,但是在绝大多数需要进行胸外按压的场景中,患者是躺在水平的硬质地面上或者带有硬质背板的床上。因此,在本申请的实施例中,可以认为患者胸骨受到按压而产生形变的方向是与水平面垂直的。当施救者在胸外按压过程中,施救者手部运动与患者胸骨受迫运动的惯性信息是相同的。In the present application, the rescuer wears the device on the wrist and performs chest compressions on patients who need cardiopulmonary resuscitation. Although the patient may be lying on a slope, in most scenarios where chest compressions are required, the patient lies on a horizontal hard ground or on a bed with a hard backboard. Therefore, in an embodiment of the present application, it can be considered that the direction in which the patient's sternum is compressed and deformed is perpendicular to the horizontal plane. When the rescuer is performing chest compressions, the inertial information of the rescuer's hand movement and the forced movement of the patient's sternum is the same.
如上所述,现有的胸外按压辅助设备多数直接放置在患者胸部,或者设计手机端应用程序,并将手机夹在施救者的左右手之间。前者,将引入一个硬质壳体对施救者的触觉产生干扰,引入不适,影响施救者对于肋骨胸骨完好性、准确施力位置的判断;后者,将智能手机夹在双手之间,也容易产生误触,干扰施救者的施压方式。As mentioned above, most of the existing chest compression assist devices are placed directly on the patient's chest, or designed as mobile phone applications, and the phone is clamped between the rescuer's left and right hands. The former will introduce a hard shell to interfere with the rescuer's sense of touch, causing discomfort and affecting the rescuer's judgment of the integrity of the ribs and sternum and the accurate force application position; the latter, clamping the smartphone between the hands is also prone to accidental touches, interfering with the rescuer's pressure application method.
为了解决上述已有胸外按压辅助设备中存在的问题,在本申请中,提供一种用于胸外按压合规性检测系统。In order to solve the above-mentioned problems existing in the existing chest compression assisting devices, in the present application, a chest compression compliance detection system is provided.
参照图1,所述的系统由中央控制处理模块1-1、惯性测量模块1-2、语音交互模块1-3、触控显示模块1-4、电源模块1-5、通信模块1-6、数据存储模块1-7、壳体与橡胶绑带1-8组成。中央控制处理模块采用低功耗嵌入式微处理器可以是单核或多核心,负责整个系统的逻辑控制、数据运算、算法部署,并与触控显示模块、语音交互模块等其他模块进行数据通信。惯性测量模块是由加速度计、陀螺仪、磁力计构成的集成单元,能够测量系统附着体的三轴惯性数据,包括加速度、角速度、姿态四元数,惯性测量模块本身具有数据预处理功能,通过数据传输总线,将实时采集的惯性数据传输给中央控制处理模块。语音交互模块有语音交互控制器、咪头、微型扬声器组成,所述的语音交互控制器可以部署所需要的心肺复苏场景下的语音交互指令和语音模型,语音交互模块通过咪头感知环境中施救者发出的语音指令,并通过微型扬声器给予施救者指导意见与实时反馈校正。所述的触控显示模块由微型触控屏、触摸驱动与显示驱动电路构成,在胸外按压开始前,可通过所述的触控显示模块对辅助系统进行配置,在胸外按压完成后,可通过触控显示模块查看按压指标检测统计信息,优选地,触控显示模块还可以在施加胸外按压时与语音交互模块配合进行视听反馈。所述地电源模块由电源变换模块、电池和充电模块组成,负责整个系统的供放电。通信模块包括有线通信和无线通信,用于将节点的数据传输到网络设备或者PC设备上;数据存储模块用于存储实施采集的IMU数据、胸外按压过程状态数据等必要的信息,可选择TF存储卡等外部存储设备;所述的壳体由3D打印、注塑、或模具加工而成,壳体对外留出必要的人机交互界面以及接口,并将前述的各个模块封闭安装在壳体内。橡胶绑带用于连接壳体和施救者的手腕。Referring to Figure 1, the system is composed of a central control processing module 1-1, an inertial measurement module 1-2, a voice interaction module 1-3, a touch display module 1-4, a power module 1-5, a communication module 1-6, a data storage module 1-7, a shell and a rubber band 1-8. The central control processing module uses a low-power embedded microprocessor that can be single-core or multi-core, responsible for the logic control, data calculation, and algorithm deployment of the entire system, and communicates data with other modules such as the touch display module and the voice interaction module. The inertial measurement module is an integrated unit composed of an accelerometer, a gyroscope, and a magnetometer, which can measure the three-axis inertial data of the system attachment, including acceleration, angular velocity, and attitude quaternion. The inertial measurement module itself has a data preprocessing function, and transmits the real-time collected inertial data to the central control processing module through a data transmission bus. The voice interaction module is composed of a voice interaction controller, a microphone, and a micro speaker. The voice interaction controller can deploy the required voice interaction instructions and voice models in the cardiopulmonary resuscitation scenario. The voice interaction module senses the voice instructions issued by the rescuer in the environment through the microphone, and gives the rescuer guidance and real-time feedback correction through the micro speaker. The touch display module is composed of a micro touch screen, a touch drive and a display drive circuit. Before the start of chest compression, the auxiliary system can be configured through the touch display module. After the chest compression is completed, the compression index detection statistics can be viewed through the touch display module. Preferably, the touch display module can also cooperate with the voice interaction module to provide audio-visual feedback when applying chest compression. The ground power module is composed of a power conversion module, a battery and a charging module, which is responsible for the power supply and discharge of the entire system. The communication module includes wired communication and wireless communication, which is used to transmit the node data to the network device or PC device; the data storage module is used to store the necessary information such as the collected IMU data and the state data of the chest compression process, and an external storage device such as a TF memory card can be selected; the shell is made by 3D printing, injection molding, or mold processing, and the shell reserves the necessary human-computer interaction interface and interface to the outside, and the aforementioned modules are sealed and installed in the shell. The rubber strap is used to connect the shell and the rescuer's wrist.
参照图2,描述了本申请腕带式辅助系统整体结构示意图,系统整体由交互触摸屏2-1、壳体2-2、集成电路板2-3、橡胶绑带2-4组成。参照图3,描述了本实施例的使用场景,患者或假人模型3-1平躺在水平地面上,施救者3-2佩戴本申请所提出的辅助设备3-3于腕部,在临床或培训场景中,进行胸外按压,在触觉、视觉上对施救者不产生干扰,无需施救者改变原有胸外按压习惯或通用操作步骤。Referring to Figure 2, the overall structure diagram of the wristband auxiliary system of the present application is described. The system as a whole is composed of an interactive touch screen 2-1, a housing 2-2, an integrated circuit board 2-3, and a rubber strap 2-4. Referring to Figure 3, the use scenario of the present embodiment is described. The patient or dummy model 3-1 lies flat on the horizontal ground, and the rescuer 3-2 wears the auxiliary device 3-3 proposed in the present application on the wrist. In clinical or training scenarios, chest compressions are performed without causing tactile or visual interference to the rescuer, and the rescuer does not need to change the original chest compression habits or general operating steps.
本申请的实施例还提供了一种用于胸外按压多维度指标合规性检测方法。参照图4,描述了由任务驱动的算法(方法)框架结构,所述的方法通过编程语言转化成程序后,运行在前述的辅助系统中。由于算法需要实时运行在双核的微控制中,对实时采集的数据求解目标,因此程序需要维护一个动态更新的数据窗口,并按照如下算法步骤进行计算:The embodiment of the present application also provides a method for detecting compliance of multi-dimensional indicators for chest compression. Referring to FIG4 , the framework structure of the algorithm (method) driven by the task is described, wherein the method is converted into a program through a programming language and then runs in the aforementioned auxiliary system. Since the algorithm needs to run in real time in a dual-core microcontroller to solve the target of the real-time collected data, the program needs to maintain a dynamically updated data window and perform calculations according to the following algorithm steps:
S1:腕带IMU接待你的数据采集和分割,微控制器通过UART通信接口采集IMU输出的数据,分割数据并添加到数据窗口中。S1: The wristband IMU receives your data collection and segmentation. The microcontroller collects the data output by the IMU through the UART communication interface, segments the data and adds it to the data window.
S2:利用姿态四元数对获得的载体系下的加速度进行坐标变换;S2: Use the attitude quaternion to transform the acceleration of the load system;
S3:选择坐标变换后垂直方向上得加速度,进行梯形数值积分计算,然后将计算结果输入0.3Hz巴特沃斯高通滤波器去除趋势项,获得垂直方向上的速度;S3: Select the acceleration in the vertical direction after coordinate transformation, perform trapezoidal numerical integration calculation, and then input the calculation result into a 0.3Hz Butterworth high-pass filter to remove the trend term to obtain the velocity in the vertical direction;
S4:对垂直方向上的速度进行分割为按压阶段与回弹阶段的速度曲线段;S4: dividing the velocity in the vertical direction into velocity curve segments of the pressing stage and the rebound stage;
S5:对分割后的按压与回弹阶段的曲线进行梯形数值积分获取按压与回弹阶段的深度;S5: performing trapezoidal numerical integration on the segmented curves of the compression and rebound stages to obtain the depths of the compression and rebound stages;
S6:根据固定的采样率和S4中分割得到的速度曲线的数据点数,可求解获得按压与回弹消耗的时间;S6: According to the fixed sampling rate and the number of data points of the speed curve obtained by segmentation in S4, the time consumed by pressing and rebounding can be obtained;
S7:在假人模型胸腔内安装线性位移传感器,采集假人胸骨受到压迫而实际产生的胸骨凹陷距离;S7: Install a linear displacement sensor in the chest cavity of the dummy model to collect the actual sternum depression distance caused by the compression of the sternum of the dummy;
S8:获得连续的按压位移曲线,基于峰值检测、频域分析进行曲线特征辨识;S8: Obtain a continuous compression displacement curve, and identify the curve features based on peak detection and frequency domain analysis;
S9:获得按压与回弹过程中得参考深度、频率和用时;S9: Obtain the reference depth, frequency and time during compression and rebound;
S10:将S9、S6、S5求解值和参考值进行对比,使用机器学习方法进行误差修正,S10: Compare the solution values of S9, S6, and S5 with the reference values, and use machine learning methods to correct errors.
以获得更加精确得按压深度、频率等信息;To obtain more accurate information such as compression depth and frequency;
S11:将纵摇角作为特征向量,输入LSTM网络,进行序列辨识,检测手臂合规性。S11: The pitch angle is used as a feature vector and input into the LSTM network for sequence recognition to detect arm compliance.
下面就所述的算法,在必要的细节和理论方法上进行分析:The following is an analysis of the algorithm in necessary details and theoretical methods:
本实施例考虑到设备是穿戴在施救者手臂,在胸外按压过程中,手臂的姿态是变化的,作为实施例的一种,需要考虑施救者手臂不满足规范垂直按压的情况,并且佩戴时设备的姿态也具有不确定性,因此需要对实施采集的加速度,基于姿态四元数,求解坐标变换到地理坐标系下的三轴加速度,基于如下算法:This embodiment takes into account that the device is worn on the rescuer's arm. During chest compression, the arm posture changes. As one embodiment, it is necessary to consider the situation that the rescuer's arm does not meet the standard vertical compression, and the posture of the device when worn is also uncertain. Therefore, it is necessary to solve the three-axis acceleration of the coordinate transformation to the geographic coordinate system based on the posture quaternion for the acceleration collected, based on the following algorithm:
pbody=[0,abx,aby,abz]T p body =[0,a bx ,a by ,a bz ] T
pworld=q·pbody·q-1=q·pbody·q*/||q||2 p world =q·p body ·q -1 =q·p body ·q*/||q|| 2
其中,abx,aby,abz分别为IMU载体坐标系下的三轴加速度,pbody为一个虚四元数,描述载体系下的加速度。q是IMU测量得到的世界坐标系下的姿态四元数,pworld是世界坐标系下的加速度四元数,由于其也是一个虚四元数,取其虚部即可得到世界坐标系下的三轴加速度,三轴分别为东北天。Among them, a bx, a by , a bz are the three-axis accelerations in the IMU carrier coordinate system, and p body is a virtual quaternion that describes the acceleration in the carrier system. q is the attitude quaternion in the world coordinate system measured by the IMU, and p world is the acceleration quaternion in the world coordinate system. Since it is also a virtual quaternion, taking its imaginary part can get the three-axis acceleration in the world coordinate system. The three axes are northeast, northeast, and celestial.
在按压深度求解方面,基于如下公式:In terms of solving the pressing depth, it is based on the following formula:
其中a’是减去重力加速度后的偏置(来源于低成本IMU标定不完善与低精度),anoise是宽频段的测量噪声,A(t),V(t)和D(t)是理想的由运动引起的加速度、速度和位移。Where a' is the bias after subtracting gravity acceleration (caused by the incomplete calibration and low accuracy of low-cost IMU), a noise is the wide-band measurement noise, and A(t), V(t) and D(t) are the ideal acceleration, velocity and displacement caused by motion.
首先,我们对坐标变换后Z轴加速度进行一次梯形积分后获得的速度信号,引入4阶0.3Hz巴特沃斯高通滤波器对漂移趋势项进行抑制,加速度中的宽频噪声以及测量精度引入的误差经过积分后,仍将大部分保留在速度求解值v中。当再次进行积分时,误差也将随着加速度序列长度而不断累加。在一次积分与滤波后,由于按压到回弹过程运动方向发生变化,因此速度的数值符号发生变化。因此,我们对获得的速度曲线分割为按压与回弹阶段,得到的速度序列也是非等长的。在小段区间内再次进行梯形数值积分,求解得到每一周期中按压与回弹过程的运动位移。由于采样率和上述分割得到的速度序列长度可知,因此可以求解得到按压与回弹过程的用时与速度。由于求解值和真实值之间存在误差,在现有的方法中,使用一个1Hz的高通滤波器来对求解的按压位移误差进行修正,一定程度上抑制位移信号中低频噪声成分;在前述的分析中,我们指出,求解误差包含了宽频段的噪声以及低成本IMU精度低引入的误差,这使得求解值与通过线性位移传感器解析得到的真值之间存在一定的误差,但两者是正相关的。First, we perform a trapezoidal integration on the Z-axis acceleration after coordinate transformation to obtain the velocity signal, and introduce a 4th-order 0.3Hz Butterworth high-pass filter to suppress the drift trend term. After integration, the broadband noise in the acceleration and the error introduced by the measurement accuracy will still be mostly retained in the velocity solution value v. When the integration is performed again, the error will continue to accumulate with the length of the acceleration sequence. After one integration and filtering, the numerical sign of the velocity changes due to the change in the direction of movement from pressing to rebounding. Therefore, we divide the obtained velocity curve into pressing and rebounding stages, and the obtained velocity sequence is also of unequal length. Perform trapezoidal numerical integration again in a small interval to solve the motion displacement of the pressing and rebounding process in each cycle. Since the sampling rate and the length of the velocity sequence obtained by the above division are known, the time and velocity of the pressing and rebounding process can be solved. Since there is an error between the solved value and the true value, in the existing method, a 1Hz high-pass filter is used to correct the solved pressing displacement error, which suppresses the low-frequency noise component in the displacement signal to a certain extent; in the above analysis, we pointed out that the solved error includes wide-band noise and the error introduced by the low precision of the low-cost IMU, which makes there is a certain error between the solved value and the true value obtained by analyzing the linear displacement sensor, but the two are positively correlated.
为此,我们引入机器学习回归算法来对误差进行修正。作为一种可选的实施方式,线性回归模型可以应用于修正按压深度求解值和参考值之间的误差。考虑有一组数据集{(xi,yi),i=1,2,…,n},其中xi是参考深度,yi是求解深度,线性回归模型基于如下形式:To this end, we introduce a machine learning regression algorithm to correct the error. As an optional implementation, a linear regression model can be used to correct the error between the compression depth solution value and the reference value. Consider a set of data sets {( xi , yi ), i = 1, 2, ..., n}, where xi is the reference depth and yi is the solution depth. The linear regression model is based on the following form:
y=xTβ+εy=x T β+ε
其中ε~N(0,σ2),误差变量σ2和参数向量β需要基于已有的数据集,通过训练与迭代确定其参数。Among them, ε~N(0,σ 2 ), error variable σ 2 and parameter vector β need to be determined based on the existing data set through training and iteration.
在本实施例中,为实现对按压手臂手肘、身体姿态的规范性辨识,我们将算法的输入特征仍然聚焦于腕带式IMU的数据,如前所述,当施救者施加胸外按压时,我们认为施救者和被施救者的胸廓具有相同的惯性数据,另一方面,当施救者在胸外按压时,出现一些非规范的胸外按压行为,如手肘弯曲按压、手臂倾斜按压、跪位较远而产生的纵向俯仰按压等。这些非规范的按压姿态和动作由于最终都将通过手腕连接并通过手掌根部作用于患者胸骨。因此,通过手腕部位的IMU传感器,获得的角速度、加速度和姿态角等不同模态的信息,可以作为评估施救者手臂规范性的有效观测输入。In this embodiment, in order to achieve the normative identification of the elbow and body posture of the pressing arm, we still focus the input features of the algorithm on the data of the wristband IMU. As mentioned above, when the rescuer applies chest compression, we believe that the chest of the rescuer and the rescued have the same inertial data. On the other hand, when the rescuer performs chest compression, some non-normative chest compression behaviors appear, such as elbow bending and pressing, arm tilting and pressing, and longitudinal pitching and pressing caused by kneeling far away. These non-normative pressing postures and actions will eventually be connected through the wrist and act on the patient's sternum through the base of the palm. Therefore, the information of different modes such as angular velocity, acceleration and posture angle obtained by the IMU sensor at the wrist can be used as an effective observation input to evaluate the normativeness of the rescuer's arm.
参照图5,当IMU节点佩戴在施救者手腕时,对纵摇角进行连续观测,图4中,将这一段纵摇角曲线分割为三个部分为:segment1、segment2、segment3.segment1描述的是手臂以相对规范的姿态垂直按压30次,segment2描述的是手臂倾斜按压30次,segment3描述的是手肘弯曲按压30次;从图4的纵摇角特征上来观察,人眼能够很容易分辨这些曲线之间的差异性。Referring to Figure 5, when the IMU node is worn on the rescuer's wrist, the pitch angle is continuously observed. In Figure 4, this section of the pitch angle curve is divided into three parts: segment 1, segment 2, and segment 3. Segment 1 describes the arm pressing vertically 30 times in a relatively standard posture, segment 2 describes the arm pressing 30 times with an inclined position, and segment 3 describes the elbow pressing 30 times. From the pitch angle characteristics of Figure 4, the human eye can easily distinguish the differences between these curves.
因此,本实施例所述的方法中,需设计行之有效的算法能够实时地用于对前述的纵摇角连续曲线中所表现的规范与非规范的类别进行辨识。Therefore, in the method described in this embodiment, an effective algorithm needs to be designed to be used in real time to identify the standard and non-standard categories shown in the aforementioned pitch angle continuous curve.
作为辨识上述规范性可选的一种实施方式,使用神经网络对序列的类别进行分类,LSTM可用于处理时间序列分类、回归和预测任务。LSTM网络是一种可学习序列数据时间步长长期依赖关系的递归神经网络。在本实施例中,需要对定长采样的纵摇角采样序列所属类别进行分类,由于一般的神经网络构建的时值与值或值与类别的映射,无法满足本申请对采样序列类比的分类,LSTM能够将当前采样点历史一定时刻内的点集作为输入,挖掘这些连续点集构成的序列所述特征的类别。在模型训练过程中,通过调整神经元数量,观察验证集残差表现,使辨识效果达到最优。As an optional implementation method for identifying the above-mentioned normativeness, a neural network is used to classify the categories of the sequence, and LSTM can be used to process time series classification, regression and prediction tasks. The LSTM network is a recursive neural network that can learn the long-term dependencies of the time steps of sequence data. In this embodiment, it is necessary to classify the category to which the pitch angle sampling sequence of fixed-length sampling belongs. Since the mapping of time value and value or value and category constructed by the general neural network cannot meet the classification of the analogy of the sampling sequence in this application, LSTM can take the point set within a certain historical moment of the current sampling point as input, and mine the category of the features of the sequence composed of these continuous point sets. During the model training process, the identification effect is optimized by adjusting the number of neurons and observing the residual performance of the validation set.
作为本实施例在施救者按压手臂与姿势规范性辨识方法的一种,优选的,除了前述以纵摇角作为算法输入外,可将水平正交轴的加速度、角速度等其他模态的惯性信息作为辨识算法的输入,以此增强算法的鲁棒性。As a method for identifying the rescuer's arm compression and posture norm in this embodiment, preferably, in addition to the pitch angle as the algorithm input, the inertial information of other modes such as the acceleration and angular velocity of the horizontal orthogonal axis can be used as the input of the identification algorithm to enhance the robustness of the algorithm.
如上所述,所述的方法通过编程语言转发为程序代码,通过编译并下载到腕带式设备中。所有的计算、推理、存储、通信任务均在穿戴式节点中独立完成,不需要外部计算机提供额外的算力支持。As mentioned above, the method is forwarded into program code through a programming language, compiled and downloaded to the wrist-worn device. All calculation, reasoning, storage, and communication tasks are completed independently in the wearable node, without the need for external computers to provide additional computing power support.
参照图6,描述的是按压深度经过误差修正后的求解值和参考值之间的误差分布,设计实验,邀请30名参与者共采集4000余次按压实验,通过前述的算法步骤求解完按压深度与参考深度后,通过5折交叉验证,应用高斯过程回归模型训练误差修正模型,预测误差修正后的按压深度,通过Bland-Altman图的方式展示求极值和真值之间的一致性,图6中所述95%一致性上下界分别为2.9449mm、-2.9439mm.Referring to Figure 6, the error distribution between the solution value and the reference value of the compression depth after error correction is described. An experiment was designed to invite 30 participants to collect more than 4,000 compression experiments. After solving the compression depth and the reference depth through the aforementioned algorithm steps, the error correction model was trained by using the Gaussian process regression model through 5-fold cross validation to predict the compression depth after error correction. The consistency between the extreme value and the true value was displayed by the Bland-Altman diagram. The upper and lower limits of 95% consistency in Figure 6 were 2.9449mm and -2.9439mm respectively.
参照图7,描述了本申请辅助系统在培训或临床场景中应用时,辅助系统工作的流程图:7 , a flowchart of the auxiliary system working when the auxiliary system of the present application is used in training or clinical scenarios is described:
S1:施救者通过预先对设备配置,使得设备处于待命状态;施救者可通过触摸交互模块对本系统反馈方式、反馈频次、监测指标、学习模式或训练模式等相关参数指标进行设置;S1: The rescuer configures the device in advance to put it in a standby state; the rescuer can set the system's feedback method, feedback frequency, monitoring indicators, learning mode or training mode and other related parameter indicators through the touch interaction module;
S2:施救者通过语音指令唤醒设备,唤醒的指令词可通过施救者习惯自定义,优选的,施救者可通过多种方式唤醒,如触摸、按键等其他方式的一种或多种。S2: The rescuer wakes up the device through voice commands. The wake-up command words can be customized according to the rescuer's habits. Preferably, the rescuer can wake up the device through multiple methods, such as one or more of touch, button and other methods.
S3:设备通过音频、屏幕光亮度的呼吸效果、以及振动信息引导施救者以规范按压的速度进行按压;S3: The device guides the rescuer to perform compressions at a standard compression speed through audio, breathing effects of screen brightness, and vibration information;
S4-1到S4-4:施救者通过语音出发完成后,即开始施加胸外按压,辅助系统开始工作,对按压次数进行计数,求解按压深度、频率;求解每一周期的按压与回弹深度、耗时,评估是否存在冲击式按压,按压与回弹消耗时间是否均衡;求解手臂手肘施压时姿态的规范性;S4-1 to S4-4: After the rescuer completes the voice start, chest compressions are started, and the auxiliary system starts to work, counting the number of compressions, solving the compression depth and frequency; solving the compression and rebound depth and time consumption of each cycle, evaluating whether there is impact compression, and whether the compression and rebound time consumption are balanced; solving the standardization of the posture when applying pressure with the arm and elbow;
S5:语音、图像反馈与指导修正,在执行步骤S4-1到S4-4时,辅助系统通过语音交互模块和触摸显示屏反馈必要的指导信息;S5: Voice, image feedback and guidance correction. When executing steps S4-1 to S4-4, the auxiliary system feeds back necessary guidance information through the voice interaction module and the touch display screen;
S6:在执行步骤S4-1到S4-4过程中,辅助系统将对按压次数进行计数,按照AHA指南要求,按压与通气按照30:2的比例进行,因此当系统对按压次数的计数到达30次时,通过语音或图形界面指导通气与除颤等后续步骤。S6: During the execution of steps S4-1 to S4-4, the auxiliary system will count the number of compressions. According to the AHA guidelines, compressions and ventilations are performed in a ratio of 30:2. Therefore, when the system counts 30 compressions, subsequent steps such as ventilation and defibrillation are guided through voice or graphical interfaces.
S7:当施救者通过语音指令,触发系统启动新一轮的按压辅助监测,否则,退出当前的实时辅助系统。S7: When the rescuer triggers the system to start a new round of compression assistance monitoring through voice commands, otherwise, the current real-time assistance system is exited.
S8:记录历史数据,反馈胸外按压急救过程中综合多维度的评价。S8: Record historical data and provide comprehensive and multi-dimensional evaluation of the chest compression emergency treatment process.
S9:当施救者在按压过程中,发出语音指令触发,即患者恢复自主循环,系统即可退出实时辅助监测,并转到S8。S9: When the rescuer issues a voice command during the compression process, that is, the patient recovers spontaneous circulation, the system will exit real-time auxiliary monitoring and go to S8.
以上所述,仅是本发明的较佳实施例而已,并非是对本发明作任何其他形式的限制,而依据本发明的技术实质所作的任何修改或等同变化,仍属于本发明所要求保护的范围。The above description is only a preferred embodiment of the present invention and does not constitute any other form of limitation to the present invention. Any modification or equivalent change made based on the technical essence of the present invention still falls within the scope of protection required by the present invention.
Claims (7)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202211729849.3A CN116019443B (en) | 2022-12-30 | 2022-12-30 | Cardiopulmonary resuscitation chest compression compliance detection system and method |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202211729849.3A CN116019443B (en) | 2022-12-30 | 2022-12-30 | Cardiopulmonary resuscitation chest compression compliance detection system and method |
Publications (2)
Publication Number | Publication Date |
---|---|
CN116019443A CN116019443A (en) | 2023-04-28 |
CN116019443B true CN116019443B (en) | 2024-07-19 |
Family
ID=86071836
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202211729849.3A Active CN116019443B (en) | 2022-12-30 | 2022-12-30 | Cardiopulmonary resuscitation chest compression compliance detection system and method |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN116019443B (en) |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN116994746B (en) * | 2023-09-27 | 2024-01-30 | 普美康(江苏)医疗科技有限公司 | Intelligent AED first aid auxiliary method, system, device and readable storage medium |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN114886758A (en) * | 2022-04-28 | 2022-08-12 | 东南大学 | Wearable doctor motion acquisition device for cardio-pulmonary resuscitation and use method |
CN115227234A (en) * | 2022-07-07 | 2022-10-25 | 电子科技大学 | Cardiopulmonary resuscitation pressing action evaluation method and system based on camera |
Family Cites Families (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11219575B2 (en) * | 2016-03-23 | 2022-01-11 | Zoll Medical Corporation | Real-time kinematic analysis during cardio-pulmonary resuscitation |
US11213454B1 (en) * | 2021-06-05 | 2022-01-04 | Altrix Medical, Inc. | Method to provide real-time feedback and coaching to augment cardiac rescue |
-
2022
- 2022-12-30 CN CN202211729849.3A patent/CN116019443B/en active Active
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN114886758A (en) * | 2022-04-28 | 2022-08-12 | 东南大学 | Wearable doctor motion acquisition device for cardio-pulmonary resuscitation and use method |
CN115227234A (en) * | 2022-07-07 | 2022-10-25 | 电子科技大学 | Cardiopulmonary resuscitation pressing action evaluation method and system based on camera |
Also Published As
Publication number | Publication date |
---|---|
CN116019443A (en) | 2023-04-28 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2022193851A1 (en) | Method and system for recognizing user actions | |
CN109069066A (en) | Wearable and connection gait analysis system | |
CN106527738A (en) | Multi-information somatosensory interaction glove system and method for virtual reality system | |
JP7520123B2 (en) | Systems and methods for automated anomaly detection in mixed human-robot manufacturing processes | |
CN107616898B (en) | Upper limb wearable rehabilitation robot based on daily actions and rehabilitation evaluation method | |
CN105979855A (en) | Detecting the limb wearing a wearable electronic device | |
CN104436596A (en) | Exercise support device and exercise support method | |
CN104147770A (en) | Inertial-sensor-based wearable hemiplegia rehabilitation apparatus and strap-down attitude algorithm | |
CN107194193A (en) | A kind of ankle pump motion monitoring method and device | |
CN113143256A (en) | Gait feature extraction method, lower limb assessment method, lower limb control method, device and medium | |
CN107389052A (en) | A kind of ankle pump motion monitoring system and terminal device | |
CN116019443B (en) | Cardiopulmonary resuscitation chest compression compliance detection system and method | |
CN115105819B (en) | Motion monitoring method and system | |
CN101695444A (en) | Foot acceleration information acquisition system and acceleration information acquisition method thereof | |
CN114504320A (en) | Cognitive quantitative detection machine based on multi-modal emotion artificial intelligence | |
CN105530581A (en) | Smart wearable device based on voice recognition and control method thereof | |
CN110276380A (en) | A real-time motion online guidance system based on deep model framework | |
KR102425481B1 (en) | Virtual reality communication system for rehabilitation treatment | |
KR102429630B1 (en) | A system that creates communication NPC avatars for healthcare | |
CN112857362B (en) | Smart shoes and action type recognition method, device, equipment, and storage medium thereof | |
Viana et al. | GymApp: A real time physical activity trainner on wearable devices | |
WO2023182726A1 (en) | Electronic device and method for segmentation of movement repetitions and extraction of performance metrics | |
CN115904086A (en) | Sign language recognition method based on wearable computing | |
CN110694252A (en) | Running posture detection method based on six-axis sensor | |
CN210091521U (en) | Percussion training auxiliary device |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |